Spark Lead developer

Location: Ann Arbor , Michigan, United States
Type: Full-time
Posted: 02.JAN.2020


We are looking for an experienced SPARK LEAD Developer Ann Arbor, MI Our preference is to hire a full-time employee, but we are open to all...


We are looking for an experienced SPARK LEAD Developer Ann Arbor, MI

Our preference is to hire a full-time employee, but we are open to all contracting ( corp to corp ) and contact to hire options. We offer highly competitive pay packages including great benefits.


IBM Watson


SPARK Lead Developer


Ann Arbor, MI

Mandetory Skills: Scala, ScalaTest, Apache Spark, Apache NiFi, Python, Java, Apache Hadoop, Any NoSQL, Ansible Scripts, GitHub

Job Description :

  • 5 to 9 years of extensive IT experience with strong professional programming skill.
  • Must have strong coding skill adhering to high industry standard and best quality.
  • Substantial Java development experience is essential, including Object Oriented Design Patterns.
  • 2 to 3 years of strong experience in Scala programming language.
  • Experience in Apache Hadoop ecosystem like Spark, Hive, HBase and data format like Avro
  • Should have an excellent experience using Scala Spark with Spark RDDs, Spark SQL DataFrames, various transformations & actions, Spark configuration & tuning techniques.
  • Good understanding of the map-reduce paradigm and able to develop Spark applications.
  • Experience in working with Apache NiFi, automating the flow of data between software systems and processing the incremental data extraction & storage into HDFS.
  • Experience on any RDBMS design & development.
  • Strong experience in DevOps - Build Preparation, Configuration of Deployment Pipeline, Configuration Management.
  • Experience in developing deployment automation tools using Ansible Scripts.
  • Strong experience in root cause analysis of issues / problems and provide quick tactical and strategical solutions.
  • Good to have experience in Python programming language.
  • Strong exposure to agile methodologies and hands-on experience on Rally / Jira would be added advantage.
  • Strong Health Care Domain experience will be plus.

Company Overview for DataEconomy:


We are a rapidly growing team of passionate DataCrats who have been living and breathing Data & Analytics in our work endeavors serving fortune 500 companies for the last 2+ decades. Our Genesis stems from the fact that there is so much untapped potential regarding Technology, people and bringing in machine and humans together. We are industry experts who have been providing thought leadership for the Fortune 100 companies to define their Data & Analytics strategies, how they can use the ecosystem approach, leverage multitude of technologies to solve real-world problems. As our Name DATAECONOMY sounds, we are here to commoditize the Niche & create scale in the areas of Data & Analytics, AI, Blockchain and Cloud. We are specialized in creating IP in the cutting edge technologies such as AI, machine learning, Block Chain, etc., and applying that IP to help mid to large sized organizations to monetize the data.


  • Competitive Compensation Plan
  • Health Insurance
  • Paid Vacation
  • 401K
  • Annual bonus

Please reach out to Suman Gurram at / Mail ur cv at

- provided by Dice

Apply Now


Free eBook

Loader2 Processing ...