Senior Data Engineer

Company: PWW Recruiting, LLC.
Location: Chantilly, Virginia, United States
Type: Full-time
Posted: 14.APR.2021

Summary

BASIC QUALIFICATIONS:Bachelor's degree in Engineering, Computer Science, Statistics, Applied Math, or a related technical field is required ...

Description

BASIC QUALIFICATIONS:Bachelor's degree in Engineering, Computer Science, Statistics, Applied Math, or a related technical field is required plus a minimum of 8 years of relevant experience; or Master's degree plus a minimum of 6 years of relevant experience. Agile experience preferred.CLEARANCE REQUIREMENTS: A TS/SCI security clearance with the ability to obtain a Polygraph is required at time of hire. Candidates must be able to obtain the Polygraph within a reasonable amount of time from date of hire. Applicants selected will be subject to a U.S. Government security investigation and must meet eligibility requirements for access to classified information. Due to the nature of work performed within our facilities, U.S. citizenship is required.JOB DESCRIPTION:We apply advanced technologies such as Artificial Intelligence, Blockchain, AR/VR, Cloud Native and Quantum Physics to solve our customers' missions in cyber, RF, undersea, interstellar space and everything in between.As a Senior Data Engineer, you'll lead model and simulation activities as you participate in requirements analysis and management, functional analysis, performance analysis, system design, trade studies, systems integration and test (verification). It's your chance to step up to the challenge and prove you're ready to lead the world.REPRESENTATIVE DUTIES AND TASKS:We are seeking a Senior Data Engineer to support the Insider Threat mission. Data Engineers work with various security system data owners to automate data integration and collection strategies. Work closely with the data science team to ensure data cleanliness and accuracy.Support data science team by designing, developing and implementing scalable ETL process for disparate datasets into a Hadoop infrastructureDesign, develop, implement and maintain data ingestion process from various disparate datasets using StreamSets (experience with StreamSets not mandatory)Develop processes to identify data drift and malformed recordsDevelop technical documentation and standard operating proceduresMentor new and junior data engineersLeads technical tasks for small teams or projectsKNOWLEDGE SKILLS AND ABILITIES:Working knowledge of entity resolution systemsExperience with messages systems like KafkaExperience with NoSQL and/or graph databases like MongoDB or ArangoDBAny of the following databases: SQL, MongoDB, Oracle, PostgresWorking experience with ETL processingWorking experience with data workflow products like StreamSets or NiFiWorking experience with Python RESTful API services, JDBCExperience with Hadoop and Hive/ImpalaExperience with Cloudera Data Science Workbench is a plusUnderstanding of pySpark Leadership experienceCreative thinkerAbility to multi-taskExcellent use and understanding of data engineering concepts, principles, and theories

 
Apply Now

Share

Free eBook

Flash-bkgn
Loader2 Processing ...