Senior Data Engineer

Company: IBM
Location: Durham, North Carolina, United States
Type: Full-time
Posted: 29.AUG.2021
< >

Summary

IntroductionSoftware Developers at IBM are the backbone of our strategic initiatives to design, code, test, and provide industry-leading sol...

Description

IntroductionSoftware Developers at IBM are the backbone of our strategic initiatives to design, code, test, and provide industry-leading solutions that make the world run today - planes and trains take off on time, bank transactions complete in the blink of an eye and the world remains safe because of the work our software developers do. Whether you are working on projects internally or for a client, software development is critical to the success of IBM and our clients worldwide. At IBM, you will use the latest software development tools, techniques and approaches and work with leading minds in the industry to build solutions you can be proud of.Your Role and ResponsibilitiesIBM Watson Advertising and Weather (WAMX) is seeking a Senior Data Engineer to join our Analytics and Cognitive Platform Operations Team and apply data engineering expertise as we continue to reimagine how data drives our future business. In this position you will partner with data scientists, business stakeholders, and team members to design, build, and operationalize strategic data platforms and processes.Responsibilities? Participate in the design and implementation of sophisticated software systems using functional programming techniques implemented in the Scala language.? Participate in software design and code reviews. Reviews include other Software Engineers and are held to ensure a high level of software quality and to share knowledge with team members.? Participate in, and adhere to, professional software engineering practices using such tools and methodologies as Agile Software Development, Test Driven Development, Continuous Integration, Source Code Management (git), Jira, and Stash? Maintain a high level of proficiency with Computer Science/Software Engineering knowledge and contribute to the technical skills growth of other team members? Work well independently and as part of a teamKnowledge? Solid experience implementing high availability, scalable cloud solutions? Strong understanding of data structures and algorithms? Knowledge of functional programing languages and techniques? Knowledge of object-oriented programming languages and techniques? Solid understanding of concurrency and concurrent programming techniques? Solid understanding of distributed computing techniques? Knowledge and understanding of operating with data in large scaleRequired Technical and Professional Expertise? Bachelor's degree in Computer Science, or 7+ years of work experience? 5+ years experience operating and deploying solutions using AWS Service including S3, EMR, SQS, Lambdas, Athena and Glue.? 5+ years experience with functional programming using Scala, Clojure, F#, ML, Lisp, Ocaml, or similar languages. Scala is desired.? 5+ years experience in object oriented development using Java, C++, C#, Ruby, or similar language? 5+ years experience with big data technologies such as Cassandra, Spark, Hadoop, Parquet etc. is desired? 5+ years experience with scripting languages.? Knowledge of Python and Apache airflow is a plus? Proficient with building data integrations using both API and file based protocols? Proficiency with Unit Testing? Proficiency with Version Control? Able to put together process documentation concisely and clearly? Excellent written and verbal communication skills? Able to work closely and effectively with peer developers and work on several active projects simultaneously and with minimal supervision.Preferred Technical and Professional Expertise? Knowledge of privacy regulations such as CCPA, GDPR, and LGPD? Desire to learn new technologies and languages a requirement? Basic understanding of Machine Learning and Data Science concepts is a plusAbout Business UnitIBM's Cloud and Cognitive software business is committed to bringing the power of IBM's Cloud and Watson/AI technologies to life for our clients and ecosystem partners around the world. IBM provides you with the most comprehensive and consistent approach to development, security and operations across hybrid environments-with complete software solutions for business and IT operations, development, data science, security, and management. Our experts and software capabilities help organizations develop applications once and deploy them anywhere, integrate security across the breadth of their IT estate, and automate operations with management visibility. With IBM, you also have access to new skills and methods, governance and management approaches, and a deep ecosystem of industry experts and partners.Your matters to you when you're looking for your next career challenge?Maybe you want to get involved in work that really changes the world? What about somewhere with incredible and diverse career and development opportunities - where you can truly discover your passion? Are you looking for a culture of openness, collaboration and trust - where everyone has a voice? What about all of these? If so, then IBM could be your next career challenge. Join us, not to do something better, but to attempt things you never thought possible.Impact. Inclusion. Infinite Experiences. Do your best work ever.About IBMIBM's greatest invention is the IBMer. We believe that through the application of intelligence, reason and science, we can improve business, society and the human condition, bringing the power of an open hybrid cloud and AI strategy to life for our clients and partners around the world.Restlessly reinventing since 1911, we are not only one of the largest corporate organizations in the world, we're also one of the biggest technology and consulting employers, with many of the Fortune 50 companies relying on the IBM Cloud to run their business. At IBM, we pride ourselves on being an early adopter of artificial intelligence, quantum computing and blockchain. Now it's time for you to join us on our journey to being a responsible technology innovator and a force for good in the world.Location StatementIBM offers a wide range of resources for eligible IBMers to thrive both inside and outside of work. In addition to a competitive benefits program consisting of medical and life insurance, retirement plans, and time off, eligible employees may also have access to:*12 weeks of paid parental bonding leave. Family care options are also available to support eligible employees during COVID-19.*World-class training and educational resources on our personalized, AI-driven learning platform. IBM's learning culture supports your restless attitude to grow your skills and build the depth and scale of knowledge needed to achieve your career goals.*Well-being programs to support mental and physical health.*Financial programs that empower you to plan, save, and manage your money (including expert financial counseling, 401(k), IBM stock discount, etc.).*Select educational reimbursement opportunities.*Diverse and inclusive employee resource groups where you can network and connect with IBMers across the globe.*Giving and volunteer programs to benefit charitable organizations and local communities.*Discounts on retail products, services, and experiences.We consider qualified applicants with criminal histories, consistent with applicable law.Being is committed to creating a diverse environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, pregnancy, disability, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.

 
Apply Now

Share

Free eBook

Flash-bkgn
Loader2 Processing ...