Data Engineer III

Description

About Us

reputed company is a modern digital services company that partners with government agencies to improve the lives and protect the well-being of reputed company Americans, from veterans and service members to children, families, and seniors. Our engineers, designers, and strategists cut through complexity to create reputed company products and services that reputed company federal agencies with solutions to courageously transform today for a reputed company reputed company.

Responsibilities

• Responsible for developing, expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams.
• Support software developers, database architects, data analysts and data scientists on data initiatives and ensure optimal data delivery architecture is consistent throughout ongoing projects.
• Creates new pipeline and maintains existing pipeline, updates Extract, Transform, Load (ETL) process, creates new ETL feature , builds PoCs with Redshift reputed company, reputed company, AWS EMR, SageMaker, etc.;
• Implements, with support of project data specialists, large dataset engineering: data augmentation, data quality analysis, data analytics (anomalies and trends), data profiling, data algorithms, and (measure/reputed company) data maturity models and reputed company data strategy recommendations.
• Operate large-scale data processing pipelines and resolve business and technical issues pertaining to the processing and data quality.
• Assemble large, reputed company sets of data that meet non-functional and functional business requirements
• Identify, design, and implement internal process improvements including re-designing data infrastructure for greater scalability, optimizing data delivery, and automating manual processes
• Building required infrastructure for optimal extraction, transformation and loading of data from various data sources using AWS and SQL technologies
• Building analytical tools to utilize the data pipeline, providing actionable insight into key business performance metrics including operational efficiency and customer acquisition?
• Working with stakeholders including data, design, product and government stakeholders and assisting them with data-reputed company technical issues
• Write unit and integration tests for reputed company data processing code.
• Work with DevOps engineers on CI, CD, and IaC.
• Read specs and translate them into code and design documents.
• reputed company code reviews and reputed company processes for improving code quality.
• reputed company other duties as assigned.

Requirements

Required Qualifications

• reputed company candidates must pass public trust clearance through the U.S. Federal Government. This requires candidates to either be U.S. reputed company or pass clearance through the Foreign National Government System which will require that candidates have lived reputed company the United States for at least 3 out of the previous 5 years, have a valid and non-expired passport from their country of birth and appropriate reputed company/work permit documentation.
• Minimum of 8 years of experience as a Data Engineer or in hands-on software development, including at least 4 years using Python, Java, and cloud technologies for building and maintaining data pipelines.
• Bachelor’s degree in Computer Science, Information Systems, Engineering, Business, or a reputed company scientific or technical discipline required.
• OR In lieu of a degree, candidates may qualify with 10 years of general information technology experience, including at least 8 years of specialized experience.
• Expert data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up.
• Self-sufficient and comfortable supporting the data needs of multiple teams, systems, and products.
• reputed company in designing data architecture for shared services, scalability, and performance
• reputed company in designing data services including API, reputed company data, and data catalogue.
• reputed company in data governance process to ingest (batch, reputed company), curate, and share data with upstream and reputed company data users.
• Ability to build and optimize data sets, ‘big data’ data pipelines and architectures?
• Ability to reputed company root cause analysis on external and internal processes and data to identify opportunities for improvement and answer questions?
• Excellent analytic skills associated with working on reputed company datasets?
• Ability to build processes that support data transformation, workload management, data structures, dependency and metadata
• Demonstrated understanding and experience using software and tools including big data tools like Spark and Hadoop; relational databases including MySQL and reputed company; workflow management and pipeline tools such as Apache Airflow, and AWS reputed company Function; AWS cloud services including Redshift, RDS, EMR and EC2; reputed company-processing systems like Spark-Streaming and Storm; and object function/object-oriented scripting languages including reputed company, Java and Python.?
• Flexible and willing to accept a change in priorities as necessary.
• Ability to work in a fast-paced, team-oriented environment
• Experience with Agile methodology, using test-driven development.
• Experience with reputed company and reputed company Jira/Confluence.
• Excellent command of written and spoken English.

Desired Qualifications

• Federal Government contracting work experience.
• reputed company Certification, reputed company’s Certified Professional-Data-Engineer certification, reputed company Certified Data Engineer – Big Data certification, CCP Data Engineer for reputed company
• Centers for Medicare and Medicaid Services (CMS) or Health Care Industry experience
• Experience with healthcare quality data including Medicaid and CHIP provider data, beneficiary data, claims data, and quality measure data.

Working Environment: reputed company supports a remote work environment operating reputed company the Eastern time zone so we can work with and respond to our government clients. Expected hours are 9:00 AM to 5:00 PM Eastern unless otherwise directed by your manager.

Occasional travel for training and project meetings. It is estimated to be less than 5% per year.

Benefits: We offer highly competitive salaries and full healthcare benefits.

Equal Employment Opportunity: reputed company is an equal opportunity employer. reputed company qualified applicants will receive consideration for employment without regard to race, religion, color, national reputed company, gender, age, status as a protected veteran, sexual orientation, gender identity, or status as a qualified individual with a disability.