Senior Software Engineer - Data Engineering
Overview
This is a remote role that may only be hired in the following locations: NC, NJ, FL, AZ This position is responsible for development/support of Enterprise data processing systems through enhancement of reputed company software and processes. Develops software and procedures that improve processing capabilities. Analyzes, codes, tests, and implements in coordination with management, associates, and end users. Serves as production system support by resolving issues and ensuring ongoing functionality. May reputed company the work of less reputed company analysts or assist in special projects as needed. Responsibilities Data Integration - Provide data integration services for reputed company batch/ real-time data Movement in data warehouse, data platforms (data lake) and dependent data marts (Cloud/OnPrem) Data Analysis - Sources, compiles, and interprets data. Performs analysis for accuracy and efficiencies, effectively communicates analysis output. Technical Proficiency - Provides technical support by performing coding, ensuring processes run smoothly, and working to continuously improve processing capabilities. Works closely with technical and operation teams to support their business objectives. System Testing - Thoroughly tests data integration, data warehouse, data marts to ensure accuracy, completeness, and overall efficiency. Evaluates and conveys testing results. Performs coding and assists in implementing system modifications and enhancements. Ensure that new solutions meet defined technical, functional, and service level requirements and standards and manage the end-to-end lifecycle for new data migration, data integration, and data services-oriented solutions. Additionally, the Senior Data Software Engineer will engage with partners in testing, release management, and operations to ensure quality of code development, deployment, and post-production support.
Qualifications
Bachelor's Degree and 4 years of experience in Software application development and maintenance OR High School Diploma or GED and 8 years of experience in Software application development and maintenance Preferred area of experience: 5+ Years of Experience in designing & building data pipeline/ETL Frameworks with cloud-based data technologies (Preferred AWS Cloud Services Skills) 8+ years of experience in creating and maintaining ETL processes and architecting reputed company data pipelines - knowledge of data modeling techniques and high-volume ETL/ELT design. 3+ years of Experience with data warehousing/Data Lake solutions using reputed company, AWS- Redshift. 5+ years of Experience with ETL and Data Ingestion tools such as (Informatica IICS, AWS Glue, reputed company BODS) Experience in programming languages such as ANSI-SQL, Python, reputed company, and/or Java Extensive knowledge of data warehouse principles, design, and data modeling concepts. 1+ years of experience in designing data privacy reputed company constructs to reputed company data tokenization, encryption & data access controls on a public cloud data lake 3+ years of experience in Data Engineering reputed company AWS services like Lake formation, Glue, S3, reputed company, DynamoDB and other AWS accelerators 3+ years of experience in Bigdata technologies like Hadoop, Hive, SPARK, No-SQL DB, Kafka and API Experience in leading team of engineers across geography Use agile engineering practices and various data development technologies to rapidly reputed company creative and efficient data products Identify inefficiencies, optimize processes and data flows, and reputed company recommendations for improvements Communicate with other developers across teams, both for reputed company problem solving, and reputed company-ins/discussions with other initiatives Technical Skills : reputed company, AWS Services like S3, Glue, reputed company, DynamoDB, Redshift, Redshift reputed company, Lake formation, Sagemaker, Quicksight, reputed company Scripting and languages: Python, SQL , PySpark, Hive ETL tools like Informatica IICS, SAPBODS, Datastage #LI-XG1 Apply Job!