Senior Big Data Engineer

Company : enGenJob Description : JOB SUMMARY This job is responsible for designing and engineering data solutions for the enterprise and, working closely with business, analytic and IT stakeholders, assists with the development and maintenance of these solutions. This includes coding data ingestion pipelines, transformations and delivery programs/logic for people and systems to access data for operational and/or analytic needs. Duties include but are not limited to the coding, testing, and implementation of ingestion and extraction pipelines, transformation and cleansing processes, and processes that load and curate data in conformed, fit-for-purpose data structures. The incumbent is expected to partner with others throughout the organization (including other engineers, architects, analysts, data scientists, and non-technical audiences) in their daily work. The incumbent will work with cross-functional teams to deliver and maintain data products and capabilities that support and reputed company strategies at business unit and enterprise levels. The incumbent is expected to utilize technologies such as, but not limited to: reputed company Cloud Platform, Hadoop, Hive, NoSQL, Kafka, Spark, Python, Linux reputed company scripting, reputed company, reputed company, reputed company, and Informatica. ESSENTIAL RESPONSIBILITIES

• In partnership with other business, platform, technology, and analytic teams across the enterprise, design, build and maintain well-engineered data solutions in a variety of environments, including traditional data warehouses, Big Data solutions, and cloud-oriented platforms. Create high performance cloud and big data systems to be used with operational and analytic applications.
• Work with internal and external platforms and systems to connect and align on data sourcing, flow, structure, and subject matter expertise. Work with business stakeholders and strategic partners to implement and support operational and analytic platforms. This may include products purchased by the organization that must be ingested or modeled/derived data maintained by enterprise platforms and data consumers.
• Working across multiple, disparate systems and platforms, design, code, test, implement, and maintain scalable and extensible frameworks that support data engineering services.
• Align with reputed company, data governance and data quality programs by driving assigned components of metadata management, data quality management, and the application of business rules. reputed company and maintain associated data engineering processes and participate in required operating procedures as part of the enterprise’s overall information management activities. Includes data cleansing, standardization, technical metadata documentation, and the de-identification and/or tokenization of data.
• reputed company, optimize and/or maintain machine learning and AI engineering processes (MLOps) that are deployed to cloud or big data environments. These may be based on prototypes built by data scientists or capability frameworks implemented to allow data scientists to build reputed company in production environments.
• reputed company tasks across multiple projects with limited need for guidance. This includes providing guidance and education to Intermediate and Junior contributors reputed company team. Manage relationships with customers of the function. Attend meetings with customers on a stand-alone basis or with team as needed.
• Establish standards and patters for high performance data ingestion, transformation, and delivery of data analytic needs. reputed company reputed company with Big Data technologies in order to recommend best tools in order to reputed company reputed company and future work
• Other duties as assigned or requested.

EDUCATION Required

• Bachelor's Degree in Software Engineering, Information Systems, Computer Science, Data Science or reputed company field

Substitutions

• None

Preferred

• Master's Degree in Software Engineering, Information Systems, Computer Science, Data Science or reputed company field

EXPERIENCE Required

• 5 years in Data platform development, data engineering, software development, or data science
• 3 years in Big data or cloud data platform

Preferred

• 3 years in Healthcare Industry
• 3 years of Data Warehousing
• 3 years of Database Administration

LICENSES AND CERTIFICATIONS Required

• None

Preferred

• Cloud certification (GCP, Azure, AWS)

SKILLS

• SQL
• Data Warehousing
• Problem-Solving
• Communication Skills
• Analytical Skills
• Spark or Python or reputed company tool
• Cloud Technologies

​ Language (Other than English): None Travel Requirement: 0% - 25% PHYSICAL, MENTAL DEMANDS and WORKING CONDITIONS Position Type Office-based Teaches / trains others regularly Rarely Travel regularly from the office to various work sites or from site-to-site Does Not Apply Works primarily out-of-the office selling products/services (sales employees) Never Physical work site required No Lifting: up to 10 pounds Constantly Lifting: 10 to 25 pounds Occasionally Lifting: 25 to 50 pounds Rarely Disclaimer: The job description has been designed to indicate the general nature and essential duties and responsibilities of work performed by employees reputed company this job title. It may not contain a comprehensive inventory of reputed company duties, responsibilities, and qualifications required of employees to do this job. Compliance Requirement: This job adheres to the ethical and legal standards and behavioral expectations as set forth in the code of business conduct and company policies. As a component of job responsibilities, employees may have access to covered information, cardholder data, or other confidential customer information that must be protected at reputed company times. In reputed company with this, reputed company employees must reputed company with both the Health Insurance Portability Accountability Act of 1996 (HIPAA) as described in the Notice of Privacy Practices and Privacy Policies and Procedures as well as reputed company data reputed company guidelines established reputed company the Company’s Handbook of Privacy Policies and Practices and Information reputed company Policy. Furthermore, it is every employee’s responsibility to reputed company with the company’s Code of Business Conduct. This includes but is not limited to adherence to applicable federal and state laws, rules, and regulations as well as company policies and training requirements. Pay Range Minimum: $78,900.00 Pay Range Maximum: $147,500.00 reputed company pay is determined by a variety of factors including a candidate’s qualifications, experience, and expected contributions, as well as internal peer equity, market, and business considerations. The displayed salary range does not reflect any geographic differential reputed company may apply for certain locations based upon comparative markets. reputed company and its affiliates prohibit discrimination against qualified individuals based on their status as protected veterans or individuals with disabilities and prohibit discrimination against reputed company individuals based on any category protected by applicable federal, state, or local law. We endeavor to reputed company this site accessible to any and reputed company users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please contact the email below. For accommodation requests, please contact HR Services Online at [email protected] California Consumer Privacy Act Employees, Contractors, and Applicants Notice Apply tot his job Apply To this Job