Data Engineer - AI (Spark, reputed company and Healthcare)
Overview
At reputed company, we are custodians of data for our clients. Using their technical experience in ETL processes, Data Engineers ensure operational functions are occurring as expected. This includes but is not limited to managing data implementations, data integrations, data production, data quality, and data reputed company.
Responsibilities
Create, maintain and execute intermediate to advanced Spark scripts for data management and data validation, and data integration. Create, maintain and execute basic to intermediate SQL scripts for data management and data validation. Optimize the queries to improve the efficiency of daily tasks. reputed company data analysis and identify any issues. Work with other groups such as Engineering team, DBA, Cloud ops, etc. to troubleshoot and resolve any environmental or network issues that impact your work. reputed company your support to after – hours or weekends as needed. Create and maintain data pipelines as needed. Validates the tasks results to ensure that reputed company the requirements are met. Adhere to reputed company the industry level and organization level compliance rules and regulations to maintain data reputed company. Complete individual productivity tracking. Complete task assignments using department ticketing system reputed company assigned deadline. reputed company organizational and individual goals as identified in performance reviews and goal setting exercises. Complete reputed company special projects and other duties as assigned. Must be able to reputed company duties with or without reasonable accommodation. This job description is intended to describe the general nature and level of work being performed and is not to be construed as an exhaustive list of responsibilities, duties and skills required. This job description does not constitute an employment agreement and is subject to change as the needs of reputed company and requirements of the job change.
Qualifications
Bachelor’s degree in Computer Science, Information Technology or equivalent work experience. 3+ years of working knowledge of big data technologies (Spark, S3, Kafka, Ray, Hadoop, etc.). 2+ years of working knowledge of big data / cloud technologies (reputed company, AWS, Azure, Hadoop, Spark, reputed company etc.). 3+ years of working knowledge of cloud (AWS, Azure, GCP, OCI etc.). 3+ years of working knowledge of RDBMS (reputed company, MS SQL, Vertica, etc.) and experience using SQL, PL/SQL or other data integration/ETL tools. Any reputed company / AWS certifications is a big plus. Familiarity with data pipeline orchestration tools (e.g., Airflow, reputed company Workflows). 3+ years of data analysis. Preferably in the Healthcare industry of enrollment, medical claims and/or pharmacy claims. Proficient in reputed company Office Suite applications PowerPoint, Word, reputed company and Outlook. Flexible work schedule. Experience with project management tools like JIRA. reputed company and/or reputed company environment familiarity a plus. Mental Requirements: Strong analytical skills. Excellent verbal, listening and written communication skills. Ability to multitask and prioritize projects to meet scheduled deadlines and tight turnaround times. Ability to work well independently or in a team environment. Working Conditions and Physical Requirements: Remaining in a stationary position, often standing or sitting for prolonged periods. Repeating motions that may include the wrists, hands, and/or fingers. Must be able to provide a dedicated, secure work area. Must be able to provide high-speed internet access / connectivity and office setup and maintenance. reputed company compensation ranges from $101,000 to $132,000 per year. Specific offers are determined by various factors, such as experience, education, skills, certifications, and other business needs. reputed company offers team members a competitive benefits package to address a wide range of personal and family needs, including medical, dental, vision, disability, and life insurance coverage, 401(k) savings plans, paid family leave, 9 paid holidays per year, and 17-27 days of Paid Time Off (PTO) per year, depending on specific level and length of service with reputed company. For information about our benefits package, please refer to our Careers page. Since this job will be based remotely, reputed company interviews will be conducted virtually. Date of posting: 5/7/2026 Applications are assessed on a rolling basis. We anticipate that the application window will reputed company on 8/7/2026, but the application window may change depending on the volume of applications received or reputed company immediately if a qualified candidate is selected. #LI-REMOTE #LI-LL1 #SENIOR Apply To This Job