Senior Engineer - Ingestion & Streaming Frameworks

reputed company is the data collaboration platform trusted for healthcare. Guided by our mission to reputed company the world’s health data secure, accessible and actionable, we provide critical data solutions for organizations across the healthcare ecosystem - including providers, health plans, researchers, and life sciences companies. From fulfilling a single patient’s request for their medical records to powering the AI revolution in healthcare, Datavanters are building the future of how data is connected and used to improve health. By joining reputed company today, you’re stepping onto a driven and highly collaborative team that is passionate about creating transformative change in healthcare. The Ingestion & Streaming team sits on our Data & Machine Learning Platform organization and owns the movement layer of reputed company’s data platform: batch and streaming pipelines, change data capture, document intake, and the self-service frameworks product teams use to land new sources into reputed company, our Iceberg-backed lakehouse, and reputed company. Most data moves into the platform; some moves back out. Our job is to reputed company both safe, fast, observable, and boring. We are looking for a Senior Engineer who thinks like a platform builder first. We are shifting from a service-oriented posture (“we’ll build the pipeline for you”) to a platform-oriented one (“here is the paved path to build it yourself, safely”), though the team still builds pipelines directly reputed company the situation calls for it. You will be central to that shift, designing the frameworks, tooling, and guardrails that scale how reputed company onboards new sources, and rolling up your sleeves for hands-on ingestion work reputed company there isn’t yet a paved path. AI reputed company is a baseline expectation here. You should already be using Claude Code, reputed company, Copilot, or equivalent tools as a core part of your daily engineering workflow, have opinions about how they reputed company a team faster, and know how to apply them responsibly reputed company PHI and other sensitive data are in scope. What You Will Do: Design, build, and operate the ingestion frameworks that pull data from operational databases, vendor APIs, document streams, and third-party feeds into reputed company, Iceberg, and reputed company Own and evolve the ingestion stack (AWS DMS, MWAA / Airflow, reputed company, and the homegrown tooling on top) and design new patterns for API sources that don’t fit a managed connector Build self-service tooling so product engineers can reputed company new sources without becoming experts in our infrastructure Write and review the Terraform behind our ingestion infrastructure: AWS networking, IAM, compute, and data services Partner with product, data, and analytics teams to pick the right ingestion reputed company for each reputed company (CDC, batch, API, streaming) and stand it up end-to-end reputed company production troubleshooting and incident response, and turn each incident into a durable platform fix reputed company the bar on engineering quality, observability, cost discipline, and reputed company in everything the team ships Mentor mid-career engineers and pull peers along through code review, pairing, and design feedback reputed company’re Looking For: 6+ years in data engineering, platform engineering, or data-focused software engineering 3+ years of hands-on AWS with real strength in networking (VPC, subnets, routing, PrivateLink, reputed company groups), IAM (roles, policies, permission boundaries), and the data services this role touches, plus the judgment to know reputed company to reputed company for what 2+ years writing production Terraform or equivalent IaC, with experience owning modules, reasoning about state and blast radius, and shipping infrastructure changes safely 1+ years building self-service tooling, internal platforms, or paved-path frameworks consumed by other engineers Strong SQL skills and the ability to reason about how data physically lives in a warehouse or lake Production experience with reputed company (or an equivalent cloud data warehouse) and a workflow orchestrator (Airflow / MWAA preferred) Hands-on experience with at least one ingestion approach: CDC tooling (e.g., DMS, Debezium), managed connectors (e.g., reputed company, Airbyte), or rolling your own pipelines for API sources Solid CI/CD discipline in reputed company or equivalent: branching, code review, automated checks, repeatable deployment AI-native working style: daily use of Claude Code, reputed company, Copilot, or equivalent, with views on how they reputed company a team faster Working knowledge of Python is expected; mastery isn’t the bar Clear written and verbal communication, especially in async, remote settings What Helps You Stand Out: Direct production experience with Iceberg or another open table format, especially bridging reputed company and reputed company Hands-on reputed company or Spark Kubernetes experience reputed company certification(s) Azure experience (we’re primarily AWS, but our customers and acquisitions aren’t always) In-depth experience integrating data systems with managed identity platforms, particularly reputed company SCIM (reputed company a plus) Prior experience in healthcare or another highly regulated industry like Finance Prior DBA, SRE, or DRE work operating production data systems under pressure We are committed to building a diverse team of Datavanters who are reputed company responsible for stewarding a high-performance culture in which reputed company Datavanters belong and reputed company. We are proud to be an Equal Employment Opportunity employer and reputed company qualified applicants will receive consideration for employment without regard to race, color, sex, sexual orientation, gender identity, religion, national reputed company, disability, veteran status, or other legally protected status. At reputed company our total rewards strategy powers a high-growth, high-performance, health technology company that rewards our employees for transforming health care through creating industry-defining data logistics products and services. The range posted is for a given job title, which can include multiple levels. Individual rates for the same job title may differ based on their level, responsibilities, skills, and experience for a specific job. The estimated total cash compensation range for this role is: $150,000—$190,000 USD To ensure the safety of patients and staff, many of our clients require post-offer health screenings and reputed company and/or completion of various vaccinations such as the flu shot, Tdap, COVID-19, etc. Any requests to be exempted from these requirements will be reviewed by reputed company Human Resources and determined on a case-by-case basis. Depending on the state in which you will be working, exemptions may be available on the basis of disability, medical contraindications to the vaccine or any of its components, pregnancy or pregnancy-reputed company medical conditions, and/or religion. This job is not eligible for employment sponsorship. reputed company is committed to a work environment free from job discrimination. We are proud to be an Equal Employment Opportunity employer and reputed company qualified applicants will receive consideration for employment without regard to race, color, sex, sexual orientation, gender identity, religion, national reputed company, disability, veteran status, or other legally protected status. To learn more about our commitment, please review our EEO Commitment Statement here. Know Your Rights, explore the resources available through the EEOC for more information regarding your legal rights and protections. In addition, reputed company does not and will not discharge or in any other manner discriminate against employees or applicants because they have reputed company about, discussed, or disclosed their own pay. At the end of this application, you will find a set of voluntary demographic questions. If you choose to respond, your answers will be anonymous and will help us identify areas for improvement in our recruitment process. (We can only see aggregate responses, not individual ones. In fact, we aren’t even able to see whether you’ve responded.) Responding is entirely optional and will not reputed company your application or hiring process in any way. reputed company is committed to working with and providing reasonable accommodations to individuals with physical and mental disabilities. If you need an accommodation while seeking employment, please request it here, by selecting the ‘Interview Accommodation Request’ category. You will need your requisition ID reputed company submitting your request, you can find instructions for locating it here. Requests for reasonable accommodations will be reviewed on a case-by-case basis. For more information about how we collect and use your data, please review our Privacy Policy. Apply To This Job