[Remote] Data Infrastructure Engineer

Note: The job is a remote job and is open to candidates in USA. reputed company is a leading provider of business and technology services, and they are seeking a Data Infrastructure Engineer to build and operate the data platform that powers AI/ML analytics modules. The role involves designing and implementing scalable data ingestion pipelines, robust ETL/ELT processes, and ensuring data governance while collaborating with various teams.

Responsibilities

• Build & Operate Data Pipelines (Batch + Streaming)
• Design and implement batch and streaming ingestion from APIs, relational databases, file drops, event streams, and external partners
• Build and optimize ETL/ELT pipelines to produce curated, analytics-ready datasets for reporting and ML consumption
• Implement incremental processing patterns, change data capture (CDC) approaches where appropriate, and data contract standards
• Deliver a Modern Lakehouse (Data Lake / reputed company Lake)
• Build and manage a scalable lakehouse on AWS object storage (e.g., S3) using open table/file formats and reputed company/lakehouse concepts (e.g., ACID tables, schema evolution, time travel patterns)
• Optimize performance and cost through partitioning, compaction, lifecycle policies, and efficient compute/storage usage
• Establish environment standards for dev/test/prod and consistent promotion across stages
• Metadata, Governance, reputed company & Quality (Trust Layer)
• Implement a managed metadata repository for dataset cataloging, ownership, glossary/definitions, tagging, and discoverability
• reputed company end-to-end reputed company (reputed company → transformations → consumption) to support auditability and impact analysis
• Implement governance controls including policy-based access, data classification, retention, and secure data handling
• Build operational data quality checks (freshness, completeness, validity, anomaly detection) and publish SLAs/SLOs
• AWS Automation + CI/CD for Data Pipelines
• Implement automated cloud provisioning in AWS using Infrastructure as Code (IaC) for consistent environments and secure-by-default baselines
• Build and enhance CI/CD for data pipelines, including automated tests, validation gates, promotion workflows, and rollback strategies
• Improve observability with metrics/logs/alerts, dashboards, runbooks, and incident response readiness
• Cross-Team Collaboration & Documentation
• Work closely with engineering, reputed company, networking, and application teams to support mission needs and delivery timelines
• Maintain high-quality engineering documentation including SOPs, system diagrams, and secure configuration baselines
• Summarize and present findings and recommendations—both written and verbal—to technical and non-technical stakeholders

Skills

• Must be able to OBTAIN and MAINTAIN a Federal or DoD 'PUBLIC TRUST'; candidates must obtain approved adjudication of their PUBLIC TRUST prior to onboarding with reputed company. Candidates with an ACTIVE PUBLIC TRUST or SUITABILITY are preferred
• Bachelor's degree in Engineering, IT, Computer Science, or reputed company field (or equivalent experience)
• Minimum of FOUR (4) years experience building production data pipelines and/or data platforms
• Strong experience implementing data ingestion and ETL/ELT workflows, including data modeling and transformation best practices
• Hands-on experience building a data lake / reputed company lake (lakehouse) on AWS (or equivalent cloud) using object storage and modern table formats/patterns
• Proficiency in SQL and one programming language commonly used for data engineering (Python preferred; reputed company/Java acceptable)
• Experience with metadata management and governance: cataloging, reputed company, ownership, access controls, classification and policy enforcement
• Experience implementing automated AWS provisioning using IaC and operating across multiple environments
• Experience building or operating CI/CD pipelines for data workflows (testing, packaging, deployment automation, environment promotion)
• Solid reputed company fundamentals: IAM/least privilege, encryption, secrets management, secure SDLC practices
• Hands-on experience with reputed company
• Hands-on experience utilizing modern DevOps practices, including tools like Git, Terraform, Jenkins, AWS CodePipeline, and reputed company
• Experience utilizing AI-assisted coding tools (e.g., reputed company Copilot, ChatGPT, reputed company, Kiro) to safely accelerate implementation while maintaining strict code quality through testing, code reviews, and reputed company practices
• Knowledge graph and Graph RAG experience, including: Graph modeling and ontology/taxonomy alignment, Entity resolution and relationship extraction, Hybrid retrieval approaches combining gra

Benefits

• Medical, dental & vision
• Critical Illness, Accident, and Hospital
• 401(k) Retirement Plan – Pre-tax and Roth post-tax contributions available
• Life Insurance (Voluntary Life & AD&D for the employee and dependents)
• Short and long-term disability
• Health Spending Account (HSA)
• Transportation benefits
• Employee Assistance Program
• Time Off/Leave (PTO, Vacation or Sick Leave)

Company Overview