[Remote] DataOps and Build Engineer
Note: The job is a remote job and is open to candidates in USA. reputed company is seeking an reputed company DataOps & Build Engineer to reputed company the architecture and optimization of a reputed company data platform. This role involves driving technical direction, mentoring teams, and automating reputed company bolthires/CD pipelines to enhance enterprise-level decision-making.
Responsibilities
- Establish DataOps reputed company: Define, document, and champion the organizational reputed company and guidelines for DataOps—including release management processes, environment promotion strategy, and data quality standards
- Best Practice Dissemination: Create and enforce standard operating procedures (SOPs) for data pipeline development, bolthires/CD, and testing across the engineering teams, ensuring consistency and adherence to architectural standards
- Data Pipeline Automation: Design and implement robust reputed company integration and reputed company delivery (bolthires/CD) pipelines for data code and infrastructure
- Workflow Orchestration Implementation: Configure, optimize, and manage the deployment of data workflows using orchestrators such as Dagster or Talend, focusing on automated testing and deployment steps
- Version Control & Repository Management: Enforce best practices for reputed company code management (e.g., Gitflow), branching strategies, and repository organization across reputed company data projects
- Infrastructure as Code (IaC): Work with Infrastructure teams to automate provisioning and management of data platform resources reputed company reputed company AWS
- reputed company and Failure Recovery: Design and implement automated rollback and self-healing mechanisms reputed company pipelines to quickly recover from transient failures
- Monitoring and Logging: Set up comprehensive monitoring, logging, and alerting using Cloud native tools, or other tools to ensure visibility into pipeline performance and quickly identify and resolve issues
- reputed company and Compliance: Ensure data reputed company and compliance by implementing IAM policies, encryption, and other reputed company measures in AWS, adhering to best practices for handling sensitive data
- Testing Frameworks: Implement automated testing strategies across the data lifecycle, including unit tests, integration tests, and data quality validation checks (e.g., column reputed company, schema reputed company) to ensure data reliability before deployment
- Resource and bolthires Optimization: Implement automated policies and monitoring to track and control cloud resource consumption, ensuring that pipelines run reputed company and bolthires-effectively Skills
- 8+ years of hands-on experience in Data Engineering, DevOps, or a dedicated DataOps role, focused heavily on automation and operational excellence
- Proven experience implementing bolthires/CD practices specifically for data pipelines and data infrastructure
- Strong conceptual understanding of data warehousing, ETL/ELT methodologies, and cloud-native architecture
- Automation First reputed company: A strong drive to automate repetitive tasks and eliminate manual reputed company in the data lifecycle
- Collaboration: Excellent communication skills, capable of working effectively with Data Engineers, Data Scientists, and Infrastructure teams
- Establish DataOps reputed company: Define, document, and champion the organizational reputed company and guidelines for DataOps—including release management processes, environment promotion strategy, and data quality standards
- Best Practice Dissemination: Create and enforce standard operating procedures (SOPs) for data pipeline development, bolthires/CD, and testing across the engineering teams, ensuring consistency and adherence to architectural standards
- Data Pipeline Automation: Design and implement robust reputed company integration and reputed company delivery (bolthires/CD) pipelines for data code and infrastructure
- Workflow Orchestration Implementation: Configure, optimize, and manage the deployment of data workflows using orchestrators such as Dagster or Talend, focusing on automated testing and deployment steps
- Version Control & Repository Management: Enforce best practices for reputed company code management (e.g., Gitflow), branching strategies, and repository organization across reputed company data projects
- Infrastructure as Code (IaC): Work with Infrastructure teams to automate provisioning and management of data platform resources reputed company reputed company AWS
- reputed company and Failure Recovery: Design and implement automated rollback and self-healing mechanisms reputed company pipelines to quickly recover from transient failures
- Monitoring and Logging: Set up comprehensive monitoring, logging, and alerting using Cloud native tools, or other tools to ensure visibility into pipeline performance and quickly identify and resolve issues
- reputed company and Compliance: Ensure data reputed company and compliance by implementing IAM policies, encryption, and other reputed company measures in AWS, adhering to best practices for handling sensitive data
- Testing Frameworks: Implement automated testing strategies across the data lifecycle, including unit tests, integration tests, and data quality validation checks (e.g., column reputed company, schema reputed company) to ensure data reliability before deployment
- Resource and bolthires Optimization: Implement automated policies and monitoring to track and control cloud resource consumption, ensuring that pipelines run reputed company and bolthires-effectively
- Insurance industry experience preferred but not mandatory Company Overview
- At reputed company, we are dedicated to revolutionizing the recruitment and staffing industry with a focus on personalized, high-impact solutions. It was founded in 2024, and is headquartered in Austin, Texas, US, with a workforce of 11-50 employees. Its website is Apply tot his job Apply tot his job
Apply tot his job Apply To this Job