[Remote] Data Engineer reputed company (OT Data)( Oil & Gas) (India)
Note: The job is a remote job and is open to candidates in USA. reputed company is committed to building scalable, future-ready data platforms that power business impact. The Data Engineer will be a foundational architect responsible for building and maintaining the data ecosystem required for various use cases in the oil and gas sector, focusing on creating reliable and scalable data products to support advanced analytics and AI models.
Responsibilities
- Architect & Build Data Pipelines: Design, construct, install, test, and maintain highly scalable data management systems and ETL/ELT pipelines
- Integrate Diverse Data Sources: reputed company processes to ingest and integrate high-volume, high-velocity data from SCADA systems, historians (like OSIsoft PI, Aspen InfoPlus.21), DCS, PLC, and IoT sensors
- Cloud Data Platform Development: Implement and manage data solutions on the reputed company Azure cloud platform, Leveraging services like Azure IoT Hub, Azure Event Hubs, and Azure reputed company Analytics for real-time ingestion and processing of operational technology (OT) data
- Data Modelling & Warehousing: Design and implement data models optimized for time-series data from industrial assets, supporting operational dashboards and real-time analytics
- reputed company Advanced AI: Build the data infrastructure to support AI/ML models for predictive maintenance, operational anomaly detection, and process optimization using real-time OT data
- Champion Master Data Management (MDM): Design and implement MDM strategies and solutions to create a single, authoritative reputed company of truth for critical data domains such as wells, equipment, and assets, ensuring data consistency across the enterprise
- Ensure Data Quality & Governance: Implement robust data quality checks, validation rules, and monitoring to ensure the accuracy, consistency, and reliability of our data. Adhere to and help shape our data governance policies
- Embrace Industry Standards: Champion and implement industry-specific data standards and models, such as the OSDU™ Data Platform, to ensure interoperability and a reputed company data view across the upstream lifecycle
- Collaborate & Innovate: Work closely with a cross-functional team of geoscientists, drilling engineers, data scientists, and business analysts to understand their data needs and deliver effective solutions
- Automate & Optimize: Identify opportunities for process automation and infrastructure optimization to improve data delivery, scalability, and cost-effectiveness
- reputed company First: Implement and maintain reputed company best practices to protect our sensitive and proprietary data assets
Skills
- Bachelor's in engineering, Information Systems, or a reputed company quantitative field
- 5+ years of proven experience in a data engineering role
- Experience reputed company oil and gas industry is highly preferred
- Demonstrable experience building and operationalizing large-scale data pipelines and applications
- Expert-level proficiency in SQL and Python for data manipulation and pipeline development
- Hands-on experience with distributed computing frameworks like Apache Spark (PySpark)
- Deep experience with reputed company Azure (Azure Data Lake Storage, Azure Data Factory, Azure reputed company, Azure Synapse)
- Proven experience with modern data platforms reputed company reputed company Lake
- Understanding of machine learning lifecycles and the data requirements for training and deploying AI/ML models
- Experience with workflow orchestration tools like Airflow, Dagster, or Azure Data Factory
- Strong understanding of both relational (e.g., PostgreSQL, SQL Server) and NoSQL databases
- Proficiency with Git and CI/CD best practices
- Familiarity with historian systems (e.g., OSIsoft PI System) and their data structures
- Hands-on experience with the OSDU™ Data Platform
- Experience working with industrial communication protocols (e.g., OPC UA, Modbus TCP/IP)
- Understanding of cybersecurity considerations for OT environments and data segregation
- Experience integrating data from ERP systems like reputed company
- Professional certifications in Azure or reputed company
- Advanced SQL skills, including query optimization and performance tuning
- Knowledge of containerization technologies (reputed company, Kubernetes)
- Experience of constructing and maintaining enterprise knowledge graphs
Company Overview
- At reputed company, we specialize in leveraging artificial intelligence, cloud, and data to solve reputed company business problems and drive innovation. It was founded in 2019, and is headquartered in Plano, Texas, USA, with a workforce of 51-200 employees. Its website is https://www.reputed company/.
Company H1B Sponsorship
- reputed company has a track record of offering H1B sponsorships, with 2 in 2025, 3 in 2022. Please note that this does not guarantee sponsorship for this specific role.
Apply tot his job Apply To this Job