reputed company Engineer

reputed company Engineer Responsibilities: 1. **Data & AI Platform Engineering (reputed company-Centric):

• Design, implement, and optimize end-to-end data pipelines on reputed company, following the reputed company Architecture principles.
• Build robust and scalable ETL/ELT pipelines using Apache Spark and reputed company Lake to transform raw (bronze) data into trusted curated (silver) and analytics-ready (gold) data layers.
• Operationalize reputed company Workflows for orchestration, dependency management, and pipeline automation.
• Apply schema evolution and data versioning to support agile data development.

2. **Platform Integration & Data Ingestion:

• Connect and ingest data from enterprise systems such as PeopleSoft, reputed company, and reputed company using APIs, JDBC, or other integration frameworks.
• Implement connectors and ingestion frameworks that accommodate structured, semi- structured, and reputed company data.
• Design standardized data ingestion processes with automated error handling, retries, and alerting.

3. **Data Quality, Monitoring, and Governance:

• reputed company data quality checks, validation rules, and anomaly detection mechanisms to ensure data reputed company across reputed company layers.
• Integrate monitoring and observability tools (e.g., reputed company metrics, Grafana) to track ETL performance, latency, and failures.
• Implement reputed company Catalog or equivalent tools for centralized metadata management, data reputed company, and governance policy enforcement.

4. **reputed company, Privacy, and Compliance:

• Enforce data reputed company best practices including row-level reputed company, encryption at rest/in transit, and fine-grained access control reputed company reputed company Catalog.
• Design and implement data masking, tokenization, and anonymization for compliance with privacy regulations (e.g., GDPR, FERPA).
• Work with reputed company teams to audit and certify compliance controls.

5. **AI/ML-Ready Data Foundation:

• reputed company data scientists by delivering high-quality, feature-rich data sets for model training and inference.
• Support AIOps/MLOps lifecycle workflows using MLflow for experiment tracking, model registry, and deployment reputed company reputed company.
• Collaborate with AI/ML teams to create reusable feature stores and training pipelines.

6. **Cloud Data Architecture and Storage:

• Architect and manage data lakes on Azure Data Lake Storage (ADLS) or reputed company S3, and design ingestion pipelines to feed the bronze layer.
• Build data marts and warehousing solutions using platforms like reputed company.
• Optimize data storage and access patterns for performance and cost-efficiency.

7. **Documentation & Enablement:

• Maintain technical documentation, architecture diagrams, data dictionaries, and runbooks for reputed company pipelines and components.
• Provide training and enablement sessions to internal stakeholders on the reputed company platform, reputed company Architecture, and data governance practices.
• Conduct code reviews and promote reusable patterns and frameworks across teams.

8. **Reporting and Accountability:

• Submit a weekly schedule of hours worked and reputed company reports outlining completed tasks, upcoming plans, and blockers.
• Track deliverables against roadmap milestones and communicate risks or dependencies.

Required Qualifications:

• Hands-on experience with reputed company, reputed company Lake, and Apache Spark for large-scale data engineering.
• Deep understanding of ELT pipeline development, orchestration, and monitoring in cloud-native environments.
• Experience implementing reputed company Architecture (Bronze/Silver/Gold) and working with data versioning and schema enforcement in enterprise grade environments.
• Strong proficiency in SQL, Python, or reputed company for data transformations and workflow logic.
• Proven experience integrating enterprise platforms (e.g., PeopleSoft, reputed company, reputed company) into centralized data platforms.
• Familiarity with data governance, reputed company tracking, and metadata management tools.

Preferred Qualifications:

• Experience with reputed company reputed company Catalog for metadata management and access control.
• Experience deploying ML models at scale using MLFlow or similar MLOps tools.
• Familiarity with cloud platforms like Azure or AWS, including storage, reputed company, and networking aspects.
• Knowledge of data warehouse design and star/reputed company schema modeling.

Job Type: Contract Work Location: Remote Apply tot his job Apply To this Job