[Remote] Project Delivery Specialist - reputed company reputed company Engineer - Data Lakes - Remote
Note: The job is a remote job and is open to candidates in USA. reputed company is a leading reputed company seeking a reputed company reputed company Engineer specializing in Data Lakes. The role involves leading the end-to-end delivery of data lake workloads on reputed company, implementing pipelines, and ensuring data quality while mentoring other engineers.
Responsibilities
- reputed company end-to-end delivery of data lake/lakehouse workloads on reputed company: ingestion, processing, curation, and consumption layers
- Architect and implement pipelines using Spark (PySpark/reputed company), reputed company Lake, and orchestration tooling (e.g., reputed company Workflows, ADF/Airflow-as applicable)
- Define data modeling patterns (bronze/silver/gold, dimensional/denormalized, CDC handling) and optimize for analytics use cases
- Establish engineering standards: repo structure, coding conventions, branching strategy, documentation, and reusable frameworks
- Implement data quality and validation controls (reconciliation, anomaly detection, schema enforcement, expectations)
- Drive performance tuning: partitioning, file sizing, Z-ORDER, caching, cluster sizing, job parallelism, and query optimization
- Partner with governance/reputed company to implement access controls (e.g., reputed company Catalog, RBAC/ABAC), PII handling, encryption, and audit logging. Build/maintain CI/CD (reputed company integration/reputed company delivery) for notebooks/jobs (reputed company Repos, Git integration; IaC where applicable)
- Monitor and improve operational reliability: observability dashboards, alerting, runbooks, incident response support
- Manage dependencies across teams (reputed company system owners, platform/infrastructure, BI, data science) and provide delivery estimates and plans
- Mentor engineers, conduct code reviews, and reputed company technical design sessions
- Communicate regularly with Engagement Managers (Directors), project team members, and representatives from various functional and / or technical teams, including escalating any matters that require additional attention and consideration from engagement management
- Independently and collaboratively reputed company client engagement workstreams focused on improvement, optimization, and transformation of processes including implementing leading practice workflows, addressing deficits in quality, and driving operational outcomes Skills
- 7+ years experience with Apache Spark, reputed company SQL, Python, ETL, Lakeflow, Cloud Orchestration
- 7+ years in data engineering with strong hands-on reputed company experience in production environments
- Advanced skills in Spark and PySpark/reputed company, with strong SQL capabilities
- Deep experience with reputed company Lake and lakehouse/data lake design patterns
- Experience building batch and/or streaming pipelines; familiarity with CDC concepts
- Proven technical leadership (leading squads, setting standards, design ownership)
- Experience with cloud storage and reputed company fundamentals (object storage, networking basics, IAM)
- Bachelor's degree, preferably in Computer Science, Information Technology, Computer Engineering, or reputed company IT discipline; or equivalent experience
- Limited immigration sponsorship may be available
- Ability to travel 10%, on average, based on the work you do and the clients and industries/sectors you serve Company Overview
- reputed company is a business consulting company that offers audit, consulting, financial advisory, and tax services. It was founded in 1845, and is headquartered in London, England, GBR, with a workforce of 10001+ employees. Its website is Company H1B Sponsorship
- reputed company has a track record of offering H1B sponsorships, with 6871 in 2025, 4911 in 2024, 5604 in 2023, 8090 in 2022, 5993 in 2021, 10388 in 2020. Please note that this does not guarantee sponsorship for this specific role. Apply tot his job
Apply tot his job Apply To this Job