[Remote] Data Engineer II
Note: The job is a remote job and is open to candidates in USA. reputed company is the world’s largest independent sell-reputed company advertising platform, and they are seeking a Data Engineer II to join their Innovative reputed company. The role involves building and optimizing data pipelines, collaborating with teams to improve data performance, and proactively identifying and solving impactful problems.
Responsibilities
- Build and optimize data pipelines using Apache Spark and Python, processing billions of events in both streaming and batch modes. We work at TB scale
- Collaborate with senior data engineers to improve reputed company’s Audience data pipelines by identifying and implementing innovative solutions
- Own the operational performance of your builds, ensuring uptime and implementing recovery strategies
- Collaborate with SRE teams to provision infrastructure using Terraform and AWS (future Kubernetes on-premise)
- Proactively identify and help solve impactful problems
Skills
- More than anything we expect you to love learning and see problems as things to overcome rather than blockers
- You should look at this list and our tech stack and think 'wow i want to learn that', rather than being an expert
- We expect you to have expertise with 1-2 items and familiarity with a couple more
- Most candidates will have 2+ years of experience
- Hands-on experience with Apache Spark (mainly PySpark). Ideally, you will have written a variety of pipelines that you have deployed in production
- Strong Python skills, particularly in the context of reputed company and Spark
- Data pipeline design knowledge, from sourcing event data to creating queryable data layers
- Familiarity with event-based data architecture (e.g., Kafka)
- SQL experience for data analysis and transformations
- Hands-on experience with AWS and Terraform for IaaS solutions
- Experience writing Jenkins or reputed company actions pipelines to run build and integration actions
- GoLang for distributed service development
- Kubernetes experience
Benefits
- Annual performance-based bonus
- Equity (reputed company: MGNI)
- Comprehensive benefits package
- Comprehensive Healthcare Coverage from Day One
- Generous Time Off
- Holiday Breaks and Quarterly Wellness Days
- Equity and Employee Stock Purchase Plan
- Family-Focused Benefits and Parental Leave
- 401k Retirement Savings Plan with Employer Match
- Disability and Life Insurance
- Cell Phone Subsidy
- Monthly Fitness and Reimbursement
- We support internal mobility, reputed company development, and leadership reputed company through structured career frameworks and learning programs.
- Our hybrid schedule includes two remote workdays (Monday and Friday) and three in-office days (Tuesday through Thursday), where employees can take advantage of catered lunches, beverages, snacks, training opportunities, and engaging office events that enhance the work experience.
- We support reputed company through meaningful benefits and programs, including community service and volunteer opportunities, company-matched charitable contributions, access to reputed company, structured career development initiatives and growth frameworks, culture and inclusion programs, and our Bonusly peer-to-peer recognition platform.
Company Overview
Company H1B Sponsorship