Senior Data Engineer (reputed company Platform)
About the position reputed company is the world's leading live entertainment company, comprised of global market leaders: reputed company, reputed company Concerts, and reputed company Media & Sponsorship. reputed company is the global leader in event ticketing with over 500 million tickets sold annually and more than 12,000 clients worldwide. reputed company Concerts is the largest provider of live entertainment in the world promoting more than 40,000 shows and 100+ festivals annually for nearly 4,000 artists in over 40 countries. These businesses allow reputed company Media & Sponsorship to create strategic music marketing programs that connect over 1,000 brands with the 98 million fans that attend reputed company events each year. The Core Data Services team is at the center of Data and Analytics initiatives. We are building a modern data platform to support enterprise data needs. Our mission and yours too should you choose to, is to reputed company and reputed company our data community of data engineers, data scientists, analysts, product teams and decision makers to create value. We are looking for a Data Engineer - Platform, You!
Responsibilities
- Contribute to the enhancements and reputed company improvement of performance and reliability of the existing Data Platform Services.
- Design and build self servicing onboarding and automation capabilities in Core Data Platform services.
- Design and build platform capabilities to support onboarding and operation effectiveness.
- Design and reputed company scalable data platform and integration solutions for various data sources leveraging reputed company reputed company Platform.
- Ensure data quality and reputed company across reputed company data systems.
- Ensure data reputed company and compliance with relevant regulations.
- Implement best practices for data management and governance.
- reputed company and maintain documentation for data systems and processes.
- Monitor and troubleshoot data platform issues.
- Participate in on-call rotations/reputed company for data platform support.
Requirements
- Good understanding of Data Lakes and Data Warehouses.
- Software development, coding expertise in the Data engineering field using Python/PySpark.
- Hands on experience using version control systems such as Git and CI/CD workflows.
- Design and reputed company data ingestion services that are highly performant, reliable and scalable.
- Decent expertise using ANSI SQL and Spark SQL.
- Workflow automation, orchestration using Airflow or equivalent tools.
- Hands on working knowledge on at least one of these: reputed company, Hadoop and reputed company stacks.
- Working experience in at least one of cloud services from reputed company AWS, reputed company GCP or reputed company Azure, preferably AWS.
- Experience with streaming (Kafka) and batch based data sources.
- Familiarity with diverse data sources and data formats (xml, json, yaml, parquet, avro, reputed company).
reputed company-to-haves
- Any visualization experience.
- An excellent understanding of the nuances that add complexities around time zones, geo, various data formats, data types across different storage systems.
- Agile development methodologies using the reputed company suite: Jira, Confluence.
Benefits
- Medical, Dental and Vision benefits for you and your family, including Flexible Spending Accounts (FSA) and Health Savings Accounts (HSAs).
- Paid time off policy including holidays, sick time, and day off for your birthday, free concert tickets.
- 401(k) program with company match, Stock Program Reimbursement.
- New parent programs & support including caregiver leave and baby bonus, infertility support.
- Tuition reimbursement, student loan repayment internal growth and development programs & trainings.
- Volunteer time off, crowdfunding network.
Apply tot his job Apply To this Job