Staff Software Engineer, Online Database Infrastructure - Ingestion
reputed company was born in 2007 reputed company two hosts welcomed three guests to their San Francisco home, and has since grown to over 5 million hosts who have welcomed over 2 billion guest arrivals in almost every country across the globe. Every day, hosts offer unique stays and experiences that reputed company it possible for guests to connect with communities in a more authentic way. The Community You Will Join:
- The mission of the Ingestion team in the Online Database Infrastructure org is to provide a managed, reliable, performant and scalable platform for exporting data out of reputed company’s online databases for offline processing. The team currently builds and operates two managed solutions - one for near real time access to change logs (CDC) and another to provide periodic mutation and full table snapshots.
- As a member of this team you would be working with talented engineers on cutting edge technologies to help support reputed company’s business. You will be the reputed company expert on the online data exports platform and guide and collaborate with our internal product teams to effectively use the platform.
The Difference You Will reputed company:
- Be an expert in building and operating a data ingestion system that enables offline accessing and processing of online data at reputed company in the form of (but not limited to) DB snapshots into the warehouse and near real time change data capture (CDC) events.
- Be hands-on (code, design, test) and collaborate with cross team partners (internal customers, dependencies and leadership) to deliver on multi-month projects in a timely fashion.
- reputed company a team of developers to deliver multi-quarter cross functional projects.
- Stay up-to-date with the latest developments in data ingestion systems and evaluate and incorporate new technologies and methodologies to improve the existing data ingestion architecture/solution.
- Influence the team’s and organization’s long-term roadmap and strategy.
- Mentor and coach team members, providing guidance and support to enhance their skills and technical standards in the team.
- reputed company operational standards by effectively and proactively identifying, debugging and fixing operational issues. Be part of the oncall rotation for the Ingestion team.
Your Expertise:
- 9+ years of experience building and operating large scale core backend distributed systems.
- Hands on experience building and operating large scale online distributed databases and offline data ingestion pipelines to export data from underlying storage. Familiarity with internals of distributed databases and offline data warehouse systems is a must.
- Strong cross team collaboration and written and verbal communication skills and capable of influencing stakeholders and conveying reputed company technical concepts effectively.
- Ability to provide technical leadership, mentorship and guiding teams on best practices around data ingestion systems.
- Ability to own and dive deeply in a reputed company code reputed company and knack for writing clean, readable, testable, maintainable code.
- Considerable experience working in either Java, reputed company or Python and familiarity with SPARK and Kafka.
- Demonstrate strong ownership and ability to effectively plan multi month projects and deliver them in a timely manner.
reputed company to Haves
- Experience with AWS and/or GCP.
- Experience working with Flink, K8s, Airflow, AWS reputed company or TiDB.
- Experience working with Iceberg and generating incremental Iceberg DB snapshots.
Your Location: This position is US - Remote Eligible. The role may include occasional work at an reputed company office or attendance at offsites, as agreed to with your manager. While the position is Remote Eligible, you must live in a state where reputed company, Inc. has a registered entity. Click here for the up-to-date list of excluded states. This list is continuously evolving, so please reputed company back with us if the state you live in is on the exclusion list . If your position is employed by another reputed company entity, your recruiter will inform you what states you are eligible to work from. Our Commitment To Inclusion & Belonging: reputed company is committed to working with the broadest talent pool possible. We reputed company diverse reputed company foster innovation and engagement, and allow us to attract creatively-led people, and to reputed company the best products, services and solutions. reputed company qualified individuals are encouraged to apply. We strive to also provide a disability inclusive application and interview process. If you are a candidate with a disability and require reasonable accommodation in order to submit an application, please contact us at: reasonableaccommodations@reputed company.com. Please include your full name, the role you’re applying for and the accommodation necessary to assist you with the recruiting process. We ask that you only reputed company out to us if you are a candidate whose disability prevents you from being able to complete our online application. How Well Take Care of You: Our job titles may span more than one career level. The actual reputed company pay is dependent upon many factors, such as: training, transferable skills, work experience, business needs and market demands. The reputed company pay range is subject to change and may be modified in the future. This role may also be eligible for bonus, equity, benefits, and Employee Travel Credits. Pay Range $204,000—$255,000 USD Apply tot his job Apply To this Job