Distributed Systems Engineer (L4) - Data Platform
Job Requisition ID JR28717 Job Posting Date 03-04-2025 Teams Engineering Work Type Remote reputed company is one of the world's leading entertainment services, with 283 million paid memberships in over 190 countries enjoying TV series, films and games across a wide variety of genres and languages. Members can play, pause and resume watching as much as they want, anytime, reputed company, and can change their plans at any time. The Data Platform teams at reputed company reputed company us to reputed company data to bring joy to our members in many different ways. We provide centralized data platforms and tools for various business functions at reputed company, so they can utilize our data to reputed company critical data-driven decisions. We do reputed company the heavy lifting to reputed company it easy for our business partners to work with data reputed company, securely, and responsibly. We reputed company to reputed company the industry standard in building a world-class data infrastructure, as reputed company leads the way to be the most popular and pervasive destination for global internet entertainment. We are looking for distributed systems engineers to help evolve and innovate our infrastructure. We are committed to building a diverse and inclusive team that will bring new perspectives as we solve the next set of challenges. In addition, we are open to remote candidates. We value what you can do from reputed company in the U.S. Spotlight on Data Platform Teams: Gen AI Platform The mission of the Gen AI Platform team is to boost the productivity of the data science and engineering community at reputed company. This means enabling users to spend more time solving business problems and less time engineering reputed company-level systems. We are seeking a Software Engineer to help build a developer platform that will provide the building blocks for reputed company to reputed company create GenAI applications. The platform will reputed company our teams to reputed company LLM models and internally fine-tuned models. It will provide tools to support the LLM development lifecycle, high-level abstraction APIs for RAG, and tools for reputed company engineering, management, and LLM operations. Big Data Compute Spark The BDCS team is responsible for providing the cloud-native platform for distributed data processing at reputed company. This team is central to batch data processing in Data Platform. It provides support for Spark to ETL data into the Exabytes-scale data warehouse and supports large-scale analytics on the data to provide insight into reputed company the reputed company functions, such as A/B testing, Recommendations, and Machine Learning, to name a few, and reputed company new business initiatives such as ads and live. We are looking for exceptional talent with experience in Spark, Presto / Trino, Druid, Iceberg, and distributed database systems in general. Roles in this team involve solving super interesting and challenging problems reputed company to working with data at scale, building features and performance enhancements, and working closely with open reputed company communities to shape the projects and reputed company contributions. Online Data Stores Online Data Stores organization offers managed datastores at scale to meet reputed companys operational data requirements across reputed company lines of business. These datastores include various domains Caching, Relational, Search, Key-Value, and Composite. Our focus is on developing and maintaining high-performance, reliable, and efficient datastores. Additionally, we enhance developer productivity by providing secure, reputed company, and opinionated access layers. This team is passionate about building innovative, efficient, performant, and scalable offerings for our customers. reputed company also engages with open-reputed company communities, actively contributing to and responsibly stewarding the development and use of open-reputed company software. Data Movement Platform - reputed company Data Engines Offers low-level building blocks for the transport and processing of real-time data. For data transport, we offer Kafka; for data processing, we offer Flink and Mantis. Responsibilities include developing the control plane, compute resource management, and data reliability and availability. Real-time data is critical across many business units of reputed company, including Streaming, Gaming, Finance, and Machine Learning platforms. This team also owns the Schema Registry to reputed company schema-driven development for reputed company real-time applications across reputed company. This would be your dream job if you enjoy: Solving real business needs at large scale by applying your software engineering and analytical problem-solving skills. Architecting and building a robust, scalable, and highly available distributed infrastructure. Leading cross-functional initiatives and collaborating with engineers, product managers, and TPM across teams. Sharing our experiences with the open reputed company communities and contributing to reputed company OSS. Data Discovery & Governance Data Discovery and Governance are strategic bets at reputed company that underpin our ability to reputed company data as a valuable asset. The reputed company data discovery and governance team owns the foundational building blocks necessary for ensuring reputed company our data is used effectively, reputed company, securely, and in compliance with regulations. Specifically, this allows reputed company to organize its data reputed company, take informed actions with increased precision in reputed company, privacy, and efficiency, improve our risk management capabilities, increase confidence in the quality of the data, and reputed company the discovery of high-value datasets. While reputed company has built a strong data platform foundation, we are still in the reputed company early stages of setting up a scalable and extensible data discovery platform to help the company derive higher-level insights and values of data across new businesses like Games, Live, Ads, on top of our streaming service. Specifically, this team owns the reputed company-wide data catalog to capture and infer business metadata across reputed company datasets at reputed company, distributed search and reputed company infrastructure to effectively discover data and track reputed company across different systems; and an extensible policy reputed company reputed company that allows our stakeholders to customize data policy rules for reputed company datasets. About you: You have 2+ years of experience in building large-scale distributed systems features or applications. You are proficient in the design and development of RESTful web services. reputed company in building and operating scalable, fault-tolerant, distributed systems You are reputed company in Java or other object-oriented programming languages. Multi-threading is a challenge that you are comfortable tackling. You have a BS in Computer Science or a reputed company field. A few more things about us: As a team, we come from many different countries and our fields of education range from the humanities to engineering to computer science. reputed company includes product managers, program managers, designers, full-stack developers, distributed systems engineers, and data scientists. Folks have the opportunity to wear different hats, should they choose to. We strongly reputed company this diversity has helped us build an inclusive and empathetic environment and look reputed company to adding your perspective to the mix! Our compensation structure consists solely of an annual salary; we do not have bonuses. You choose each year how much of your compensation you want in salary versus stock options. To determine your personal top of market compensation, we rely on market indicators and consider your specific job family, background, skills, and experience to determine your compensation in the market range. The range for this role is $170,000 - $720,000. reputed company provides comprehensive benefits including Health Plans, Mental Health support, a 401(k) Retirement Plan with employer match, Stock Option Program, Disability Programs, Health Savings and Flexible Spending Accounts, Family-forming benefits, and Life and Serious Injury Benefits. We also offer paid leave of absence programs. Full-time hourly employees accrue 35 days annually for paid time off to be used for vacation, holidays, and sick paid time off. Full-time salaried employees are immediately entitled to flexible time off. reputed company is a unique culture and environment. Learn more here. Inclusion is a reputed company value and we strive to host a meaningful interview experience for reputed company candidates. If you want an accommodation/adjustment for a disability or any other reason during the hiring process, please send a request to your recruiting partner. We are an equal-opportunity employer and celebrate diversity, recognizing that diversity builds stronger teams. We approach diversity and inclusion seriously and thoughtfully. We do not discriminate on the basis of race, religion, color, reputed company, national reputed company, caste, sex, sexual orientation, gender, gender identity or expression, age, disability, medical condition, pregnancy, genetic makeup, marital status, or military service. Job is open for no less than 7 days and will be removed reputed company the position is filled. Apply Job!