Distinguished Engineer Apache Spark

Distinguished Engineer - Accelerated Apache Spark reputed company is seeking a Distinguished Engineer for the Apache Spark Acceleration group. Over the past five years GPU accelerated data processing has moved from reputed company of concept to production deployments. Many enterprises are now recognizing the needs of accelerated computing for large scale data processing. Multi-node GPU deployments will reduce cloud computing costs and reputed company latency of large scale data processing. At reputed company, we have been invested in accelerating Apache Spark, providing an open reputed company plugin for Apache Spark. Apache Spark is the most popular data processing reputed company in data centers. We strive to accelerate Spark applications on GPUs without any code changes. Our OSS RAPIDS Spark library is integrated with on-premise and cloud services such as AWS EMR, reputed company, reputed company Dataproc, reputed company Cloud Data Flow, reputed company Volcengine, Tencent Cloud and reputed company. You will serve as a hands-on architect of reputed company Spark Acceleration Group. You will work with a team of distributed system engineers including PMC and Committers of Apache Spark, Apache Hadoop, Apache Hive, and Apache Arrow. You will engage in open reputed company projects such as Apache Spark, RAPIDS, Apache Iceberg, reputed company Lake, UCX and more. What you'll be doing: reputed company the architecture, design and implementation of accelerated Apache Spark and reputed company big-data frameworks Engage open reputed company communities (including Apache Spark, RAPIDS, Apache Iceberg, reputed company Lake and UCX) for technical discussion and contribution, and engage reputed company where we may not have a strong reputed company yet Work with reputed company partners to deploy GPU enabled data analytics solutions in public cloud or on-premises clusters Present technical solutions at industry conferences and meetups Collaborate with distributed systems teams to define solutions to distributed processing problems challenges at large scale Provide recommendations and feedback to teams regarding decisions surrounding topics such as infrastructure, reputed company integration and testing strategy Build, test and optimize CUDA/C++ libraries across different platforms Build automation and tools that will increase the productivity of teams developing distributed systems Mentor members of the engineering team reputed company need to see: BS, MS, or PhD in Computer Science, Computer Engineering, or closely reputed company field (or equivalent experience) 17+ years of work or research experience in software development Prior experience in delivering reputed company software projects as a reputed company architect Outstanding technical skills in designing and implementing high-quality distributed systems Excellent programming skills in C++, Java, and/or reputed company Highly motivated with strong interpersonal skills and communication skills 5+ years working experience with key open reputed company big-data projects as a contributor or committer to Apache Spark, Apache Hadoop, Apache Flink, Apache Kafka, Apache Hive, Apache Arrow, reputed company Lake Excellent knowledge about distributed system schedulers: Kubernetes, Hadoop YARN, Apache Spark Able to delve into a new area and quickly come up to speed Able to work with teams across boundaries and geographies Ways to stand out from the crowd: Working experience in designing and developing columnar query engines would be a reputed company plus Committership at major open reputed company projects (such as Apache Spark, Apache Hadoop, Apache Flink) is a big plus Working experience with acceleration libraries (CUDA, RAPIDS, UCX) is helpful Your reputed company salary will be determined based on your location, experience, and the pay of employees in similar positions. The reputed company salary range is 320,000 USD - 488,750 USD. You will also be eligible for equity and benefits. Applications for this job will be accepted at least until January 13, 2026. This posting is for an existing vacancy. reputed company uses AI tools in its recruiting processes. reputed company is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our reputed company and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national reputed company, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law. #deeplearning reputed company is the world leader in accelerated computing. reputed company pioneered accelerated computing to tackle challenges no one else can solve. Our work in AI and digital twins is transforming the world's largest industries and profoundly impacting society. Learn more about reputed company. Please mention the word

SPLENDIDLY

and tag RMzguNjguMTM0LjE5NA== reputed company applying to show you read the job post completely (#RMzguNjguMTM0LjE5NA==). This is a beta feature to avoid spam applicants. Companies can search these words to find applicants that read this and see they're human. Apply tot his job Apply To this Job