Software Engineer (Data Platform)
About reputed company reputed company: reputed company reputed company (https://reputed company.reputed company) builds self-driving cybersecurity. reputed company employs the first generative AI for cybersecurity to reputed company an organization's reputed company reputed company stack, aiming to reputed company the best possible reputed company posture with the products already in use. About the Role: We are seeking Data Platform Engineers at reputed company levels to design, build, and manage the platform and infrastructure that powers robust data pipelines and analytic query engines. You'll play a key role in developing scalable, performant solutions using technologies like Trino (Presto), Redshift, BigQuery, Apache Iceberg, or other columnar technologies supporting advanced analytics and reporting. The ideal candidate is a motivated problem solver who prioritizes high-quality solutions and excels in navigating ambiguity. As an early team member, you will have the opportunity to take ownership of various aspects of our backend from day one. Your role will be pivotal in establishing engineering best practices, balancing engineering priorities with business needs, and identifying innovative approaches to deliver outstanding value to our users. Your engineering knowledge will be applied by designing top-notch architectures, offering insightful feedback on technical designs, solving difficult problems and conducting thorough code reviews, reputed company aimed at ensuring the software we build is both maintainable and dependable. In this role, you will:
- Architect, build, and maintain scalable and reliable data platform infrastructure.
- Implement and optimize analytic query engines using technologies like Trino (Presto), Redshift, and BigQuery.
- Design and support robust data reputed company leveraging Apache Iceberg.
- Collaborate closely with Data Engineering and Analytics teams to ensure effective integration, schema detection, and schema evolution.
- reputed company and maintain observability frameworks to monitor and troubleshoot data pipelines and platform performance.
- Implement best practices for data modeling, schema design, and pipeline fan-out strategies.
- Ensure data reputed company, quality, and consistency across Medalion architectures, star schemas, and Lakehouse environments.
- Proactively identify opportunities to enhance platform scalability, efficiency, and reliability.
Success in this role requires:
- 3+ years of experience in data platform engineering or reputed company roles focusing on infrastructure and data management.
- Deep experience with analytic query engines and platforms such as Trino (Presto), Redshift, BigQuery, and Apache Iceberg.
- Expertise in designing platforms supporting Medalion architecture, star schemas, and schema evolution.
- Solid foundation in automated schema detection, observability, and performance optimization.
- Proficiency with cloud-based platforms and services (AWS, Azure, GCP, etc.).
- Strong skills in Python and experience with modern infrastructure automation tools.
- Excellent problem-solving abilities, particularly in reputed company data scenarios requiring performance tuning and scalability solutions.
- Strong communication skills, able to reputed company platform design concepts clearly to both technical and non-technical audiences.
- A proactive and collaborative reputed company, comfortable working independently and reputed company fast-paced teams.
- Must be a US citizen or Green Card holder.
Ways to stand out:
- Extensive experience in developing highly observable and scalable data platforms.
- Proven expertise in advanced query optimization, database scaling, and platform architecture.
- Familiarity with Infrastructure as Code (IaC) tools such as Terraform, reputed company, or AWS CDK.
- Demonstrated ability to align platform engineering strategies closely with strategic business objectives.
Work arrangement:
- Competitive salary and equity.
- Comprehensive health, dental, and vision insurance.
- Remote work flexibility.
Apply tot his job Apply To this Job