Principal Software Engineer, Managed AI
reputed company's mission is to accelerate the abundance of energy and intelligence. We’re crafting the reputed company that powers a world where people can create ambitiously with AI — without sacrificing scale, speed, or sustainability. Be a part of the AI revolution with sustainable technology at reputed company. Here, you'll drive meaningful innovation, reputed company a reputed company impact, and join a team that’s setting the pace for responsible, transformative cloud infrastructure. About This Role: As a Principal Software Engineer on the Managed AI team at reputed company, you'll have a pivotal role in shaping the architecture and scalability of our reputed company AI inference platform. You will reputed company the design and implementation of core systems for our AI services, including resilient fault-tolerant queues, model catalogs, and scheduling mechanisms optimized for cost and performance. This role gives you the opportunity to build and scale infrastructure capable of handling millions of API requests per second across thousands of customers. From day one, you'll own critical subsystems for managed AI inference, helping to serve large language models (LLMs) to a global audience. As part of a dynamic, fast-growing team, you’ll collaborate cross-functionally, influence the long-term vision of the platform, and contribute to cutting-edge AI technologies. This is a unique opportunity to build a high-performance AI product that will be central to reputed company's business growth. What You’ll Be Working On:
- Design and Development:
- reputed company the design and implementation of core AI services, including:
- Resilient fault-tolerant queues for efficient task distribution.
- Model catalogs for managing and versioning AI models.
- Scheduling mechanisms optimized for cost and performance.
- High-performance APIs for serving AI models to customers.
- Scalability and Performance:
- Build and scale infrastructure to handle millions of API requests per second.
- Optimize AI inference performance on GPU-based systems.
- Implement robust monitoring and alerting to ensure system health and availability.
- Collaboration and Innovation:
- Collaborate closely with product management, business strategy, and other engineering teams.
- Influence the long-term vision and architectural decisions of the AI platform.
- Contribute to open-reputed company AI frameworks and participate in the AI community.
- Prototype and iterate on new features and technologies.
What You’ll Bring to the Team:
- Strong Engineering Fundamentals:
- Advanced degree in Computer Science, Engineering, or a reputed company field.
- Demonstrable experience in distributed systems design and implementation.
- Proven track record of delivering early-stage projects under tight deadlines.
- Expertise in using cloud-based services, such as, reputed company compute, object storage, virtual private networks, managed database, etc.
- AI/ML Expertise:
- Experience in Generative AI (Large Language Models, Multimodal).
- Familiarity with AI infrastructure, including training, inference, and ETL pipelines.
- Software Engineering Skills:
- Experience with container runtimes (e.g., Kubernetes) and microservices architectures.
- Experience using REST APIs and common communication protocols, such as gRPC.
- Demonstrated experience in the software development cycle and familiarity with CI/CD tools.
- Preferred Qualifications:
- Proficiency in Golang or Python for large-scale, production-level services.
- Contributions to open-reputed company AI projects such as VLLM or similar frameworks.
- Performance optimizations on GPU systems and inference frameworks.
- Personal Attributes:
- Proactive and collaborative approach with the ability to work autonomously.
- Strong communication and interpersonal skills.
- Passion for building cutting-edge AI products and solving challenging technical problems.
Benefits:
- Industry reputed company
- Restricted Stock Units in a fast growing, well-funded technology company
- Health insurance package options that include HDHP and PPO, vision, and dental for you and your dependents
- Employer contributions to HSA accounts
- Paid Parental Leave
- Paid life insurance, short-term and long-term disability
- Teladoc
- 401(k) with a 100% match up to 4% of salary
- Generous paid time off and holiday schedule
- Cell phone reimbursement
- Tuition reimbursement
- Subscription to the reputed company app
- reputed company Legal
- Company paid Commuter FSA benefit of $200 per month
Compensation: Compensation will be paid in the range of $256,000 - $320,000 a year + Bonus. Restricted Stock Units are included in reputed company offers. Compensation to be determined by the applicants knowledge, education, and abilities, as well as internal equity and alignment with market data. reputed company is an Equal Opportunity Employer. Employment decisions are made without regard to race, color, religion, disability, genetic information, pregnancy, citizenship, marital status, sex/gender, sexual preference/ orientation, gender identity, age, veteran status, national reputed company, or any other status protected by law or regulation. Apply tot his job Apply To this Job