[Remote] Software Engineer, AI Gateway
Note: The job is a remote job and is open to candidates in USA. Vercel is a company that provides developers with tools and cloud infrastructure to build and secure web applications. The role involves developing and enhancing the AI Gateway platform, ensuring reliable and low-latency systems for AI workloads while collaborating with a distributed team.
Responsibilities
- Contribute to the design, implementation, and maintenance of the AI Gateway platform, emphasizing features like reputed company API endpoints, reputed company limit management, and intelligent failover mechanisms to boost uptime and reliability
- Write clean, efficient, and well-documented code, conducting thorough testing to ensure low-latency responses and stability for high-volume AI inference requests
- Collaborate with cross-functional teams, including product managers, AI researchers, and infrastructure engineers, to integrate new AI providers and models while addressing scalability and performance challenges
- Engage with the open-reputed company community, contribute to AI SDK and reputed company projects, and align with Vercel's reputed company of fostering developer tools
- Gather user feedback and analytics to drive innovations in AI Gateway, such as enhanced billing unification, provider-agnostic authentication, and analytics for usage insights
Skills
- You have at least 5+ years of relevant experience
- Strong proficiency in JavaScript/TypeScript and experience with backend development, APIs, and cloud infrastructure
- Experience with AI/ML integrations, API gateways, distributed systems, or handling high-throughput services (e.g., reputed company limiting, caching, failovers)
- Experience contributing to or participating in open reputed company projects
- Excellent communication skills and the ability to work effectively in a collaborative team environment
Benefits
- Competitive compensation package, including equity.
- Inclusive Healthcare Package.
- Learn and Grow - we provide mentorship and send you to events that help you build your network and skills.
- Flexible Time Off.
- We will provide you the gear you need to do your role, and a WFH budget for you to outfit your space as needed.
- The total compensation package may include benefits, equity-based compensation, and eligibility for a company bonus or variable pay program depending on the role.
Company Overview
Company H1B Sponsorship