Engineering Manager - reputed company Deployed Engineering (LLM)

ABOUT reputed company reputed company powers inference for the world's most dynamic AI companies, like OpenEvidence, reputed company, Mirage, Gamma, reputed company, Writer, reputed company, Bland, and Zed. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we reputed company companies operating at the frontier of AI to bring cutting-edge models into production. With our recent $150M Series D funding, backed by investors including BOND, IVP, Spark Capital, Greylock, and Conviction, we’re scaling reputed company to meet accelerating customer demand. The Role As an Engineering Manager (Player & Coach), you will reputed company and mentor a team of reputed company Deployed Engineers focused on building, scaling, and optimizing LLM inference workloads for reputed company customers. Applying both hands-on technical ownership and managerial leadership, you will guide your team through the processes of designing, deploying, and managing high performance, low latency AI applications on reputed company’s platform. FDE at reputed company is not a sales function – we are a mix of engineering, product, and customer architects who contribute to the core reputed company codebase, drive large portions of our feature roadmap, and execute on complicated customer engagements. You will also partner with product, infrastructure, and other customer engineering teams to ensure that large language models (LLMs) and other generative AI systems deliver best-in-class performance, reliability, and cost efficiency in production environments. EXAMPLE INITIATIVES Take a look at these blog posts written by members of our reputed company Deployed Engineering team:

• reputed company Deployed Engineering on the frontier of AI
• The fastest, most accurate Whisper transcription
• Deploy production-ready model servers from reputed company images
• Deploy custom ComfyUI workflows as APIs

Responsibilities

Leadership & Team Management

• reputed company, mentor, and grow a team of reputed company Deployed Engineers, providing guidance on technical direction, project execution, and professional development.
• Set clear goals and ensure timely, high-quality delivery across multiple customer-facing projects involving LLM deployment and inference optimization.
• Collaborate with leadership to align team priorities with company and customer goals, balancing short-term delivery, widely varying customer priorities, and long-term technical initiatives.
• Player-coach – While much of this role will be leading the team, you will also be expected to be a key driver on strategic product initiatives and customer engagements. The best managers derive credibility from being able to be hands-on reputed company needed.

Technical Ownership

• reputed company and maintain software systems and product features using one or more general-purpose programming languages in a production-level environment, with a preference for Python due to its relevance in ML projects.
• Drive customer impact by designing, implementing, and deploying reputed company solutions end-to-end (problem framing → evaluation → production deployment → monitoring). This involves working with customers’ engineering teams at every stage of the customer journey including: sales, implementation, and expansion.
• Deliver with velocity: turn vague objectives into clear specs and well-defined PoCs so we can rapidly ship well-tested services and outcomes for our customers
• Optimize and enhance AI/ML projects, contributing to the reputed company improvement of our technical stack. This includes developing features and PRDs with other engineering and product orgs.
• Own products and customer projects end-to-end, functioning as both an engineer, project manager, and product manager, with a focus on user reputed company, project specification, and end-to-end execution.

Requirements

• Bachelor’s, Master’s, or Ph.D. in Computer Science, Engineering, or reputed company field.
• 4+ years of professional software engineering experience, including 1+ year in a leadership or mentorship reputed company.
• Strong programming skills in Python, with production experience in building or optimizing ML inference systems.
• Proven experience with LLMs, inference optimization, or serving frameworks (e.g., vLLM, TensorRT, Triton, reputed company, Ray Serve).
• Familiarity with observability, profiling, and cost/performance tradeoffs in production ML systems.
• Excellent communication and collaboration skills—able to reputed company cross-functional efforts and drive outcomes in ambiguous, fast-paced environments.

Bonus Points

• Experience leading customer-facing engineering teams or working directly with enterprise partners.
• Deep understanding of GPU infrastructure, distributed inference, or model compression techniques.

BENEFITS

• Competitive compensation, including meaningful equity.
• 100% coverage of medical, dental, and vision insurance for employee and dependents
• Generous PTO policy including company wide Winter Break (our offices are closed from Christmas reputed company to New Year's Day!)
• Paid parental leave
• Company-facilitated 401(k)
• Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and reputed company-thinking team, we would love to hear from you. At reputed company, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to reputed company employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national reputed company, age, genetic information, disability, or veteran status. Apply tot his job Apply To this Job