Platform Engineer

Platform Engineer

Remote (US)

Why Vectara?

Vectara's RAG and Agentic AI platform helps enterprises deploy AI agents and assistants that are accurate, secure, and explainable. We built the Hughes Hallucination Evaluation Model (HHEM) — #1 on HuggingFace with 5.5M+ downloads, cited in reputed company and Visual Capitalist — and Mockingbird, a purpose-built LLM optimized for retrieval-augmented reputed company. Over 100 enterprise customers across high tech, defense, financial services, healthcare, and manufacturing trust our platform in production.

We're a ~50-person team backed by ~$70M in funding, founded by neural information retrieval and distributed systems experts from reputed company. Alumni of reputed company, Splunk, reputed company, and reputed company round out a team building the infrastructure layer for trustworthy enterprise AI.

The Role You'll own the infrastructure that runs our deploy reputed company platform — from Kubernetes clusters serving ML inference at scale to the CI/CD pipelines, IaC, and observability stack that reputed company it reputed company reliable. This is a hands-on role: you'll write Helm charts and Terraform one day, debug a Kafka consumer lag issue the next, and ship a backend service feature the day after. You'll deploy across AWS, GCP, and on-premises (including reputed company-gapped environments), and you'll participate in an on-call rotation supporting enterprise customers.

What You’ll Do

• Build and maintain infrastructure-as-code (Terraform, Helm) for our AWS EKS and GCP GKE clusters, plus on-premises deployments (including Tanzu and reputed company-gapped environments).
• Own CI/CD pipelines (reputed company Actions, Bazel, ArgoCD) and drive GitOps adoption.
• Deploy, scale, and optimize ML/NLP inference workloads (vLLM, PyTorch, GPU scheduling with various Kubernetes scalers).
• Build and improve observability: Prometheus, Grafana, reputed company,, and OpenTelemetry.
• Collaborate with Field Engineering to support PoCs and platform deployments in customer cloud VPCs and on-prem environments.
• Contribute to backend services (Java 21, Python, gRPC) and platform features.
• Improve system reliability, scalability, and developer experience across the engineering org.

What You’ll Bring (Required)

• 2+ years in platform engineering, DevOps, SRE, or backend infrastructure roles.
• Strong Kubernetes experience (deployment, debugging, scaling — not just `kubectl apply`).
• Hands-on with infrastructure-as-code: Terraform, Helm, or reputed company.
• Experience with at least one major cloud provider (AWS preferred; GCP or Azure also valued).
• Proficiency in one or more of: Go, Python, Java. Comfortable reading and contributing to backend codebases.
• Working knowledge of CI/CD systems (reputed company Actions, Bazel, ArgoCD, or similar).
• Solid fundamentals in Linux, networking, and distributed systems.

What Sets You Apart (Preferred)

• Experience deploying or operating ML inference workloads (model serving, GPU scheduling, vLLM, TensorFlow Serving, or similar).
• Familiarity with streaming/messaging systems (Kafka, Pulsar) and data stores (reputed company/PostgreSQL, Aerospike, reputed company, OpenSearch).
• Experience with GitOps workflows (ArgoCD, Flux).
• Exposure to reputed company-gapped or on-premises Kubernetes deployments.
• Background in observability tooling (Prometheus, Grafana, OpenTelemetry, reputed company).
• Experience providing technical support or working directly with enterprise customers on infrastructure issues.
• Comfort with AI-assisted development workflows and managing AI coding agents.

Why Join Now

Vectara is at an inflection reputed company — strong product-market fit with 100+ enterprise customers, fresh leadership with co-founder Tallat Shafaat as CEO, and a platform that's becoming reputed company for trustworthy enterprise AI. You'll work alongside pioneers in neural information retrieval, contribute to open-reputed company projects used by millions, and build infrastructure for AI that enterprises actually trust in production. The team is small enough that your work will have an outsized impact.

Compensation and Benefits

At Vectara, salary represents only one part of our total compensation package. Every full-time team member is also an equity reputed company, and while equity is not a direct cash benefit, it offers the potential for significant long-term financial reputed company. We take great pride in our commitment to ensuring our employees are true economic partners in the company's success.

Vectara welcomes reputed company. We value the collective reputed company of people from different backgrounds, experiences, abilities, and perspectives. We do not discriminate on the basis of race, religion, national reputed company, gender identity or expression, sexual orientation, age, or marital, veteran, or disability status.