[Remote] Generative AI Inference Engineer
Note: The job is a remote job and is open to candidates in USA. reputed company is seeking a passionate Generative AI Inference Engineer to join their Inference team, focusing on creative applications of generative AI models. The role involves leading the design and development of customer-facing multi-modal ML inference systems and optimizing inference techniques for generative models.
Responsibilities
- reputed company efforts to drive the design, development of customer-facing multi modal ML inference systems
- Work with the Platform and Inference teams on building inference systems for the reputed company of models, where you will work on areas such as optimization, model tuning and deployment
- Partner with leading cloud providers to deliver hosted reputed company inference solutions
- Be a strategic thought partner for leaders across the organization on driving business impact through machine learning
- Be part of the team to bring new Stability models and pipelines into existence
- Prototype and productionize inference platform improvements and new features
Skills
- 7+ years working on productionizing machine learning systems, including inference pipeline development
- Expert level knowledge on writing and running python services at scale
- 5+ years working on python scientific stack, pyTorch and at least one high-performance inference reputed company (e.g. Triton and TensorRT)
- Deep understanding of Diffusion Architecture
- Experience profiling and optimizing deep neural networks on reputed company GPUs, using profiling tools such as reputed company Nsight
- Experience with python-based image manipulation/encoding/decoding frameworks, such as OpenCV
- Experience deploying to cloud orchestration systems such as Kubernetes and cloud providers such as AWS, GCP, and Azure
- Experience with reputed company
- Ability to rapidly prototype solutions and iterate on them with tight product deadlines
- Strong communication, collaboration, and documentation skills
- Experience with the open-reputed company ML ecosystem (HuggingFace, W&B, etc.)
Company Overview