Senior Machine Learning Platform Engineer — Model Hosting & MLOps

Design and build hosting for custom ML and AI models across AWS and Azure, focusing on GPU-backed LLM inference and real-time endpoints. Develop infrastructure as code and deployment automation for model-hosting environments. Establish production monitoring for service health, latency, and model behavior.

Hands-on experience hosting LLM inference on GPU infrastructure in a production environment. Strong software engineering skills, especially in Python, with experience in building services and automation. Experience provisioning and maintaining Kubernetes or another production hosting platform for containerized inference workloads.

The pay range for this role is $147,050 to $230,850 USD annually with additional opportunities for pay in the form of bonus and/or equity. HP offers a comprehensive benefits package including health insurance, dental insurance, vision insurance, and generous time off policies.