Career Path
MLOps, LLMOps or AI Platform Engineer
Builds and runs the platform that deploys, monitors and scales models and LLM apps.
- 159 Free Lessons
- 13 Seasons
- 10 Interview Questions
What The Job Is
An MLOps, LLMOps or AI platform engineer builds the shared platform that every model and AI app runs on: containers, cloud infrastructure, deployment pipelines and the gateways that route calls to models.
The role keeps that platform healthy at scale: automating releases, monitoring quality, cost and latency, and giving the teams who build AI a safe, repeatable way to ship it.
At a Glance
- 6 of 159lessons out now
- 10interview questions
- 8key skills explained
Job Titles to Search
- Infrastructure Engineer
- Site Reliability Engineer
Your First Lessons
The Job in Detail
Why Companies Hire for It
As soon as a company runs more than a few models or LLM applications, it needs a shared way to deploy, monitor and pay for them. Without that platform every team rebuilds the same things and nobody sees costs or failures in time. MLOps and AI platform engineers make every AI team faster and every system safer to run.
A Typical Week
- 1Build pipelines that train, test and deploy models automatically when code or data changes.
- 2Run the infrastructure that serves models and LLM applications, and keep it fast and available.
- 3Set up monitoring, tracing and alerts so the team sees errors, cost and quality in production.
- 4Manage access, secrets and costs across cloud accounts used by data and AI teams.
- 5Help engineers ship faster by improving shared tools, templates and documentation.
Tools and Terms You Will Meet
- Docker
- Packages an application and everything it needs into one container.
- Kubernetes
- Runs and scales many containers across machines.
- CI/CD
- Automatic build, test and deploy steps that run on every change.
- Terraform
- Describes cloud infrastructure as code, so it can be reviewed and repeated.
- Observability
- Logs, metrics and traces that show what a system is doing.
Who Moves Into This Job
MLOps and AI platform engineers usually come from DevOps, site reliability or backend engineering, and add machine learning and language model workloads to what they know. Others are ML engineers who enjoyed the deployment side more than training. Linux, cloud and automation skills matter more here than math.
Industry Example: Pharma
In pharma, MLOps engineers build platforms where models can be deployed under GxP rules: every version recorded, every change approved, every prediction traceable. They often work with validation and quality teams, and with IT teams that run cloud platforms used by research, manufacturing and commercial groups.
A Common Mix-Up
MLOps is not only about machine learning. Much of the work is classic infrastructure: containers, networks, access and cost. The machine learning part is knowing what models need, such as GPUs, model versions and monitoring for quality, not only uptime.
Is This Job for You?
A good fit if
- You enjoy infrastructure, automation and systems that run themselves.
- You like making other engineers faster.
- You are calm when something breaks in production and like finding the cause.
Maybe not if
- You want to design models or user features yourself.
- You dislike command lines, configuration and on call duty.
- You prefer research and theory to operations.
Where the Job Leads
The job leads to platform lead, staff infrastructure engineer, AI architect or head of platform roles. Because every AI team depends on the platform, experienced MLOps engineers are often asked to set standards for the whole company.
How to Get In
- 1Learn Linux, Git, Python and Docker, then one cloud platform well.
- 2Deploy a small model or LLM app with a CI/CD pipeline, monitoring and alerts.
- 3Write about what you built and what broke: platform hiring managers value clear operational thinking.
What Employers Ask For
Real lines from real job ads for this role, each with the lesson that teaches it.
Hermès
Engineering Manager AI/ML Platform, Pantin
Industrialize deployments with AWS, Terraform, Docker, Kubernetes and CI/CD.
Translated from French.
Taught InS12 · #148Full CI/CD
Sanofi
Data & AI Engineer, Paris
Knowledge of CI/CD practices (GitHub Actions preferred), version control (Git), and infrastructure as code principles (Terraform preferred).
Taught InS12 · #147Infrastructure as Code
Angi
Principal Product Manager, AI Platform, Denver, CO
Hands-on familiarity with LLM gateways/proxies (e.g., LiteLLM), evaluation and observability tooling (e.g., Langfuse), and model serving frameworks (e.g., KServe, SageMaker, Bedrock, Ray).
Taught InS13 · #158AI Gateways
Onepoint
Agentic & Product Delivery Manager, Paris
Experience with LLMOps practices: evaluation, monitoring and lifecycle management
Translated from French.
Taught InS13 · #159MLOps, LLMOps, AgentOps
Skills Checklist
The skills this role is hired for, each with the free lesson that teaches it.
- 01
Linux and the command line
S1 · #12The Command Line From Zero
- 02
Git and CI/CD pipelines
S3 · #39CI/CD Introduction
- 03
Docker containers
S12 · #139Docker 1
- 04
Kubernetes
S12 · #141Kubernetes Fundamentals
- 05
Infrastructure as code with Terraform
S12 · #147Infrastructure as Code
- 06
Model serving
S12 · #149Serving Models at Scale
- 07
Observability and tracing for LLM apps
S13 · #154Observability and Tracing
- 08
MLOps and LLMOps practices
S13 · #159MLOps, LLMOps, AgentOps
What is MLOps?
Your Path
Every lesson of this path, season by season. Published lessons open their page.
Season 0: Start Here
8 Lessons- S0 · #1Learn AI to Get Hired: The Full MapLive
- S0 · #2What AI Really Is: AI vs Machine Learning vs LLMsLive
- S0 · #3AI Jobs Explained: Which Role Fits You?Live
- S0 · #4Why Code Isn't the Hard Part AnymoreLive
- S0 · #5Escape Tutorial Hell: Learn by BuildingLive
- S0 · #6AI Assistants for Learners: Catch the MistakesLive
- S0 · #7Prompting from Zero: Get Better Answers
- S0 · #8Tokens, Context Windows and Model Families
- S1 · #9How a Computer Works
- S1 · #10Operating Systems
- S1 · #11Files, Folders, Paths, Formats
- S1 · #12The Command Line From Zero
- S1 · #13Linux Essentials
- S1 · #14How the Internet Works
- S1 · #15HTTP From Zero
- S1 · #16JSON and YAML
- S1 · #17Your Code Editor
Season 2: Python
17 Lessons- S2 · #18Install Python, First Script
- S2 · #19Variables, Types, Operators
- S2 · #20Strings and f-strings
- S2 · #21Lists, Dicts, Tuples, Sets
- S2 · #22Conditionals and Loops
- S2 · #23Functions
- S2 · #24File I/O and Parsing
- S2 · #25Errors and Exceptions
- S2 · #26Modules, Packages, Dependencies
- S2 · #27Classes and Objects
- S2 · #28Type Hints and Pydantic
- S2 · #29Reading Code You Didn't Write
- S2 · #30Calling Web APIs in Python
- S2 · #31Async Python
- S2 · #32High-Concurrency Python
- S2 · #33Testing With pytest
- S2 · #34Mini-Project: A CLI Tool
Season 3: Git and GitHub
6 Lessons- S3 · #35Version Control and Git
- S3 · #36Branches and Merges
- S3 · #37GitHub
- S3 · #38Pull Requests and Code Review
- S3 · #39CI/CD Introduction
- S3 · #40A Portfolio-Grade Repo
Season 4: Data Foundations
15 Lessons- S4 · #41What Data Is
- S4 · #42SQL 1
- S4 · #43SQL 2
- S4 · #44SQL 3
- S4 · #45Database Design and PostgreSQL
- S4 · #46Python Meets SQL
- S4 · #47NumPy
- S4 · #48pandas
- S4 · #49Data Visualization
- S4 · #50Business Intelligence and Data Storytelling
- S4 · #51NoSQL
- S4 · #52Data Engineering Basics
- S4 · #53The Modern Data Stack
- S4 · #54Data Governance and Master Data Management
- S4 · #55Ingesting Messy Documents
Season 8: Harnessing Models (CAM)
14 Lessons- S8 · #83Hugging Face Hub
- S8 · #84Running Pretrained Models
- S8 · #85Hardware Realities
- S8 · #86Open Models on Your Own Machine
- S8 · #87The OpenAI API
- S8 · #88The Anthropic API
- S8 · #89Controlling Generation
- S8 · #90Production-Grade Calls
- S8 · #91Project: The Summarizer
- S8 · #92Prompt Engineering Properly
- S8 · #93Context Engineering
- S8 · #94Structured Outputs
- S8 · #95Multimodal APIs
- S8 · #96Going Provider-Agnostic
Season 9: Embeddings, RAG and Search
16 Lessons- S9 · #97Why AI Hallucinates, and How RAG Reduces It
- S9 · #98Embeddings
- S9 · #99Vector Search
- S9 · #100Vector Databases
- S9 · #101RAG From Scratch, No Framework
- S9 · #102Chunking Strategies
- S9 · #103Better Retrieval
- S9 · #104Grounding and Citations
- S9 · #105LangChain and LlamaIndex
- S9 · #106Advanced RAG
- S9 · #107Knowledge Graphs and GraphRAG
- S9 · #108Building an Enterprise Knowledge Base
- S9 · #109Search and Recommendation Systems
- S9 · #110Semantic Caching
- S9 · #111Text-To-SQL
- S9 · #112Project: HR Policy Assistant
Season 10: Agents and Tool Use
16 Lessons- S10 · #113Workflows vs Agents
- S10 · #114Tool Calling From Scratch
- S10 · #115The Agent Loop
- S10 · #116Agent Memory and State
- S10 · #117Guardrails
- S10 · #118MCP Explained
- S10 · #119Build Your Own MCP Server
- S10 · #120Agent-To-Agent Interoperability
- S10 · #121Agent Frameworks
- S10 · #122Multi-Agent Orchestration
- S10 · #123Human in the Loop
- S10 · #124Computer-Use and Browser Agents
- S10 · #125AI Coding Agents for Engineers
- S10 · #126The Agentic Software Lifecycle
- S10 · #127Legacy Modernization With AI
- S10 · #128Project: Data-Analyst Agent
- S11 · #129FastAPI
- S11 · #130API Security
- S11 · #131Quick UIs
- S11 · #132Web Frontend Basics
- S11 · #133Beyond Python
- S11 · #134Scaling the Backend
- S11 · #135Webhooks and Event-Driven Systems
- S11 · #136Integrating AI With Enterprise Systems
- S11 · #137Industrial and Lab Data Systems
Season 12: Deployment and Cloud
13 Lessons- S12 · #138Cloud Fundamentals
- S12 · #139Docker 1
- S12 · #140Docker 2
- S12 · #141Kubernetes Fundamentals
- S12 · #142AWS for AI
- S12 · #143GCP for AI
- S12 · #144Microsoft Azure for AI
- S12 · #145Enterprise Data and AI Platforms
- S12 · #146Sovereign AI and Deployment Choices
- S12 · #147Infrastructure as Code
- S12 · #148Full CI/CD
- S12 · #149Serving Models at Scale
- S12 · #150Project: Deploy the RAG App
- S13 · #151Why Evaluation
- S13 · #152Evaluation Methods
- S13 · #153Evaluating Agents
- S13 · #154Observability and Tracing
- S13 · #155Production Monitoring
- S13 · #156Product Analytics
- S13 · #157Cost Governance
- S13 · #158AI Gateways
- S13 · #159MLOps, LLMOps, AgentOps
- S13 · #160Batch Processing
- S13 · #161Auditing AI You Didn't Build
- S14 · #162AI Security Threats
- S14 · #163Securing Agents and MCP
- S14 · #164Guardrail Frameworks
- S14 · #165The Agent Trust and Autonomy Ladder
- S14 · #166Data Privacy
- S14 · #167The EU AI Act
- S14 · #168AI and the Law Beyond the AI Act
- S14 · #169AI in Regulated Industries
- S14 · #170Governance Frameworks
- S14 · #172Red Teaming
- S14 · #173Running an AI Governance Program
Season 17: Getting Hired
14 Lessons- S17 · #211Choose Your AI Role: Decode Any Job Ad
- S17 · #212Portfolio Project 1: Deployed RAG Knowledge System
- S17 · #213Portfolio Project 2: MCP Agent for GitHub and Slack
- S17 · #214Portfolio Project 3: Evaluated, Observed App With Cost Dashboard
- S17 · #215Capstone: Enterprise RAG
- S17 · #216Capstone: Autonomous Multi-Agent Coder
- S17 · #217Your AI CV
- S17 · #218Build in Public
- S17 · #219Networking
- S17 · #220Certifications Worth Your Time
- S17 · #221System Design Interviews
- S17 · #222Coding Interviews in the AI Era
- S17 · #223Case Study and Business Case Interviews
- S17 · #224Behavioral Interviews and Negotiation
The Books Behind This Path
The lessons on this path were researched from these books. Read them to go deeper:

Designing Machine Learning Systems
Chip Huyen, O'Reilly, 2022
Seasons 0, 4, 6, 13 and 15. Cited in AI Jobs Explained: Which Role Fits You?, Why Code Isn't the Hard Part Anymore



Kubernetes: Up and Running
Brendan Burns, Joe Beda, Kelsey Hightower and Lachlan Evenson, 3rd edition, O'Reilly, 2022
Season 12

Related Paths
The paths that share the most lessons with this one.
Compare:ML Engineer vs MLOps Engineer
Never Miss a Lesson
Subscribe on YouTube, or get an email the day each new lesson goes live.