Career Path

AI Engineer

Builds AI features on top of language models, from RAG to agents, and runs them in production.

  • 190 Free Lessons
  • 17 Seasons
  • 10 Interview Questions

What The Job Is

An AI engineer builds the features people actually use on top of language models: assistants that answer from a company's own documents, agents that call tools, and the APIs and screens around them.

The work runs from the first prototype to production: choosing a model, grounding it with retrieval, testing how well it answers, and keeping it fast, safe and affordable once real users arrive.

At a Glance

  • 6 of 190lessons out now
  • 10interview questions
  • 8key skills explained

Job Titles to Search

  • Software Engineer
  • Backend Engineer
  • Machine Learning Engineer
  • Inference Engineer

The Job in Detail

Why Companies Hire for It

Almost every company now wants features built on language models: assistants for customers and staff, search over their own documents, and automations that save hours of manual work. Models are easy to try and hard to make reliable, so companies hire AI engineers to turn a promising demo into a feature that answers correctly, safely and at a cost the business accepts.

A Typical Week

  1. 1Turn a product request into a working feature built on a language model, such as an assistant that answers from company documents.
  2. 2Write and test prompts, retrieval steps and tool calls, then measure the answers against a set of real questions.
  3. 3Find why a feature fails on some inputs and fix it with better context, better data or a guardrail.
  4. 4Watch cost, speed and quality in production, and choose between models when one becomes cheaper or better.
  5. 5Review code with the team and explain to product people what the model can and cannot do reliably.

Tools and Terms You Will Meet

LLM APIs
The services that let code send a prompt to a model and get an answer back.
RAG
Retrieval augmented generation: fetching the right documents before the model answers.
Vector database
A store that finds text by meaning, used to feed RAG.
Evals
Repeatable tests that score model answers, so changes can be compared.
Agents and tool calling
Letting a model call functions, search or act in a system, step by step.

Who Moves Into This Job

Most AI engineers come from software engineering: backend developers, full stack developers and data engineers who added language models to what they already knew. Others arrive from data science, or from a technical field such as engineering or science, after learning Python and building projects. A degree in computer science helps but is not required; employers look for code they can read and features that run.

Industry Example: Pharma

In pharma and life sciences, AI engineers build assistants that search standard operating procedures and regulatory documents, tools that draft parts of clinical or quality reports for a human to check, and agents that pull data from lab and manufacturing systems. The extra demand is traceability: every answer must point to its source, and systems that touch regulated work are validated before use.

A Common Mix-Up

An AI engineer is not the person who trains models from scratch. The job is building reliable products on top of models that already exist. Training and tuning models is closer to the ML engineer job, and inventing new model types is research.

Is This Job for You?

A good fit if

  • You enjoy building things people use, and seeing them work end to end.
  • You like debugging: finding why something fails and making it reliable.
  • You are comfortable writing Python every day and learning new tools fast.

Maybe not if

  • You want to spend most of your time on math and model theory.
  • You prefer analysis and reports to shipping software.
  • You dislike change: the tools in this job move every few months.

Where the Job Leads

After a few years, AI engineers grow into senior and staff engineering roles, AI architect roles that design systems across a company, or engineering management. Some move toward ML engineering to go deeper into models, others toward forward deployed work with customers.

How to Get In

  1. 1Learn Python, Git and how web APIs work, then call a language model from your own code.
  2. 2Build a small RAG assistant on documents you know, and test it with a list of real questions.
  3. 3Publish two projects on GitHub with a clear README, and describe them in your CV with the words AI job ads use.
See the 190 Free Lessons

What Employers Ask For

Real lines from real job ads for this role, each with the lesson that teaches it.

  • Pfizer

    Senior Manager, LLMOps & AI Integration Engineer

    Hands‑on with GenAI/LLM ecosystems (e.g., tool/function calling, structured outputs, prompt orchestration) and RAG components (embeddings, retrievers, rerankers, vector stores).

    Taught InS9 · #103Better Retrieval

  • Technergetics

    AI/ML Engineer III, Rome, NY

    Implementing retrieval-augmented generation pipelines that ground model outputs against authoritative data sources

    Taught InS9 · #104Grounding and Citations

  • Sanofi

    Digital R&D Staff Software Engineer, Hyderabad

    Understanding of agent memory models (short-term, long-term, episodic), tool use, and planning strategies (ReAct, Plan-and-Execute, etc.)

    Taught InS10 · #116Agent Memory and State

  • Doctolib

    Senior AI Engineer - Patient Health Platform, Paris

    Hands-on experience building end-to-end retrieval: ranking, reranking pipelines and familiar with nDCG, MAP, Recall@k, MRR

    Taught InS17 · #215Capstone: Enterprise RAG

Skills Checklist

The skills this role is hired for, each with the free lesson that teaches it.

  • 01

    Python for production code

    S2 · #18Install Python, First Script

  • 02

    Calling LLM APIs with error handling and cost tracking

    S8 · #87The OpenAI API

    What is an API?
  • 03

    Prompt and context engineering

    S8 · #93Context Engineering

    What is Context Engineering?
  • 04

    Structured output and validation

    S8 · #94Structured Outputs

  • 05

    Retrieval-augmented generation end to end

    S9 · #112Project: HR Policy Assistant

    What is Retrieval-Augmented Generation?
  • 06

    Agents, tool calling and MCP

    S10 · #118MCP Explained

    What is an AI Agent?
  • 07

    LLM evaluation with golden datasets

    S13 · #151Why Evaluation

    What is LLM Evaluation?
  • 08

    Deploying an API in a container on the cloud

    S12 · #150Project: Deploy the RAG App

Your Path

Every lesson of this path, season by season. Published lessons open their page.

    • S1 · #9How a Computer Works
    • S1 · #10Operating Systems
    • S1 · #11Files, Folders, Paths, Formats
    • S1 · #12The Command Line From Zero
    • S1 · #13Linux Essentials
    • S1 · #14How the Internet Works
    • S1 · #15HTTP From Zero
    • S1 · #16JSON and YAML
    • S1 · #17Your Code Editor
    • S2 · #18Install Python, First Script
    • S2 · #19Variables, Types, Operators
    • S2 · #20Strings and f-strings
    • S2 · #21Lists, Dicts, Tuples, Sets
    • S2 · #22Conditionals and Loops
    • S2 · #23Functions
    • S2 · #24File I/O and Parsing
    • S2 · #25Errors and Exceptions
    • S2 · #26Modules, Packages, Dependencies
    • S2 · #27Classes and Objects
    • S2 · #28Type Hints and Pydantic
    • S2 · #29Reading Code You Didn't Write
    • S2 · #30Calling Web APIs in Python
    • S2 · #31Async Python
    • S2 · #32High-Concurrency Python
    • S2 · #33Testing With pytest
    • S2 · #34Mini-Project: A CLI Tool
    • S3 · #35Version Control and Git
    • S3 · #36Branches and Merges
    • S3 · #37GitHub
    • S3 · #38Pull Requests and Code Review
    • S3 · #39CI/CD Introduction
    • S3 · #40A Portfolio-Grade Repo
    • S4 · #41What Data Is
    • S4 · #42SQL 1
    • S4 · #43SQL 2
    • S4 · #44SQL 3
    • S4 · #45Database Design and PostgreSQL
    • S4 · #46Python Meets SQL
    • S4 · #47NumPy
    • S4 · #48pandas
    • S4 · #49Data Visualization
    • S4 · #50Business Intelligence and Data Storytelling
    • S4 · #51NoSQL
    • S4 · #52Data Engineering Basics
    • S4 · #53The Modern Data Stack
    • S4 · #54Data Governance and Master Data Management
    • S4 · #55Ingesting Messy Documents
    • S5 · #56Vectors and Matrices
    • S5 · #57Dot Product and Cosine Similarity
    • S5 · #58Probability and Statistics
    • S5 · #59Derivatives and Gradients
    • S5 · #60Gradient Descent
    • S5 · #61Loss, Softmax, Cross-Entropy
    • S6 · #62What Machine Learning Is
    • S6 · #63First Model With scikit-learn
    • S6 · #64Classification
    • S6 · #65Evaluating Models
    • S6 · #66Features and Pipelines
    • S6 · #67Trees and Boosting
    • S6 · #68Clustering and Dimensionality Reduction
    • S6 · #69Time Series and Anomaly Detection
    • S6 · #70Optimization and Simulation
    • S6 · #71Experiment Tracking
    • S6 · #72Project: Predictive Maintenance
    • S7 · #73A Neural Network From Scratch
    • S7 · #74PyTorch Fundamentals
    • S7 · #75Training Loop in PyTorch
    • S7 · #76TensorFlow and Keras
    • S7 · #77CNNs and Computer Vision
    • S7 · #78NLP Foundations
    • S7 · #79From RNNs to Attention
    • S7 · #80Transformers Explained
    • S7 · #81Tokenization Deep Dive
    • S7 · #82How LLMs Are Made
    • S8 · #83Hugging Face Hub
    • S8 · #84Running Pretrained Models
    • S8 · #85Hardware Realities
    • S8 · #86Open Models on Your Own Machine
    • S8 · #87The OpenAI API
    • S8 · #88The Anthropic API
    • S8 · #89Controlling Generation
    • S8 · #90Production-Grade Calls
    • S8 · #91Project: The Summarizer
    • S8 · #92Prompt Engineering Properly
    • S8 · #93Context Engineering
    • S8 · #94Structured Outputs
    • S8 · #95Multimodal APIs
    • S8 · #96Going Provider-Agnostic
    • S9 · #97Why AI Hallucinates, and How RAG Reduces It
    • S9 · #98Embeddings
    • S9 · #99Vector Search
    • S9 · #100Vector Databases
    • S9 · #101RAG From Scratch, No Framework
    • S9 · #102Chunking Strategies
    • S9 · #103Better Retrieval
    • S9 · #104Grounding and Citations
    • S9 · #105LangChain and LlamaIndex
    • S9 · #106Advanced RAG
    • S9 · #107Knowledge Graphs and GraphRAG
    • S9 · #108Building an Enterprise Knowledge Base
    • S9 · #109Search and Recommendation Systems
    • S9 · #110Semantic Caching
    • S9 · #111Text-To-SQL
    • S9 · #112Project: HR Policy Assistant
    • S10 · #113Workflows vs Agents
    • S10 · #114Tool Calling From Scratch
    • S10 · #115The Agent Loop
    • S10 · #116Agent Memory and State
    • S10 · #117Guardrails
    • S10 · #118MCP Explained
    • S10 · #119Build Your Own MCP Server
    • S10 · #120Agent-To-Agent Interoperability
    • S10 · #121Agent Frameworks
    • S10 · #122Multi-Agent Orchestration
    • S10 · #123Human in the Loop
    • S10 · #124Computer-Use and Browser Agents
    • S10 · #125AI Coding Agents for Engineers
    • S10 · #126The Agentic Software Lifecycle
    • S10 · #127Legacy Modernization With AI
    • S10 · #128Project: Data-Analyst Agent
    • S11 · #129FastAPI
    • S11 · #130API Security
    • S11 · #131Quick UIs
    • S11 · #132Web Frontend Basics
    • S11 · #133Beyond Python
    • S11 · #134Scaling the Backend
    • S11 · #135Webhooks and Event-Driven Systems
    • S11 · #136Integrating AI With Enterprise Systems
    • S11 · #137Industrial and Lab Data Systems
    • S12 · #138Cloud Fundamentals
    • S12 · #139Docker 1
    • S12 · #140Docker 2
    • S12 · #141Kubernetes Fundamentals
    • S12 · #142AWS for AI
    • S12 · #143GCP for AI
    • S12 · #144Microsoft Azure for AI
    • S12 · #145Enterprise Data and AI Platforms
    • S12 · #146Sovereign AI and Deployment Choices
    • S12 · #147Infrastructure as Code
    • S12 · #148Full CI/CD
    • S12 · #149Serving Models at Scale
    • S12 · #150Project: Deploy the RAG App
    • S13 · #151Why Evaluation
    • S13 · #152Evaluation Methods
    • S13 · #153Evaluating Agents
    • S13 · #154Observability and Tracing
    • S13 · #155Production Monitoring
    • S13 · #156Product Analytics
    • S13 · #157Cost Governance
    • S13 · #158AI Gateways
    • S13 · #159MLOps, LLMOps, AgentOps
    • S13 · #160Batch Processing
    • S13 · #161Auditing AI You Didn't Build
    • S14 · #162AI Security Threats
    • S14 · #163Securing Agents and MCP
    • S14 · #164Guardrail Frameworks
    • S14 · #165The Agent Trust and Autonomy Ladder
    • S14 · #166Data Privacy
    • S14 · #167The EU AI Act
    • S14 · #168AI and the Law Beyond the AI Act
    • S14 · #169AI in Regulated Industries
    • S14 · #170Governance Frameworks
    • S14 · #171Responsible AI
    • S14 · #172Red Teaming
    • S14 · #173Running an AI Governance Program
    • S16 · #187Finding AI Use Cases
    • S16 · #188The AI Business Case
    • S16 · #204Enterprise and Solution Architecture for AI
    • S17 · #211Choose Your AI Role: Decode Any Job Ad
    • S17 · #212Portfolio Project 1: Deployed RAG Knowledge System
    • S17 · #213Portfolio Project 2: MCP Agent for GitHub and Slack
    • S17 · #214Portfolio Project 3: Evaluated, Observed App With Cost Dashboard
    • S17 · #215Capstone: Enterprise RAG
    • S17 · #216Capstone: Autonomous Multi-Agent Coder
    • S17 · #217Your AI CV
    • S17 · #218Build in Public
    • S17 · #219Networking
    • S17 · #220Certifications Worth Your Time
    • S17 · #221System Design Interviews
    • S17 · #222Coding Interviews in the AI Era
    • S17 · #223Case Study and Business Case Interviews
    • S17 · #224Behavioral Interviews and Negotiation

The Books Behind This Path

The lessons on this path were researched from these books. Read them to go deeper:

Never Miss a Lesson

Subscribe on YouTube, or get an email the day each new lesson goes live.