Skip to main content
Engineering AI Agents Book Cover
This book is a work in progress. Some chapters are incomplete or in draft form. Content is being actively developed and may change.
Welcome to Engineering AI Agents. This comprehensive resource covers the foundations and advanced topics needed to build intelligent autonomous systems.

What you’ll learn

This book bridges multiple disciplines to provide a unified understanding of AI agents:

Foundations

Statistical learning theory, regression, classification, and optimization fundamentals.

Neural Networks

Backpropagation, normalization, regularization, and training techniques.

Perception

CNNs, sensor models, object detection, and segmentation.

LLMs

NLP foundations, transformers, and large language models.

Logic

Logical reasoning and knowledge-based agents.

VLMs

Vision-language models including CLIP, LLaVA, and BLIP-2.

Planning

Task planning, global planning, and local planning for autonomous navigation.

MDPs & RL

Markov decision processes, Bellman equations, and reinforcement learning.

Robotics Systems

Kinematics, state estimation, SLAM, and systems integration.

Physical AI

Vision-Language-Action agents for embodied intelligence.

How to use this book

The content is organized into two tracks that share key chapters:
  • AI/ML track, Foundations → Neural Networks → Perception → LLMs → Reasoning → VLMs → Planning → MDPs → RL
  • Robotics track, Perception → Robotics Systems → Physical AI
Each section contains groups of related lectures that build upon each other. We recommend following the sequence within each track, though experienced readers may jump to specific topics. The book contains Python notebooks and code snippets for hands-on experience. The notebooks are available in the GitHub repository, and results from notebook runs are logged in the Weights & Biases workspace.

Table of contents