AI Capabilities And Limitations
← All lessons
Lesson 02AI Capabilities And Limitations

What We Mean by AI

Summary audio

Spoken summary — press play to read along: the line being spoken stays near the top.

Study notes

What you'll learn

Estimated time: 20 minutes

By the end of this lesson you'll be able to:

  • Distinguish generative AI from the classification and prediction AI you already encounter daily
  • Understand that generative AI's properties exist on a continuum from capability to limitation
  • Preview the four core properties you'll explore in depth: Next Token Prediction, knowledge, working memory, and steerability

What we mean by generative AI

(4 minutes)

Most AI in the world (spam filters, recommendations, fraud detection) isn't generative. This course is about the kind that is: transformer-based text models that produce new content one token at a time.

Building a mental model of the machine

AI Capabilities & Limitations Framework

Four properties that shape what AI can and can't do for you. Each sits on a spectrum — the further right, the more you should verify and compensate.

Capability

Limitation

Next Token Prediction

Where do AI answers come from?

Well-worn paths: summarize, reformat, explain common conceptsNovel territory, sparse patterns, "true vs. sounds true"

Knowledge

What does AI actually know?

Frequent, recent-in-training, consistent: mainstream topics, popular languagesRare, post-cutoff, niche, local, or contested topics

Working Memory

What is the AI paying attention to right now?

Material fits comfortably, session is current, you supply relevant contextVery long docs/conversations, expecting cross-session continuity (the cliff)

Steerability

How much am I in control?

Short, concrete, verifiable instructions ("respond as a table," "under 100 words")Long reasoning chains, abstract asks, native precision

Key takeaways

  • Generative AI produces new content rather than classifying existing content.
  • **AI isn't uniformly capable or uniformly unreliable. ** It's strong and weak along four predictable axes: Next Token Prediction, Knowledge, Working Memory, and Steerability.
  • **Each property is a continuum. ** The same mechanism gives you both the capability and the limitation.
  • Calibrated trust means locating your task on the continuum, not granting or withholding trust wholesale.

Exercises

Exercise: Generative or Not?

Why? You just learned that generative AI is fundamentally different from the AI that filters your spam and recommends your next video. Now you're going to use that distinction on your own experience.

  • **List five AI-powered features you've interacted with this week. ** Cast a wide net: autocomplete, photo tagging, spam filtering, chatbot answers, translation, product recommendations, voice assistants.
  • For each one, jot down your call: is it producing new content, or is it sorting, ranking, and classifying existing content?
  • **Share your list with an AI and ask it to check your calls. ** For any you got wrong (or weren't sure about), ask it to explain the distinction in one sentence. Then ask: "Which of these five is most likely to have a failure mode this course will help me understand? "
  • **Go back to your Lesson 1 task list. ** For each task, tag it with the property question that feels most relevant right now:
  • Where do the answers come from? (Next Token Prediction)
  • What does it know? (Knowledge)
  • What's it paying attention to? (Working Memory)
  • How much am I in control? (Steerability)

You're not expected to get these right. You're creating predictions you'll test over the next four lessons.

Lesson reflection

  • Did the generative/classification distinction with AI change how you think about any tool you use?
  • Look at how you tagged your task list. Did any task feel like it could belong under more than one property?

What's next

Before we dig into the four properties, we'll spend one lesson on how an AI system ends up with a personality at all. Why it's polite, helpful, honest, why it sometimes agrees too easily, why it declines certain things. That shaping process leaves fingerprints on everything that follows.

Feedback

As you progress through the course, we'd love to hear from you about how you are using concepts from the course in your work, plus any feedback you may have. Share your feedback here.

Acknowledgments and license

Copyright 2026 Anthropic. Original work building on the AI Fluency Framework developed by Prof. Rick Dakan (Ringling College of Art and Design) and Prof. Joseph Feller (University College Cork). Released under the CC BY-NC-SA 4. 0 license.

Flashcards 8 cards
Question
click to reveal · ←/→
Answer
click to flip back
Export to Anki (.tsv) ↓
Knowledge check 6 questions