Neuroscience · Skim version

Feeding, Motivation and Reward

About 2 min to skim · 2 figures · Rewritten on

Read the full lesson → Skim the whole course →

The guiding idea

A well-fed mouse starts eating within minutes when one small group of hypothalamic neurons is switched on with light. What are those neurons for?

A midbrain dopamine neuron's quick burst or pause reports a reward prediction error, whether things turned out better or worse than predicted, and hunger changes how much the reward is worth.

From the film: Received Minus Predicted

  • Dopamine bursts and pauses report better or worse than predicted, not the reward itself.
  • When a reward is fully predicted there is no error and firing stays steady; with learning, the burst moves to the cue that announces it.
  • This holds for many, not all, dopamine neurons, in trained monkeys and rodents, and it says nothing about pleasure.

From the film: The Tone and the Juice

  • In monkeys, about three quarters of recorded dopamine neurons burst to unexpected juice, and once a tone predicted it the burst came at the tone.
  • In the model, the error is the reward plus the change in prediction, so unexpected good news about the future counts as an error.
  • When an expected juice is left out, firing pauses at about the time it was due.
  • A recording shows only that firing matches the error; an imposed burst in rats is enough to drive learning, not shown to be needed.

From the film: Wanting Is Not Liking

  • In rats, depleting forebrain dopamine stopped food seeking but left liking reactions to sugar intact.
  • In mutant mice with extra extracellular dopamine, animals reached sweet food sooner without stronger liking reactions.
  • So in these tests dopamine moved wanting, not liking; a lifelong mutation is not an acute drug, and a rat's face is not a human report.
  1. Two questions, one idea

  2. Hunger: a fuel gauge and two opposed groups of neurons

    AI-generated illustration: Schematic of the hunger circuit: fat cells release leptin into the blood, which inhibits AgRP neurons and excites intermingled POMC neurons in the arcuate nucleus; POMC neurons release alpha-MSH that activates MC4R on a downstream neuron while AgRP peptide blocks it, and the downstream output sets the drive to eat. An inset shows the arcuate nucleus at the base of the hypothalamus.
    Leptin from fat inhibits AgRP neurons and excites POMC neurons in the arcuate nucleus; POMC's alpha-MSH presses MC4R while AgRP peptide covers it, and the balance between them sets the drive to seek and eat food. AI-generated illustration
  3. Dopamine neurons report prediction errors

    AI-generated illustration: Three schematic spike rasters from a midbrain dopamine neuron: unexpected juice evokes a burst at the juice; after a tone has come to predict the juice, the burst comes at the tone and nothing extra happens at the juice; when the expected juice is left out, the tone still evokes a burst and firing pauses when the juice was due.
    Drawn after the monkey recordings: the dopamine burst moves from unexpected juice to the tone that predicts it, and when the expected juice is left out, firing pauses at the time it was due. AI-generated illustration
  4. Wanting is not liking

  5. In addiction, wanting can grow while liking does not

  6. Going deeper

Read the full lesson → Skim the whole course →