/sites/cognition.ens.fr/files/2018-04/Exercise4-2018_0.pdfLecturers

  • Boris Gutkin (boris.gutkin at ens.fr)
  • Gregory Dumont (gregory.dumont at ens.fr)
  • Johann Lussange
  • Sophie Deneve (sophie.deneve at ens.fr)
     

Tutor

  • Gregory Dumont
     

Time & place : every Tuesday, 17:00-19:00, Salle Ribot, 29, rue d'Ulm
 

Literature : textbook: Dayan & Abbott. Theoretical Neuroscience. MIT Press 2001.

1. Quantitative Models of Behavior (Lecturer: Johann Lussange)

  1. The Rescorla-Wagner Learning Rule, Johann Lussange
    MathReminder-Lecture1.1, Johann Lussange
     
  2. The Exploration-Exploitation and Reinforcement Learning, Johann Lussange
    Mathreminder-Lecture1.2 (Expectation Values)
     
  3. Reinforcement Learning Continued, Johann Lussange

 

Homework

  1. HW1, due March ?? at 17:00
  2. HW2, due March ?? at 17:00.

Solutions

  1. HW1 solution
  2. HW2 solution

Literature

Chapter 9 of Dayan & Abbott.

Background Literature:

  • Sutton & Barto: Chapter 1-6 Highly readable introduction to reinforcement learning
  • Schneiderman et al (1962). Science 136:650--652 Article on rabbit eye-blink conditioning
  • Real (1991). Science 253:980--986 Article on bumblee behavior
  • Schultz et al (1997). Science 275:1593--1599 Dopamine, conditioning, and reinforcement learning brought together
  • Daw et al (2006). Nature 441: 876--879 Reinforcement learning applied to fMRI.
  • Doya (2008). Nature Neuroscience 11: 410-416 Recent review of the literature.

2. Neural Correlates of Behavior (Lecturer: Boris Gutkin)

  1. Neural Decoding, Boris Gutkin
  2. Population Coding/Decision Making, Boris Gutkin
  3. Neural EncodingBoris Gutkin
  4. Research Seminar, Sophie Deneve

Homework

  1. HW3, due April 3 at 17:00
  2. HW4 due  april 17 at 17:00
     

Solutions

  1. HW3 Solution
  2. HW4 Solution
     

3. Neural Mechanisms: Neurons and Networks (Lecturer: Gregory Dumont)

  1. Binary Neurons and Networks, Gregory Dumont
  2. Biophysics of Neurons, Gregory Dumont
  3. The Hodgkin-Huxley model, Gregory Dumont

MathReminder2.1

Homework

  1. HW5 due  at 17:00
  2. HW6 due  at 17:00

Solutions

  1. HW5 Solution
  2. HW6 Solution

Literature

Chapter I1-- 5,6; III-- 8 of Dayan & Abbott

Literature

Chapter 1--3, 7.3, 8.4 (pg36-38) of Dayan & Abbott

Background Literature:

  • David Marr (1980). Vision. MIT Press. Introduction Must read 
  • Parker & Newsome (1998). Annual Review of Neurosciences Nice review on detection and discrimination experiments
  • Hubel (1988). Eye, Brain, and Vision. Scientific American. Chapters 2-4.

Further reading suggestions:

 

4.  Exam

Written exam 2 hours, June 5 17:00 - 19:00

Notes allowed. Lecture Slides allowed. Questions on the lecture and homework topics.

Exam will count as 20% of grade.