28
Learning, Memory, and Representation CGSC 1001 Mysteries of Mind by Jim Davies [email protected] 1

Learning, Memory, and Representation (in Cognitive Science)

Embed Size (px)

Citation preview

  1. 1. CGSC 1001 Mysteries of Mind by Jim Davies [email protected] 1
  2. 2. environment Cognitive System perception action Transforms things in the environment to internal representations Turns desires to act into physical changes in the environment 2
  3. 3. Brain Body World Perception Action Senses 3
  4. 4. sensors actuators perception action The world 4
  5. 5. Amazon.coms recommender system User input Updating database Display to screen perception action 5
  6. 6. People and artifacts The world action perception Sensors, sensory organs, etc. Actuators, software effects, body 6
  7. 7. Polleverywhere.com Which is a description of a distributed cognitive system and its environment? (DCS/Environment) 7
  8. 8. 1 2 3 4 5 6 7 8 1 2 3 4 5 6 7 8 X Y 3 7 4 7 5 7 6 7 7 7 6 6 4 5 5 5 6 4 7 4 3 3 7 3 4 2 5 2 6 2 7 2 (object 3) (3 less-than 4) (3 more-than 2) (is-prime 3) (is-number 3) (img345987 is-symbol 3) (img838727 is-symbol 3) Etc. Neuron J783gtjg Jnd7y3nh8 Dnbtvv893n etc 8
  9. 9. Animal Software Distributed System Brain, Long-term memory, Short- term memory Databases, symbols Paper, brain, disk, environmental manipulations 9
  10. 10. Sensory Memory Short Term Memory Long Term Memory Sensory memory is like a scratch pad (for vision), or a bit of recording tape (for hearing), that can be overwritten with new things. It is re- written every few seconds by new perceptions. Short Term Memory is a temporary store. Some things from it end up becoming long term memories. Probably stored here forever, though we might have trouble with retrieval. 10
  11. 11. 11
  12. 12. We dont know much about where declarative long term memories are stored. The hippocampus appears to be important for transforming short term into long term memories. Procedural memory appears to happen in the cerebellum, the basal ganglia, and the motor cortex. 12 Image courtesy of HowStuffWorks.com
  13. 13. Computer Memory Disk Flash Memory But who cares? This description is not at the cognitive level. 13 Software Memory Hash tables Schemata Frames Scripts Logical sentences Bitmaps Activation patterns Weights in links To a cognitive scientist, this is interesting stuff.
  14. 14. Examples: Books Brains Fingers Notes Arrows and signs Etc. 14
  15. 15. 02.5 How does a meeting remember? 15
  16. 16. Learning is changing memory with the purpose of preparing a mind for better action in the future. Well go over several kinds of learning. 16
  17. 17. Diminution of a behavioural response with repeated stimulation. E.g., the first time you hear a loud noise, you might jump, but afterward you stop jumping. 17
  18. 18. The more someone pokes you, the more it bugs you. At first you get very hungry when you skip lunch, but after a few weeks you arent. After living in the old house for a while, you learn where to avoid stepping so that the floorboards dont creak. After tasting lots of Indian food, you come to expect it to be spicy. 18
  19. 19. When a behavioural response is amplified by repeated exposure to a stimulus. E.g., at first you can barely feel a vibrating phone in your pocket, but eventually you become very sensitive to it. 19
  20. 20. Learning to associate two previously unrelated stimuli. Typically, this means that you learn to behave similarly to stimulus B as you do to stimulus A. E.g., the dog learns that when you pick up the leash, a walk is soon to follow. Also, Pavlovs salivating dogs. 20
  21. 21. A child learns not to touch the stove because it burns her. After hearing the same joke a few times, you stop laughing at it. You learn that the capitol of France is Paris in a textbook. You eat a new food and then get sick because of the flu. However, you develop a dislike for the food and feel nauseated whenever you smell it. 21
  22. 22. Positive reinforcement (the strongest) Someone smiles at you when you hold the door for him or her. Negative reinforcement A baby screams until you give them candy. Then she stops. (Adult learning NR, baby learning PR) Positive punishment You get burned by touching the hood of a car in the sun. Negative punishment Your parents cut off your allowance because you lied. 22
  23. 23. Making a behaviour more or less likely to happen in the presence of a stimulus depending on reward, punishment, or taking away a reward or aversive stimulus. Mnemonic: Positive = Present, Negative = Remove, Reinforce = Make more likely, Punish = Make less likely. 23 Adding feedback Removing feedback Encouraging behaviour Positive reinforcement Negative reinforcement Diminishing behaviour Punishment (positive punishment) Extinction (negative punishment)
  24. 24. Practice involves doing something over and over and learning how to do it better. It uses reinforcement and punishment to hone the skill. Play is theorized to be a form of practice for future events (chasing, fighting, caretaking, manipulating objects, etc.) Motor skills (that is, moving your body) gets easier because of automatization. It becomes instinct, fast, unconscious, and automatic. For most of you, tying your shoes is automatized. 24
  25. 25. A time-sensitive learning in an animal that is insensitive to behavioural outcomes. E.g., a goose learning who its mother is happens 13-16 hours after hatching. 25
  26. 26. Learning that happens by observing another individual do something. E.g., copying Michael Jackson dance moves on YouTube. Some have tried to get robots to do this. Much of cultural learning (called enculturation) is observational, but some is explicitly taught. 26
  27. 27. When someone tells you something. E.g., how to start a web browser, or that orcas are mammals. It can be read or heard aloud. We also get facts by figuring them out, but this is better described as reasoning or inference than learning. 27
  28. 28. Genetic When environments change very slowly Cultural learning (imitation) When environments change relatively quickly Content Bias Imitate the best idea Prestige bias Imitate the most successful Conformist bias Imitate the most common ways of doing things Individual learning (figuring out for yourself, perhaps influenced by the Baldwin effect) When environments change very rapidly, there is reduced cultural transmission Of course, cultures are subject to natural selection as well. Evolution is substrate-neutral. 28