Introduction to the History & Problems
of Motor Control
History of motor control in psychology
"Modern" psychology has ignored movement for the most part...
Thought that movement is simple - animals can do it!
Real human abilities are perceptual and cognitive
Modern cognitive psychology arose from 'information processing' and
so was aligned more with computer science.
e.g., computers can be programmed to play chess
...but it should not.
Real movement is complicated
e.g., building operational robots has been extremely challenging.
Imagine building a chess-playing computer that actually picked up and
moved the pieces.
Further, none of the movements we make as humans are fundamentally
much different from what other animals do.
Activities that have been regard as distinctively human...
communication - speaking, writing, pointing
tool manufacture and use
are based on skills that are evident in other species
chimpanzees have rich vocal repertoire of communication and they use
tools, e.g., sticks to get ants.
Also the relation between perception and action was a dominant theme
at the birth of experimental psychology in 19th century.
Wilhelm Wundt
established first laboratory of experimental psychology in 1879 at
University of Leipzig
1881 founded first journal for psychology
Wrote first textbook, Principles of Physiological Psychology
discussed motor control in his text under 'Volitional Processes'
William James
established psychology at Harvard, 1876
conceived of psychology as an experimental science based on physiology
of the brain and not just philosophy
wrote 2 volume Principles of Psychology in 1890
devoted 3 chapters - "The production of movement", "Instinct",
and "Will".
In general the view was of multilevel sensorimotor control in which
volitional action was built on foundation of reflex. Experimental data
used in support of ideas included reaction time as today.
Two problems were recognized
What is the role of perception in the production of action? In other
words, what is the origin of basic action?
James proposed that perception and imagery was origin of action:
"We may ... lay it down for certain that
every representation of a movement awakens in some degree the actual movement
which is its object; and awakens it in a maximum degree whenever it is
not kept from so doing by an antagonistic representation present simultaneously
to the mind. Movement is the natural immediate effect of feeling, irrespective
of what the quality of the feeling may be. It is so in reflex action, it
is so in emotional expression, it is so in voluntary life. (Principles
of Psychology, 1890, p 526, 527)
but precisely how "feeling" resulted in movement was never
clear
What is the role of action in perception?
Commonly accepted since Berkeley that perception was determined by
action.
e.g., what you see depends on where you look.
But there was a problem of how space itself was perceived and how spatial
relations between agents and objects in the world could seem constant when
perception varied by action so much.
e.g., with each eye movement how does your brain "know" that
it was your eye and not the world that moved?
Space constancy was solved by the idea of corollary discharge
a neural representation of a movement against which the movement's
sensory consequences are matched. Idea traced to Helmholtz in Physiological
Optics, but gained real currency in 1950s (von Holst & Mittelstaedt,
Sperry, Teuber).
There were 2 competing notions about how this happened.
On the one hand, sensory information could be merged with innervation
feelings to produce spatial perception.
On the other hand, kinesthetic feedback for each movement could be
used.
Thus, in 19th century the 'inflow' vs. 'outflow' debate had started
which continues today!
At the beginning of the 20th century there developed a schism between
the investigation of perception and of action with the birth of behaviorism
and of gestalt psychology
Classical experimental psychology died because it proved unable to
answer practical questions
e.g. what are the best educational practices?
One shortcoming of 19th century psychology was its claim for special
status. Wundt argued that all other sciences were concerned with 'mediate
experience', the outer physical world. The ultimate topic of psychology
was 'immediate experience'. Thus psychology isolated itself from the rest
of science.
Behaviorism and gestalt psychology corrected this.
Behaviorism was based on biology.
Watson, Skinner
Gestalt psychology was rooted in physics.
Wertheimer, Köhler, Koffka
This close relation with the growing fields of biology and physics
made it possible to effectively wipe out experimental psychology as an
intellectual field in 1 decade, 1910-1920.
Both behaviorism and gestalt psychology would claim to offer an account
of all the problems that 19th century experimental psychology addressed
- including movement. But in practice they would fall short and lose sight
of problems and issues dealt with in 19th century.
The classic questions were 1) How is sensory information used to control
action? and 2) How is perception influenced by movement?
Behaviorism said little if anything about #2, and disposed of #1 by
committing itself to explaining which stimuli lead to which
responses and not how the relation happened.
Gestalt psychology did not directly address action. Movements were
thought to occur to result in better organization of the psychophysical
field. It does not explain how movements are selected and executed.
Both behaviorism and gestalt psychology had simplistic notion that
movements were automatically executed once the sensory stimulus or perceptual
state was dictated. Thus, from 1920 to 1950 research on cognitive processes
and research on control of behavior took place in different labs (different
countries) under different theories.
The 1960s was a period of reunification of experimental psychology
with the development of the information processing perspective which arose
from a number of influences: 1) human factors research in WWII, 2) Shannon's
information theory of communication, 3) cybernetics, 4) computer technology
Many of the problems of the 19th century were rediscovered
This brand of psychology was not a school per se, being less
based on a theory than on a metaphor or set of metaphors that related brain
to the most advanced computational machinery and concepts available at
the time.
Early on, action was part of the package in the sense of controlling
processes. One of the most influential publication series in the field
is entitled Attention and Performance.
But there was a legacy of the original split between perception and
action. What has become cognitive psychology became more concerned with
perception and cognitive processes and until recently virtually ignored
movement.
A founding father of the approach, Ulric Neisser, described the central
tenet of cognitive psychology as "attempting to trace the fate of
the input", a pursuit that stops short of control of overt action.
Thus psychology has typically stopped at memory and thought.
BUT even just to do the experiments required overt movements
Why did cognitive psychology ignore movement?
The nature of the computational metaphor.
Most computers had input and processing; but there was no action.
Also, computational machinery has until recently been too limited to
be very effective in controlling processes in real time.
Cognitive psychology picked up the work on the problems left by behaviorism
and Gestalt psychology which were mainly perceptual and cognitive. Also
as interest moved toward higher cognitive abilities like mental representations,
categories & concepts, and language, primary action was forgotten.
Current status
With development of connnectionism and neural networks in mid 1980s,
cognitive psychology is returning to its biological roots.
"Cognitive Neuroscience"
Development of active perception approach in robotics
Traditional AI approach to problems of perception yielded ill-posed
problems
e.g., specifying the 3-d reconstruction from a stereo image - in a
single snap-shot frame - has more variables than there are equations.
However, if the cameras moved, then the resulting mathematical problems
had explicit solutions.
New generation of robots that link perception and action
Important to learn that psychology (as all of science ) has not progressed
cumulatively. The work of one line of thought can dry up and be replaced
by views and findings of different approaches.
Overview of central issues of motor control
Two fundamental aspect of motor control to remember
How are successful movements generated?
How is stability maintained?
Consider physiological & psychological levels of explanation
e.g., Parkinson's disease
Four major problems of motor control
The Degrees-of-freedom problem
Define motor equivalence - ability to achieve goal, perform task using
variety of movements, e.g., writing with either hand, foot or mouth
Specification of the parameters of movement is computationally complex
because there are so many degrees of freedom
e.g., arm has 7 degrees of freedom (shoulder = 3, elbow = 2, wrist
= 2)
Solution of efficiency
avoid extreme joint angles
minimize jerk (derivative of acceleration)
minimize changes in muscle torque or muscle stiffness
Synergies
dependencies between components of motor system
e.g., blink during sneezing
rhythmic movements with 2 hands have similar frequency
but skilled jazz drummers can hold 2 different beats with the two hands!
evolutionary basis - certain movements 'belong' together or in other
words are adaptive
Relying on mechanics
biomechanical properties simplify degrees of freedom problem
Path planning, inverse kinematics, and inverse dynamics
Consider different levels
path planning - which route for limb to move to achieve objective
inverse kinematics - convert desired path into desired joint angles
inverse dynamics - determine forces necessary to produce desired joint
angles
People generally make straight line movements, even curved trajectories
can be shown to be comprised of straight segments
3 possible reasons
Path planning is done with respect to the Cartesian coordinates in
which the hand moves. This assumes that path planning is under geometric
constraints.
Minimizing jerk. This assumes kinematic constraints.
Minimizing torque changes at joints. This assumes dynamic constraints.
General rule of biological systems is that every possible trick will
be used, so each of these factors probably contributes. Thus, high level
control is constrained by and influenced by lower level control factors.
The serial-order problem
How do we produce sequences of movements
Speech errors
Action slips
Coarticulation
The perceptual-motor integration problem
Feedback and feedforward control
ballistic versus controlled corrective movements
use of error to guide movement is negative feedback, servomechanism
control systems approach to motor control
reference signal
plant
comparator
gain
closed loop
open loop
Spatial coordinates
body-centered
environment-centered
Movement enhances perception
Perception is necessary for effective movement...
but movement is necessary for effective perception.
Suppression effects
When appropriate, movement impairs perception
Necessary to distinguish sensory changes that are due to movement of
the world from changes due to movement of the sensory receptor relative
to the world.
The skill-acquisition problem
Extent of innate skills?
How are skills learned?
Once learned, what is form of memory?
Example of vestibulo-ocular reflex
More complex examples - playing the piano, hitting a ball, performing
surgery, etc.