Thursday, October 23, 2008

How motor skills are different from language

Some people like to argue that the development and learning of motor skills in humans is a lot like the development and learning of language in humans: intertwined, hard to separate, probably with a large element of hardwired knowledge and only a few parameters to tune through experience.

And sure, it may be helpful to think of motor skills this way, and people talk of motor primitives (kind of like words) and grammars that tell you how to combine them, which further helps with the analogy. From a computational standpoint, of course, natural language is a fascinating system clearly governed by rules that nonetheless admit a large degree of fuzziness in practice. Despite several good linguistic models of language production, it's still really hard to make a computer do a decent job of things like conversation and translation. There is, though, spectacular progress, and a whole body of research on the subject. So if motor skills are like natural language, then maybe we can apply things we know about the latter to the former. "Natural" motor skills: their fluidity, robustness to perturbation, and extremely precise yet very compliant control, are hard for robots perhaps the same way language is hard for computers. And it's quite probable that movements are compositional the way sentences are.

But I'd like to point out three fundamental differences.

1. Kinds of compositionality

Utterances are compositional according to the rules of grammar. Things like "apod ihfoa dhf" or "but the why cow give tree storm" don't count as language, even though they are strings composed of letters or phonemes (or words) and strung together. On the other hand, if I start twitiching and winking and throwing my limbs about, this is acceptable movement and maybe even a dance. The point is: movement is compositional (composed of little things you can do called motion primitives) but nothing dictates its acceptability other than physical laws. If a motion sequence is impossible for a human being, it's because the joint doesn't bend that way, or the muscle isn't strong enough, or the required degree of freedom is lacking from our body etc. On the other hand, as demonstrated above, I can make any number of utterances that don't mean or communicate anything because they don't obey the restricted, symbolic compositionality rules (grammar) of a language. Why is this distinction relevant?

2. Kinds of available information for learning

How utterances vs. movements are created, and which ones are acceptable is relevent because it directly bears on the question of how a human infant/child could possibly learn the two sets of skills. It's widely accepted in linguistics that there isn't enough information (enough examples of what does and doesn't constitute a grammatical sentence) in order to learn (infer) a complete grammar from nothing. The conclusion is that we must be born with a language organ in the brain that essentially has a hardwired grammar, the parameters of which need to be set by learning via exposure to a particular language. In particular, children don't hear nearly enough ungrammatical utterances, nor are they usually corrected when they say ungrammatical things, in order to reliably identify the grammar of a language.

Does the same hold in the case of motor skills? Let's see. Every waking minute of every day of our lives, we move our muscles and receive sensory feedback on our movements. We actively send neural control signals to our muscles and directly sense what happens as a result for everything that we do, including sitting, standing, breathing and blinking. Clearly, there are instinctive motor skills such as breathing and blinking that don't require any learning. We have the required neural circuitry at birth. But sitting and standing does not come at birth. Nor do any directed limb movements. But those muscles too get commanded relentlessly and at a high rate. And also relentlessly, at a high rate, we perceive the results of our actions in the form of sensory signals that come from proprioception, touch, and vision (and also hearing and smell and taste sometimes). But mostly proprioception. So it seems like a true wealth of experience to draw on for learning how to move.

Notice also, that there is a wealth of negative experience or negative examples of how not to move for human infants. They lose their balance all the time, they stumble, they fall, they bite their tongues ... They control their muscles in all these ways they shouldn't be, and they immediately get a negative failure signal due to the laws of physics. Again, there is plenty to learn from. And this disparity is specifically due to the fact that motor skill compositionality is not based on rules for stringing symbols, but directly and only on the physical capabilities of the body and the physical universe.

3. Kinds of goals

Utterances are vehicles for communication. Movements are vehicles for displacement. While the intended meaning of an utterance changes with its grammatical structure, any movement that achieves the desired displacement is generally acceptable.

There is surely more to say on the subject, but these three things lead me to believe motor skills are more learnable and less hardwired than linguistic abilities.

2 comments:

P. James Dennedy-Frank said...

So this isn't my area of expertise, and I certainly will concede points 2 and 3, but it's not clear to me that point 1 is valid. Certainly there can be nonsense sentences that contain no meaning, created. However, in certain cases these become poetry with great meaning. Similarly, why can't there be nonsense movement? Certainly it's still movement, but there could be movement that no one would ever, in any culture, identify as a dance because it is so spastic and irregular, that doesn't serve a purpose in terms of meaningful displacement, and doesn't accomplish any other meaningful goal. Isn't this analogous to a nonsense collection of words?

I'd look at certain collections of brain damage as examples (note again--I'm not an expert on this, but I'm assuming given the great breadth of different neurological disorders, that both of these exist). There are neurological disorders that cause people to have a hard time forming meaningful sentences--strokes can cause them sometimes, and one might think of a severe case of Tourette's syndrome as an extreme example of this. Similarly, I can certainly imagine there being neurological disorders in which people can move limbs, but can't do so in a coordinated, coherent way to accomplish a particular goal.

All right, now that I've waded in WAY over my head, I'll await your smackdown.

gavastik said...

Hey, James, thanks for writing! You certainly make a valid point about potential relationships between brain structure and function in both cases. I'm no neurology expert either, but I haven't heard of a motor impairment conditions when movements became "ungrammatical" if you will. If motor skills were like language, this would be roughly equivalent to lesions in the Broca area which result in language impairment in the form of "telegraphic speech": few or no connective words, little or no grammatical structure to utterances. In motor impairment, I have read about forms of ataxia (trouble moving) and dyskinesia (spastic involuntary movement, like Tourette's), and impairments due to sensory loss (notably of proprioception) or cerebellar lesions that may result in a dysfunction of rhythmic motions. Another thing that can happen is that if there's a lesion in the M1 (primary motor control cortical area), the corresponding limb will not move (unless maybe retrained). I'm not entirely sure what a rough equivalent of "telegraphic speech" would be in motion planning. A patient trying to execute motions in some sort of "wrong" order? Making a grasping motion before reaching the object to grasp? I'm not sure that kind of behavior would necessarily point to the existence (and impairment) of "grammar"-style compositionality of movements. I've read about experiments where monkeys exhibited that kind of behavior, which was explained by very focused lesions in areas responsible for proprioception info integration.

Your other point, about nonsensical movement, would then be a very valid criticism of my post if we could demonstrate that the nonsense isn't coming from very primary kind of sensory or "lower" neural deficiency but from a focal lesion to this "rough equivalent of Broca's area". The kind of nonsensical movement found in Tourette's chorea, on the other hand, affects motor control pretty indiscriminately, including speech production.

I'm not disagreeing that there could potentially be sequences of movements that are just as "bad" in some sense as random collections of words. This is a tricky question, and I should think about it more, but I don't like how far the analogy has often been taken. Maybe I should do the next post on why motor skills are like language to be fair.