Related News
'Talking' in color social skills remedy
By David Lawsky |
April 5, 2009, Sunday
|
Print Edition
Print Edition
KARRIE Karahalios in San Francisco can show a child with Asperger's Syndrome when he's lost in a conversational riff or a taciturn spouse who doesn't speak much.
Their voice appears on a computer terminal as vibrant colors - red, yellow, blue, green - the image growing in size if the voice gets louder, overlapping another color as it interrupts or narrowing with silence. They are talking in color.
Karahalios, a University of Illinois at Urbana-Champaign computer scientist, has devised how to digitize conversations and convert them into images that let people "see" their own utterances on computer monitors.
The Massachusetts Institute of Technology-trained professor says her method provides feedback in real time and can act as a type of social mirror, allowing people to adjust speech the same way they adjust their appearance in a glass mirror.
"You look into a mirror and you change your dress, your expression, because you see exactly how it's happening in real time," she said.
The colors linger so people can see the progression of an entire conversation, not only the moment.
The computer program, which she calls a "conversation clock," has been tested with low-functioning autistic children and in marriage counseling and is being prepared for use with Asperger's Syndrome.
People with that disorder, at the high end of the autism spectrum, often have sophisticated vocabularies but troubled social interactions.
"Kids with Asperger's tend to do 'monologuing' and 'lecturing' without letting others intervene," said Maria Dixon, a clinical instructor in hearing and speech at the University of Maryland.
"The challenge is to get them visual feedback while this is happening."
The experiment will use the conversation clock program with two children sitting across the table from each other.
Monologuing
It will show if children with Asperger's do what other users of the clock tend to do - change their conversational patterns to balance the colors that appear on the computer screen. That would put an end to monologuing, at least during the experiment.
"My older son is fascinated, as he thinks this could really help him," said psycholinguist Sara Weyland, Dixon's colleague and the mother of two children with Asperger's.
Karahalios' team has prepared for a year and will run the study this summer at the College Park, Maryland, campus.
She has been studying the use of computers and visualization of human speech for more than a decade. She published her work on the "conversation clock" two years ago and is continuing to refine it.
Experts in various fields have suggested a variety of applications, including marriage counseling. She also has a request to use the clock to teach turn-taking to people with a specific kind of brain injury.
Karahalios described a test in which four people sat at a table, each fitted with a lapel microphone matched to a color and attached to a computer.
The conversation clock charts a colorful, real-time record of their conversation that is projected on the table, instead of on a wall or a computer screen.
The "clock" shows the progress of the talk. Three times a second, a color bar pops up showing who was speaking.
The louder the speech, the longer the bar. Interruptions are shown as overlapping color bars. Every minute, a new circle of bars is rendered in a visual record akin to the rings of tree trunks.
Karahalios found that once it was turned on, people tried to balance their conversation.
"Everyone sees the exact same thing and people almost felt like it had to be a balance of color," Karahalios said. "I'm not saying that balanced conversation is good conversation. It's fascinating how people behaved." Once she had established her techniques, Karahalios worked to apply them to children with autism.
Research has shown computers can teach in ways that reduce human-to-human interaction, which tends to be a source of anxiety to people with autism.
Karahalios hopes for the day her work can become widely available to help children and families, through iPhone programs and as toys for autistic children who have trouble working with doctors, or who are far away from specialized help.
Their voice appears on a computer terminal as vibrant colors - red, yellow, blue, green - the image growing in size if the voice gets louder, overlapping another color as it interrupts or narrowing with silence. They are talking in color.
Karahalios, a University of Illinois at Urbana-Champaign computer scientist, has devised how to digitize conversations and convert them into images that let people "see" their own utterances on computer monitors.
The Massachusetts Institute of Technology-trained professor says her method provides feedback in real time and can act as a type of social mirror, allowing people to adjust speech the same way they adjust their appearance in a glass mirror.
"You look into a mirror and you change your dress, your expression, because you see exactly how it's happening in real time," she said.
The colors linger so people can see the progression of an entire conversation, not only the moment.
The computer program, which she calls a "conversation clock," has been tested with low-functioning autistic children and in marriage counseling and is being prepared for use with Asperger's Syndrome.
People with that disorder, at the high end of the autism spectrum, often have sophisticated vocabularies but troubled social interactions.
"Kids with Asperger's tend to do 'monologuing' and 'lecturing' without letting others intervene," said Maria Dixon, a clinical instructor in hearing and speech at the University of Maryland.
"The challenge is to get them visual feedback while this is happening."
The experiment will use the conversation clock program with two children sitting across the table from each other.
Monologuing
It will show if children with Asperger's do what other users of the clock tend to do - change their conversational patterns to balance the colors that appear on the computer screen. That would put an end to monologuing, at least during the experiment.
"My older son is fascinated, as he thinks this could really help him," said psycholinguist Sara Weyland, Dixon's colleague and the mother of two children with Asperger's.
Karahalios' team has prepared for a year and will run the study this summer at the College Park, Maryland, campus.
She has been studying the use of computers and visualization of human speech for more than a decade. She published her work on the "conversation clock" two years ago and is continuing to refine it.
Experts in various fields have suggested a variety of applications, including marriage counseling. She also has a request to use the clock to teach turn-taking to people with a specific kind of brain injury.
Karahalios described a test in which four people sat at a table, each fitted with a lapel microphone matched to a color and attached to a computer.
The conversation clock charts a colorful, real-time record of their conversation that is projected on the table, instead of on a wall or a computer screen.
The "clock" shows the progress of the talk. Three times a second, a color bar pops up showing who was speaking.
The louder the speech, the longer the bar. Interruptions are shown as overlapping color bars. Every minute, a new circle of bars is rendered in a visual record akin to the rings of tree trunks.
Karahalios found that once it was turned on, people tried to balance their conversation.
"Everyone sees the exact same thing and people almost felt like it had to be a balance of color," Karahalios said. "I'm not saying that balanced conversation is good conversation. It's fascinating how people behaved." Once she had established her techniques, Karahalios worked to apply them to children with autism.
Research has shown computers can teach in ways that reduce human-to-human interaction, which tends to be a source of anxiety to people with autism.
Karahalios hopes for the day her work can become widely available to help children and families, through iPhone programs and as toys for autistic children who have trouble working with doctors, or who are far away from specialized help.
- About Us
- |
- Terms of Use
- |
-
RSS - |
- Privacy Policy
- |
- Contact Us
- |
- Shanghai Call Center: 962288
- |
- Tip-off hotline: 52920043
- 沪ICP证：沪ICP备05050403号-1
- |
- 互联网新闻信息服务许可证：31120180004
- |
- 网络视听许可证：0909346
- |
- 广播电视节目制作许可证：沪字第354号
- |
- 增值电信业务经营许可证：沪B2-20120012
Copyright © 1999- Shanghai Daily. All rights reserved.Preferably viewed with Internet Explorer 8 or newer browsers.
