Ivan Sysoev and Anneli Hershman

[Currently in-progress]

SpeechBlocks is a smartphone app that allows children to explore spelling principles in an open-ended way. Children rearrange words on the screen by pulling them apart and putting them together with their fingers. Each word formed is pronounced aloud by a speech synthesizer. The interactions afforded by the app were informed by current research findings in early literacy learning. To alleviate the fear of making a mistake, and to support fun exploration, we excluded the notion of “right” and “wrong” from our design: Nonsense words are pronounced along with regular words, much to children’s amusement. While the app is intended to help children acquire basic reading and writing skills, it has also turned out to be a medium for self-expression and creativity. We conducted several studies with children using SpeechBlocks and found that (a) the app facilitated children’s engagement, sense of authorship and self-efficacy, and (b) it evoked a significant number of social interactions between children as they explored words. Please see our last paper for details.

Guided SpeechBlocks

In their play with SpeechBlocks, children often want to spell specific words. If adults are available, the kids will ask them for help. Such cases present valuable learning opportunities, as children’s skills grow largerly within the “zone of proximate development” - the range of activities that they cannot do on their own yet, but can perform with some assistance. But what if there is no adult around willing to provide such assistance? Can the app do it on its own? We are trying to answer this question in our recent work. Our experimental system learns about the word that the child wanted to spell through one of the input channels (such as optical character recognition, as in the video below), and then helps to spell the word by highlighting the connection between sounds and letter combinations.

Social SpeechBlocks: Word Pong

[Currently on hold]

We are experimenting with ways to incorporate social elements into our SpeechBlocks prototype to add meaningful ways for children to interact within the app. In this video, you can see children sending their words to one another. A character, which is the child’s avatar on his/her friend’s phone, then pronounces the word aloud.

SpeechBlocks Collaborators: Susan Fine, MA CCC-SLP and 826 Boston

Projects building on SpeechBlocks:

Bilingual SpeechBlocks - modifying SpeechBlocks to help bilingual Spanish-English speaking children differentiate between letter-to-sound mappings in their two languages

PlayTrees - visualizing children’s play with SpeechBlocks

Literacy coaches - creating a supportive environment around the learner