The W3C Multimodal Interaction Activity is developing specifications as a basis for a new breed of Web application with multiple modes of interaction. Consider applications which use speech, hand writing, and key presses for input, and spoken prompts, audio and visual displays for output. It is implemented by several drafts, which we will briefly review in this article. These include InkML, a language that serves as the data exchange format for representing ink entered with an electronic pen or stylus; and EMMA, a data exchange format for representing
The W3C Multimodal Interaction Activity group is developing specifications for a new breed of Web application that allows multiple modes of interaction—for instance, speech, handwriting, and keypresses for input, and spoken prompts, audio, and visual displays for output. Specification drafts include:
* Ink Markup Language (InkML), which serves as the data exchange format for representing ink entered with an electronic pen or stylus.
* Extensible MultiModal Annotation (EMMA), a data exchange format for representing application-specific
According to Kress (2004), multimodality deals with all the means human beings have for making meaning, referring to the modes of representation, such as drawing or writing. The author affirms that each mode forces individuals into making commitments about meaning, whether intended or not.
Multimodality is based on the use of sensory modalities by which humans receive information, such as touch, vision, audition etc. and requests the use of at least two response modalities regarding presentation of information, like verbal and manual activity (Baber