This paper presents a methodology to apply speech technology for compensating sensory and motor and cognitive and affective usage difficulties. It distinguishes (1) an analysis of accessibility and technological issues for the identification of context-dependent user needs and corresponding opportunities to include speech in multimodal user interfaces and and (2) an iterative generate-and-test process to refine the interface prototype and its design rationale. Best practices show that such inclusion of speech technology and although still imperfect in itself and can enhance both the functional and affective information and communication technology-experiences of specific user groups and such as persons with reading difficulties and hearing-impaired and intellectually disabled and children and older adults.