Skip to main content
RISE logo

Speech-to-Text System using Augmented Reality for People with Hearing

The aim of the project is to study visual, optical and ergonomic conditions for a speech-to-text
system that, through Augmented Reality (AR)-technology, presents text for people with hearing
impairments. STAR is a project for innovation which both develops the technology and studies the basic conditions for such a system.

The project will explore visual, optical and ergonomic conditions for a speech-to-text system that will present text to people with hearing impairment using technologies based on Augmented Reality and automatic speech recognition (Speech-to-Text System using Augmented Reality ”, abbreviated STAR).

The goals are to
1. create a demonstrator for an AR-based speech-to-text system
2. implement an experimental set up and
3. investigate basic visual, optical and ergonomic principles for presenting text in AR for people
with hearing impairments, to create a demonstrator for an AR-based speech-to-text system, with
related guidelines.

The project will be led and carried out by RISE Research Institutes of Sweden in close collaboration with De Hörselskadades Riksförbund, HRF (the organisation in Sweden for people with hearing impairments).

Project members at RISE are: Börje Andrén, Kjell Brunnström, Pär Johanson and Bo Schenkman

This project is now finished, but continues in RISE funded projects about digital aids for people with sensory disabilities and medical equipments

This video presents the project result and is not the same as the video above (mostly in Swedish)

Summary

Project name

STAR

Status

Completed

Region

Region Stockholm

RISE role in project

Coordinator

Project start

Duration

15 months

Total budget

1630000 SEK

Project members

Kjell Brunnström

Contact person

Kjell Brunnström

Forskare

+46 70 841 91 05

Read more about Kjell

Contact Kjell
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.

* Mandatory By submitting the form, RISE will process your personal data.