← All projects

Project 04

Accessibility Device for Speech Therapy

Lightweight headgear that reads lip and mouth movement with flexible magnetic tags and an array of magnetoresistive sensors, streaming over BLE to a phone app for real-time syllable classification.

Assisted speech recognition system

This device is designed to facilitate the analysis and interpretation of mouth and lip movements. It utilizes flexible magnetic tags strategically placed around the wearer’s mouth, each emitting a distinct magnetic field. An array of magnetoresistive sensors captures these fields in real time. The resulting magnetic data can be used to train a supervised neural network for syllable classification, or explored using unsupervised models to identify broader speech patterns. The system operates wirelessly over Bluetooth Low Energy (BLE) and interfaces seamlessly with a companion mobile application. Alternatively, raw data can be streamed to a PC for custom processing, analysis, or integration into other pipelines.