Site icon Wonderful Engineering

New Sensor-Powered Pen Transforms Braille Into English Text With 84.5% Accuracy

Sensor-powered Pen Transforms Braille Into English Text With 84.5% Accuracy

Engineers at the University of Bristol have created a device called “Braille-tip,” a pen that can translate Braille into English text in real time.

This pen-like device features a small sensor, just one centimeter in size, with 19 channels specifically designed to read Braille. In early trials, the device achieved an impressive 84.5% accuracy in converting Braille into English text, proving its potential to transform Braille literacy.

“This device, Braille-tip, was designed to aid people’s ability to learn independently and will hopefully form part of the solution to increasing Braille literacy,” explained Dr. George Jenkinson, lead author of the study.

At the core of the Braille-tip is a compact tactile sensor mounted on a standard pen, capable of reading Braille through an intricate system of fluid channels beneath a soft silicone membrane. These channels transmit tactile information from the 19 sensitive areas to a camera, allowing the device to detect raised Braille dots commonly found on embossed cardboard, which is widely used by Braille readers.

Dr. Jenkinson shared his personal experience using the device: “I used the handheld device to read multiple passages of Braille and analyzed how accurately it could process the tactile cues (Braille bumps) into English text.”

One of the most impressive aspects of Braille-tip is its algorithm, which operates in real-time without the need for deep learning or extensive training. This makes the device highly predictable and adaptable, offering users a straightforward experience that doesn’t rely on complicated software.

The Braille-tip pen acts similarly to the advanced Braille-reading technique where both index fingers are used simultaneously—one re-checking letters while the other continues reading. For learners, Braille-tip can serve as a guide, helping them build their skills while offering real-time English translations of Braille text.

The team behind Braille-tip is already working on improving the device’s functionality to make it even more accurate and user-friendly. “As soon as possible, the device should be tested with participants, and prototypes should be made available to the intended end-users so that their desires and the potential use for such a device can be assessed in earnest,” Dr. Jenkinson said.

“A co-design approach that involves users is much more likely to have a positive real-world impact than an approach siloed in the laboratory,” he added.

Exit mobile version