(Image credit: Alex Dolce, Florida Atlantic University)

Learning piano is challenging enough as it is. But relearning piano after a stroke or neuromuscular disorder can be absolutely defeating. These conditions often lead to diminished sensation, proprioception (the awareness of body position and movement) and dexterity in the hands, making it very challenging to perform tasks that require fine motor skills – like playing the piano. Traditional rehabilitation methods often fall short in restoring these complex abilities, leaving many patients struggling to regain their former skills. So what can be done?

Today we’re exploring the “smart hand exoskeleton”. This is a revolutionary device that looks like a glove – designed to bridge this gap. Not only does it help you move your fingers but it also helps you ‘feel’ the difference between playing a correct or incorrect note on the piano. This concept is especially crucial for stroke survivors and individuals with neuromuscular disorders who often experience reduced limb functionality and impaired sensation. The smart hand exoskeleton is a lightweight, flexible glove equipped with tactile sensors and soft actuators, weighing only 191 grams. It is custom-made using 3D printing technology, and it fits each wearer’s hand perfectly, with fingertip sensors providing essential tactile feedback.

The study, published in Frontiers in Robotics and AI, demonstrated the glove’s ability to distinguish between correct and incorrect versions of a song using machine learning algorithms. Researchers trained the glove on songs like “Mary Had a Little Lamb,” employing algorithms which effectively allowed the glove to provide real-time feedback on piano play.

The smart hand exoskeleton aligns offers personalized rehabilitation plans. Clinicians can use data from the glove to identify specific weaknesses and tailor exercises to address them, similar to how we adapt our teaching methods to meet the needs of each student. This glove is like having a personal coach that not only guides your movements but also understands and adapts to your progress.

To me, as piano teacher, this is incredibly intriguing. Imagine a tool that not only guides your hand movements but also corrects your mistakes on the spot. This kind of feedback is invaluable, especially for those recovering from neurotrauma who need precise and supportive guidance.

Although the study presents a promising proof-of-concept, the researchers acknowledge the need for further optimization. Improving tactile sensing accuracy, exoskeleton adaptability, and machine learning algorithms will be key to unlocking the full potential of this technology. As these improvements are made, we can expect even more profound impacts on rehabilitation practices and patient outcomes.

Thank you for reading!

Frontiers in Robotics and AI: Lin M, Paul R, Abd M, et al. “Feeling the beat: a smart hand exoskeleton for learning to play musical instruments.” Front Robot AI. 2023;10. doi: 10.3389/frobt.2023.1212768.