Researchers at Texas A&M University, led by Dr. Rebecca Friesen, are developing haptic display technology to bring the sense of touch to telemedicine. The system uses a shape-shifting robotic display to replicate the tactile sensations of a physical exam captured by a sensing glove. Supported by a $1.5 million NSF grant, the team collaborates with physicians like Dr. Ericka Greene from the School of Engineering Medicine to refine the technology for remote clinical use.
Haptic telemedicine display technology
- ▪The prototype haptic display uses a cluster of actuators to translate signals collected by a sensing glove's sensors into tactile motion against a user's finger.
- ▪Texas A&M University researchers, led by Dr. Rebecca Friesen, are developing haptic display technology designed to digitally transfer the sense of touch during remote medical examinations.
- ▪Pilot data collected from the haptic display system helped the Texas A&M University research team secure a $1.5 million National Science Foundation grant.
Remote palpation exam workflow
- ▪During a prototype test, Dr. Pijuan Yu correctly identified a simulated neck tissue lump using haptic feedback while Dr. Anzu Kawazoe performed the physical exam across the hall.
- ▪A remote physician watches the exam video while a finger-sized haptic display replicates the captured sensations with a delay of just a few seconds.
- ▪In the envisioned workflow, a nurse in a rural clinic performs a palpation exam wearing a sensing glove while a camera records the procedure.
Yu's robotics to haptics transition
- ▪Dr. Pijuan Yu joined Dr. Rebecca Friesen's lab at Texas A&M University in fall 2022, defending his doctoral dissertation in June 2026.
- ▪Dr. Pijuan Yu completed a master's degree at Northwestern University in December 2021 before working as an autonomous vehicle control systems intern in early 2022.
- ▪Dr. Pijuan Yu transitioned to haptics by working as a research technician in Dr. Netta Gurari's Northwestern University lab, developing a device for stroke patients.
EnMed physician feedback sessions
- ▪The Texas A&M University engineering team holds workshops twice a year with Texas A&M's School of Engineering Medicine to test the haptic devices.
- ▪The School of Engineering Medicine is a joint four-year program offering a medical doctorate and a Master of Engineering degree.
- ▪Dr. Ericka Greene, an associate dean at the School of Engineering Medicine, collaborates with the engineering team to connect mechanical sensations to clinical reality.
Human-centered haptic design challenges
- ▪Developing haptic devices requires researchers to account for human perception, user comfort, and whether different users experience a mechanical stimulus in the same way.
- ▪Dr. Pijuan Yu stated that humanoid robots struggle with fine motor skills because they rely heavily on vision rather than rich tactile sensing.
- ▪Dr. Ericka Greene noted that translating mechanical haptic feedback to the sensation of a hands-on evaluation requires an additional cognitive step for physicians.
Story comments
Loading comments…