Robotic Photogrammetry System for Syndactyly Surgery

Syndactyly is one of the most common congenital malformations of the hand and it is a result of a failed separation of adjacent digits. For any type of syndactyly, reconstructive surgery would be essential to separate the digital skin, reconstruct the web space between fingers, and cover the web space with dorsal flap for digit separation. However, the shape and size selection of the dorsal flap is still based purely on the surgeon’s clinical judgment and experience. This research aims to build an autonomous solution that extracts geometric features from a dorsal flap to optimize its dimensions and shape using Finite Element Analysis (FEA).

Collaborated with: Hui Shen, Ohio Northern University

You will perform: design, prototyping, FEA, experiment, and/or image processing.

Augmented Reality with AI in Robotics

The research project is centered on developing and evaluating an AR application using HoloLens 2, aiming to provide an enhanced robotics educational experience. This application projects digital coordinate frames onto the links of an actual robotic arm, greatly facilitating the 3D comprehension of Denavit-Hartenberg (D-H) convention, a critical topic in robotics. The objective is to apply the AR headset to detect the links on a robotic arm, affix D-H frames to them, and automatically adjust the frames to the arm’s movements, thereby enhancing student’s spatial understanding.

You will: program AR headsets, perform image processing and computer vision, have a better understanding of D-H parameters in robotics, and conduct experiments.

Upcoming Projects

Visualizing and enhancing surgery outcomes with AI and AR technology.