SeeFit
SeeFit an application that makes exercise entertaining by providing auditory and visual feebacks based on the user’s body movement.
My Role
Project Leader | UIUX Designer
Woked on research, ideation, prototyping, front-end coding using HTML and CSS,
javascript, video production using After Effects, 3d animation
Team Member
Hyejun Youn, Brian Li, Hannah Han, David Wang
Tools
Figma, Mixamo, Unity p5js, openCV After Effects javascript
![]()
![]()
The project started from my observation during my volunteer, where people with disabilities attend a service center to exercise their bodies. They became more energized and engaged with the exercise as they danced with one another while listening to music. This gave me an inspiration to create a website that teaches users how to exercise, detects their body movements, gives feedback about their movement, and generates sounds corresponding to their movements.
![]()
First, I started researching some of the problems people with disabilities - especially Down Syndrome face - and the reasons that they might attend a service center. Especially in Asian countries, disabled people are not often seen in public, because many of them stay in their homes, suffering from social isolation.Down syndrome (DS) is a risk factor for the development of depression. Biological events that may adversely affect brain developmen social withdrawal and compulsive behavior (routinized behavior) are associated features in depressed adults with Down syndrome.
Both the thyroid and a lower metabolic rate contribute to people with Down syndrome being overweight. This means that children with Down syndrome burn fewer calories overall compared to a typical child and need to need to exercise more to burn off the same number of calories.
A behavioral presentation as a form of communication is particularly salient for individuals with developmental disabilities who are unlikely to express distress verbally or to be able to use abstract thinking skills to connect experiences with thoughts and emotions.
Youth with DS had higher rates of overweight and obesity than youths without DS. Likely determinants of obesity included increased leptin, decreased resting energy expenditure, comorbidities, unfavorable diet, and low physical activity levels.
![]()
Woked on research, ideation, prototyping, front-end coding using HTML and CSS,
javascript, video production using After Effects, 3d animation
Team Member
Hyejun Youn, Brian Li, Hannah Han, David Wang
Tools
Figma, Mixamo, Unity p5js, openCV After Effects javascript
Ideation
The project started from my observation during my volunteer, where people with disabilities attend a service center to exercise their bodies. They became more energized and engaged with the exercise as they danced with one another while listening to music. This gave me an inspiration to create a website that teaches users how to exercise, detects their body movements, gives feedback about their movement, and generates sounds corresponding to their movements.
Research
Both the thyroid and a lower metabolic rate contribute to people with Down syndrome being overweight. This means that children with Down syndrome burn fewer calories overall compared to a typical child and need to need to exercise more to burn off the same number of calories.
A behavioral presentation as a form of communication is particularly salient for individuals with developmental disabilities who are unlikely to express distress verbally or to be able to use abstract thinking skills to connect experiences with thoughts and emotions.
Youth with DS had higher rates of overweight and obesity than youths without DS. Likely determinants of obesity included increased leptin, decreased resting energy expenditure, comorbidities, unfavorable diet, and low physical activity levels.
Design Prototype
Our virtual coach will give feedback based its detection of a user’s body movement. If a user moves correctly, the coach will give positive feedback, so that the user gradually learns the correct movements. SeeFit also makes exercise more entertaining by providing auditory and visual inputs based on the user’s body movement. Ultimately, we want to add a multiplayer section that allows interaction among different users, with the movements of each user generating sound, and the sounds combining to create music.
Development
We built our platform using p5js and an open-source library called Openpose; specifically, we used MLI instead of COCO. We also edited some of the functionality to better fit our purposes. For example, we took out the hand and finger calculations and only focused on the major joints to improve computational speed, since we were mainly focusing on large-scale general body movements during a workout.
![]()
