My very first Flutter AR app used the Google pose detector library to track points on an image or video. I’m really excited for this as I can see all kinds of uses for this library in the future. This started as a Udemy course that built the pose detector app which uses the phone camera to recognize a person’s motion.
It could also detect when a rep of a specific exercise is completed. It also can provide feedback on form. When I went to capture the video below, for some reason, it stopped the counting rep functionality. I was using my Pixel 8 Pro phone on Android for testing. The next step is to rebuild this in Unreal with support for both VR and AR.
I’ll post updates in the future as I continue to develop this app in Unreal.