For the previous five weeks, I have been mainly working on ideation of the project and programming the main system for my capstone project.
I am planning to do a body tracking realtime interactive simulation, so my main goal for this quarter is to get the functionality of pose estimation and tracking consistent and relevant to real life.
I programmed the progress to track the parts of the body that I needed (hand, feet, neck, and spline- root) through camera outside unreal, transferred this data into the engine in realtime, and also blueprinted the code inside unreal to retrieve this tracked data, to make it available to use in further events.
I programmed to track the velocity of each hand, connecting it to material scripts to make it glow responding to the user's velocity.
I am currently in progress of programming a multi player system that allows up to maximum 4 users to track in real time, but if it takes up the frame rate too much, is considering to limit it to two people. Currently the two people tracking is working, and needs more development for consistency of tracking
I also tested out simulations in houdini and converting simulations into material animations for replacing usage of skeletal meshes and animation. This is mainly for optimization for future development progress.
Below is the test demo recorded at week 5, which was recorded before developing the root tracking and multi tracking / Auto detection system.
Comments