Egocentric Motion Tracking for 3D Scene Interactions
2 degrees of interaction in kitchen
- Designed a model pipeline to identify hand-object interactions with varying degrees in a given video stream.
- Explored pseudo-labelling techniques for contact point identification in 3D meshes of objects in an environment.
- Formulated a hybrid model involving semantic segmentation, depth estimation and scene flow tracking in 3D.