All research

3D Scene Flow for Mesh-Subject Correspondence Tracking

Tracking 3D objects onto moving 2D subjects via scene flow and feature correspondence.

Dec 2021 Computer Vision
PresentationPDF
Projecting an Iron Man helmet onto a subject's face.
Projecting an Iron Man helmet onto a subject's face.

An algorithm that projects and tracks a 3D mesh onto a moving subject using scene flow and pose correspondence.

  • Implemented an algorithm to track 3D objects on 2D subjects using 3D scene flow and feature correspondence.
  • Used the OpenPose framework for human-pose estimation to extract skeleton feature points.
  • Employed homography transformations with 3D-mesh correspondence methods like 3D point-regression models.
BackAll research