frankmocap

We have hosted the application frankmocap in order to run this application in our online workstations with Wine or directly.

Quick description about frankmocap:

FrankMocap is a monocular 3D human capture system that estimates body, hand, and optionally face pose from a single RGB image or video. It regresses parametric human models (e.g., SMPL/SMPL-X) directly, producing temporally stable meshes and joint angles suitable for animation or analytics. The pipeline couples a robust 2D keypoint detector with 3D mesh regression networks and priors that keep results anatomically plausible. It can run frame-by-frame or with temporal smoothing, and includes demo apps for live webcam capture as well as batch processing. Outputs include textured meshes, joint locations, and model parameters that can be exported to common DCC tools and game engines. The codebase offers pretrained models, clear inference scripts, and utilities to visualize results, making single-camera motion capture approachable on commodity hardware. Researchers and creators use it for motion studies, AR/VR prototyping, character animation, and human-in-the-loop editing.

Features:

• Single-view 3D body and hand reconstruction using SMPL/SMPL-X
• Image and Video inference with optional temporal smoothing
• Pretrained checkpoints and ready-to-run demo applications
• Export of meshes, joints, and parameters for DCC and engine workflows
• Utilities for visualization, rendering, and result inspection
• Works on commodity hardware with straightforward setup

Programming Language: Python.
Categories: