Live ML anywhere
Built-in fast ML inference and processing accelerated even on common hardware
Build once, deploy anywhere
Unified solution works across Android, iOS, desktop/cloud, web and IoT
Free and open source
Framework and solutions both under Apache 2.0, fully extensible and customizable
Explore what is possible with MediaPipe today:
1- Human Pose Detection and Tracking High-fidelity human body pose tracking, inferring minimum of 25 2D upper-body landmarks from RGB video frames
2- Face Mesh 468 face landmarks in 3D with multi-face support
3- Hand Tracking 21 landmarks in 3D with multi-hand support, based on high-performance palm detection and hand landmark model
4- Holistic Tracking Simultaneous and semantically consistent tracking of 33 pose, 21 per-hand, and 468 facial landmarks
5- Hair Segmentation Super realistic real-time hair recoloring
6- Object Detection and Tracking Detection and tracking of objects in video in a single pipeline
7- Face Detection Ultra lightweight face detector with 6 landmarks and multi-face support
8- Iris Tracking and Depth Estimation Accurate human iris tracking and metric depth estimation without a specialized hardware. Tracks iris, pupil and the eye contour landmarks.
9- 3D Object Detection Detection and 3D pose estimation of everyday objects like shoes and chairs
For more info go to MediaPipe website.
Ideas for the projects can be found here.
MediaPipe 2021 Projects
Arabic Sign Language RecognitionPeople with special-needs face a variety of different challenges and barriers that isolate them from their surroundings. Nowadays, several assistive...
Build an open-source realtime web video effects appMediaPipe fills the gap of handling the implementation of models for different systems and allows the developers to focus more on experimentation...
Efficient Realistic Image ManipulationIn our work, we aim to research, implement and integrate a method that is capable of real-time manipulation of faces on mobile devices like changing...
Inference Latency Estimator with Ensemble of Regression ModelsBuild a offline TFLite GPU inference latency estimator with ensemble of regression models
MediaPipe Cross-Platform SolutionCreating a new cross-platform solution API from an open-sourced ML model so that developers can use the API to integrate an off-the-shelf MediaPipe...
MediaPipe Holistic in UnityIn this project, I will be building a unity plugin that runs the MediaPipe Holistic model to do animation of a rigged 3D model as shown on this link....