AI-Powered Motion Capture and CG Character Animation Platform to Replace Actors in my Videos Automatically.

Create a platform that replaces actors in live-action footage with CG characters. The system should automate body motion capture, facial animation, and scene integration using open-source or one-time purchase software (no subscriptions).

Key Requirements:

1. Motion Capture from Video:

Track actor body movements and facial expressions from video using tools like OpenPose, Plask, or DeepMotion (no subscriptions).

2. Facial Expression Capture:

Automate facial animation using DeepFaceLab or Animaze (FaceRig) for real-time facial tracking.

3. Seamless CG Character Integration:

Use Blender (free) for animation, rigging, and rendering of CG characters. The system must apply motion capture data without manual intervention.

4. No Expensive Subscriptions:

The platform should use free or one-time purchase tools like Blender, OpenPose, Plask, DeepMotion, and MakeHuman (no ongoing subscriptions).

5. User-Friendly Interface:

Provide a drag-and-drop interface where users can upload videos, select CG characters, and replace actors automatically.

6. Real-Time Rendering:

Support real-time or near real-time rendering using Blender or NVIDIA Omniverse (free for individuals).

7. Must work fast on server and on Windows 10 and higher computers. Must be able to save all work as an MP4 and highest quality for YouTube video upload.

8. I have my own CG Character. I don't need any CG Characters made. This program must work perfectly with my CG Characters and any new CG Characters I have made for me.

Tech Stack:

• Blender, MakeHuman, OpenPose, Plask, DeepMotion, DeepFaceLab, Animaze (FaceRig), NVIDIA Omniverse.

Deliverables:

1. A platform capable of replacing live-action actors with CG characters.

2. Automated workflows for motion capture and facial animation.

3. A user-friendly interface for non-technical users.

Ideal Freelancer:

• Expertise in AI, machine learning, and motion capture.

• Experience with Blender and CG animation.

• Familiarity with open-source tools like OpenPose and DeepFaceLab.

What 5 software skills must the freelancer have

For this project, the freelancer should have the following five essential software skills: Blender, AI/Computer Vision, Python Programming, Facial Animation Tools, Real-Time Rendering.

Blender (3D Animation and Rendering):

Expertise in using Blender for modeling, rigging, animating, and rendering CG characters. This is crucial for integrating motion capture data and ensuring seamless character replacement.

AI/Computer Vision (OpenPose, DeepMotion, or Plask):

Proficiency in using AI-based motion capture tools like OpenPose, Plask, or DeepMotion to track actor body movements and facial expressions from video.

Python Programming:

Strong skills in Python for scripting and automating workflows, especially for integrating motion capture data with Blender, as well as managing various APIs and open-source tools.

Facial Animation Tools (DeepFaceLab or Animaze):

Experience with facial animation tools like DeepFaceLab or Animaze (FaceRig) for capturing and applying facial expressions to CG characters.

Real-Time Rendering (NVIDIA Omniverse or Blender Eevee):

Proficiency in real-time rendering engines like NVIDIA Omniverse or Blender Eevee to ensure seamless integration of CG characters into live-action footage.

These skills will ensure that the you can handle the entire scope of the project, from motion capture and facial animation to rendering and automation.

This project does not have a specified deadline; however, I am looking for a developer or team who can commence work promptly and proceed efficiently without sacrificing quality.

Everything must work perfectly per all my instructions including my video instructions and instructions I will give in our online meetings.

You must sign my MNDA before I can share any samples of exactly what I need made.

I will own the copyright to all the images, graphics, files, programs, source code, coding, animations, text, lists, menu's, files, rendered files, AI access, native files, and source files.

The Interactive 3D Graphic must also be saved as an HTML file, so I can load it to my server for the users to look at and try the graphics.

I will own the copyrights to the native files, source files, rendered files, source code, Graphics, and completed files.

You will send me all the full Graphics, source code, native files, and source files when completed.

I will release the full milestone when the work is fully completed, tested, and accepted by me.

I do not pay any milestones until the work is fully completed, all files delivered, tested, and accepted by me.

If your work is High Quality and exactly what I need I would be interested in considering you for Future projects.

I don't communicate on Sundays and I don't expect you to work on Sundays.

Blender Computer Vision Python Facial Recognition AI Rendering

ID projekta: #38632643

Več o projektu