10 Top AI Entertainment Companies

Artificial intelligence (AI) is fast evolving to meet the needs of the entertainment industry. Creative pros in entertainment are using AI for a range of uses, from creating visual effects to speeding up production times and opening up foreign-language markets. Here, we look at some of the top AI companies serving the entertainment sector:

Table of Contents

• 1. MARZ
• 2. DeepDub
• 3. Wonder Dynamics
• 4. Metaphysic
• 5. Respeecher
• 6. Flawless AI
• 7. Electric Sheep
• 8. Runway
• 9. Beeble
• 10. Deep Voodoo

1. MARZ

MARZ provides visual effects for television productions, having provided work for shows, such as Marvel’s “WandaVision” and HBO’s “The Umbrella Academy.” The company says it has TV-specific workflows designed for speed and volume to meet television production schedules and aims to provide effects fitting television budgets. It uses GPU rendering in producing its effects.

2. DeepDub

DeepDub uses generative AI to provide dubbing and voice-over narration. It can dub a film from one language to another using text-to-speech technology, enhanced by human experts who make sure the dubbing sounds natural to the target country. It can also add subtitles to video. The company says it cuts the cost of dubbing by up to half and can reduce turnaround time by as much as 70%.

3. Wonder Dynamics

Wonder Dynamics makes an AI tool that can track an actor’s performance, from body motion to facial expressions, and then inserts a computer-generated character on to the performance. It automates the animation process, eliminating the need for time-consuming frame-by-frame work. The company says its tool is simpler than traditional motion capture and designed to fit in with existing software.

4. Metaphysic

Metaphysic uses AI to create realistic content. It uses a machine learning (ML) framework designed to provide realism and control. It allows for precise adjustments to facial performances, including modulating emotions and manipulating dialogue. It incorporates voice likeness translation and can generate 3D objects and scenes.

5. Respeecher

Respeecher uses AI voice cloning technology to provide films and television shows with voices they might not have access to. It can recreate the voices of deceased actors or clone the voice of a voice-over actor when they’re not available for production. It can enhance the vocal performance of non-actors, retain the youthful voices of cartoon characters even as the actors age and create background voices. The company says it gets permission from actors in order to follow legal and ethical standards.

6. Flawless AI

Flawless AI provides tools that help the process of filmmaking. One allows film editors to adjust performances and dialogue without having to reshoot a scene, speeding up production and lowering costs. Another provides visual dubbing into other languages, altering lip movements to match the speech actor’s words to avoid bad lip-syncing. The company says its technology complies with standards by the actors union SAG-AFTRA.

7. Electric Sheep

Electric Sheep speeds up the creation of visual effects by automating rotoscoping, the process by which live-action sequences are traced over frame by frame. The software can tackle tasks that are usually complex, such as hair detail, occlusion and motion blur. The company says the software can reduce the cost of rotoscoping by up to 70%. It says it helps artists spend more time on the creative part of the work, instead of getting tied down by mundane tasks.

8. Runway

Runway allows producers to create visual effects, such as generating animals, hair, fur and landscapes. It can capture frames from video and use the still images to generate effects. It can interpolate frames to turn images into video and generate images from text. The company also has a production and entertainment arm called Runway Studios.

9. Beeble

Beeble helps film editors realistically insert actors into different environments using green screens, by giving them a way to adjust the lighting on the actor to match the scene. Their AI generates a series of passes for a video, such as depth, roughness and albedo, with each pass describing how light interacts with a surface. This allows it to replicate real-world lighting. The company says its software can be used by people with no knowledge of physically based rendering.

10. Deep Voodoo

Deep Voodoo uses deepfake technology to swap out faces in videos. After the company won $20,000 in funding from Connect Ventures, it planned to use the money to develop visual effects services that are faster and less expensive than traditional VFX technology. Billy Joel took advantage of the company’s technology to release a new music video showing him singing a song with different looks from throughout his career.