AI PlanetX
Posts
Oasis AI Generates Open-World Games

Oasis AI Generates Open-World Games

Runway Introduces Advanced Camera Control

Altiam Kabir
November 04, 2024

In partnership with

Welcome to another edition of AI PlanetX.

Open-world games get a boost with Oasis AI; Runway launches advanced camera control features.

Inside This Edition: 💎

Hottest AI News
Top AI & SaaS Tools
AI Tutorial: Achieving Natural Lip Sync in AI Videos
Top AI & Tech News
Interesting Uses of AI
Top AI Video Tutorial
AI Job List
Complimentary AI Course of the Day

Hottest AI News

Decart

AI Tool Oasis Transforms Images Into Explorable 3D Game Worlds

Decart’s Oasis, the first playable "open-world" AI model, marks a milestone in AI gaming, backed by $21 million in funding. It creates a real-time, Minecraft-like experience, poised to revolutionize the field.

Details:

Oasis uses Minecraft footage to generate real-time frames with physics and graphics on Nvidia H100 GPUs, with plans to optimize for Etched's AI chips
It currently runs at low resolution with layout issues, but Decart aims for future versions to reach 4K quality and add text and audio prompts
Legal challenges may arise over copyright, as there's no proof of Microsoft's approval for using Minecraft footage, raising concerns about unauthorized use

Decart's Oasis highlights the potential and challenges of AI-generated content, with its real-time generation vision poised to transform interactive entertainment, despite technical and legal hurdles.

Learn AI in 5 Minutes a Day

AI Tool Report is one of the fastest-growing and most respected newsletters in the world, with over 550,000 readers from companies like OpenAI, Nvidia, Meta, Microsoft, and more.

Our research team spends hundreds of hours a week summarizing the latest news, and finding you the best opportunities to save time and earn more using AI.

Runway ML

Gen 3 Alpha Turbo Adds Precision Camera Movement Controls

Runway, a New York startup backed by Google and Nvidia, is shaking up the AI video landscape with new camera controls for its Gen-3 Alpha Turbo model.

Details:

Advanced Camera Controls offer precise manipulation of AI-generated scenes, allowing smooth zooming and panning while maintaining visual depth and character integrity without glitches
Runway's features include horizontal movements, speed ramping, and smooth transitions, enabling cinematic-quality content, which is especially beneficial for filmmakers like Lionsgate
This is part of Runway's "world models" initiative, introduced by CTO Anastasis Germanidis in December 2023, aiming to simulate real-world physics and interactions for enhanced capabilities

Runway's latest advancement in AI video generation places them at the forefront of the industry, offering tools that blur the line between traditional and AI filmmaking.

Top AI & SaaS Tools

Video To Blog (Life-time Deal): Transform any YouTube video into a structured article with images and SEO metadata for better search visibility
bolt new: Create and deploy full-stack web applications in real-time without writing any code, all from your browser
KlipLab: AI platform for creating voiceovers and lip-synced videos with celebrity and fictional character voices
Relume: Use AI as a design ally to generate sitemaps and wireframes for marketing websites
Spafe ImGen: Choose from models like DALL-E, DALL-E 2, and Midjourney to create unique visuals from your prompts [F-R-E-E]

AI Tutorial

How to Achieve Natural-Looking Lip Sync in AI Videos

Here's how to get natural, realistic lip sync in AI videos using Kling AI and Runway for a smoother result:

Use Kling to generate a shot of your character performing the emotion you want. Kling’s v1.5 model offers impressive visual fidelity. Once satisfied, press the "Lip Sync" button. Ensure the character’s face is well-lit and consistently on screen to avoid issues with lip sync detection.
When the face is successfully detected, you can either create speech using text and a pre-trained voice or upload your own recording. If your audio clip exceeds 5 seconds, trim it to fit, then click "Lip Sync" and wait for the video to generate.
The video produced by Kling is generally good but may seem choppy due to a lower frame rate. To improve smoothness, use Runway. In Runway, scroll to "Super-Slow Motion" and upload your Kling video. Process it at 0.5x speed to add frames and slow it down.
Next, export the modified clip at the highest resolution and format available, like ProRes at 1080p, making sure to include audio. This step will simplify syncing in your timeline later.
Import the clip into your editor of choice, such as Adobe Premiere Pro. Drag it to the timeline and adjust the speed to 200%. Use the audio waveforms to sync the clip with the original, then delete the sped-up, high-pitched audio.

Top AI & Tech News

Anthropic's Claude 3.5 Sonnet can analyze PDFs and images inside them [Read More]
Perplexity launches an elections tracker [Read More]
AI on your smartphone? Hugging Face’s SmolLM2 brings powerful models to the palm of your hand [Read More]
Apple is buying photo-editing app Pixelmator [Read More]
FlexOS released the top 100 most popular AI tools for work by web traffic [Read More]

Interesting Uses of AI

AI Art Spotlight

Model: Midjourney

Prompt:

A close-up, dynamic shot of a fierce adult leopard in an aggressive stance, with its mouth open wide, baring sharp teeth. The leopard's ears are pinned back, eyes intensely focused forward, and its body is slightly crouched as it lunges forward. Muscles are visible and tense, with the fur rippling from the movement. The lighting is dramatic, casting deep shadows across its spotted fur, while the background is dark and blurred, drawing full attention to the predator's powerful expression and forward motion. --ar 9:16 --quality 2 --stylize 1000 --v 6.1

AI Prompt of the Day

Social Media Posts Framework

This prompt is about crafting a social media post that effectively engages the audience by adhering to the 4 Cs: Clear messaging, Concise wording, Compelling content that captures attention, and Credible information to build trust.