Adobe's AI tool turns ordinary photos into navigable 3D worlds
What's the story
At its annual Max conference, Adobe has unveiled some mind-boggling experimental features. These include Project Screen Test, which simplifies the creation and use of AI-generated characters for video content. Instead of just text prompts to describe a character's voice and behavior, this tool allows users to interact with the character in an audition-like environment. You can give basic personality traits like "anxious, shy" and even assign a voice by choosing from presets or uploading reference audio.
Character development
Project Screen Test lets you interact with an AI character
The Project Screen Test tool also lets you customize the character's persona by having a conversation with it.
You can define its backstory, temperament, goals, flaws, fears, and movement quirks.
Once satisfied with the character's development, you can generate animated screen tests by describing an environment or scenario for them.
This feature is currently a standalone creative exercise, and it's unclear how it could fit into Adobe's existing AI video tools.
3D exploration
Project Sight Span recontextualizes images into a navigable 3D space
Another innovative tool unveiled at the conference is Project Sight Span. It recontextualizes photos and images into a 3D space that can be explored and navigated.
The 3D space generates elements and backgrounds beyond what was originally captured, but they feel like a natural extension of the image.
The visuals in this environment may be pixelated, but resolution quality is restored when you select your desired angle.
Audio customization
Project Sound Bender offers audio mixing at your fingertips
Adobe also showcased Project Sound Bender, an AI audio mixing tool that lets you customize sound effects as if you're clicking your cursor around a color wheel.
You upload a video clip and describe the desired audio in a text prompt. The tool then generates sound effects and automatically syncs them to the video.
It also provides a square sound canvas for real-time adjustments of noises, making it easier than ever to create unique audio experiences for your videos.
Editing tool
Rinse Repeat copies edits across multiple subjects in a photo
Adobe also introduced Project Rinse Repeat, a tool that lets you copy edits and automatically apply them to other objects or people in the same photo.
For instance, if you've airbrushed out acne or blemishes on one person, Rinse Repeat will adapt those specific changes to anyone else in a group who needs similar touchups.
The edits applied to other subjects remain fully editable as the tool recreates them with native Photoshop tools.