Apple's Latest AI Tool Can Animate an Image Based on Your Description

Apple has made another addition to its growing AI repertoire with the creation of a tool that leverages large language models (LLMs) to animate static images based on a user's text prompts.

apple AI research dall e

MacRumors image made with DALL·E

Apple describes the innovation in a new research paper titled "Keyframer: Empowering Animation Design Using Large Language Models."

"While one-shot prompting interfaces are common in commercial text-to-image systems like Dall·E and Midjourney, we argue that animations require a more complex set of user considerations, such as timing and coordination, that are difficult to fully specify in a single prompt—thus, alternative approaches that enable users to iteratively construct and refine generated designs may be needed especially for animations.

"We combined emerging design principles for language-based prompting of design artifacts with code-generation capabilities of LLMs to build a new AI-powered animation tool called Keyframer. With Keyframer, users can create animated illustrations from static 2D images via natural language prompting. Using GPT-4 3, Keyframer generates CSS animation code to animate an input Scalable Vector Graphic (SVG)."

To create an animation, the user uploads an SVG image – of a space rocket, say – then types in a prompt like "generate three designs where the sky fades into different colors and the stars twinkle." Keyframer then generates CSS code for the animation, and the user can then refine it by editing the code directly or by entering additional text prompts.

"Keyframer enabled users to iteratively refine their designs through sequential prompting, rather than having to consider their entire design upfront," explain the authors. "Through this work, we hope to inspire future animation design tools that combine the powerful generative capabilities of LLMs to expedite design prototyping with dynamic editors that enable creators to maintain creative control."

According to the paper, the research was informed by interviews with professional animation designers and engineers. "I think this was much faster than a lot of things I've done," said one of the study participants quoted in the paper. "I think doing something like this before would have just taken hours to do."

ai model animates images 1
The innovation is just the latest in a series of AI breakthroughs by Apple. Last week, Apple researchers released an AI model that harnesses the power of multimodal LLMs to perform pixel-level edits on images.

In late December, Apple also revealed that it had made strides in deploying LLMs on iPhones and other Apple devices with limited memory by inventing an innovative flash memory utilization technique.

Both The Information and analyst Jeff Pu have said that Apple will have some kind of generative AI feature available on the ‌iPhone‌ and iPad later in the year, when iOS 18 is released. The next version of Apple's mobile software is said to include an enhanced version of Siri with ChatGPT-like generative AI functionality, and has the potential to be the "biggest" update in the ‌iPhone‌'s history, according to Bloomberg reporter Mark Gurman.

(Via VentureBeat.)

Popular Stories

iPhone 16 Pro Sizes Feature

iPhone 16 Series Is Just Two Months Away: Everything We Know

Monday July 15, 2024 4:44 am PDT by
Apple typically releases its new iPhone series around mid-September, which means we are about two months out from the launch of the iPhone 16. Like the iPhone 15 series, this year's lineup is expected to stick with four models – iPhone 16, iPhone 16 Plus, iPhone 16 Pro, and iPhone 16 Pro Max – although there are plenty of design differences and new features to take into account. To bring ...
maxresdefault

Apple's AirPods Pro 2 vs. Samsung's Galaxy Buds3 Pro

Saturday July 13, 2024 8:00 am PDT by
Samsung this week introduced its latest earbuds, the Galaxy Buds3 Pro, which look quite a bit like Apple's AirPods Pro 2. Given the similarities, we thought we'd compare Samsung's new earbuds to the AirPods Pro. Subscribe to the MacRumors YouTube channel for more videos. Design wise, you could potentially mistake Samsung's Galaxy Buds3 Pro for the AirPods Pro. The Buds3 Pro have the same...
Beyond iPhone 13 Better Blue Face ID Single Camera Hole

10 Reasons to Wait for Next Year's iPhone 17

Monday July 8, 2024 5:00 am PDT by
Apple's iPhone development roadmap runs several years into the future and the company is continually working with suppliers on several successive iPhone models simultaneously, which is why we sometimes get rumored feature leaks so far ahead of launch. The iPhone 17 series is no different – already we have some idea of what to expect from Apple's 2025 smartphone lineup. If you plan to skip...
macbook pro january

Best Buy's Black Friday in July Sale Takes Up to $700 Off M3 MacBook Pro for Members

Monday July 15, 2024 11:05 am PDT by
Best Buy's "Black Friday in July" sale is in full swing today, and in addition to a few iPad Air discounts we shared earlier, there are also some steep markdowns on the M3 MacBook Pro. You will need a My Best Buy Plus or Total membership in order to get some of these deals. Note: MacRumors is an affiliate partner with Best Buy. When you click a link and make a purchase, we may receive a small...
Generic iOS 18 Feature Real Mock

Apple Seeds Revised Third Betas of iOS 18 and iPadOS 18 to Developers

Monday July 15, 2024 10:09 am PDT by
Apple today seeded updated third betas iOS 18 and iPadOS 18 to developers for testing purposes, with the software coming a week after Apple initially released the third betas. Registered developers are able to opt into the betas by opening up the Settings app, going to the Software Update section, tapping on the "Beta Updates" option, and toggling on the ‌iOS 18/iPadOS 18‌ Developer Beta ...
ipaos 18 image playground

Apple Releases First iOS 18 and iPadOS 18 Public Betas

Monday July 15, 2024 1:16 pm PDT by
Apple today provided the first betas of iOS 18 and iPadOS 18 to public beta testers, bringing the new software to the general public for the first time since the Worldwide Developers Conference in June. Apple has seeded three developer betas so far, and the first public beta includes the same content that's in the third developer beta. Subscribe to the MacRumors YouTube channel for more videos. ...

Top Rated Comments

jayryco Avatar
22 weeks ago
I think it's cool but the implications of these tools on the creative industry will be devastating once brands and corporations find the feasibility of an AI far cheaper than creative professionals. Especially in the next 5-10 years.
Score: 19 Votes (Like | Disagree)
purplerainpurplerain Avatar
22 weeks ago

I think it's cool but the implications of these tools on the creative industry will be devastating once brands and corporations find the feasibility of an AI far cheaper than creative professionals. Especially in the next 5-10 years.
Incorrect and badly ignorant. Don’t listen to stupid Wall Street AI bros.

Companies employ people to use the tools. They can’t just have some executive sitting there asking AI. The executives and managers have other things to do.

Companies require their creative departments to use the tools.

The tools like this are very imperfect and unpredictable. They always will be. You cannot replace all traditional workflows with ‘talk to AI’. That can only happen if you want everything to be really sht.

The output of AI tools is combined with other materials that are all made normally. The creative professionals do this.
Score: 16 Votes (Like | Disagree)
swiftapplefan Avatar
22 weeks ago
That’s actually really cool, can’t wait to see how they’ll implement it in their products.
Score: 10 Votes (Like | Disagree)
victorvictoria Avatar
22 weeks ago
I have seen the future, and am happy I won't be around to witness it.
Score: 8 Votes (Like | Disagree)
Wanted797 Avatar
22 weeks ago

I think it's cool but the implications of these tools on the creative industry will be devastating once brands and corporations find the feasibility of an AI far cheaper than creative professionals. Especially in the next 5-10 years.
AI won’t take our jobs. People who know how to use AI will.
Score: 7 Votes (Like | Disagree)
HeinoM Avatar
22 weeks ago

I think it's cool but the implications of these tools on the creative industry will be devastating once brands and corporations find the feasibility of an AI far cheaper than creative professionals. Especially in the next 5-10 years.
I had the exact same thought, only I fear it may happen even sooner than that. Major publications are already laying off writers in droves as they transition to AI generated content. Creative careers of all types are going to be devastated.
Score: 6 Votes (Like | Disagree)