February 25, 2024

Apple is dabbling in AI image-editing with an open-source multimodal AI model.

Earlier this week, researchers from Apple and the University of California, Santa Barbara released MLLM-Guided Image Editing, or “MGIE;” a multimodal AI model that can edit images like Photoshop, based on simple text commands.

On the AI development front, Apple has been characteristically cautious about its plans. It was also one of the few companies that didn’t announce any big AI plans in the wake of last year’s ChatGPT hype. However, Apple reportedly has an in-house version of a ChatGPT-esque chatbot dubbed “Apple GPT” and Tim Cook said Apple will be making some major AI announcements later this year.

Whether this announcement includes an AI image editing tool remains to be seen, but based on this model, Apple is definitely doing some research and development.

While there are already AI image editing tools out there, “human instructions are sometimes too brief for current methods to capture and follow,” said the research paper. This often leads to lackluster or failed results. MGIE is a different approach that uses MLLMs, or multimodal large language models, to understand the text prompts or “expressive instruction,” as well as image training data. Effectively, learning from MLLMs helps MGIE understand natural language commands without the need for heavy description.

In examples from the research, MGIE can take an input image of a pepperoni pizza and using the prompt, “make this more healthy” infer that “this” is referring to the pepperoni pizza and “more healthy” can be interpreted as adding vegetables. Thus, the output image is a pepperoni pizza with some green vegetables scattered on top.

In another example comparing MGIE to other models, the input image is a forested shoreline and a tranquil body of water. With the prompt “add lightning and make the water reflect the lightning,” other models omit the lightning reflection, but MGIE successfully captures it.

MGIE is available as an open-source model on GitHub and as a demo version hosted on Hugging Face.

Source link

Leave a Reply

Your email address will not be published. Required fields are marked *

Batman138 Bro138 Dolar138 Gas138 Gudang138 Hoki99 Ligaciputra Panen77 Zeus138 Kilat77 Planet88 Gaspol168 Sikat88 Rupiah138 Garuda138 Gacor77 Roma77 Sensa138 Panen138 Slot138 Gaco88 Elanggame Candy99 Cair77 Max7 Best188 Space77 Sky77 Luxury777 Maxwin138 Bosswin168 Cocol88 Slot5000 Babe138 Luxury138 Jet77 Bonanza138 Bos88 Aquaslot Taktik88 Lord88 Indobet Slot69 Paus138 Tiktok88 Panengg Bingo4d Stars77 77dragon Warung168 Receh88 Online138 Tambang88 Asia77 Klik4d Bdslot88 Gajah138 Bigwin138 Markas138 Yuk69 Emas168 Key4d Harta138  Gopek178 Imbaslot Imbajp Deluna4d Luxury333 Pentaslot Luxury111 Cair77 Gboslot Pandora188 Olxtoto Slotvip Eslot Kuy138 Imbagacor Bimabet