Apple unveils AI image tool that lets you make edits by just describing them

The researchers highlighted the model's ability to derive explicit visual-aware intentions, leading to meaningful image enhancements. Apple researchers have introduced an AI model enabling users to write desired changes to a photograph using simple language, eliminating the need for traditional photo editing software. The groundbreaking model, named MGIE (MLLM-Guided Image Editing), is the result of a collaboration between Apple and the University of California, Santa Barbara.

Capable of executing various editing tasks including cropping, resizing, flipping, and applying filters solely through text prompts, MGIE represents a significant advancement in image editing technology. This innovation can handle both straightforward and intricate editing requests, such as altering specific objects within a photo or enhancing brightness levels.

MGIE harnesses the power of multimodal language models, first deciphering user prompts and then generating corresponding edits. For instance, a request for a "bluer sky" translates to adjusting the brightness of the sky portion of an image. This approach ensures precise interpretation and execution of editing instructions.

For example, a prompt to "make it more healthy" when editing an image of a pepperoni pizza results in the addition of vegetable toppings. Similarly, instructing the model to "add more contrast to simulate more light" enhances the brightness of a dark image, such as tigers in the Sahara.