Automatic image descriptions

BAIA is capable of auto creating image descriptions using the latest vision models. This can speed up enrichment of products and provide value to the experience for people unable to see the image.

Permissions

The access to the automatic image description features is governed by the permissions:

• Manage automatic image descriptions: Allows the user to access and manage the settings.
• Generate image descriptions: Allows the user to generate automatic image descriptions
• Approve and reject generated image description: Allows a user to approve and reject generated image descriptions.This permissions gives view access to ALL images with unapproved descriptions, regardless of folder permissions.

Setting up

The feature needs to be configured before it can be used. This can either be done through the UI or the API. Navigate to settings->automatic image description.

Instruction

Write an instruction to BAIA. It is always possible to go back and modify the prompt if the generated description is not focusing on the right image properties. A template is provided but it should be corrected before auto generating images.

Manual approval

BAIA can either modify the image description directly or save the generated descriptions for manual approval. If manual approval is chosen the generated descriptions will appear in the manual approval menu in the top navigation bar.

When an auto-generated description is approved it will then be saved to the image description

Choosing Model

It is possible to choose between the fast and the precise model. Fast is cheaper and if it creates acceptable results it can be used. The current recommendation is to chose precise.

Languages

These are the languages BAIA will autogenerate descriptions on. The languages that can be chosen are the languages specified under Settings->Content Languages.

Requesting automatic image descriptions

Automatic image descriptions can be requested through the API. See API specification for further details.

Image descriptions can be requested by navigating to the image in the UI and press the wand button.

It is possible to choose between the configured languages and generate the description.

Manual approval

If the manual approval flow was chosen in the settings menu. The generated descriptions will appear in the menu. Manual approval is not necessary when requesting descriptions from the UI.

From here the description can either be approved, edited or deleted.

If the description is approved or edited and saved it will be moved to the image description. Notice this will overwrite any existing description of the image.