> For the complete documentation index, see [llms.txt](https://docs.roboflow.com/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.roboflow.com/annotate/annotate-multimodal-data.md). # Annotate Multimodal Data If you are labeling a dataset that is part of a Multimodal project, prefixes are used to annotate your images. A prefix can either be: * An identifier like ``, that is used to prompt a [VLM](https://blog.roboflow.com/what-is-a-vision-language-model/) like Florence-2, or; * A question like "What is in this image?", ideal for use with general VQA models like GPT-4o. For Florence-2 fine-tuning, for example, the prefix chosen will correspond to the prefix prompt you give to the model. For Florence-2, prefixes should be in the format ``, like ``. For GPT-4o, your prefix may be: "What is the total in this receipt?". You may want to add different prefixes different features in an object that we want to identify, like total, subtotal, and tax. ### Add Prefixes To add prefixes, click "Classes & Tags" in the Roboflow sidebar, then click the "Add " button:
Then, enter the prefix. This may be a question like "What is in the image?" or a unique ID like "\", depending on the model you want to train. You can add multiple prefixes with the "+" button. Click “Add Prefixes” to add your prefixes. Once you have set prefixes, they will be available as questions in your annotation editor:
--- # Agent Instructions This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com. ## Querying This Documentation If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question. Perform an HTTP GET request on the current page URL with the `ask` query parameter, and the optional `goal` query parameter: ``` GET https://docs.roboflow.com/annotate/annotate-multimodal-data.md?ask=&goal= ``` `ask` is the immediate question: it should be specific, self-contained, and written in natural language. `goal` is optional and describes the broader end goal you are ultimately trying to accomplish on behalf of the user. GitBook uses it to tailor the answer towards what is most useful for that goal. The response will contain a direct answer to the question and relevant excerpts and sources from the documentation. Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.