The Labeling Interface
An overview of the Labeling Interface for Roboflow's Annotation Tool, including shortcut keys.
Dark Mode is available. Toggle the button in the bottom-right corner to activate/deactivate it.
Annotation UI (Light Mode)
Annotation UI (Dark Mode)
On the right-hand side of the labeling interface, you will find the Toolbar. It contains the following options:
- Drag/Select (represented by a hand icon) allows you to select, edit, and drag individual annotations.
Drag Tool (D) selection
- Single-click an existing bounding box to select it. Once selected, you can change a bounding box's size with the circular white handles that appear on its corners and on each side. Or use the class editor to change the box's label.
- Drag a box to move it.
- Drag the background to pan.
- Click the background to deselect all boxes.
- Bounding Box (represented by a rectangular box icon) allows you to draw new bounding-box annotations. In this mode, you will see crosshairs that will help you determine where to start drawing.
- Click and drag across the image to create a new annotation, then use the Class Selector to choose its label.
Bounding Box Tool (B) selection
- Polygon allows you to draw new polygonal annotations. In this mode, you will see crosshairs that will help you determine where to start drawing.
Polygon Tool (P) selection
- Click on the image around objects of interest to create an enclosed polygon annotation, then use the Class Selector to choose its label.
- Smart Polygon allows you to draw new Smart Polygon annotations. In this mode, you will see a green dot when you are selecting a new area of interest (new label); a red dot when selecting areas to remove from the area of interest (parts of the object or image that you don't want to label/enclose with the polygon); and options to adjust the polygon by Convex Hull, Smooth, and Complex settings. Smart Polygon is particularly useful for (Instance and Semantic) Segmentation projects, however, you may see performance boosts in Object Detection models when labeling with Smart Polygons on Roboflow.Smart Polygon (S) Tool selection
- Comment allows for the addition of Comments to images. Comments and comment history can be added, viewed or resolved in this mode.
- Mark Null (Null annotation) is to be used for the "labeling" of background, or null, images. This setting can also be used to clear all annotations from an image, or to mark the image as Unannotated.
Mark Null (N) Tool selection
- While in Bounding Box (B), Polygon (P), or Smart Polygon (S) mode:
- Undo reverts the previous action.
- Redo reverses a previously undone action.
- Repeat Previous reapplies label(s) on an image in the same location(s) as the last annotated image
When an image is selected, the Class Selector will appear. It contains the following options for choosing the label of a bounding box:
The Class Selector
- Textfield to create a new class or filter existing classes.
- Buttons to save or discard your changes.
- Class List of the existing classes in the dataset (filtered by the text field and with the active option highlighted in purple) and, sometimes, a "Create class" option if the text you typed does not match an existing class.
Zoom Tool found at the bottom left of the screen.
- Zoom in and out to fit more of the image on your screen at one time or to get a closer look for more detailed editing. There is also an option to "lock" the zoom to a specified percentage, or reset the zoom to fit the entirety of the image within the Annotation Tool's viewport.
- Note that if you select the "Zoom Lock" option, all images will appear at this zoom-level. Deselect, or unlock, the lock to remove Zoom Lock.
On the left-hand sidebar you will find the following drawers:
- Annotations (abbreviated Annots) show which classes are present and not present in an image, what color their boxes are, and layering of labels.
Annotations (Annots) Sidebar
- Comments contains comment history (All Comments and Unresolved Comments)
- Tags can be used to help with organizing, filtering or sorting through images in datasets
Tags Sidebar with included tag
- Annotation History allows for one to view the full history or lifecycle of an image after upload to Roboflow. The option to revert labels or annotations on an image to a previous state is also available (Revert to this Version).
Annotation History Sidebar
- Raw Data is mostly used for debugging and can be safely ignored by most users unless our support team requests that you access it. It contains Roboflow internal representation of the image.
Raw Data Sidebar
In the header you will find navigation to exit the labeling interface, move on to the next or previous image in the dataset, and perform the following actions:
- View source image (represented by an eye with a slash through it) temporarily hides the bounding boxes to give you a closer look at the original image.
- Options (represented by an ellipsis or three dots)
- Find Similar Unassigned Images to Label locates images within the Unassigned Annotation batch that look similar to the current image and presents them visually in a search result
Unassigned Images: Similar Image Search Results
- Find Similar Images in Dataset locates images within the Dataset Annotation batch (i.e Approved & Added to Dataset) that look similar to the current image and presents them visually in a search result
Dataset (Labeled and Approved) Images: Similar Image Search Results
- Use as Cover Photo marks the current image as the icon for the dataset on your homepage and uses it as the preview image for preprocessing and augmentation options.
- Remove from Project removes the image from the project after confirmation.
Video walkthrough of hotkeys
The following keyboard shortcuts are available to speed up your labeling flow. The meta key is usually the command key on macOS and the ctrl key on Linux and Windows.
If no annotation is selected, the following keyboard shortcuts apply:
- meta - temporarily switches between the Drag/Select and Bounding Box (B) or Polygon (P) tools while held down. (For example, if you are in Bounding Box mode, hold down the meta key and click an existing bounding box to select it.)
- b - Switches to the Bounding Box tool.
- p - Switches to the Polygon tool.
- d - Switches to the Drag/Select tool.
- n - Switches to the Mark Null tool.
- entering n while annotating an image that is already marked as Null will mark that image as Unannotated if it is currently in the Annotating queue.
- s - switches to the Smart Polygon tool.
- plus - Zooms In.
- minus - Zooms Out.
- zero - Returns to Default Zoom (fits image into the viewport).
- one - Zooms to 100%.
- escape (esc) - Exits the Labeling Tool.
- left arrow - Navigates to the previous image.
- right arrow - Navigates to the next image.
Once an annotation is selected and the Class Selector is visible, the shortcuts are as follows:
- enter - Saves the Active Option (highlighted in purple) as the current class, or label, for the selected bounding box.
- escape (esc) - Cancels and deselects the current box without changing its label (if the currently selected box was just drawn it will be deleted).
- up arrow - Changes the Active Option (class/label) to the previous one.
- down arrow - Changes the Active Option (class/label) to the next one.
- backspace - Deletes the current bounding box if there is no text in the text field (this means you will usually have to push backspace twice to delete a box after selecting it; one time to delete the highlighted text and a second time to confirm deletion).
In Review Mode, the following shortcuts are available:
- a (in Review Mode) Approve annotation or label
- r (in Review Mode) Rejects annotation or label
Preview of Review Mode
Labeling Images with the Roboflow Annotate Smart Polygon Tool
Polygon annotations are critical to prepare datasets for training instance segmentation or semantic segmentation models and can often improve model accuracy when used instead of bounding boxes for object detection models.
Polygons are more precise than bounding boxes but, without the proper tools, take more time to apply labels because adding a detailed bounding takes multiple interactions to label an object. For Roboflow users, that is no longer the case. Polygon labels are now as fast to apply to objects as bounding boxes in many instances.
To use the Smart Polygon feature, click Smart Polygon in the labeling toolbar (Shortcut Key:
Smart Polygon in the Annotation Toolbar
Then click the center of the object you want to label and Smart Polygon will apply an initial label to the object. This will use a machine learning model behind the scenes to suggest a shape for your object. The least amount of vertices required to accurately label your object is best.
Oftentimes the label will be predicted accurately with just a single click and you can move on to the next object by pressing enter, then selecting a class for your object.
Smart Polygons vs. Manual Polygon Annotation
Using the Smart Polygon options on the top-left of the annotation tool, you’re able to choose the number of vertices in your label by toggling between Convex Hull, Smooth, and Complex labels (and can also undo points you've placed if you make a mistake).
Smart Polygon Options (Convex Hull, Smooth, Complex labels)
Smart Polygon is helpful for labeling semantic segmentation data as well. Just be sure to properly order the objects' z-indexes so the masks are properly stacked according to how you would want to train your model. You can visualize the stacking by using the
Layerstab in the sidebar. This will help you understand what your segmentation mask will look like once rasterized.
Layerstab is available on all Roboflow project types. To edit a bounding box without changing the ordering of
Layers, simply click on the Layer/annotation you'd like to edit in the
Layerstab and then make your edits.