Change the mode to "Create box".
To draw a box, click 2 points.
If necessary, click 4 points for xmin, xmax, ymin, and ymax of the object.
Press enter key to finish drawing when the number of points is less than 4.
When you finished drawing, the label dialog would open, and the label would be added to the label table.
Drag the center of the box to move the box.
Drag one of the four corner points to transform the box.
If necessary, show edit points between box corners.
Drag on the box pressing the option key, the box size is scaled up/down from the center.
Drag a box pressing the command key, you can select multiple boxes.
When you select multiple boxes and right click on them, you can merge boxes.
To change the box color, use the color picker at the top-right corner.
To change the cross hairs color, deselect all boxes and change the default color.
You can hide the cross hairs.
You can show labels on boxes.
Change the mode to "Create polygon", "Create cubic bezier", "Create line", or "Create point".
Click to add points.
Press enter key to finish drawing.
Press escape key to cancel drawing.
When you right click on the point, edit menu would open.
"Add a point forward/backward" to add a point.
You can add a new point to the polygon/cubic bezier/line, clicking a point along the shape.
"Delete this point" to delete the point.
"Set to the first point" to set the point to the first point for DOTA text format.
"Point size up/down" to change the size of points.
When you right click on the label, edit menu would open.
"Convert to polygon" to change to polygon.
"Convert to cubic bezier" to change to cubic bezier.
"Convert to rotated box" to change to rotated box.
When you select multiple polygons and right click on them, you can merge polygons.
To separate the merged polygon to multiple polygons, right click on the merged polygon.
Change the mode to "Create polygon using SAM".
Select a Segment Anything model among "MobileSAM", "ViT-Large SAM", and "ViT-Huge SAM".
After downloading the model, the preprocessing for the image begins. Because of CPU mode, it takes 2 seconds for "MobileSAM", 30 seconds for "ViT-Large SAM", and 60 seconds for "ViT-Huge SAM" on the Apple M1 device.
Downloaded models are saved in the folder "~/Library/Containers/RectLabel/Data/models".
Click to add foreground points.
Click to add background points.
Pressing the option key, you can switch the foreground mode and background mode.
Press enter key to finish labeling.
Press escape key to cancel labeling.
Change the mode to "Create keypoints".
Click to add points.
Click holding option + command button, the point is added as not labeled.
Click holding option button, the point is added as labeled but not visible.
Press enter key to finish drawing.
Press escape key to cancel drawing.
To add an edge, drag from one to another point holding option button.
Drag an point pressing the shift key, the line angle between the point and the neighbor point is locked during the transformation.
When you right click on the point, edit menu would open.
"Change keypoint name" to change the keypoint name.
You can hide keypoints names.
"Change keypoint color" to change the keypoint color and the edge color is defined by the source point color.
"Make not labeled" to make the point not labeled
"Make labeled but not visible" to make the point as labeled but not visible.
"Delete edge" to delete the edge with the point.
If you put empty string to the keypoint name, the keypoint name is hidden.
When you right click on the label, edit menu would open.
"Clear bounding box" to clear the current bounding box.
To show and edit the bounding box, show boxes on keypoints.
"Flip horizontally" to flip the "left" included keypoint position and the "right" included keypoint position.
"Make visible" to make the point visible.
Keypoints names and edges are saved in the settings file.
For the first keypoints object, you have to press enter key to finish drawing, change keypoints names, and add edges.
From the second keypoints object, if currently selected object or lastly selected object has keypoints names and edges, the label dialog would appear without pressing the enter key and keypoints names and edges are automatically shown.
You can label pixels using brushes and superpixels.
You can change the brush size using command + option + mouse wheel up/down.
Brush size 1 means 1px in the image.
Erase is used to erase pixels.
When sidecar, double tap on Apple Pencil toggles the pixels erase checkbox.
Polygon is used to label pixels using the polygon tool.
Right clicking on the pixels, "Convert to polygon", "Flood Fill", "Clear pixels", and "Import pixels" menus appear.
You can drag & drop grayscale mask images to the labels table.
You can drag & drop the COCO RLE JSON file of the SA-1B dataset to the labels table to import mask annotations.
Changing to the Move mode, you can click to select each pixels object on the image.
Changing to the Create box mode, dragging a box, you can select multiple pixels objects.
You can hide pixels.
You can show other pixels.
The pixels file is saved as {image_file_name}_pixels{pixels_idx}.png in the annotations folder.
Click or drag on the superpixels.
Superpixel size is used to adjust the segmentation size.
Superpixel smoothness is used to adjust the segmentation smoothness.
On the pixels panel, right or left arrow key changes the superpixel size by 1px.
You can hide superpixels.
If the superpixels are not shown, reselect the label on the label table.
You can label the whole image without drawing boxes.
To train an image classifier model, export images for classification.
Change the mode to "Move".
To switch between Create and Move mode, hold space key when Create mode.
Drag the box or the image to move the position.
You can use mouse wheel to move the image position.
You can select multiple boxes and move them.
When you click on the box or the label, four corner points would appear.
Drag one of the four corner points to transform the box.
When you right click on the box or the label, edit menu would open.
"Focus" to quick zoom to the selected box, "Edit" to open the label dialog, "Duplicate" to duplicate the box, and "Delete" to delete the box.
When you double click on the box or the label, the label dialog would open.
To change the layer order, drag the label up/down on the label table.
Change the mode to "Rotate".
Drag up/down on the box to rotate the box.
You can select multiple boxes and rotate them.
You can rotate the image and annotation to the right/left by 90 degrees.
You can select multiple boxes and delete them.
Change the layer order of the box.
For creating polygon mode, toggling the erase mode, the "Erase polygon" panel is shown, and you can use the polygon tool for erasing multiple points of the selected polygon.
"Erase points" erases polygon points inside the drawn dashed area.
"Erase mask" erases polygon points in the same way as pixels mask.
For creating pixels mode, toggling the erase mode, you can erase pixels using brushes and the polygon tool.
Change the image brightness and contrast for dark images.
Change the object color using the color picker.
Clear the object color to the default color.
You can search object, attribute, and image names in a gallery view.
To show all images again, clear search images.
You can use Wildcard(*), AND(&), OR(|), NOT(!), and more in the search text.
To search unlabeled images, use empty search text.
Clear searching and show all images.
Replace labels using regular expressions.
You can undo/redo actions.
You can select multiple boxes and cut/copy/paste them on another image.
