SAM3

Meta의 SAM3 모델을 Serverless Hosted API를 통해 사용하세요

우리는 Meta의 Segment Anything Model 3 추론을 Serverless Hosted API를 통해 지원합니다. 두 가지 다른 SAM3 엔드포인트를 제공합니다:

• 프롬프트 가능한 개념 분할 (PCS), 분할은 텍스트 프롬프트를 사용합니다

• 프롬프트 가능한 시각적 분할 (PVS), 대화형 분할은 포인트/박스를 사용합니다

코드 샘플

PCS 코드 샘플

아래는 SAM3 추론을 위해 PCS 엔드포인트를 사용하는 코드 샘플입니다. 사용자는 Roboflow의 API 키 를 통해 전달해야 합니다 API_KEY 환경 변수.

import os
import requests
import base64
import cv2
import numpy as np

# "https://media.roboflow.com/notebooks/examples/dog.jpeg"에서
image = cv2.imread("./dog.jpeg")

# 이미지를 base64로 인코딩
_, buffer = cv2.imencode('.jpg', image)
image_base64 = base64.b64encode(buffer).decode('utf-8')

payload = {
    "image": { "type": "base64", "value": image_base64 },
    "prompts": [
        { "type": "text", "text": "person" },
        { "type": "text", "text": "dog" },
    ],
    "output_prob_thresh": 0.5,
    "format": "polygon",
}

url = "https://serverless.roboflow.com/sam3/concept_segment?api_key=" + os.getenv("API_KEY")
response = requests.post(url, json=payload)
data = response.json()

for key in dat
    print(key) # 프롬프트 결과와 시간이어야 함

PVS 코드 샘플

참조 Github Gist OpenCV를 사용한 대화형 데모로, 이 비디오에서 사용되었습니다:

엔드포인트

SAM3 PCS (promptable concept segmentation)

post

Concept Segmentation (Text Prompts)

Allows you to segment objects using text prompts.

Image Input: The image field accepts either:

• {"type": "url", "value": "<IMAGE_URL>"} - A publicly accessible image URL

• {"type": "base64", "value": "<BASE64_DATA>"} - Base64 encoded image data

Prompts: Each prompt in the prompts array should have type: "text" and a text field with the object description.

Query parameters

api_keystringRequired

Your Roboflow API Key. Get one at https://app.roboflow.com/settings/api

Body

application/json

formatstringOptional

One of 'polygon', 'rle'

Default: polygon

image_idstringOptional

Optional ID for caching embeddings.

output_prob_threshnumberOptional

Score threshold for outputs.

Default: 0.5

model_idstringOptional

The model ID of SAM3. Use 'sam3/sam3_final' to target the generic base model.

Default: sam3/sam3_final

nms_iou_thresholdnumberOptional

IoU threshold for cross-prompt NMS. If not set, NMS is disabled. Must be in [0.0, 1.0] when set.

Responses

200

Successful Response

application/json

timenumberRequired

The time in seconds it took to produce the segmentation including preprocessing

422

Validation Error

application/json

post

/sam3/concept_segment

HTTPcURLJavaScriptPython

POST /sam3/concept_segment?api_key=text HTTP/1.1
Host: serverless.roboflow.com
Content-Type: application/json
Accept: */*
Content-Length: 206

{
  "image": {
    "type": "url",
    "value": "https://media.roboflow.com/notebooks/examples/dog.jpeg"
  },
  "prompts": [
    {
      "type": "text",
      "text": "person"
    },
    {
      "type": "text",
      "text": "car"
    }
  ],
  "output_prob_thresh": 0.5,
  "format": "polygon"
}

{
  "prompt_results": [
    {
      "prompt_index": 0,
      "echo": {
        "prompt_index": 0,
        "type": "text",
        "text": "dog",
        "num_boxes": 0
      },
      "predictions": [
        {
          "masks": [
            [
              [
                345,
                251
              ],
              [
                344,
                252
              ],
              [
                343,
                253
              ]
            ]
          ],
          "confidence": 0.89453125,
          "format": "polygon"
        }
      ]
    }
  ],
  "time": 0.221
}

SAM3 PVS (promptable visual segmentation)

post

Interactive Segmentation (SAM 2 Style)

SAM 3 also supports interactive segmentation using points and boxes.

Image Input: The image field accepts either:

• {"type": "url", "value": "<IMAGE_URL>"} - A publicly accessible image URL

• {"type": "base64", "value": "<BASE64_DATA>"} - Base64 encoded image data

Note: NumPy arrays are NOT supported on the serverless API. Use URL or base64 encoding only.

Prompts: Support point-based prompts with positive/negative clicks for interactive segmentation.

Query parameters

api_keystringRequired

Your Roboflow API Key. Get one at https://app.roboflow.com/settings/api

Body

application/json

SAM2 visual segmentation request.

image_idstringOptional

The ID of the image to be segmented used to retrieve cached embeddings. If an embedding is cached, it will be used instead of generating a new embedding. If no embedding is cached, a new embedding will be generated and cached.

Example: image_id

formatstringOptional

The format of the response. Must be one of 'json', 'rle', or 'binary'. If binary, masks are returned as binary numpy arrays. If json, masks are converted to polygons. If rle, masks are converted to RLE format.

Default: jsonExample: json

sam2_version_idstringOptional

The version ID of SAM to be used for this request. Must be one of hiera_tiny, hiera_small, hiera_large, hiera_b_plus

Default: hiera_largeExample: hiera_large

multimask_outputbooleanOptional

If true, the model will return three masks. For ambiguous input prompts (such as a single click), this will often produce better masks than a single prediction.

Default: trueExample: true

save_logits_to_cachebooleanOptional

If True, saves the low-resolution logits to the cache for potential future use.

Default: false

load_logits_from_cachebooleanOptional

If True, attempts to load previously cached low-resolution logits for the given image and prompt set.

Default: false

Responses

200

Successful Response

application/json

timenumberRequired

The time in seconds it took to produce the segmentation including preprocessing

422

Validation Error

application/json

post

/sam3/visual_segment

HTTPcURLJavaScriptPython

POST /sam3/visual_segment?api_key=text HTTP/1.1
Host: serverless.roboflow.com
Content-Type: application/json
Accept: */*
Content-Length: 294

{
  "image": {
    "type": "url",
    "value": "http://www.example-image-url.com"
  },
  "image_id": "image_id",
  "prompts": [
    {
      "prompts": [
        {
          "points": [
            {
              "positive": true,
              "x": 100,
              "y": 100
            }
          ]
        }
      ]
    }
  ],
  "format": "json",
  "sam2_version_id": "hiera_large",
  "multimask_output": true,
  "save_logits_to_cache": false,
  "load_logits_from_cache": false
}

{
  "prompt_results": [
    {
      "prompt_index": 1,
      "predictions": []
    }
  ],
  "time": 1
}