For the complete documentation index, see llms.txt. This page is also available as Markdown.

Cosmos 3

Reason about physical scenes with NVIDIA Cosmos 3.

This workflow block runs the NVIDIA Cosmos 3 reasoner - a world model tuned for physical scene understanding - on an image with an optional text prompt, and returns a text answer. The model is well suited to questions about spatial relations, safety, and what will happen next in a scene.

Type identifier

Use the following identifier in step "type" field: roboflow_core/cosmos3_edge@v1 to add the block as a step in your workflow.

Properties

Name

Type

Description

Refs

name

str

Enter a unique identifier for this step..

prompt

str

Optional text prompt to pass to Cosmos 3 Edge. Otherwise a default scene-description prompt is used, which may affect the desired model behavior..

model_version

str

The Cosmos 3 Edge model to be used for inference..

system_prompt

str

Optional system prompt to provide additional context to Cosmos 3 Edge..

The Refs column marks possibility to parametrise the property with dynamic values available in workflow runtime. See Bindings for more info.

Runtime compatibility

hard - runtime self_hosted_cpu; execution local : Requires a GPU; run_locally() loads a model that needs CUDA.

Input and Output Bindings

The available connections depend on its binding kinds. Check what binding kinds Cosmos 3 in version v1 has.

Input and output bindings
  • input

    • images (image): The image to infer on..

    • prompt (string): Optional text prompt to pass to Cosmos 3 Edge. Otherwise a default scene-description prompt is used, which may affect the desired model behavior..

    • model_version (roboflow_model_id): The Cosmos 3 Edge model to be used for inference..

    • system_prompt (string): Optional system prompt to provide additional context to Cosmos 3 Edge..

  • output

Example JSON definition

Last updated

Was this helpful?