Skip to content

Loading search…

vlm

Questions about images to a vision-language model.

  • Layer: base
  • Needs: vlm
  • Requires: –
  • Conflicts with: –
  • Never dropped: no
  • Mixin: skills.vlm:VisionQuestions
  • Manifest: skills/vlm/skill.toml
def query_vlm(images, question)

Ask the vision model a question about one or more RGB arrays.

From the RoboDojo prompt pack (prompts/robodojo/), with every skill and feature on:

query_vlm(rgb_or_list, question) -> str