# Describe Surroundings

> >-

- **Type:** Skill
- **Install:** `agentstack add skill-sumitaich1998-jarvisvr-describe-surroundings`
- **Verified:** Yes — security-reviewed for prompt injection and unsafe behavior
- **Seller:** [sumitaich1998](https://agentstack.voostack.com/s/sumitaich1998)
- **Installs:** 0
- **Category:** [AI & ML](https://agentstack.voostack.com/c/ai-and-ml)
- **Latest version:** 0.1.0
- **License:** MIT
- **Upstream author:** [sumitaich1998](https://github.com/sumitaich1998)
- **Source:** https://github.com/sumitaich1998/jarvisvr/tree/main/skills/perception/describe-surroundings

## Install

```sh
agentstack add skill-sumitaich1998-jarvisvr-describe-surroundings
```

Requires the [AgentStack CLI](https://agentstack.voostack.com/docs/cli). Works with Claude Code, Cursor, and any MCP-compatible agent.

## About

# Describe Surroundings

Give a concise, useful overview of what Jarvis currently sees and pin labels on
the most relevant few objects (the backend caps annotations at ~3 so the view
stays readable).

## Steps

1. **Ensure a fresh frame.** If vision is active the buffer already has one; for a
   cold start request `perception.request{stream:"vision", action:"once",
   reason:"user asked to describe the room"}`.
2. **Call `describe_view`.** Returns `data.speech`, `data.objects` (top labels),
   and an `observation{text, annotations}` plus up to three `vision_annotation`
   directives. It also records what it saw to episodic memory (so
   `locate-remembered-object` can recall it later).
3. **Narrate** the scene with `agent.observation`; render the labels.
4. **Optionally open `show_vision_feed`** ("show me what you see") so the user can
   confirm the camera view with detection overlays.

## Output

`agent.observation` with spatial annotations:

```json
{ "text": "I can see a coffee mug, a laptop, and a notebook on your desk.",
  "final": true,
  "annotations": [
    { "label": "coffee mug", "position": [0.3,0.8,0.7], "anchor": "world" },
    { "label": "laptop", "position": [0.0,0.78,0.65], "anchor": "world" },
    { "label": "notebook", "position": [-0.25,0.79,0.7], "anchor": "world" }
  ] }
```

Each annotation is realized as a `vision_annotation` `holo.spawn`
(`annotate_object`). Optional feed (`show_vision_feed` → `vision_feed`):

```json
{ "widget_type": "vision_feed",
  "props": { "title": "What Jarvis sees", "source": "rgb_center", "show_detections": true, "fps": 2.0 } }
```

## Edge cases

- **Empty / featureless view** → "It's pretty bare from here — I mostly see a wall
  and the floor."
- **Too cluttered** → describe categories ("a desk covered in cables and a few
  mugs") rather than enumerating everything; cap labels at ~3.
- **Specific subset asked** ("just the desk") → describe only objects near the
  named surface from `client.scene.surfaces`.
- **Single object focus** → use `identify-object` instead.
- **Privacy/battery** → stop a `once` stream when finished; honor `perception.state`
  thermal/battery hints by lowering fps.

## Source & license

This open-source skill is cataloged on AgentStack and links to its original source — we do not rehost the code.

- **Author:** [sumitaich1998](https://github.com/sumitaich1998)
- **Source:** [sumitaich1998/jarvisvr](https://github.com/sumitaich1998/jarvisvr)
- **License:** MIT

Install and usage instructions live in the source repository linked above.

## Pricing

- **Free** — Free

## Security capabilities

Automated source analysis of v0.1.0 — what this tool can access:

- **Network access:** no
- **Filesystem access:** no
- **Shell / process execution:** no
- **Environment & secrets:** no
- **Dynamic code execution:** no

*"Yes" means the capability is present in the source — more access means more to trust, not that it is unsafe.*


## Versions

- **0.1.0** — security scan: passed — Imported from the upstream source.

## Links

- Listing page: https://agentstack.voostack.com/l/skill-sumitaich1998-jarvisvr-describe-surroundings
- Seller: https://agentstack.voostack.com/s/sumitaich1998
- Browse the marketplace: https://agentstack.voostack.com/browse

---
Listed on AgentStack — the marketplace for AI agent skills and MCP servers. Every listing is security-reviewed. Creators keep 70%.