Can AI agents build
AR and VR apps?

Yes, if the agent has live XR APIs, validation, and a renderer it can run. The ViroReact MCP server gives Claude, Cursor, Codex, and Windsurf the real component catalogue, then lets the agent validate and test scenes, including in a recorded room. A free Studio plan is enough to authenticate.

Create a free Studio account
https://mcp.reactvision.xyz/viro

Agent-first, not docs pasted into a prompt

Most XR tooling assumes a human in a visual editor, so agents are left guessing from stale training data. ReactVision treats the agent as a first-class builder: the MCP server hands it the same live APIs, component schemas, and infrastructure a human developer uses, plus the tools to check its own work.

What the agent knows

The full ViroReact component catalogue with prop schemas and event handlers, working scene examples, current release notes, and the live platform matrix across iOS, Android, Meta Quest, and visionOS.

What the agent can do

Validate scenes against the real APIs, execute them in a real renderer and read back the frames, diagnose errors and crash logs, check 3D models against performance budgets, diff renders, and convert scenes between Studio and TSX.

The closed loop: build, validate, test

Writing XR code is the easy part. Knowing whether it renders is the hard part, and it is the part agents normally cannot do. These three steps all run through the MCP server.

01

Build

The agent writes ViroReact against the current component catalogue, prop schemas, real scene examples, and the live platform matrix, so it knows what runs where before it commits to an approach.

A Claude Code session grounding itself with the ViroReact MCP server, calling tools to confirm component props before writing code.
Build: the agent grounds itself in the real API before it writes.
02

Validate

Structural scene checks catch a misspelled prop or a component that does not exist immediately. Performance budget checks flag 3D models too heavy for the target headset, and crash logs come back explained.

A render report listing eight ViroReact scenes with rendered results, engine warnings, render times, and frame sizes.
Validate: every scene run, with the warnings that came back.
03

Test

The agent runs the scene in a real renderer and gets the frames back: it taps objects, waits for animations, and compares two renders to see what changed. Record a room once and it can test in that space.

Two phones side by side: one recording a real room, the other running an AR bowling scene the agent tested in that recorded space.
Test: record a room once, then let the agent test in it.

Two agent surfaces, one stack

There are two ways to put an AI agent to work on XR here. Both build against the same renderer, the same Platform, and the same scene format.

MCP server, in your IDE or terminal

For engineering teams. Your own coding agent works inside your repo with full ViroReact context and validation tools. Add the server URL, authenticate with a free Studio account, and keep your existing prompts and review habits.

Studio Agent, in the browser

For designers and mixed teams. Describe the experience and the agent builds scenes, generates and places 3D assets, and wires up physics, animation, and triggers inside ReactVision Studio, with drag-and-drop editing alongside.

The ViroReact MCP server is listed in the Claude Connectors Directory. Setup for every agent is in the docs. Agent-written scenes still ship like any ViroReact app: a development build rather than Expo Go, and a physical device for on-device AR testing.

What each part of ReactVision does

ViroReact

The open-source native XR renderer. One TypeScript API mapped onto ARKit, ARCore, and OpenXR. MIT licensed, free forever.

Studio

The browser-based visual editor and CMS for XR scenes. Free to sign up.

Platform

Managed Cloud Anchors, Geospatial Anchors, asset hosting, and Environment Testing, accessed with an rvApiKey and rvProjectId.

MCP server

How coding agents use the stack: live ViroReact knowledge plus tools to validate, run, and test scenes.

ViroReact is MIT licensed and free forever. Studio and Platform are managed products: Cloud Anchors, Geospatial Anchors, asset hosting, Environment Testing, and the MCP server. iOS (ARKit), Android (ARCore), and Meta Quest (OpenXR) are supported today. visionOS is in internal preview. Android XR is coming.

Proof it ships

~10,000

npm installs of ViroReact per month

140,000+

npm installs in 2025

3 platforms

iOS, Android, and Meta Quest supported today

Shipped on ViroReact: Looking Glass (geospatial AR heritage storytelling), Pikd (brand AR for Red Bull and Burger King), InkStory (AR image recognition, built solo). The ViroReact MCP server is listed in the Claude Connectors Directory.

Common questions

Can AI agents build AR and VR apps?
Yes, if the agent has live XR APIs, validation, and a renderer it can run. The ViroReact MCP server gives Claude, Cursor, Codex, and Windsurf the real ViroReact component catalogue, then lets the agent validate scenes structurally, run them in a real renderer, and test them in a recorded room. Without that loop, agents generate plausible XR code they can never check.
Why is an MCP server better than pasting docs into the chat?
Pasted docs go stale and cannot act. The MCP server is a live connection: the agent queries the current component catalogue, prop schemas, and platform matrix at the moment it writes, and it can call tools to validate, execute, and compare the scenes it produces. Knowledge plus a feedback loop, instead of a snapshot.
Which coding agents work with the ViroReact MCP server?
Any agent that speaks the Model Context Protocol, including Claude, Claude Code, Codex, Cursor, and Windsurf. The server is also listed in the Claude Connectors Directory, so Claude users can add it in a couple of clicks.
What does it cost to connect an agent?
A free ReactVision Studio plan is enough to authenticate. Add https://mcp.reactvision.xyz/viro as an MCP server in your agent, sign in with the Studio account, and you are connected. Usage draws on Studio AI credits, and paid plans get higher limits.
Should I use the Studio Agent or the MCP server?
The Studio Agent lives in the browser: describe an experience and it builds scenes, generates assets, and wires interactions inside ReactVision Studio, no code. The MCP server lives in your IDE or terminal: it makes your own coding agent fluent in ViroReact inside your repo. Same stack underneath; pick the surface that matches how you build.
Can the agent actually see whether its scene renders?
Yes. Through the MCP server the agent executes a scene in a real renderer and receives the frames that appeared on screen. It can tap objects, wait for animations, capture results, and diff two renders. With Environment Testing it can run scenes against a recording of a real room, so spatial behaviour is tested without a device in hand.

Want a worked example? Read how a geospatial AR app was built with Claude Code and ViroReact.

Related comparisons and guides

Put your agent to work on XR

Add the ViroReact MCP server to the coding agent you already use, authenticate with a free Studio account, and tell it what to build.

Create a free Studio account