Project hero image

Symbiotic Voxel

Generative AI + Spatial Computing: Symbiotic Voxel

An experimental sandbox investigating spatial AI agency within a 3D environment. Unlike passive chatbots, the resident agent "Loom" perceives spatial context and actively collaborates on design tasks. Built on a custom Unity-to-Python pipeline, the system utilizes a two-stage reasoning architecture to negotiate high-level plans before execution. This project prototypes a future where AI evolves from a tool into a grounded, structural partner. This is my master's graduation project. itch.io: https://lijiayii.itch.io/symbiotic-voxels Github: https://github.com/JiayiLi18/Symbiotic-Voxels-AI

WHAT I DID

  • 01AI Architecture - Designing the Two-Stage Reasoning pipeline and Unity-Python bridge
  • 02Full-Stack Development - Implementing the Voxel engine, agent behaviors, and backend integration
  • 03Interaction Design - Structuring the UX of Negotiation and defining agent personality mechanics

TOOLS & TECH

UnityGenerative AIPythonLLMsAPIsComfyUIRAG
Gallery item 0

Gallery item 1

Built as a solo full-stack project, the architecture focuses on structured agency. I designed a Two-Stage Reasoning system where the LLM outputs high-level plans as structured JSON data before execution. This ensures the AI acts as a reliable collaborator rather than a black box. This approach—prioritizing visible, structured actions over pure text—aligns with the emerging engineering standards for autonomous agents in complex interfaces.

Gallery item 2

Gallery item 3

Project image 2
Project image 3
Project image 4
Project image 5
Project image 6