ScribbleSpace: Apple Vision Pro Drawing App – Case Study

Project Overview

ScribbleSpace is a fun and intuitive drawing app for Apple Vision Pro.

It lets users draw, sketch, doodle, and create art on a large, responsive floating canvas that appears in their real-world environment. Using natural hand gestures and finger movements, no controllers needed. Users can comfortably draw as if they had a giant digital sketchbook floating in front of them.

This was my second Vision Pro app.

Why I Built an Apple Vision Pro Drawing App

I built ScribbleSpace to turn a familiar drawing experience into a spatial one. A floating canvas gives users more room to sketch, doodle, write, and experiment while staying connected to their real-world environment.

The Problem

Early Vision Pro apps for creativity were often limited or felt more like productivity tools than fun creative experiences. Traditional drawing apps on flat screens don’t take advantage of the spatial nature of mixed reality. I wanted to build something more enjoyable and interactive than my previous sticky notes app (StickOns).

The Apple Vision Pro Drawing App Solution

ScribbleSpace gives users a large floating canvas they can position anywhere in their space. With simple finger gestures, users can draw, write, erase, and create art naturally, making the experience feel closer to real drawing while leveraging the immersive capabilities of visionOS..

My Role & Process

I built ScribbleSpace entirely by myself as a solo developer. This was my second visionOS project and my first time using PencilKit on Vision Pro.

The main focus was creating a delightful, responsive drawing experience that felt natural in spatial computing. I spent significant time refining how the canvas behaves, how hand tracking interacts with it, and how to make drawing feel smooth and enjoyable for longer sessions.

Challenges

This project came with several new technical and design challenges:

  • First time integrating PencilKit with visionOS and adapting it for a spatial floating canvas.
  • Ensuring the floating canvas remains stable and responsive while users move their head and hands.

Key Features

  • Large floating canvas that users can position in their environment
  • Natural finger and hand gesture drawing (no controllers needed)
  • Smooth, responsive PencilKit integration
  • Colorful brush tools and easy erase functionality
  • Comfortable spatial drawing experience

Technologies Used

  • SwiftUI
  • PencilKit
  • visionOS SDK
  • Hand tracking & spatial anchoring

Outcome & Learnings

ScribbleSpace was a fun and important step in my visionOS learning journey. Moving from StickOns (sticky notes) to a full drawing experience on a floating canvas helped me better understand how to create engaging creative tools in spatial computing.

The project taught me a lot about adapting familiar 2D tools (like PencilKit) into spatial environments, the importance of comfort in mixed reality, and how small interaction details can make or break the user experience.

It reinforced my belief that the best spatial apps often take real-world activities and make them more immersive and delightful without overcomplicating them.

Try ScribbleSpace

ScribbleSpace is available for Apple Vision Pro.