Module 2 of 2 in visionOS: Beyond the Basics Learning Path

RealityKit & Reality Composer Pro

Mar 27 2024, Swift 5.10, visionOS 1.1, Xcode 15.3
Leave a rating/review

Learn how to create augmented reality experiences using Reality Composer Pro with RealityKit and USDz. Create 3D scenes employing models, animations, and interactions using RealityKit. Also learn how to use both RealityKit and Reality Composer Pro to create AR experiences to be added to visionOS apps. By Tim Mitra.

Start learning for free
 
EXPERIENCE
Intermediate level
EST TIME TO COMPLETE
1 hr, 11 mins
CONTENT
4 lessons
Share
Save for later

Module outcomes

  • Create simple 3D Scenes with models, shaders, animations, and interactions using RealityKit
  • Use RealityKit Attachments to create info boxes for 3D models
  • Add SwiftUI Views inside RealityKit
  • Use Reality Composer Pro to create AR experiences
  • Implement AR experiences in their own visionOS apps
  • Applying materials to 3D models in Reality Composer Pro and command line tools
  • Using ShaderGraphs on 3D Models
  • Using Collisions and Physics Body on 3D models
  • Creating custom materials and shaders
  • Using particle emitters
  • Using spatial audio
  • Using Image-based lighting & grounding shadows
  • Understand MaterialX

Covered concepts

  • Creating 3D models, animations, and interactions using RealityKit
  • Using Reality Composer Pro to create AR experiences without coding
  • Implementing AR experiences in visionOS apps

Module content

1
Introduction to RealityKit Lesson (22 mins)

RealityKit is a high-performance 3D renderer and simulator of AR/VR experiences for visionOS and iOS. This lesson introduces the core functionality of the Entity Component System that underlies RealityKit. You’ll learn how to use RealityKit with SwiftUI in a mixed mode Immersive View.

 Start
Introduction • Start Reading · 1 min
Instruction Reading · 4 mins
Demo Video · 17 mins
Conclusion Reading · 1 min
Quiz: Introduction to RealityKit 5 questions
2
Creating 3D Models & Animations in RealityKit Lesson (17 mins)

Building on lesson 1, we’ll refine the game and dig deeper into Components, interactions, materials creation and application.

 Start
Introduction • Start Reading · 1 min
Instruction Reading · 7 mins
Demo Video · 9 mins
Conclusion Reading · 1 min
Quiz: Creating 3D Models & Animations in RealityKit 5 questions
3
Creating Interactions in RealityKit & Reality Composer Pro Lesson (18 mins)

Building on the app started in the previous lessons, we’ll cover more on Entities, Components and Materials, in both code and with Reality Composer Pro. Basic Shaders will be covered in Reality composer.

 Start
Introduction • Start Reading · 1 min
Instruction Reading · 7 mins
Demo Video · 10 mins
Conclusion Reading · 1 min
Quiz: Creating Interactions in RealityKit & Reality Composer Pro 5 questions
4
Using Reality Composer Pro to Create AR Experiences Lesson (15 mins)

Building on the app started in the previous lessons, we’ll look at tools in RCP to add Particle and spatial audio. ShaderGraph will also be employed to create custom materials.

 Start
Introduction • Start Reading · 1 min
Instruction Reading · 3 mins
Demo Video · 10 mins
Conclusion Reading · 1 min
Quiz: Using Reality Composer Pro to Create AR Experiences 4 questions