What Is Spatial Computing?

Spatial computing is an emerging technology that brings together digital and physical worlds, allowing users to interact with computers in seamless and immersive ways. Learn more about this exciting field and how to get started if you're interested in a spatial computing career.

What is spatial computing?

Spatial computing combines several different technologies—such as machine learning, haptic feedback, and the Internet of Things (IoT)—to read the physical world and integrate digital information into it, ultimately combining the two. These experiences can be completely immersive or can add digital elements to the real world.

There are many devices, such as Apple Vision Pro, that employ spatial computing, but far beyond personal uses, the field is poised to affect several industries because of its high-impact technologies. For instance, spatial computing can be used to model an immersive end result before time and materials are spent producing it.

Spatial computing also collects data, which machines can use to then optimize and automate human processes. For example, imagine a “smart building” with cameras and sensors that track how people move, from a conference room to offices to lobbies to the cafeteria, and so forth. The system then analyzes the data and signals the building’s controls to adjust lighting and temperature in unoccupied spaces to save energy.  

What are examples of spatial computing?

Spatial computing is an umbrella term that encompasses technological experiences like virtual reality (VR) and augmented reality (AR), as well as related concepts mixed reality and extended reality. 

• Virtual reality (VR): A fully immersive visual environment that blocks the view of real environments and replaces it with a virtual one.

• Augmented reality (VR): Digital content is transposed onto the real world while still allowing visibility of the real-world environment.

• Mixed reality (MR): Digital content is transposed onto a view of the real world while allowing the elements to interact with one another.

• Extended reality (XR): An umbrella term that includes VR, AR, and MR.

Read more: Virtual Reality (VR) Terms: A to Z Glossary

How does spatial computing work?

The technology behind spatial computing that enables it to blend the digital and physical world is fascinating. Explore some of the specific technologies behind it: 

• Computer vision: When software can understand the content of an image (what it would mean to a human) instead of just reading an image’s pixels 

• Sensor fusion: When a machine combines sensory data from multiple sensors, like cameras or GPS  

• Spatial mapping: When a machine creates a 3D map of an area using data captured by cameras or sensors

• Haptic feedback systems: When a device communicates with humans with a tactile experience, such as a phone vibrating when a call comes through

• Machine learning (ML): When a system gathers and analyzes spatial data to find patterns and automate processes  

• Edge computing: When data is processed physically close to where it’s being used—the “edge” of a network—rather than sending data to a central data processing center 

• Robotics: When robots use spatial data to move around and perform tasks, and even enhance remote work with “surrogate” robots 

• Internet of Things (IoT): When a network of physical devices uses spatial data to understand a physical environment and enhance humans’ experiences

Read more: What Is a Digital Twin? Definition, Types, and Uses

VR headsets

A common way to experience what spatial computing offers is to use a VR headset. A headset is a piece of hardware that slips over your eyes and is held in place by a band or straps around the back of your head. It then projects a virtual view. Your view changes as motion sensors detect where you’re looking when you move your head or change directions. Headsets may feature eye tracking, hand-gesture recognition, and voice recognition capabilities to make your experience as natural and intuitive as possible. 

Some of the headsets offered by major brands include:

• Apple Vision Pro: A spatial operating system device that you can navigate using your hands, eyes, and voice to enjoy entertainment, apps, games, photos, videos, video conversations, and more.   

• Microsoft HoloLens: A holographic device for use in the workplace that helps enterprise-level organizations collaborate, featuring hand-tracking, voice commands, eye-tracking, and spatial mapping.

• Meta Quest Pro: An MR headset connecting teams, individuals, creators, and loved ones, and enabling an immersive experience in gaming, entertainment, the workplace, and more. 

• Magic Leap: An AR device for the workplace that enables a remote AR collaboration experience, including remote assistance and lifesize overlay, for enterprise-level organizations. 

What can you do in spatial computing?

As human-computer interaction becomes more widespread, it can enhance our lives in a variety of ways, making our hobbies, passions, educational experiences, and jobs more immersive. Explore the range of possibilities:

Navigation

Take the fastest, most direct route to your destination using location-based service apps like Waze or Google Maps. These apps determine your location and provide relevant information, such as nearby gas stations, restaurants, and traffic congestion. 

Stargazing

Download a stargazing app like SkySafari or Night Sky and point your phone at a segment of the sky to learn more about stars and constellations. 

Virtual home design

Use a 3D home designer app like Homestyler to envision the look and layout of your interior space before you make changes. 

Gaming

Immerse yourself in 3D environments and experience gaming worlds as though you are actually in them. Manipulate virtual objects and move about in these worlds with the use of voice commands, motion sensors, and haptic feedback. 

Health and fitness

Enhance physical performance by tracking your movements and analyzing them for ways you can improve your athletic activity. 

Virtual shopping 

“Try on” clothing virtually or see how products might look in your environment before you buy them. 

Spectator sports

Watch your favorite sports team virtually from a specific vantage point, such as the 50-yard line of a football game or courtside at a basketball game.

Education

Explore concepts, subjects, and skills in immersive environments with 3D models, simulations, and virtual “group” activities. 

Industrial factory settings 

Digitize physical space to analyze workers’ movement patterns, interactions with machines, and how long they spend on individual tasks. Then use this information to optimize their processes. 

Health care 

Improve the safety and accuracy of surgical procedures, train medical students, consult with patients, and conduct clinical trials.

Architecture and design

Create immersive design models that allow clients and stakeholders to understand a proposed design better before making decisions. 

Data science

Collect data that has a geographical or spatial component and use approaches from data science, computer science, statistics, machine learning, automation, and artificial intelligence to solve complex spatial problems. 

How to get into spatial computing

With all the possibilities that spatial computing enables, becoming more involved in this field—for fun or to launch a career—can offer many rewards, from finding job opportunities to exploring your passions in ways you’ve only imagined. Explore these actionable steps you can take to get started in spatial computing: 

1. Experience spatial computing as a user.

Have fun with this first step as you gain insights into what this technology is capable of. While some of the headsets, glasses, and wearable sensors might be expensive to purchase, you may be able to find ways to access these devices for free or low cost:

• AR and VR experiences at art galleries or tech events 

• AR and VR product demos in stores 

• Apps on your smartphone like Google AR and VR

• MR community networking events 

2. Take spatial computing courses and boot camps.

To deepen your spatial computing knowledge for both personal and professional purposes, watch online training, such as Apple’s video series on spatial computing or XR Bootcamp’s beginner, intermediate, and advanced classes in AR, VR, and MR. 

Also consider courses in skills related to spatial computing, such as:

• Programming languages: Python, C++, and Java

• 3D creation tools: Unreal Engine, Unity, ARCore, ARKit, and WebXR

• Design tools: 3D modeling/design, animation, sound design, wireframing 

• Data analysis and machine learning: TensorFlow, scikit-learn, PyTorch

To thrive in spatial computing, you’ll also need workplace skills like communication, collaboration, and creativity, as well as technical skills from other fields like project management. 

3. Research jobs in spatial computing.

Start exploring career possibilities by seeing what roles companies are hiring for. Given that spatial technology is an emerging field, job titles may vary from one company or industry to the next, so read job listings carefully for mentions of “spatial technology, ” even if the titles themselves don’t mention it. You can consider jobs like spatial computing prototyper, spatial information technology specialist, and spatial solutions architect.

Spatial computing prototyper

Average salary in the US (Glassdoor): $69,264 [2]

Job outlook (projected growth from 2022 to 2032): 16 percent [3]

As a spatial computing prototyper, you will collaborate with artists and engineers to create new user experiences, drawing upon skills in Python, C++, VR/AR, game design, 3D design, and a relevant degree. In this role, you will experiment with spatial computing to design experiences for users to interact with. 

Spatial information technology specialist

Average salary in the US (Glassdoor): $81,413 [4]

Job outlook (projected growth from 2022 to 2032): 16 percent [3]

As a spatial information technology specialist, you will develop spatial computing applications, drawing upon skills in C++ and other programming languages. You can also specialize in geospatial technology or research. 

Spatial solutions architect

Average salary in the US (Glassdoor): $123,294 [5]

Job outlook (projected growth from 2022 to 2032): 4 percent [6]

As a spatial solutions architect, you will advise on AR/VR strategy, build architectures and prototypes, and deliver workshops, drawing upon skills in 3D development, immersive applications, and large-scale computing. In this role, you will organize and coordinate the work of varied departments to create spatial or geospatial software. 

4. Earn credentials. 

To land a job in spatial computing, you may need specific credentials or education that demonstrate your expertise in this field. Universities are beginning to offer degrees in spatial computing, spatial data science, and spatial information science, as well as spatial computing coursework as part of degree programs in broader subject areas. Depending on your goals, you can also consider getting a degree in one of these areas:

• Human computer interaction

• Product design

• Visual design

• Game design

• Film

• Computer science

If you already have a degree and want to add a credential in spatial computing (or a related area) to your resume, consider a Professional Certificate or certification, like the Certified Augmented Reality (AR) Expert™ Certification

What’s the future of spatial computing?

This field is growing! According to Grandview Research, the global spatial computing market reached $102.5 billion in 2022 and is expected to grow at a compounded annual growth rate of 20.4 percent year over year until 2030 [7]. As the technology expands, be on the lookout for how AR, VR, and MR become more mainstream and accessible to everyone, from developers, engineers, and early adopters to hobbyists and creators. 

Explore spacial computing with Coursera

Whether you're interested in a human computer interaction career or want to learn more about this exciting technology, you have a lot of options on how to get started. Consider online learning experiences on Coursera to stay at the forefront of emerging technologies and envision a future with them. Explore these options: