Realwear
Realwear
UI/ UX, AR experience
Role:
Lead Designer
Feature crew: 1 Designer, 1 PM, 1 Eng
Opportunity
Opportunity
I was tasked with designing an MVP AR experience enabling integration with Teams calls for the RealWear lens. This specifically focusing on frontline worker (FLW) scenarios in manufacturing that required a hands-free solution.
The goal was to address critical, real-time challenges by enabling workers to troubleshoot immediate issues efficiently and access assistance without disrupting their workflow. This involved exploring how augmented reality and voice-controlled interactions could enhance productivity, safety, and communication in high-paced, hands-on environments where critical and timely information is needed.
I was tasked with designing an MVP AR experience enabling integration with Teams calls for the RealWear lens. This specifically focusing on frontline worker (FLW) scenarios in manufacturing that required a hands-free solution.
The goal was to address critical, real-time challenges by enabling workers to troubleshoot immediate issues efficiently and access assistance without disrupting their workflow. This involved exploring how augmented reality and voice-controlled interactions could enhance productivity, safety, and communication in high-paced, hands-on environments where critical and timely information is needed.
Final designs
Final designs
Home
Home
Video call
Video call
What is Realwear?
What is Realwear?
Hands- free industrial
wearable device
Hands- free industrial wearable device
Hands- free industrial
wearable device
RealWear is a hands-free, voice-activated wearable device designed for frontline workers in industries like manufacturing and field services. The headset is Zone 1 safety compliant and optimized for video and camera use, It functions as an Android-based tablet, allowing users to access digital workflows, remote assistance, and real-time data while keeping their hands free for tasks.
RealWear is a hands-free, voice-activated wearable device designed for frontline workers in industries like manufacturing and field services. The headset is Zone 1 safety compliant and optimized for video and camera use, It functions as an Android-based tablet, allowing users to access digital workflows, remote assistance, and real-time data while keeping their hands free for tasks.
Goals
Goals
Teams works hands-free on Realwear and allows FLWs
to use video calling
Teams works hands-free on Realwear and allows FLWs to use video calling
Teams works hands-free on Realwear and allows FLWs to use video calling
For v1, validate traction by unblocking
Firstline customers to pilot Realwear
device using Teams
For v1, validate traction by unblocking Firstline customers to pilot Realwear device using Teams
For v1, validate traction by unblocking Firstline customers to pilot Realwear device using Teams
for design
for design
for design
Align to expected patterns in Realwear
Align to expected patterns in Realwear
Address the UX with minimal design investment
Address the UX with minimal design investment
Business approach
Business approach
20+ Firstline customers specifically asking
for Teams; 500k MAU
20+ Firstline customers specifically asking for Teams; 500k MAU
Validate traction of pilot
with high ROI
Validate traction of pilot with high ROI
Validate traction of pilot with high ROI
Based on traction decide
on future investments
Based on traction decide on future investments
Based on traction decide on future investments
10/15 Plan to demo calling experience on RW at Satya PR event
10/15 Plan to demo calling experience
on RW at Satya PR event
Pilots starting in November
thru Q1
Pilots starting in November thru Q1
Pilots starting in November thru Q1
User roles:
Manufacturing FLW
Works in the oil and gas industry and generally out in the field. They are working on machines in potentially hazardous conditions. They need a safe and compliant headset that allows them to communicate hands-free with their team.
Works in the oil and gas industry and generally out in the field. They are working on machines in potentially hazardous conditions. They need a safe and compliant headset that allows them to communicate hands-free with their team.
Remote expert
Works in the oil and gas industry and generally in a building, at headquarters, etc. They are using laptops to communicate and
support the workers who are out in the field. They need to be able
to clearly see the situation on the video when the worker calls, communicate via voice, and send support materials when needed.
Works in the oil and gas industry and generally in
a building, at headquarters, etc. They are using laptops to communicate and support the workers who are out in the field. They need to be able
to clearly see the situation on the video when the worker calls, communicate via voice, and send support materials when needed.
MVP Scenarios
MVP Scenarios
Seamless Setup
and Secure Access
Seamless Setup and Secure Access
Seamless Setup and Secure Access
Receive a device with Teams auto-installed, allowing me to sign in securely using my user ID and password without additional setup.
Receive a device with Teams auto-installed, allowing me to sign in securely using
my user ID and password without additional setup.
Receive a device with Teams auto-installed, allowing me to sign in securely using my user ID and password without additional setup.
Hands-Free Interaction
Hands-Free Interaction
Interact with Teams hands-free using voice commands, enabling me to stay focused while accessing information
or communicating.
Interact with Teams hands-free using voice commands, enabling me to stay focused while accessing information
or communicating.
Remote Expert Consultation
Remote Expert Consultation
Make or receive a 1:1 video call with a remote expert on Teams, regardless of the platform they are using.
Make or receive a 1:1 video call with a remote expert on Teams, regardless of the platform
they are using.
Make or receive a 1:1 video call with a remote expert on Teams, regardless of the platform they are using.
Receiving Shared Content
Receiving Shared Content
Share images or content with me
through Teams, providing visual
guidance to help me resolve issues
efficiently.
Share images or content with me through Teams, providing visual guidance to help me resolve issues efficiently.
Share images or content with me through Teams, providing visual guidance to help me resolve issues efficiently.
Reliable Video Communication
Reliable Video Communication
Depend on Teams video calling to function
smoothly under minimum network conditions.
Depend on Teams video calling to function
smoothly under minimum network conditions.
Goodyear and Realwear
Goodyear and Realwear
“Instead of spending days traveling, I can be online in minutes with a subject matter expert to provide technical support or install a new piece of equipment. Microsoft Teams for RealWear is part of my everyday life to support my projects.”
“Instead of spending days traveling, I can be online in minutes with a subject matter expert to provide technical support or install a new piece of equipment. Microsoft Teams for RealWear is part of my everyday life to support my projects.”
“Instead of spending days traveling, I can be online in minutes with a subject matter expert to provide technical support or install a new piece of equipment. Microsoft Teams for RealWear is part of my everyday life to support my projects.”
- Taylor Davis, Goodyear
Outcome
Outcome
High demand during Covid
In March 2020, shortly after RealWear introduced Teams integration, the company experienced a 35% surge in business due to increased adoption across industrial clients needing remote collaboration tools.
In March 2020, shortly after RealWear introduced Teams integration, the company experienced a 35% surge in business due to increased adoption across industrial clients needing remote collaboration tools.
Tripling growth in adoption
Between October 2020 and October 2021, usage of Teams on RealWear devices grew by 250%, effectively more than tripling the number of frontline worker Teams users—and significantly fueling RealWear’s reported 3× year-over-year revenue growth.
Between October 2020 and October 2021, usage of Teams on RealWear devices grew by 250%, effectively more than tripling the number of frontline worker Teams users—and significantly fueling RealWear’s reported 3× year-over-year revenue growth.
Customer case examples
• Goodyear credits Teams on RealWear as the key driver behind rapid deployment across its plants during the pandemic.
• In Mercedes-Benz deployment, RealWear-enabled Teams use led to an 80% boost in problem-resolution performance, substantial cost savings (~$100k/year), and operational efficiencies across 56 service centers.
• Goodyear credits Teams on RealWear as the key driver behind rapid deployment across its plants during the pandemic.
• In Mercedes-Benz deployment, RealWear-enabled Teams use led to an 80% boost in problem-resolution performance, substantial cost savings (~$100k/year), and operational efficiencies across 56 service centers.