Ford Motor Company is Using a Gamified VR Experience to Demonstrate the New Co-Pilot360™ Safety Technology
Consumers and the press got a chance to experience a VR driving experience in the 2019 Ford Edge and Explorer vehicles. The experience took them from their home to a busy highway and then into the city. This five-minute interactive experience put them in various scenarios where they faced numerous obstacles and hazards to demonstrate the safety technology.
The users attempted to react to the hazards and obstacles with a game controller to see how they compared to the Co-Pilot360 technology. This was achieved by programming eye tracking into the experience to accurately understand the obstacles they noticed versus the ones they missed.
These new DAT (Driver-Assisted Technologies) are becoming an important part of everyday life. This was the first time an automaker demonstrated the technologies in a side-by-side comparison, giving drivers a firsthand experience to test their abilities and compare against a DAT ride-along.
- You will RIDE along and experience how the DAT systems work.
- You will get to REACT and compete against the new technology and test your reaction skills.
- Then, you will get to REVIEW how your reactions compare with the new Ford DAT technology.
The Experience Begins When You Leave Your House
The VR experience begins as you leave your house. Participants are given instructions and a brief overview of their goal – to make it into the city for an important meeting. After hearing the instructions, you must back out of the driveway and avoid any obstacles or distractions in the dark.
Some of the distractions you encounter are an early morning jogger and two deer that cross your path.
Once you leave your neighborhood, you encounter crowded highway traffic. Along the way, you may see a speeding motorcyclist, oversized trucks barreling along the side of you, and a police patrol officer.
The Ford team loved the narrative story, which included a few “Easter Eggs” along the way.
Into the City
After you exit the speeding highway, you enter a congested city street. This puts the DAT systems and your observation skills to work. Here, you encounter a few jump scares, like a texting pedestrian that walks out into your path and a few aggressive drivers. At the end of the drive, you needed to parallel park in front of your destination at Groove Jones Records.
Gamifying the Experience
How did we gamify the experience? This was a first of its kind approach as we wanted to enhance the narrative experience by adding interactive and tracking features. First, we integrated the Oculus Go Controller as part of a tagging system, giving the participants the ability to pull the trigger when they detected any road hazards or obstacles along the ride.
We then qualified the tags by tracking where the user was looking. This allowed the scoring system to ensure that when they tagged the obstacle or hazard, it was actually in their FOV (Field of View).
This included seeing an object in your mirrors or through the rearview camera display. Since the Co-Pilot360 sensors had a much larger range of detecting objects, it was virtually impossible to beat the technology. This is important as we wanted to demonstrate how the DAT system gave you more visibility than a human driver could ever have.
Reviewing and Scoring Your Performance
At the end of the experience, the driver could review their journey and see how they performed. A score was based on the percentage of objects detected. Below is an overview of what they learned during the review portion:
- Participants can see all of the targets that they encountered
- The System displays where they were looking at all times in real time
- They received a breakdown of the DAT systems in use
- Scoring is displayed and indicates whether or not they received a point for tagging the object
Below are some screenshots of the review portion of the experience.
Social Share Scorecard
At the end of the experience, the participants received a 360º panoramic image of the interior of the vehicle they were driving, along with their score. This image could be socially shared on your favorite channels.
Brand ambassadors were given iPads with an App that connected to Oculus Gos. This app was used to collect user registration data and socially share their scores when they were done.
Launch Event @ CES
The VR experience debuted at the 2019 CES (Consumer Electronics Showcase) in Las Vegas. The onsite activation allowed attendees the opportunity to view the Ford Edge and test their abilities. A leaderboard system displayed the daily rankings of user’s scores.
Ford’s Co-Pilot360 Technology
Ford’s Co-Pilot360 safety contains a combination of standard technologies that would otherwise cost extra with purchasing a vehicle from the company’s non-luxury competitors. These features include automatic emergency braking with pedestrian detection, a blind spot monitoring system with rear cross-traffic alert, a lane-keeping assist system, automatic high beams, and a reverse camera. Link to Ford’s Co-Pilot360 site – https://www.ford.com/technology/driver-assist-technology/