Sitecore and Augmented Reality: Connecting the Offline and Online Customer Experience

Brimit developed a virtual try-on for headwear and similar accessories which is based on Sitecore and uses AI-powered computer vision technology.

The solution features a smooth transition from offline to online user behavior, which helps to automate marketing and increase the sales of both online and brick-and-mortar shops.

Set up:

• A TV screen or a touch screen
• An HD webcam
• A computer connected to the internet
• A gesture-tracking device

The solution enables apparel retailers with online and brick-and-mortar stores to apply multiple scenarios for engaging customers and increasing sales. A few of them are listed below.

The solution enables apparel retailers with online and brick-and-mortar stores to apply multiple scenarios for engaging customers and increasing sales. A few of them are listed below.

Scenario #1. Engaging customers offline, retargeting them online

• A mall visitor tries on a few pairs of sunglasses.
• A new session is created together with an anonymous contact in Sitecore.
• The app collects analytics data and attaches it to the Sitecore contact.
  It stores the actual models of sunglasses the visitor tried on, records how much time the user tried on each model, as well as some other data.
• The app offers to add the model to a cart with a discount.
• The visitor scans a QR code with their smartphone camera and is directed to an e-commerce website.
  The URL where the user lands is unique and loads all the analytics data from the Sitecore contact profile.
• In order to complete the order or save their choice for later, the visitor needs to sign up.
• When a Sitecore profile is created, offline and online contact behavior profiles are merged by Sitecore for cross-channel insights and future optimizations.

Scenario #2. Adding AR experience to Sitecore commerce

A virtual try-on is integrated into an online store and adds the benefits of a real try-on to online shopping. The user can make sure a piece of headwear fits their body and head type, hairstyle, and matches their clothes.

Scenario #3. Engaging customers offline, increasing brick-and-mortar store traffic

• A mall visitor tries on a few pairs of sunglasses.
• A new session is created together with an anonymous contact in Sitecore.
• The app collects analytics data and attaches it to the Sitecore contact.
• The app collects analytics data and attaches it to the Sitecore contact.
  It stores the actual models of sunglasses the visitor tried on, records how much time the user tried on each model, as well as some other data.
• The app offers the shopper a discount and to pick up the model at a store nearby.
• The visitor scans the QR code with their smartphone camera and is directed to a web page where they receive a unique order number and instructions for where to go. The contact profile is synced with a custom entity in CRM or integrated into POS software.
  Brimit’s Experience Add-in can be opened to show the Sitecore contact profile.
• The visitor tells the order number to a store associate. The associate can see the model ordered as well as the other accessories the visitor tried on.

The store associate browses through a custom CRM dashboard displaying the visitor’s profile and the model ordered. Brimit’s Experience Add-in integrated with CRM can be opened to get additional contact insights.

Banuba Augmented Reality SDK

Banuba is a groundbreaking start-up specializing in computer vision and shaping a future beyond cameras. Their innovative Face AR platform creates immersive augmented reality web and cross-platform mobile apps. Banuba's Face AR SDK combines Face Filters, AR Beauty and Avatar components to enable real-time 3D masks, face animation and virtual try ons experiences on mobile, web and in-store. Banuba Web SDK is connected to our Sitecore commerce website, loads 3D models of sunglasses from it, and creates a virtual scene out of a live camera stream. The SDK includes face-tracking technology, image segmentation (animated subtracted backgrounds), a rendering engine for realistic effects, a default beautification filter, sound effects, and a scripting engine, as well as background segmentation.

Sitecore Message Bus

Sitecore Experience Platform contains a built-in Message Bus technology, a hidden gem. The Message Bus is a message transport mechanism that allows Sitecore application roles to communicate across boundaries.

Experience Add-in

Brimit developed an add-in that seamlessly integrates with CRM software and enables marketing, sales, service, and support teams to get real-time insights and manage the Sitecore contact experience profile, thereby increasing efficiency and maturing the overall customer experience (visit add-in.brimit.com for details).