Multimodal kiosk UI
Insights

Beyond the Tap: Kiosks and the Case for Multimodal UI

Sarah Appleby UK Managing Director
Date of last update :
reading 3 minutes

Touchscreens are as synonymous with self-service kiosks as they are with smartphones. But as anyone who uses Siri or Google Assistant to give voice commands to their mobile will tell you, there’s more than one way to interact with modern digital devices.

It’s hard to imagine a future where kiosks used in retail and hospitality don’t feature a touchscreen interface. But it is very easy to imagine one where kiosks have multiple UIs. In fact, that’s already the reality in many cases.

Here are some of the most common non-touchscreen UI alternatives already widely available on kiosks, and why you should know about them.

Voice control

Well what would you know – just like touchscreens, voice-controlled interfaces are not just for smartphones, either. Across all devices, more than half of all online searches are conducted using voice assistants.

The advantages of voice UI include its speed and immediacy. The fact that it offers a ‘hands-free’ way of interacting with digital devices makes it popular in situations where you can’t use your hands, like in-car technology. But ‘hands-free’ also benefits kiosk users who just want a quick answer to a quick enquiry, such as asking where to find a particular product in a store.

A lot of people like voice UI for longer, more detailed queries, too, because it is easier to give precise instructions or ask longer questions than it is to type them out. With the latest AI chat tools, requests for help can also develop in a natural, conversational way that makes using a kiosk more like interacting with a member of staff.

Finally, another major benefit of voice UI, and a compelling reason for all businesses to consider it for their kiosks, is that it makes kiosks accessible to people with visual impairment and other needs that make touchscreens difficult or impossible to use.

Mobile interaction and QR codes

There used to be something of an ‘us v them’ attitude across the wider business community towards customers using their own mobile devices on their premises. That probably arose from a belief that someone using their smartphone is invisible to the business, so the aim was to get them using their own systems instead.

But that was always a losing battle. More than half of shoppers say they use their smartphones in store for shopping-related tasks like comparing prices or reading customer reviews.

That has shifted the dial on business attitudes to smartphones towards more of a ‘if you can’t beat them, join them’ stance. Operators are increasingly happy to hand off parts of the self-service experience from kiosks to customers’ own devices by providing QR codes that open links to the brand’s content.

This provides a better experience for the customer, as they can take self-service assistance with them as they move around the premises, rather than having to stay at the kiosk. And that in turn frees up more time per machine, meaning more people can get assistance.

Sensors and proximity controls

Another rapidly evolving field in kiosk technology is the use of cameras and sensors to ‘read’ movement from users to trigger appropriate responses. At the most basic level, this can be as simple as a kiosk screen resting in power-saving mode until a customer approaches, at which point it automatically flashes on and provides a greeting.

At its most advanced, and when paired with AI, this type of technology can be used to personalise self-service, even to the point of interpreting and responding to people’s emotions. For example, in retail, cameras can capture people’s movements when browsing shelves and make educated guesses about the sort of things they are looking for. If a customer then goes to a kiosk to ask a question, it can already be primed with suggestions and recommendations based on the camera data.

As someone uses a kiosk, so-called ‘emotion AI’ can read their facial expressions and gestures from a camera to interpret their emotional state. If there are visible signs of agitation or frustration, this can prompt the system to ask if the customer needs particular help with something, or if they’d prefer to get assistance in another way.

Let the customer choose

The lesson from the changing nature of kiosk interfaces is not that one is better than the other. They all, touchscreens included, work together to create a richer tapestry of engagement options. Going forward, best practice in kiosk UI will be to combine multiple interfaces and let customers choose their own preferred option.

Sarah Appleby
Written by Sarah Appleby, UK Managing Director

Sarah Abbleby is the UK Managing Director at Oxhoo. She leads the company’s UK operations, driving strategic growth and supporting organisations in delivering intelligent, outcomes-led digital signage and customer experience solutions. With a strong focus on collaboration, performance and long-term partnerships, Sarah plays a key role in aligning technology with real business objectives.

Other topics that may interest you