Businesses are so busy racing to build AI into their digital products that many are failing to give consumers the control and transparency needed to use these features with confidence, let alone consider whether they want the tools in the first place.
That is according to new research from MTM, part of Brave Bison, which assessed 20 consumer apps against five pillars of good AI experience: transparency, personalisation, competence, consistency, and agency and control.
The findings from the “AI Experience Framework” study highlight significant shortcomings in two critical areas:
User control: Of the 20 apps assessed for agency and control, 18 received Basic or Developing ratings (1 received no rating).
In practice, this means AI can make recommendations or propose actions, but users often have few opportunities to influence what happens next, or easily correct mistakes. None of the apps achieved the highest rating, Leading.
Personalisation: Just 4 of the 20 apps assessed achieved Advanced or Leading ratings. Most apps use consumers’ behaviour to personalise recommendations and content, but offer limited visibility into what they assume about users and how those assumptions inform personalisation.
According to the research, Amazon was the only app to offer users an opportunity to correct those assumptions.
MTM insists the findings raise important questions about brands’ readiness for more autonomous AI, as applications evolve from recommending products and content, to taking actions on consumer’s behalf.
The audit also identified examples of apps taking a more considered approach to AI experiences. Booking.com, for example, allows users to review and approve AI-generated message drafts before they are sent, giving oversight over AI-assisted interactions. Trading212 was recognised for an AI-analysis feature that provides relevant answers and allows users to check sources and ask follow-up questions.
MTM managing partner Rob Collier said: “Businesses are becoming obsessed with what AI can do, but are paying far less attention to what customers actually experience. Our research suggests that even some of the biggest consumer apps can make improvements in giving people meaningful control over AI.
“As AI becomes capable of doing more on our behalf, this will only become more important. The winners won’t necessarily be the brands with the most sophisticated AI. They’ll be the ones that make it easiest for customers to understand, trust and control”.
The AI Experience Framework is designed to help businesses identify where their AI-powered experiences are falling short and understand what needs to change. By assessing experiences across five pillars, it provides a practical way to benchmark performance and identify opportunities to improve the design and delivery of AI-powered products and services.
The full whitepaper is available to download from the MTM website>


Be the first to comment on "Brands leaving consumers behind in AI app stampede"