Podcast Summary: The Agile Brand with Greg Kihlström® Episode #653: Accelerating Speed to Insights Using Synthetic Feedback with Ali Henriques, Qualtrics Release Date: March 21, 2025
Introduction
In Episode #653 of The Agile Brand with Greg Kihlström®, host Greg Kihlström engages in an insightful conversation with Ali Henriques, the Global Director of EDGE at Qualtrics. Recorded live at Qualtrics X4 in Salt Lake City, the episode delves into the transformative power of synthetic feedback and how it accelerates the speed to insights for brands. The discussion covers synthetic research methodologies, Qualtrics' innovative products like Edge Instant Insights and Edge Audiences, and the evolving role of researchers in an AI-driven landscape.
Understanding Synthetic Research
Defining Synthetic Research: Ali Henriques begins by explaining synthetic research, emphasizing its foundation in AI-modeled responses. He categorizes synthetic offerings into three main approaches:
-
Wrapper Models ([04:53]): These use interfaces like ChatGPT to emulate specific populations based on publicly available information. While effective, they are limited to the data accessible publicly.
-
RAG Method ([04:53]): This method involves using machine learning to expand a set of human responses. For instance, transforming 200 human responses into 400 by analyzing patterns and behaviors within the original data.
-
Custom Foundational Models ([04:53]): Qualtrics is developing a proprietary foundational model that integrates the first two approaches with robust, anonymized data sources. This includes decades of experience data and extensive research data, amounting to over 30 million responses from recent studies.
Key Insights:
- The strength of synthetic research lies in the quality and breadth of data used to train the models.
- Qualtrics' unique position stems from its vast repository of anonymized responses, enabling more accurate and reliable synthetic data generation.
Notable Quote:
“We have millions and millions and millions of responses… those behaviors, preferences, those are things like, how do you like this new product, right?” - Ali Henriques [04:53]
Edge Instant Insights and Edge Audiences
Edge Instant Insights ([07:00]): Ali introduces Edge Instant Insights as an industry-specific market intelligence platform. Using the restaurant industry as an example, the platform combines survey research with additional data sources like search trends, news, social media activity, transaction data, and behavioral data (both physical foot traffic and digital interactions). This comprehensive approach allows brands to understand not only customer preferences but also their broader behaviors and competitive context.
Edge Audiences ([04:23]): Edge Audiences leverages synthetic feedback to transform weeks of research into minutes. By utilizing AI-modeled responses, teams can conduct rapid testing and gain on-demand marketing intelligence, enhancing their ability to make timely and informed decisions.
Notable Quotes:
“Instant Insights is here to kind of bring that to life, but also give you more of that kind of competitive context.” - Ali Henriques [11:42]
“It's a good topic to talk about… Things are moving quick, so this is a good topic.” - Qualtrics Host [02:43]
Use Cases and Partnerships
Booking.com Partnership ([14:20]): Ali shares insights from a recent session with Booking.com, highlighting how synthetic data was employed to compare AI-generated responses with human responses. The key takeaway was the identification of biases in human responses, such as recency bias, where respondents prioritized recent experiences (e.g., visiting friends and family) over more common behaviors like beach trips. This comparison underscored the potential of synthetic data to provide more accurate and less biased insights.
Notable Insights:
- Synthetic responses excel in attitudinal and psychographic research.
- AI can uncover underlying patterns and behaviors that humans might overlook due to inherent biases.
Notable Quote:
“Have we been lying to ourselves for 10 years thinking that friends and family are the top travel?” - Ali Henriques [18:21]
Overcoming Bias with AI
The discussion emphasizes how AI can mitigate human biases in research. While concerns about AI bias persist, Ali argues that AI can help identify and overcome cognitive biases inherent in human responses. By providing a more objective analysis, AI-driven synthetic data ensures that research insights are more accurate and reflective of true consumer behaviors.
Notable Quote:
“AI is thinking very, very critically and reflecting on that. And so you see that come through in a couple for other examples like solo travel or traveling alone.” - Ali Henriques [19:31]
Future of Synthetic Data and Research
Looking ahead, Ali envisions a future where synthetic data streamlines the research process, reducing the need for extensive data sets and enabling real-time insights. He anticipates a shift where researchers can pose a single question and receive comprehensive answers instantly, democratizing access to rapid insights across marketing, customer experience, and operational teams.
Key Predictions:
- Transition from requiring thousands of data points to single-question responses.
- Empowerment of marketers and CX leaders with immediate, actionable insights.
- The enduring importance of researchers in designing effective questions and interpreting AI-generated data.
Notable Quote:
“We just ask a question and get an answer. These models have gotten so smart, so real time… you're going to go from 1000 rows of data to one question answer.” - Ali Henriques [22:45]
Evolving Role of Researchers
As synthetic data becomes more prevalent, the role of researchers is set to evolve. Instead of focusing on data collection and processing, researchers will concentrate on crafting insightful questions and interpreting the nuanced responses generated by AI. This shift allows for greater creativity and strategic thinking, enhancing the overall quality of research outcomes.
Notable Quote:
“We are freed up to focus on the things that we actually really, really are genuinely passionate about and not coding the open ended responses and tabulating the data.” - Ali Henriques [25:22]
Staying Agile
Ali shares his personal strategies for maintaining agility in his role, emphasizing continuous learning through podcasts and leveraging insights from his children to approach problems with fresh perspectives. He highlights the importance of staying informed about AI advancements and the evolving research landscape to effectively harness synthetic data’s potential.
Notable Quote:
“I spend most of the rest of my time just listening to very like business related type of content in particular AI… to understand a lot of where some of these visionaries see this going.” - Ali Henriques [27:14]
Conclusion
Episode #653 of The Agile Brand with Greg Kihlström® offers a comprehensive exploration of synthetic feedback and its impact on accelerating research insights. Ali Henriques provides valuable perspectives on Qualtrics' innovative approaches to synthetic data, the practical applications in partnerships like Booking.com, and the future trajectory of AI-driven research. The conversation underscores the importance of agility, continuous learning, and the evolving role of researchers in a rapidly changing technological landscape.
Additional Information:
- Follow Ali Henriques and Qualtrics: Links provided in the show notes.
- Subscribe and Rate: Listeners are encouraged to subscribe to the podcast and leave ratings to help others find the show.
This summary omits advertisements, introductions, and outros to focus solely on the core content of the episode.
