In this episode of The Learning and Performance Podcast, I speak with Dr. Alaina Szlachta, an education entrepreneur and data and measurement "nerd," about leveraging data to improve workplace learning and performance. Alaina is the founder and Chief Measurement Architect at By Design Development Solutions, a consultancy that works with leaders and teams to create simple data collection systems that enable their programs to facilitate real, evidence-based impact and change. Together, Alaina and I discuss why measurement, assessment, evaluation, and data are so critical to learning and performance improvement, and she shares some great insights and tools for measuring and understanding the true impact of your learning and performance efforts.

Key Topics

In our conversation, we hit on a number of interesting topics relevant to learning and performance, including:

The importance of collecting and utilizing data (and why data is power)
Evaluation, measurement - what they are and why they matter
The criticality of having feedback loops in teaching and learning
The similarities and differences between measurement, evaluation, and assessment
Why analysis and evaluation are so often overlooked
The difference between analyzing and addressing performance gaps vs. designing learning solutions
Some challenges with measuring the impact of training and other interventions, and how to overcome them
How to artfully navigate questionable training requests
How to evaluate intangible skills in highly tangible ways
And a whole lot more!

Connect with Alaina

Mentions and Resources:

Learning 2024 Conference
Dr. Megan Torrance - Why data is power
The data pyramid and how wisdom requires data
Performance - a combo of attitudes and actions, beliefs and behaviors that show up in how we work
Learning - a means to an end at work, NOT the end result
The importance of evaluating performance changes, not just assessing learning!
Importance of constant feedback loops in teaching and learning and the lack of feedback loop in much workplace learning and performance improvement

Telling Ain't Training
Definition of measurement - strategic planning to collect data and collecting it
Definition of evaluation - analyzing the data and determining effectiveness
Importance of measurement and evaluation to decision-making
The ADDIE Framework - so easy to neglect/overlook A and E
Analyzing and addressing performance gaps vs. designing and delivering learning solutions
The Pareto Principle - 20 percent of content providing 80 percent of value
Why evaluation is overlooked - (1) lack of time, money, and people to do a comprehensive evaluation, (2) focusing on superficial aspects of learning experiences, (3) not clearly identifying the important things to value
Kirkpatrick's Four Levels of Evaluation
Assessment vs. Evaluation - assessments collect data on learning, and evaluations determine changes in performance
Challenges with measuring impact - (1) building a training or learning solution without validating the problem is a lack of knowledge, (2) not digging into the data closely
Measurement and Evaluation on a Shoestring (ATD Press 2025)
Getting out of the shoestring by being strategic
Aligning L&D resources with core business/organizational metrics
Heidi Kirby - Useful Stuff
Importance of listening to your gut when sensing red flags with requests
How to sidestep training requests with strategic questions about the problem
Evaluating the "intangibles" - (1) Translate intangible skills into tangible behaviors and indicators. (2) Tie it back to the problem. What would be different if the person was better at this? If they did it, would it solve the problem?
Importance of using tech to automate other things and free up time for better analysis and evaluation
Being clear on key indicators/criteria before making professional decision (e.g., finding a job, taking on a client)