Video transcript
Welcome to Instructional Designers in Offices Drinking Coffee
[00:32] Hey folks, welcome to Instructional Designers in Offices Drinking Coffee, hashtag IDIODC.
[00:37] That's meant as funny as we were discussing in the green room ahead of today.
[00:41] Hey, my colleague Paul is away this week.
[00:43] He's still enjoying an extended Thanksgiving vacation.
About the show and sponsor
[00:47] This episode of Instructional Designers in Offices Drinking Coffee is brought to you by us here at the dominKnow team.
[00:54] Makers of dominKnow | ONE, where we help our clients create, manage, and deliver impactful and measurable learning at scale.
Introducing the topic and guest
[01:02] Chris changes things up today with the word measurable, because that's our topic.
[01:07] Joining us for the first time is Dr. Alaina Szlachta.
[01:15] Since it's your first time, tell the folks a little bit about yourself.
Guest introduction and background
[01:49] I’m Dr. Alaina Szlachta, and I like to call myself a chief measurement nerd.
[01:55] I work for By Design Development Solutions.
[01:59] We build data solutions for small businesses to help them make smart choices.
[02:09] Data can truly make a difference when we're trying to make or sustain change.
Measurement challenges in learning and development
[02:35] Horror stories often come from organizations that don’t measure anything at all.
[02:53] I came from data-driven environments and was shocked when measurement was missing.
[03:49] I was asked which Kirkpatrick level I was using, but measurement wasn’t framed that way for me.
Limitations of traditional measurement models
[04:22] There is a place for all frameworks, but sometimes familiar models hold us back.
[04:48] Measurement can and should be simpler.
[05:03] Kirkpatrick can feel like a mountain instead of a roadmap.
The domino metaphor for learning impact
[05:46] I like to think about learning outcomes as a domino effect.
[06:06] Completion is just one domino.
[06:34] We often miss the dominoes in between learning and business results.
Key dominoes between learning and results
[09:09] Readiness to learn is critical.
[09:28] Motivation, incentives, and environment all matter.
[10:12] Capabilities and skills must be developed and demonstrated.
[10:49] Performance on the job is the domino that leads to business results.
Capabilities vs skills and competencies
[21:07] Capabilities are intersectional.
[21:29] Knowledge alone is not enough.
[22:06] We must measure knowledge, technology use, and real-world performance.
Using LMS data effectively
[22:12] LMS data can support capability measurement.
[22:27] Quizzes alone are insufficient.
[22:44] We need richer data points to show growth.
Quantity versus quality in measurement
[34:03] Measurement often focuses only on numbers.
[34:48] We must also measure quality.
[35:56] Quantity without quality can create negative outcomes.
Real-world examples of quality impact
[36:07] Billable hours without service quality reduce retention.
[37:05] Call centers can hit answer-rate targets while delivering poor service.
[38:22] Quality must be trained and measured alongside efficiency.
Designing learning for real impact
[29:11] Measurement is not separate from good learning design.
[29:48] We must design for behavior and performance, not just compliance.
Closing thoughts
[40:34] Thank you so much for joining us.
[40:42] Measurement and Evaluation on a Shoestring is available now.
[41:00] Instructional Designers in Offices Drinking Coffee is brought to you by dominKnow.
[41:18] It’s time to dance on out. Thanks so much.
.svg){kind=icon}
.svg)
