Case Study / AI Enablement

AI-Supported Knowledge Checks

Overview

At Allstate, I used generative AI to create practice questions for employees preparing for insurance licensing exams. The questions appeared at the end of instructional content so employees could check their understanding before moving forward.

I also taught employees how to use AI ethically to quiz themselves and study independently rather than relying on it to provide answers.

The Need

Insurance pre-licensing can be difficult because many new employees are entering an unfamiliar career and learning a large amount of technical information at once.

Employees needed opportunities to engage with the material and identify gaps in their understanding. Adding questions at the end of PowerPoint lessons gave both employees and trainers more information about which concepts were understood and where additional learning was needed.

The Prompt

Please generate a robust multiple-choice question similar to AD Banker that includes the correct answer and an explanation, using only the slide information provided.

The Process

I used the slide content to prompt AI to generate an exam-like multiple-choice question. I asked employees the question at the end of the material to see who understood the concept and who did not. Then, I discussed the explanation and answered any further questions. I also adjusted weak distractors so the questions were robust rather than easy to answer through simple elimination.

Example

The slides below show the instructional content, the AI-supported knowledge check, and the answer explanation used to reinforce the concept.

Instructional slide explaining the 7-Pay Test concept.
01Instructional slide
AI-supported multiple-choice knowledge check question.
02AI-supported knowledge check
Answer explanation reinforcing the concept.
03Answer explanation

Responsible Use

AI helped me create practice materials more efficiently, but I did not use the output without review. I checked the question, answer, explanation, and distractors for accuracy before presenting them to employees.