On-Demand Webinar

Thank you for your interest in the webinar, “Nine Formative Evaluation Techniques to Build Effective Learning Solutions”

You can view your webinar on-demand at any time below.

Session materials

1. Nine Formative Evaluation Map
2. Formative Evaluation Intervention Summary
3. High-level Design Template
4. Informal High-level Design Template
5. Detailed Design Document
6. Small Group Feedback Template
7. Pilot Feedback Template
8. Communication Plan
9. Job Aid 20 Gen AI Prompts to Learn About Formative Evaluation
10. PowerPoint Nine Formative Evaluation Techniques

Watch the Recording

Session Summary: Nine Formative Evaluation Techniques to Build Effective Learning Solutions

The workshop, led by Gary, focused on the significance of formative evaluation in enhancing confidence and success. Gary defined formative evaluation and differentiated it from summative evaluation, and emphasized the necessity of sponsor approval, initial and subsequent conversations with the sponsor, and the involvement of subject matter experts, experienced performers, and new performers in the formative evaluation process. The workshop also highlighted the importance of high-level design approval, planning deliverables and evaluation in advance, implementing a communication plan, effective communication, stakeholder analysis, and thorough analysis throughout the entire process of developing and implementing learning solutions.

Formative Evaluation Workshop Discussion

Gary led a workshop on formative evaluation, stressing its importance in enhancing confidence and success. They noted that participants would receive a recording link, a PDF of the PowerPoint, and several takeaway items, including templates and prompts for generative AI. Gary defined formative evaluation, its application, and its techniques, emphasizing its distinction from summative evaluation. They further discussed the process of developing learning solutions, highlighting the role of sponsor approval and the importance of initial and subsequent conversations with the sponsor. They also mentioned Guy Wallace’s book, “The Pivot Point”, and the usual suspects for conducting evaluations.

Expert, Performer, and Learner Perspectives in Formative Evaluation

Gary and Marian discussed the importance of involving subject matter experts, experienced performers, and new performers in formative evaluation. They highlighted the benefits each group brings, with subject matter experts providing critical knowledge and new performers offering fresh perspectives. Gary emphasized the challenge of subject matter experts struggling to explain tacit knowledge and the importance of focusing on tasks rather than overwhelming learners with too much information. They also discussed the importance of formative evaluation techniques and shared their approach to high-level design approval, stressing the need to define learners’ capabilities, learning environment, goals, and assessment plans before initiating the building process. Gary also introduced the high-level design template and emphasized the importance of everyone’s alignment during the high-level design meeting. They discussed the process of designing learning modules, highlighting the importance of describing different modules, clarifying any prerequisites, and defining the instructor’s role. They stressed the need for a delivery method to be listed, planning deliverables and evaluation in advance, and mentioned the often overlooked aspect of maintenance planning.

Prototyping and Design Processes for Web Portals

Gary shared their prototyping experiences at the detailed design level for clients, including a nuclear engineer think tank and a high-end retailer customer web portal. They emphasized the efficiency of using PowerPoint to simulate work areas and develop modules, as well as the use of AI for voice acting and developer notes. Gary also discussed the effectiveness of simulating a web page using hotspots or hyperlinks, allowing users to navigate through the database without actual building, which was well-received by customers and resulted in significant cost savings. They also highlighted the detailed design process for web-based training, stressing the importance of teaching the right tasks, ensuring content completeness, relevance, and accuracy, and conducting usability testing. They further explained the role of technical editing, the Small Group Session, the use of a pilot feedback form, and the implementation readiness approval technique.

Communication Plan Execution and Stakeholder Analysis

Gary and Paul discussed the significance of implementing a communication plan in the execution process, stressing its role in ensuring everyone’s understanding. Gary presented a template for this plan, which includes deciding on the desired outcome for the target audience, determining who is responsible for the communication, and identifying the method to be used. They highlighted the importance of effective communication and stakeholder analysis in the implementation of learning and non-learning solutions. They emphasized the need for clear decision-making roles and early involvement of stakeholders such as executives and product design teams. Gary and Paul also discussed the potential difficulties of group consensus decision-making, using a national bank’s management style as an example. They stressed the importance of thorough analysis throughout the entire process of developing and implementing learning solutions, including internal and external communication with trade partners.

Generative AI Project and Feedback Session

Gary shared their experience from a technical training project on generative AI where they encountered resistance from managers who saw it as a commodity rather than a partnership. They suggested that involving managers in the testing phase and understanding their specific needs would have improved the outcome. They also mentioned a successful webinar on generative AI and the role of Google Bard and Chat Gpt in their work. Gary and Marian then discussed the importance of involving subject matter experts in the instructional design process and the idea of conducting a pilot session for feedback. They outlined the next steps which included providing a webinar recording link, sending a file containing all discussed deliverables, and gathering more information about formative evaluation.