Learning Experience Designer
EVALUATION OF INSIGHTS DISCOVERY PROGRAM
This is your Project description. Whether your work is based on text, images, videos or a different medium, providing a brief summary will help visitors understand the context and background. Then use the media section to showcase your project!
ABOUT THIS PROJECT
In 2018, the Insights Discovery program was implemented within Connect, Inc (a pseudonym). This program was introduced to create a common language around communication and assist employees with understanding why they struggle to communicate with others.
Three years after the initial implementation of Insights Discovery, the need for a formative evaluation was identified to understand opportunities where content application and implementation can be better supported and improved.
The Global Talent Development team at Connect agreed to partner with the evaluation team to conduct this program evaluation.
DETAILS
PROJECT TYPE
Evaluation
TOOLS
Chyung’s 10-step evaluation procedure
Kirkpatrick’s 4-level model of evaluation
Bloom’s taxonomy of educational objectives
SKILLS
Performance Analysis
Needs Assessment
Evaluation
Performance Improvement
COMPLIANCE
American Evaluation Association (AEA)’s guiding principles for evaluators
ISPI’s code of ethics
ISPI’s standards for performance improvemen
BACKGROUND
Organization
​
Connect, Inc. (a pseudonym) designs software for flexible work. Connect’s software provides customers with tools for unified communication and collaboration, IT management, and support, including cloud-based phone systems, video/webinar meeting systems, contact center solutions, and IT remote access and support tools. Since the global Covid pandemic in 2020, Connect adopted a hybrid-remote work model where the majority of 3,700 employees work from home and/or spend limited days in an office globally.
Insights Discovery Program
Insights is an external company that provides people development programs that help companies worldwide get the best from their people at work. This program focuses explicitly on self-awareness by using a four-color model to help individuals learn more about their personal preferred communication styles and behaviors.
​
In 2018, the Insights Discovery program was implemented within Connect. This program was introduced to create a common language around communication and assist employees with understanding why they struggle to communicate with others. In addition to engaging learning content, Insights Discovery offered the benefit of a team-building activity and positive working relationships. The program consists of an initial course called Insights Discovery and custom follow-up workshops. Insights Discovery is a 2.5-hour virtual, instructor-led course.
Evaluation Purpose
Insights course costs approximately $107 per participant, which covers the cost of producing a unique Insights Discovery Personal Profile for each participant. Since launching the program in 2018, over 1,400 (37%) of the company's current employees have completed the training. In the first two months of 2022, Connect's T&D team facilitated four Insights Discovery workshops. Connect adopted Insights Discovery without conducting a formal needs analysis. Participants' informal feedback is positive, but Connect has yet to collect formal feedback regarding return on investment (ROI) and how it can be improved to be more effective.
Evaluation Goal
The client and upstream stakeholders intend to use the evaluation findings to identify areas for improvement, the team conducted a formative evaluation. The evaluation team understood that the evaluation findings would be used by the client to:
-
Obtain data on whether participants can apply what is taught in the Insights Discovery Program.
-
Identify where there may be gaps in applying the concepts taught
-
Identify strategies to reinforce and/or follow up to help with the content application.
STAKEHOLDERS
Three facilitators within Connect are certified, through Insights, to deliver the training. It is their responsibility to maintain and provide the course and workshop content.
The direct impactees are the teams that have attended the course or follow-up workshops within the Insights Discovery Program. Since Connect has implemented the Insights Discovery Program, over 1,400 employees have participated in the training. In 2021 alone, there were 645 direct impactees.
The client is the Vice President of Talent Development for Connect. She is responsible for ensuring the benefits of the Insights Discovery Program for Contact. The three facilitators and the financial management of Insights Discovery fall under her mandate.
The indirect impactees interact with the participants who have attended the Insights Discovery Program. These individuals could be other internal team members within or external to their department, members of leadership, or external customers.
EVALUATION METHODOLOGY
Process
The evaluation team employed an evidence-based 10 - step evaluation process (Chyung,2019) to conduct the identification, planning, and implementation phases of the project. (See Figure 1)
10- Step Evaluation Process
Ten-step evaluation for training and performance improvement.
Process
The evaluation team employed an evidence-based 10 - step evaluation process (Chyung,2019) to conduct the identification, planning, and implementation phases of the project. (See Figure 1)