TeachMe Analytics Dashboard

Updated on October 21, 2020 Download PDFDownload as PDF
Download PDF

Overview

TeachMe customers can leverage the new TeachMe Dashboard to gain visibility into how end-users are engaging with their lessons, courses, and WalkMe items, as well as to evaluate end-users’ knowledge level by analyzing quiz performance.

TeachMe Analytics is part of the new TeachMe Dashboard that can be accessed via teachme.walkme.com.

TeachMe Analytics includes 3 main pages:

  1. TeachMe Analytics Overview (Main page)
  2. Course Analytics
  3. Users Analytics
Please note:

The new dashboard does not support editing & viewing analytics of courses with old Walk-Thrus. This data can be accessed via Custom Reports in Insights.

TeachMe Analytics Overview (Main page)

A. Filters

  1. Systems
  2. Environments
  3. Time Filter
    1. Historic Data is available for customers in a rolling window of one year
    2. Date filter applies to all data fields on this page
    3. Default range is last 7 days; after the first change, the range doesn’t change with every new session

B. Metrics

  1. “User Started” –
    1. Number of users who started at least one course in the date range
    2. Starting a course means starting any SWT or Resource that is assigned to that course, even if started outside TeachMe
  2. “User Completed” –
    1. Number of users that completed any course in the date range
    2. If there are multiple “User Completed” for the same user, we will use the most recent event
    3. Completing a course means completing last SWT or Resource that is assigned to that specific course, even if completed outside TeachMe
  3. “Quiz Completion Rate” –
    1. Number of users with a “Pass” score out of Total number of users who submitted a quiz in the date range
    2. This rate is calculated by using the most recent quiz submission per user per course
  4. “Avg. Completion Time” –
    1. Average of the time between “User Started” and “User Completed”, for a specific course, for each user, within date range
    2. Users that only have “User Started” or “User Completed” (not both) in date range, would not be included in this metric.
    3. Chart formula:

0                                                        Average                                                          Max

|——————|——————|—————–|——————-|

Average of all low times                   Average of all high times

C. Course Table

  1. “Avg. Quiz Score” –
    1. An average of all most recent “Quiz Score” of all users within the selected date range
    2. “Quiz Score” means the score of the most recent quiz that was taken by a user within the selected date range
    1. If this course doesn’t have a quiz, it will show a dash icon
  2. “Avg. Quiz Attempts” –
    1. The total number of times a user completed a quiz and received a Quiz Score, within the selected date range
    2. Aggregation of all “Pass” score or “Fail” scores for a specific user within the selected date range
    3. If this course doesn’t have a quiz, it will show a dash icon

Course Analytics

A. Filters

  1. Systems
  2. Environments
  3. Time Filter –
    1. Historical Data is available for customers in a rolling window of one year
    2. Date filter applies to all data fields on this page
    3. Default range is last 7 days; after the first change, the range doesn’t change with every new session.

B. Metrics

  1. “User Started” – number of users who started THIS course in the selected date range
  2. “User Completed” –
    1. Number of users that completed THIS course in the selected date range. If there are multiple “User Completed” for the same user, we will use the most recent event.
    2. Completing the course means completing the last SWT or Resource that is assigned to that specific course, even if completed outside TeachMe
  3. “Quiz Completion Rate” –
    1. Number of users with a “Pass” score out of Total number of users who submitted a quiz in the date range
    2. This rate is calculated by using the most recent quiz submission per user per course
    3. If this course doesn’t have a quiz, it will state “No Quiz”
  4. Avg. Quiz Score –
    1. Average of most recent “Quiz Score” of all users for this course within the selected date range
    2. If this course doesn’t have a quiz, it’d state “No Quiz”
  5. “Avg. Completion Time” –
    1. Average of the time between “User Started” and “User Completed”, for THIS course, for each user, within the selected date range
    2. Users who only have “User Started” or “User Completed” (not both) in date range, would not be included in this metric
    3. Chart formula:

0                                                        Average                                                          Max

|——————|——————|—————–|——————-|

Average of all low times                   Average of all high times

C. “Outline” Tab

  1. “Users Completed Item” –
    1. For SWTs – number of users who completed the SWT (number) + percentage of users who completed it out of the users who started the SWT (%)
    2. For Resources – number of users who started the item (since we can’t track actual resource completion)
  2. “Drop-off” –
    1. Data will be shown only if the “Enforce order for course outline” setting is turned on for that specific course.
    2. For SWTs – number of users who haven’t completed the SWT  / number of users who started the SWT (%)
    3. For Resources – will always show 100% since we can’t track actual resource completion

D. Quiz Tab

  1. Answers –
    1. All potential answers for a specific question that were available for the users within the selected date range
    2. “Number” next to answer – total number of selections of that answer in each user’s most recent submitted quiz 
    3. “Percentage” next to answer – % of number of selections of that answer in each user’s most recent submitted quiz out of total selections
  2. Updating questions and answers –
    1. If the text of an answer is updated / changed on a specific day, if we select a date range before that specific day, we would still see the most recent version of the question’s text
    2. The question ID does not change if we change text

User Analytics

A. Filters

  1. Systems
  2. Environments
  3. Time Filter –
    1. Historic Data is available for customers in a rolling window of one year
    2. Date filter applies to all data fields in this page
    3. Default range is last 7 days; After the first change, the range doesn’t change with every new session.

B. Users table

  1. “User” – the UUID of the user as defined when setting up the system
  2. “Course Name” – the name of the course that this users has started
  3. “Started” – the most recent start date of any SWT or Resource that is assigned to that course, even if started outside TeachMe, within the selected date range
  4. “Completed” –
    1. the most recent completion date of this course in the selected date range.
    2. Completing the course means completing last SWT or Resource that is assigned to that specific course, even if completed outside TeachMe
  5. “Time to Complete” –
    1. Average of the time between “Started” and “Completed”, for THIS course, for THIS user, within the selected date range.
    2. For users that only have “Started” or “Completed” (not both) in date range, we would show “⊘ Did not complete”
  6. “Quiz Result” –
    1. “Quiz Score” means the score of the most recent quiz that was submitted by a user within the selected date range
    2. If this course doesn’t have a quiz OR the user hasn’t completed it, it’d show “⊘ Did not submit”
  7. “No. of quiz attempts” – the total number of times this user submitted the quiz for a specific course and received a Quiz Score, within the selected date range
    1. Aggregation of all “Pass” score or “Fail” scores for a specific user within the selected date range
    2. If this course doesn’t have a quiz, it’d show “⊘ Did not complete”

Was this article helpful?

Related Articles

< Back