How data is collected for Assessment and Usage reports

Follow

*Note - LTI integration is only relevant for InfoLit (formerly Instruct) products. The Quiz Form mentioned below is only relevant for Learning Tools products that include assessments (InfoLit, and some legacy K-12 products). 

 

The following inputs provide data to Credo Insights and may be used as filters or identifying information in Credo Insights.

LTI Integrations within Learning Management Systems

When multimedia is integrated with a Learning Management System via an LTI integration, Credo’s system uses the information provided by the LMS to create a unique user profile for each student. This includes:

  • Student Name
  • Student Email
  • Course information (course name/number, but may also include course section number)

Students do not have to remember a specific username/password, because their LMS login authenticates them into Credo's platform. When students use the multimedia through another course in the LMS, their data is saved under the previously created user profile. For example, if a student accesses multimedia through an FYE course in their first semester, then in an English Course in their second semester, data from both courses is available in Credo Insights under the same student-user profile.

Note: Filters for LMS-integrated Courses were established in March 2018. Before March 2018, the data from courses in your LMS will be displayed under the INFOLIT course in Credo Insights. This affects both assessment and usage reports. 

 

Anonymous (Non-LTI) Access

IP/Proxy/Referring URL Authentication

  • When your students authenticate into Credo's platform via any authentication method other than LTI (proxy, IP, or referring URL authentication), they are signed into an anonymous account that is used only for the length of their session (until they close the window or log out). Unlike with an LTI integration, these authentication methods do not automatically provide any information about the student that could be used to identify them on the assessment report.
  • Therefore, when students use one of these non-LTI authentication methods, they are prompted to self-identify before they complete a test or quiz. A brief form called the Quiz Form appears before the quiz/test start page and prompts them to enter their name, email address, instructor name, and any custom fields that Credo support has created for their institution. The test/quiz appears after they have submitted the form, and the information they enter is associated with their score on the grade report.
  • The Quiz Form only appears when students access multimedia via proxy, IP, or referring URL authentication (from LibGuides or other websites, or directly on Credo's platform). When a student accesses multimedia using one of these methods, Credo’s platform creates a temporary anonymous user and tags the usage and assessment data with the metadata the student provides in the Quiz Form (name, email, course). Credo does not create a “new user” based on information provided by the student on the Quiz Form, which differs from how LMS integrations create a new student user.
  • While this may result in slightly less consistent data for reporting at the student level, there are benefits to this systemnamely ease of use/low barriers to use by students accessing multimedia via proxy or IP authentication. As Credo does not create a new user when students complete the Quiz Form, students are not required to remember a username and password to access the multimedia at a later date, or go through a password reset if they forget.
  • The Quiz Form only appears when students click on a quiz (it does not appear for videos or tutorials). The Quiz Form must be configured by Credo staff for each institution’s account to capture this information. The following information is strongly recommended as part of the Quiz Form configuration:
    • Student Name
    • Student Email
  • The following are optional configurations:
    • Course Information (this can be configured as a drop-down option vs. a text box)

Note: For customers only using a direct link, proxy/IP, or referring URL authentication (e.g.,LibGuides), adding course information can be useful in reporting, and our Customer Success Team can help you determine the best approach for your students (pre-loading courses or relying on student inputs).

For customers using both IP authentication and LMS/LTI integrations, we recommend carefully considering if course information from IP authenticated usage is needed. Course information may appear multiple times in filters if captured from the LMS and from the Quiz form, as that data and the data from both sources cannot be merged together at this time.

 

Direct Link via Credo's platform

If you are sending students directly to Credo's platform to access multimedia via IP, proxy, or referring URL authentication AND you are also not capturing course information on the Quiz Form, then all your data will be automatically captured under the Course filter "INFOLIT", "Instruct", or "View" (depending on your product). 

This course option captures any data that is not attributed to a particular course at your institution (from an LMS integration or the Quiz Form).

Data that appears under the INFOLIT/Instruct/View course filter could come from the following inputs:

  • Students who access multimedia from a non-LTI link (a LibGuide, Credo’s platform, or other anonymous session) to watch multimedia, but do not take any quizzes (thus never encountering the Quiz Form)
  • Students who access multimedia from a non-LTI link (a LibGuide, Credo’s platform, or other anonymous session), but the Quiz Form is not configured to capture Course Information.



Term information

Term information is configured by Credo staff during your onboarding. Each term is defined by the start and end dates for semesters (quarters, etc.) based on your institutional academic calendar.

Note: The terms configuration was established in February 2018. Student usage or assessment data that occurred prior to February 2018 were not assigned to a term and therefore may be grouped under a different filter in Credo Insights (2017 or 2016 for some customers), or not be available as a filtered option.
We are investigating a report by specific date range, which will allow more detailed reporting of historical data.

 

See this page for more information about How to use Credo Insights.

0 out of 0 found this helpful