Goal

Understand/Make Sense of your tool’s data to identify trends and relationships that will inform product development and to (when applicable) demonstrate promise of impact by connecting product usage to outcomes.

Objectives

  • Collect preliminary evidence that connects tool's usage to intended outcomes.

  • Identify patterns and collect correlational evidence on the ways of use that yield greater teacher and/or student engagement with the tool (Possibly ESSA level 3 evidence)

  • Through A/B testing, establish which feature/activity of tool yielded better performance/engagement

    • (more systematic than usability testing)

Questions Answered

What aspect of usage is really making a difference in school outcomes?

When combined with qualitative interviews:

  • What explains the relationship between product use and teacher/student outcomes?  

  • What explains teacher and/or student use and engagement with the product?

  • That is, why do we see the trends and relationships we do in the data analysis?

Deliverables

  • All companies that make at least one product enhancement and/or update implementation guidelines based on end-user feedback will receive a Co-Design Certification

  • Correlation Report - includes results linking product usage to teacher and/or student outcomes

  • Graphics illustrating correlations between usage and outcomes

  • Marketing and sales collaterals

Prerequisites

  • Must have a written theory of change or logic model based in and documented with existing literature

  • Must have a working prototype of product

  • Evidence of successful usability research done in a "lab" (may include focus groups, product testing, formal interviews)

  • Evidence of teacher implementation fidelity

ESSA Standards

Tier 3 (Promising Evidence)

Usability Research

Implementation Research