Every tool in The Pedagogical Vault is evaluated using our evidence-based 6D Framework. Tools must first pass four non-negotiable safety gatekeepers, then score at least 70/100 on our weighted rubric to qualify for listing.
This methodology prioritizes student safety, pedagogical rigor, and equity above all else.
These are non-negotiable safety criteria. If a tool fails even one gatekeeper, it does not qualify for the Vault—no matter how high it scores on other dimensions.
Tools must meet WCAG 2.1 AA standards and provide keyboard navigation, screen reader support, and published accessibility statements.
Tools must comply with COPPA and FERPA, provide transparent data practices, and allow educators to delete student data on request.
AI-powered tools must include content filters, disclose limitations to users, provide human oversight options, and mitigate bias.
Tools must filter age-inappropriate content, moderate user-generated content, and provide mechanisms to report concerning material.
Tools that pass all gatekeepers are scored 1-5 on six dimensions. These scores are weighted to produce a final 0-100 score. Only tools scoring 70+ qualify for listing.
Does the tool reflect evidence-based instructional design? Are learning activities scaffolded, aligned to standards, and designed to promote higher-order thinking?
Is there peer-reviewed research showing the tool improves learning outcomes or teacher effectiveness? We follow ESSA evidence tiers.
Does the tool provide timely, actionable feedback? Can educators see detailed progress data and adapt instruction accordingly?
Does the tool serve ALL learners? We evaluate language support, accessibility beyond WCAG minimums, cultural responsiveness, and bias mitigation.
Is the tool intuitive, fast, and ethically designed? We evaluate UX, performance, AI transparency, and data minimization.
Does the tool integrate with existing systems? We evaluate LMS integration, SSO support, data portability, and setup time.
The 6D Framework is optimized for evaluating student-facing instructional tools where learning design is the primary function. For teacher-facing tools (Learning Analytics & Data Insights, Educator Copilots), dimensions are interpreted through a decision-support lens—assessing whether the tool empowers educators to make better pedagogical decisions rather than directly delivering instruction to students.
Tool delivers instruction directly to learners
Tool supports educator decision-making
| DIMENSION | STUDENT-FACING TOOLS | TEACHER-FACING TOOLS |
|---|---|---|
| Learning Design Integrity | Does it scaffold higher-order thinking? UDL alignment? Standards-based? | Does it surface pedagogically meaningful data? Support instructional decisions? |
| Instructional Efficacy | Evidence of student learning gains | Evidence teachers make better decisions or save time without sacrificing quality |
| Feedback & Assessment | Timely, actionable feedback TO students | Clear, interpretable reporting TO teachers; flags at-risk students |
| Equity & Access | UDL, WCAG, culturally responsive content | Disaggregated data views, bias-free algorithms, accessible dashboards |
| Tech & Ethical Design | Privacy, AI transparency, human override | Same + data governance, interoperability standards |
| Integration & Usability | Fits student workflow | Fits teacher workflow, LMS integration, time savings |
Research Basis: This differentiated interpretation aligns with Digital Promise's separate certification tracks for Instructional Products vs. Learning Analytics, and follows Verbert et al.'s LA Process Model (awareness → reflection → sensemaking → impact) for evaluating teacher-facing analytics tools.
Each tool receives a score of 1-5 on all six dimensions. These scores are weighted and converted to a 0-100 scale using this formula:
Qualification Rule: A tool qualifies for the Vault if it passes ALL four gatekeepers AND scores 70 or higher.
Point-in-Time Assessments: Our evaluations reflect the tool at a specific moment. Tools are updated, features change, and research evolves. We aim to re-evaluate tools annually, but scores may not reflect the very latest version.
Interpretive Judgment: While our rubrics are evidence-based, scoring inherently involves professional judgment. Two evaluators may score the same tool slightly differently within the same tier.
Evidence Limitations: Some excellent tools lack published research not because they don't work, but because rigorous studies are expensive and time-consuming. We balance research evidence with expert analysis.
Independence: The Pedagogical Vault is editorially independent. We do not accept payment from vendors for inclusion or higher scores. All evaluations are conducted by experienced educators and instructional designers.
Corrections: If you believe an evaluation contains an error or is out of date, please contact us at hello@pedagogicalvault.com. We take accuracy seriously and will promptly investigate.
We believe in transparency. If you have questions or suggestions for improving our evaluation framework, we'd love to hear from you.
CONTACT US