10.1 Why Quality Assurance Matters
Quality assurance (QA) in e-learning is the systematic process of evaluating course design, content, and delivery to ensure they meet established standards of quality. QA is not a one-time event but an ongoing cycle of review, feedback, and improvement that extends throughout the course lifecycle.
Why does quality assurance matter? Research consistently shows that well-designed courses lead to better learning outcomes, higher student satisfaction, and improved retention. Quality assurance helps ensure:
- Alignment: Objectives, content, activities, and assessments work together coherently
- Accessibility: All learners can access and engage with materials
- Usability: Navigation is intuitive and technical elements function correctly
- Engagement: Materials are engaging and promote active learning
- Consistency: Courses meet institutional standards and learner expectations
10.2 Quality Matters (QM)
Quality Matters — The Gold Standard in Online Course Quality
Quality Matters (QM) is a nationally recognized, faculty-centered, peer-review process for certifying the quality of online and blended courses. QM provides a set of standards and a research-supported rubric for course design evaluation.
The QM Rubric
The QM Rubric is organized into eight general standards with specific review points. Courses are evaluated against these standards and must meet specific criteria to achieve QM certification.
QM General Standards
- 1. Course Overview and Introduction: Clear information about course structure, navigation, and instructor expectations
- 2. Learning Objectives (Competencies): Measurable objectives that align with assessments and activities
- 3. Assessment and Measurement: Assessments that measure achievement of objectives with clear criteria
- 4. Instructional Materials: Materials that support learning objectives and are appropriately cited
- 5. Learning Activities and Learner Interaction: Activities that promote engagement and interaction
- 6. Course Technology: Technology that supports learning goals and is accessible
- 7. Learner Support: Resources to support student success
- 8. Accessibility and Usability: Course design that is accessible to all learners
The QM Peer Review Process
- Self-Review: Course instructor or designer reviews against rubric
- Peer Review: Trained QM peer reviewers evaluate the course independently
- Consensus Review: Reviewers reach consensus on findings
- Recommendations: Specific, actionable recommendations for improvement
- Certification: Courses meeting all standards receive QM certification
QM's Impact
Research shows that QM-certified courses lead to higher student satisfaction, improved learning outcomes, and better retention rates. Over 1,500 institutions use QM standards, and more than 100,000 faculty members have participated in QM professional development.
10.3 OSCQR (Open SUNY Course Quality Review)
OSCQR — A Flexible, Open-Source Quality Framework
Developed by SUNY (State University of New York), OSCQR is an open-source, customizable quality review tool. It provides a comprehensive rubric and a collaborative review process that can be adapted to institutional needs.
OSCQR Standards
The OSCQR rubric includes over 50 standards organized into categories:
- Course Overview and Information — 12 standards including syllabus, navigation, and instructor introduction
- Course Technology and Tools — 6 standards for technology accessibility and functionality
- Design and Layout — 8 standards for visual design, organization, and consistency
- Content and Activities — 12 standards for alignment, engagement, and interaction
- Interaction — 6 standards for communication and community building
- Assessment and Feedback — 8 standards for assessment design and feedback quality
OSCQR vs. Quality Matters
Quality Matters: More rigorous certification process, nationally recognized, requires trained reviewers, certification valid for 5 years
OSCQR: More flexible, open-source, customizable, no formal certification, ideal for internal quality improvement
Many institutions use both: OSCQR for formative improvement, QM for summative certification
10.4 The Peer Review Process
Instructor/designer reviews course against rubric
Trained peer reviewers evaluate independently
Reviewers discuss findings and reach agreement
Specific, actionable feedback for improvement
Course is revised based on feedback
Course meets standards and is certified
Effective Peer Review Practices
- Train Reviewers: Peer reviewers need training on the rubric and review process
- Focus on Design, Not Instruction: Review the course as designed, not how it was taught
- Be Specific: Recommendations should be concrete and actionable
- Maintain Confidentiality: Course materials and review outcomes should be confidential
- Emphasize Improvement: Frame feedback as opportunities for improvement, not criticism
10.5 Quality Assurance Checklist
Syllabus includes course objectives, grading policies, schedule, and instructor contact information
Objectives are measurable, learner-centered, and aligned with assessments and activities
Assessments align with objectives; grading criteria are clear; feedback is provided
Materials support objectives; are current; include citations and permissions
Activities promote active learning; opportunities for interaction are provided
Technology supports learning; tools are accessible; instructions for use are provided
Resources for technical support, academic support, and accessibility are provided
Course is accessible; navigation is intuitive; visual design supports learning
All links work; media plays correctly; assessments function as intended
Content displays correctly on mobile devices
10.6 Continuous Improvement Strategies
Quality assurance is not a one-time event. Effective courses evolve through continuous improvement cycles.
Student Feedback
- Mid-Course Surveys: Gather feedback while there's time to make adjustments
- End-of-Course Evaluations: Comprehensive feedback for future iterations
- Focus Groups: Deeper qualitative insights from representative students
- Analytics: LMS data on engagement, completion, and performance patterns
Instructor Reflection
- Document what worked and what didn't during course delivery
- Identify areas where students struggled
- Note time-intensive aspects that could be streamlined
- Capture innovations that enhanced learning
Data-Informed Improvement
- Assessment Analysis: Review question performance; identify items where many students struggled
- Engagement Metrics: Identify content that students access frequently or abandon
- Discussion Quality: Evaluate patterns of interaction; identify opportunities for improved facilitation
- Completion Rates: Identify drop-off points; investigate causes
Annual Course Review Cycle
After Course Ends: Review student feedback, assessment data, and instructor notes
Pre-Design (1-2 months before revision): Plan changes based on feedback and data
Development: Make updates to content, activities, and assessments
Quality Review: Apply QA rubric to revised course
Pre-Launch Testing: Verify all links, media, and functionality
Launch: Deliver improved course
10.7 Common Quality Issues and Solutions
Issue 1: Vague or Missing Learning Objectives
Solution: Write measurable objectives using action verbs (Bloom's Taxonomy). Ensure objectives are clearly stated and accessible to students.
Issue 2: Misalignment Between Objectives and Assessment
Solution: Map each objective to specific assessments. Ensure assessment matches the cognitive level of the objective.
Issue 3: Inconsistent Navigation
Solution: Use consistent module structure; provide a course orientation; use clear headings; maintain predictable navigation patterns.
Issue 4: Broken Links or Non-Functional Media
Solution: Conduct pre-launch testing; schedule regular content audits; use link-checking tools.
Issue 5: Accessibility Barriers
Solution: Test with screen readers; ensure color contrast; provide captions and transcripts; use accessible authoring practices.
10.8 Building a Quality Culture
Quality assurance is most effective when it becomes part of organizational culture, not just a compliance exercise.
Elements of a Quality Culture
- Leadership Support: Quality initiatives need institutional backing, resources, and recognition
- Faculty Engagement: Involve instructors in QA processes; emphasize improvement over evaluation
- Professional Development: Offer training on QA standards, accessible design, and effective practice
- Recognition: Celebrate quality achievements; highlight exemplary courses
- Continuous Learning: Treat QA as ongoing learning, not a one-time project
Getting Started with QA
1. Choose a Framework: Adopt QM, OSCQR, or develop your own standards
2. Pilot with a Few Courses: Test the QA process with a small cohort
3. Train Reviewers: Invest in reviewer training and calibration
4. Establish a Process: Define roles, timelines, and workflows
5. Communicate Value: Emphasize how QA benefits instructors and learners
6. Scale Gradually: Expand QA to more courses as capacity grows
📌 Episode Summary
Quality assurance is essential for creating effective, accessible e-learning experiences:
- Quality Matters (QM): The gold standard for online course quality with a rigorous peer review process
- OSCQR: Flexible, open-source quality framework ideal for internal improvement
- Peer Review: Collaborative process that identifies strengths and opportunities for improvement
- Continuous Improvement: Use student feedback, instructor reflection, and data to refine courses annually
- Quality Culture: Integrate QA into institutional practices with leadership support and faculty engagement
In Episode 11, we'll explore career pathways in instructional design—how to build your skills, create a portfolio, and advance in the field.