Learning Analytics & Evaluation

This section highlights my comprehensive approach to learning analytics, usability evaluation, and iterative instructional design. By systematically collecting and analyzing data from learner engagement, performance metrics, and usability testing, I identify actionable insights to inform targeted refinements of course content and delivery. Collaborating closely with technology specialists, subject matter experts (SMEs), and learners, I ensure that both the technical functionality and instructional effectiveness continuously improve throughout the design cycle. This data-driven, iterative process results in learner-centered, accessible, and impactful digital learning experiences that align with organizational goals and adapt to evolving learner needs..

The Evaluation Plan

This evaluation plan establishes a rigorous framework for assessing the GeneQuest online course, grounded in current academic research. It employs a combination of usability testing, multimedia effectiveness analysis, and learner impact measurement to ensure comprehensive evaluation. The plan also details the development and deployment of targeted evaluation instruments and outlines a clear, methodical process for data collection and analysis, supporting data-driven improvements to the course.

Evaluation Participants

To support a comprehensive evaluation, data was collected from two technology specialists, two subject matter experts, and three learners representative of the target population.

Technology Specialists

The two technology specialists involved in this evaluation are professionals with expertise in educational technology, user experience design, and accessibility standards. Their primary role was to assess the course’s usability, focusing on navigation, interface functionality, accessibility compliance, and overall user experience. Their feedback provided critical insights into how the course design supports or hinders effective learner interaction in a digital environment.

Subject Matter Experts

The two subject matter experts who contributed to this evaluation are experienced science educators with backgrounds in curriculum development and digital instruction. Their role focused on evaluating the alignment and effectiveness of multimedia components in supporting mastery of learning objectives. Drawing on their expertise, they provided detailed feedback on content accuracy, instructional clarity, and the pedagogical impact of multimedia elements within the course.

Learners from the Target Population

The learner participants included three 8th-grade science students representing a range of academic profiles: one gifted, one general education, and one performing below grade level. These students provided valuable usability feedback through the USE Questionnaire and contributed critical data on the effectiveness of the course’s multimedia components in supporting mastery of learning objectives, measured through pre- and post-assessments. Additionally, they offered both quantitative and qualitative insights into the course’s impact on their confidence, engagement, and motivation. Their diverse perspectives were essential in evaluating the course’s effectiveness across different learner needs and informing targeted improvements to enhance learning outcomes and retention.

Evaluation Tools

A variety of tools were used to collect data for the evaluation. Explore each tool and learn how it contributed to gathering essential data.

*Made with Rise 360

Data Analysis

The goal of this data analysis was to uncover key patterns, assess outcomes, and evaluate the effectiveness of the tools and strategies implemented to inform iterative improvements. By analyzing both quantitative and qualitative data, the evaluation produced meaningful insights that guided course enhancements and supported data-driven decision-making. Explore the data collected and the methodologies used for analysis below.

The Evaluation Report

This evaluation report presents the methodology and outcomes of a formative evaluation conducted on the online GeneQuest Course. The evaluation engaged two technology specialists, two learning specialists, and three target learners to collect both quantitative data and qualitative feedback. Leveraging learning analytics aligned with the evaluation objectives, the process provided a comprehensive assessment of the course’s effectiveness. The report details the data collection, analysis, and synthesis methods, with results presented through narrative summaries, tables, and visualizations. Findings were integrated with relevant literature to guide data-driven, iterative enhancements aimed at optimizing learner experience and instructional impact.