The Question Analysis Report provides a detailed breakdown of learner performance at the question level within an evaluation. It helps administrative users identify questions that may need review, revision, or remediation by combining performance data with statistical indicators of question quality.

What the Report Shows

For each question, the report provides:

• Scoring distribution
  • No Credit
  • Partial Credit
  • Full Credit
• Mean score per question
• Point‑Biserial Correlation, indicating how well a question differentiates between high‑ and low‑performing learners
• Color‑coded performance indicators to quickly identify concerns
• Downloadable reports in Excel or PDF format

Accessing the Question Analysis Report

You can access the report in two ways.

Option 1: From the Reports Menu

1. Select Reports from the global navigation
2. Under QuickLink, select Course Results
3. Choose Question Analysis from the Report dropdown

Option 2: From a Course

1. Select Courses from the global navigation
2. Open the course you want to review
3. In the Results pod, select View Reports
4. Choose Question Analysis from the Report dropdown

Report Fields Explained

Evaluation Selector

• Select the evaluation to analyze
• If a scenario filter is applied, only evaluations within that scenario appear

Question Content

• Question Instruction & Question: Displays the full question text as presented to learners

Question Statistics

For each question, you’ll see:

• No Credit / Partial Credit / Full Credit counts
• Mean Score
• Point‑Biserial Correlation, showing how well the question distinguishes between stronger and weaker performers

A visual indicator highlights questions that may need review.

Color‑Coded Scoring Indicators

• Red: No credit
• Light Green: Partial credit
• Green: Full credit

These colors help quickly assess how learners performed on each question.

Understanding Point‑Biserial Correlation

The Point‑Biserial Correlation measures how strongly a question aligns with overall learner performance.

• Green: High correlation (effective question)
• Yellow: Low correlation (may need review)
• N/A: Not enough data to calculate

Optional setting:

• Count no answers as no credit includes unanswered questions in the correlation calculation, which can affect results for optional or skipped questions.

Answer Analysis

The Answer Analysis view is especially useful for Likert‑style and multiple‑choice questions.

This section displays:

• Question text
• Available points
• Percentage of learners selecting each answer (with visual bars)
• Total response counts

Use this view to understand response patterns and detect confusing or ineffective answer choices.

Filtering Options

You can refine results using:

• Scenario filters to focus on specific scenarios
• Evaluator or Evaluatee filters to search by specific users

Report Metadata

Each generated report includes:

• Report type (Question Analysis or Answer Analysis)
• Date generated
• Any applied filters (Scenario, Evaluator, Evaluatee)