Skip to main content
Evaly provides comprehensive analytics to help you understand how participants performed, identify problem areas, and improve future assessments. Use these insights to refine your teaching and test design.

Accessing Analytics

To view test analytics:
  1. Navigate to your test from the Tests list
  2. Click the Analytics tab
  3. Explore different analytics views
Analytics are available after at least one participant completes the test. More data provides more accurate insights.

Overview Dashboard

High-level metrics about test performance.

Key Metrics

Total Participants

Number of unique participants who started the test

Completed

Number who finished all sections

Completion Rate

Percentage of participants who completed vs started

Average Score

Mean score across all completed participants

Median Score

Middle score when all scores are ordered

Average Time

Average time spent by participants who completed
Example Overview:
Test: Biology Midterm Exam

Participation:
  Total Participants: 87
  Completed: 83 (95.4%)
  In Progress: 4 (4.6%)

Performance:
  Average Score: 76.3%
  Median Score: 78.0%
  Highest Score: 98%
  Lowest Score: 42%
  Average Time: 48 minutes

Interpreting Overview Metrics

Possible Reasons:
  • Test was too easy
  • Participants were well-prepared
  • Topics were covered thoroughly
  • Clear, fair questions
Actions:
  • Consider increasing difficulty next time
  • Add more challenging questions
  • Verify questions tested higher-order thinking
Possible Reasons:
  • Test was too difficult
  • Insufficient preparation time
  • Concepts not covered adequately
  • Confusing question wording
Actions:
  • Review difficult questions
  • Consider adjusting grading
  • Plan additional instruction on weak areas
  • Clarify confusing questions for future
Possible Reasons:
  • Not enough time
  • Test too long
  • Technical issues
  • Lost motivation
Actions:
  • Review time limits
  • Reduce question count
  • Check for technical problems
  • Improve test instructions
What It Means: If average is much lower than median, a few very low scores are pulling the average down (and vice versa).Actions:
  • Review outlier scores
  • Identify struggling students
  • Check for bimodal distribution
  • Consider score distribution graph

Score Distribution

Visual breakdown of how scores are distributed across participants.

Distribution Graph

Histogram showing score ranges:
0-20%:   ██ 2 participants
20-40%:  ███ 3 participants
40-60%:  ███████ 7 participants
60-80%:  █████████████████████ 21 participants
80-100%: █████████████████████████ 25 participants

Distribution Patterns

Pattern: Bell curve centered around 70-80%Interpretation:
  • Test difficulty is appropriate
  • Good range of easy/medium/hard questions
  • Discriminates between performance levels
  • Most participants in middle range
This is Ideal for most assessments.

Question Analysis

Detailed performance data for individual questions.

Question Difficulty

For each question, see:

Success Rate

Percentage of participants who answered correctly

Total Attempts

Number of participants who answered this question

Correct Answers

Number of participants who got it right

Average Score

For partial credit questions (point-based or ranking)

Hardest Questions

Questions with lowest success rates:
Hardest Questions:

1. Question 8: "Explain quantum entanglement"
   Type: Text Field
   Success Rate: 23%
   Attempts: 85
   
2. Question 15: "Balance this chemical equation"
   Type: Fill in the Blank
   Success Rate: 34%
   Attempts: 85
   
3. Question 12: "Which organelle performs..."
   Type: Multiple Choice
   Success Rate: 41%
   Attempts: 85
How to Use:
  • Review these questions for clarity
  • Check if they’re testing appropriate difficulty level
  • Determine if concept needs more instruction
  • Consider revising or removing problem questions
  • Use for planning review sessions

Easiest Questions

Questions with highest success rates:
Easiest Questions:

1. Question 1: "What is photosynthesis?"
   Type: Multiple Choice
   Success Rate: 97%
   Attempts: 85
   
2. Question 3: "True or False: Cells have DNA"
   Type: Yes or No
   Success Rate: 95%
   Attempts: 85
How to Use:
  • Verify these are appropriately easy (warmup, foundational)
  • Consider if they’re too easy (not discriminating)
  • Use as confidence builders
  • May be candidates for removal to shorten test

Question-Level Insights

Very Easy QuestionsPossible Reasons:
  • Foundational knowledge
  • Good teaching of this concept
  • Question is too obvious
  • Answer is given away by other questions
Actions:
  • Keep if testing basic prerequisites
  • Remove if not adding value
  • Increase difficulty if meant to be challenging
Good Difficulty QuestionsInterpretation:
  • Appropriate difficulty level
  • Tests understanding well
  • Discriminates between prepared/unprepared
  • These are your best questions
Actions:
  • Keep these questions
  • Use as model for future questions
  • This is the sweet spot
Challenging QuestionsCould Mean:
  • Advanced/difficult concept
  • Unclear wording
  • Trick question
  • Material not covered well
Actions:
  • Review question wording
  • Verify concept was taught
  • Consider if difficulty is appropriate
  • May need revision
Very Difficult QuestionsRed Flag - Investigate:
  • Is question confusing?
  • Is correct answer actually wrong?
  • Was concept taught?
  • Is it testing something obscure?
Actions:
  • Carefully review the question
  • Check participant feedback
  • Consider removing from final grade
  • Reteach this concept

Section Analysis

Performance breakdown by test section. Section Performance:
Section 1: Multiple Choice (20 questions)
  Average Score: 82%
  Completed By: 85 participants
  Average Time: 18 minutes
  
Section 2: Problem Solving (5 questions)
  Average Score: 68%
  Completed By: 85 participants
  Average Time: 22 minutes
  
Section 3: Essay Questions (2 questions)
  Average Score: 71%
  Completed By: 83 participants
  Average Time: 28 minutes
Insights from Section Analysis:
Compare performance across sections:
  • Which sections are hardest?
  • Are time limits appropriate?
  • Is section order effective?
  • Do scores drop off in later sections (fatigue)?
Review time spent per section:
  • Are participants rushing (too little time)?
  • Are they taking too long (too much time)?
  • Does section order need adjustment?
  • Which sections need more/less time?
Track section completion:
  • Did participants finish all sections?
  • Where did they drop off?
  • Were time limits reasonable?
  • Do you need to adjust durations?

Option Distribution

For multiple choice questions, see how participants answered. Example Analysis:
Question 5: "What is the mitochondria's function?"
Type: Multiple Choice

Option Distribution:
  A) Energy production (correct)        65% (55 participants)
  B) Protein synthesis                  18% (15 participants)
  C) Cell division                      12% (10 participants)
  D) DNA storage                         5% (4 participants)

Correct Answer: A
Success Rate: 65%
How to Use Option Distribution:
If a wrong answer is very popular:
  • Indicates common misconception
  • May reveal teaching gap
  • Shows what concept to review
  • Helps plan targeted instruction
Example: If 30% chose “Protein synthesis” for mitochondria question, many students confuse mitochondria with ribosomes.
If answers are roughly equal:
  • Participants are guessing
  • Question may be poorly worded
  • Concept not taught clearly
  • All options seem plausible
Action: Revise question or reteach concept
If an option is rarely/never selected:
  • It’s obviously wrong (good distractor elimination)
  • Or it’s too obscure
  • Consider replacing with more plausible distractor

Time Analysis

Understand how long participants spend on the test.

Time Metrics

Average Completion Time

Mean time for participants who finished

Median Completion Time

Middle completion time (less affected by outliers)

Fastest Completion

Shortest time to complete

Slowest Completion

Longest time to complete (excluding incomplete)
Time Distribution:
0-20 min:  ██ 2 participants (very fast, check for validity)
20-40 min: ████████████ 12 participants
40-60 min: ████████████████████████ 24 participants
60-80 min: ██████████ 10 participants
80+ min:   ███ 3 participants (may need accommodations)

Time vs Performance Correlation

Analyze whether more time = better scores:
More time spent = higher scoresInterpretation:
  • Careful work pays off
  • Time limit is appropriate
  • Questions require thought
This is Normal and Good

Comprehensive Analytics Report

Full analytics view combining all metrics:
Test: Comprehensive Final Exam
Date: March 15, 2024

OVERVIEW
========
Total Participants: 127
Completed: 122 (96.1%)
Average Score: 73.4%
Median Score: 76.0%
Highest Score: 97%
Lowest Score: 38%
Average Time: 52 minutes

SCORE DISTRIBUTION
==================
0-20%:   1 participant (0.8%)
20-40%:  5 participants (4.1%)
40-60%:  18 participants (14.8%)
60-80%:  52 participants (42.6%)
80-100%: 46 participants (37.7%)

Pattern: Normal distribution (appropriate difficulty)

QUESTION DIFFICULTY
===================
Hardest Questions:
  Q18: 28% success rate - "Calculate standard deviation"
  Q25: 31% success rate - "Explain quantum mechanics"
  Q12: 42% success rate - "Derive formula"

Easiest Questions:
  Q1: 94% success rate - "Define basic term"
  Q3: 91% success rate - "Identify element"

Average Success Rate: 71%

SECTION PERFORMANCE
===================
Section 1 (Multiple Choice): 78% average
Section 2 (Problems): 69% average
Section 3 (Essay): 71% average

RECOMMENDATIONS
===============
- Review Q18 and Q25 for clarity
- Most questions show good difficulty (60-90% range)
- Time limits appear appropriate
- Consider adding more challenging questions

Using Analytics to Improve

Immediate Actions

1

Identify Problem Questions

Review questions with less than 40% success rate for issues
2

Plan Remedial Instruction

Target concepts with low performance for review
3

Adjust Grading If Needed

Consider curve or question removal if test was unfair
4

Support Struggling Students

Reach out to participants with very low scores

Long-Term Improvements

Revise Questions

  • Remove or fix questions with very low success rates
  • Improve wording of confusing questions
  • Add more questions at appropriate difficulty
  • Balance easy/medium/hard distribution

Adjust Instruction

  • Spend more time on difficult concepts
  • Use different teaching methods
  • Provide more examples and practice
  • Address common misconceptions

Refine Test Design

  • Adjust time limits based on completion data
  • Reorder sections if needed
  • Balance question types
  • Consider alternative assessment methods

Build Question Bank

  • Save high-performing questions
  • Create difficulty-rated libraries
  • Document what works well
  • Share insights with colleagues

Exporting Analytics

Save analytics data for further analysis:
  • Export to CSV/Excel for custom analysis
  • Share with colleagues or administrators
  • Track performance over time
  • Compare multiple test versions
  • Include in reports or publications
(Export features depend on subscription plan)

Best Practices

  1. Review After Each Test: Don’t skip analytics review
  2. Track Trends: Compare analytics across multiple test administrations
  3. Share with Students: Discuss aggregate results (not individual scores)
  4. Document Insights: Keep notes on what you learn
  5. Iterate: Use insights to improve next test
  6. Consider Context: Analytics don’t tell the whole story
  7. Act on Data: Don’t just collect data, use it

Privacy & Ethics

When sharing or discussing analytics:
  • Never reveal individual participant performance publicly
  • Use aggregate data only
  • Respect participant privacy
  • Follow institutional policies
  • Be mindful of how data is interpreted

Next Steps

Question Library

Build better questions based on analytics

Grading

Complete grading to unlock full analytics

Test Settings

Adjust test configuration based on insights

Results

View and export participant results

Build docs developers (and LLMs) love