Skip to main content
Test settings give you fine-grained control over how tests behave, how they’re scored, and what participants can see. Configure these options to match your assessment requirements.

​
Accessing Test Settings

To modify test settings:
  1. Navigate to your test
  2. Click the Settings tab
  3. Choose from the categories: General, Sections, Results

​
General Settings

​
Basic Information

The test name visible to participants and in your test list.Best Practices:
  • Use descriptive names: “Midterm Exam - Biology 101”
  • Include date or term if applicable
  • Keep under 60 characters for display
Optional context shown to participants before they start.What to Include:
  • Test purpose and coverage
  • Instructions or requirements
  • Materials needed
  • Expected completion time
  • Any special notes

​
Access Mode

Controls the base visibility of your test:
Anyone with the test link can access it.Use When:
  • Open practice tests
  • Public demonstrations
  • Anonymous surveys
  • Marketing assessments
Note: You can still add password protection or other restrictions to public tests.

​
Randomization

Control how questions and answers appear to participants:
Shuffle the order of questions within each section.Benefits:
  • Reduces cheating
  • Each participant sees different order
  • Maintains section organization
Considerations:
  • Question numbers change for each participant
  • May affect narrative or progressive difficulty
  • Reports show original question order
Shuffle the order of options for multiple choice and similar questions.Benefits:
  • Prevents answer pattern sharing
  • Each participant sees different option order
  • Applies to: multiple-choice, yes-or-no, image-choice, audio-choice
Not Applied To:
  • Fill-in-the-blank
  • Text fields
  • Ranking (order is the answer)
Randomization settings are applied when participants start the test. Changes to randomization after publishing don’t affect participants who already started.

​
Section Settings

Each section can be configured independently.

​
Section Duration

Set time limits for individual sections:
1

Enable Section Durations

Toggle “Use Section Durations” in test settings
2

Set Duration Per Section

In the Questions page, set duration (in minutes) for each section
3

Validate Total Time

Ensure total section durations fit within test availability window
Behavior:
  • Each section has its own countdown timer
  • Participants must complete section before timer expires
  • Can’t return to previous sections
  • Automatically moves to next section when time expires

​
Scoring Modes

Choose how questions are scored within each section:
Each question is worth 1 point regardless of complexity.Formula:
Score = (Correct Questions / Total Questions) × 100
Best For:
  • Equal-weight questions
  • Simple percentage scores
  • Standardized tests
  • When all questions test similar difficulty
Example:
  • 10 questions in section
  • 7 answered correctly
  • Score: 70%
Scoring mode is set per section. Different sections in the same test can use different modes.

​
Section Organization

Adding Sections:
  1. Go to Questions page
  2. Click “Add Section”
  3. Set section title and description
  4. Add questions to the section
Reordering Sections:
  • Drag sections to reorder
  • Section order affects participant experience
  • Consider logical flow and difficulty progression
Deleting Sections:
  • Soft delete (can be restored)
  • Questions in section are also deleted
  • Existing participant attempts are preserved

​
Results Settings

Control what participants can see after completing the test.

​
Results Release

Determines if and when participants can view their detailed results:
Participants can view their detailed results immediately after completion.Shows:
  • Overall score
  • Section-by-section scores
  • Individual question results
  • Correct answers
  • Their submitted answers
  • Feedback (if provided)
Best For:
  • Practice tests
  • Self-study
  • Formative assessments
  • Learning activities
Results are automatically withheld for any participant whose test includes questions that need manual review. Once you grade all manual questions, results become visible.

​
Schedule Settings

Control when the test is available.

​
Start Time

Set when participants can begin:
  • Immediate: Test is active as soon as published
  • Scheduled: Test activates at a specific date/time

​
End Time

Set when the test closes:
  • Manual: No automatic end time, stop manually when ready
  • Scheduled: Test automatically ends at specified date/time

​
Scheduling Validation

When using section-based durations, the system validates that total section time fits within the test window:
Section 1: 30 minutes
Section 2: 45 minutes
Section 3: 30 minutes
Total: 105 minutes

Test Window: Must be ≥ 105 minutes
See Creating Tests for detailed scheduling options.

​
Advanced Configurations

​
Multi-Section Tests

Combining different scoring modes: 
Test: "Comprehensive Final Exam"
  Section 1: "Multiple Choice" (Percentage Mode)
    - 20 questions, each worth 1 point
    - 30 minutes
  
  Section 2: "Problem Solving" (Point-Based Mode)
    - 5 questions with varying points (2-10 points)
    - 45 minutes
  
  Section 3: "Essay" (Point-Based Mode)
    - 2 questions worth 25 points each
    - 60 minutes
    - Manual grading required

​
Progressive Difficulty

Structure tests with increasing challenge:
  1. Section 1: Easy warmup (short time, percentage mode)
  2. Section 2: Medium difficulty (more time, point-based)
  3. Section 3: Hard problems (ample time, point-based with high values)

​
Adaptive Learning Paths

Though Evaly doesn’t have automatic branching, you can:
  1. Create multiple test variants
  2. Use participant groups for different paths
  3. Manually assign appropriate tests based on performance

​
Best Practices

Set Clear Expectations

Use description field to explain:
  • Time limits
  • Scoring method
  • Available resources
  • Submission requirements

Test Your Settings

Before publishing:
  • Take the test yourself
  • Verify randomization
  • Check time limits
  • Test results display

Consider Question Mix

Balance:
  • Auto-graded vs manual
  • Objective vs subjective
  • Easy vs difficult
  • Quick vs time-intensive

Plan Grading Time

Account for:
  • Manual grading requirements
  • Number of participants
  • Complexity of questions
  • When results must be released

​
Common Configurations

​
Quick Quiz

Access: Public
Duration: 10 minutes (schedule-based)
Randomize Questions: Yes
Randomize Answers: Yes
Scoring: Percentage mode
Results: Released immediately

​
Formal Exam

Access: Private (participant list)
Duration: Section-based (3 sections)
Randomize: No (preserve difficulty progression)
Scoring: Point-based (weighted by difficulty)
Results: Withheld until grading complete

​
Practice Test

Access: Public
Duration: No time limit
Randomize Questions: Yes
Randomize Answers: Yes
Scoring: Percentage mode
Results: Released with feedback

​
Next Steps

Access Control

Add passwords and participant restrictions

Monitoring

Track participants during the test

Grading

Learn the grading workflow

Analytics

Analyze test performance

Build docs developers (and LLMs) love

Get started for freeTalk to us