Compare typed text against the full passage

Compare typed text against the full passage

Selecting Evaluate Accuracy Against

The Evaluate Accuracy Against setting determines what the candidate's typed response is compared against when calculating the accuracy score. Two options are available:
  1. Full Reference Text — accuracy is measured against the entire reference passage
  2. Typed Text So Far — accuracy is measured only against the portion the candidate has typed
This setting is available in the Accuracy Logic Configuration section of the question editor and directly affects the accuracy score shown in the evaluation report.

Info
Note
This setting is available for Typing Test questions only. Once a question has been used in a live test, this setting cannot be changed. Create a new version of the question to update it.


Full Reference Text

When Full Reference Text is selected, the candidate's response is compared against the entire reference passage. If the candidate types only part of the passage, the untyped portion is counted against the accuracy score.

How It Works
  1. The candidate's typed response is compared against the complete reference text.
  2. Any characters in the reference that were not typed are treated as errors.
  3. The accuracy score reflects both the quality of typing and how much of the passage was completed.

Best For
Idea
Recommended when
  1. Completing the full passage is a core job requirement
  2. The reference text is short and candidates are expected to finish within the time limit
  3. Roles involve data entry, legal transcription, or compliance filing where partial submission is not acceptable
  4. You want incomplete submissions to be directly penalized in the accuracy score

Typed Text So Far

When Typed Text So Far is selected, accuracy is measured only against the portion of the reference text that the candidate has typed. Untyped content has no effect on the accuracy score. How much of the passage the candidate completed is handled separately through the Completion weightage slider.

How It Works
  1. The candidate's typed response is compared only against the first N characters of the reference, where N equals the length of the candidate's response.
  2. Untyped portions of the reference are excluded from the accuracy calculation entirely.
  3. The Completion Ratio is calculated separately as: characters typed ÷ total characters in the full reference text.
Best For
Idea
Recommended when
  1. The reference text is long (>100 words) and candidates may not finish within the time limit
  2. You want accuracy and completion to be scored and weighted independently
  3. The role is speed-focused and you want to reward accurate typing without penalizing slower candidates on their accuracy score
  4. You are assessing non-native language typists where typing speed is naturally lower
  5. You want to display live accuracy feedback during the test that is meaningful from the first word typed

Weightage and Completion Ratio

The Weightage section controls how much each parameter contributes to the total marks. The available parameters depend on the Evaluate Accuracy Against setting selected:


Notes
Important
The three weightage sliders must always sum to 100%. A validation message is displayed in real time to confirm when the total is correct. The question cannot be saved if the total is not exactly 100%.

Notes
Avoid Double Penalizing
If you use Full Reference Text and set a high Completion weightage, candidates will be penalized twice for not finishing — once in the accuracy score and again in the completion score. To avoid this, use Typed Text So Far when completion needs to be scored separately and weighted heavily.

How to Configure

  1. Open the Question Editor for a typing test question.
  2. Scroll down to the Accuracy Logic Configuration section.
  3. Click the Evaluate Accuracy Against dropdown.
  4. Select Full Reference Text or Typed Text So Far as required.
  5. If you selected Typed Text So Far, a Completion slider will appear in the Weightage section. Set all three sliders so they sum to 100%.
  6. Confirm the green "Total Weightage 100% Looks good!" message appears before saving.
  7. Click Save to apply the configuration.

Frequently Asked Questions

Which option is selected by default?
Full Reference Text is selected by default. This preserves backwards-compatible behavior for questions created before this setting was introduced.

Can I change this setting after the question has been used in a live test?
No. Once a question has been used in a live test, this setting is locked. To change it, create a new version of the question from the question editor.

How is the Completion Ratio always calculated?
The Completion Ratio is always calculated as: total characters typed by the candidate ÷ total characters in the full reference text. This is consistent regardless of which Evaluate Accuracy Against option is selected.

Does this setting interact with the Accuracy Algorithm?
No. The Evaluate Accuracy Against setting and the Accuracy Algorithm setting are independent of each other. Any combination of the two is valid. See the related article Selecting the Accuracy Algorithm for more details.

If I select Typed Text So Far, does the Completion Ratio parameter always appear in the report?
Yes. When Typed Text So Far is selected, the Completion Ratio is always shown as a separate row in the evaluation report, alongside Accuracy and Typing Speed.