Becoming a Judge

You've been selected! If you received an email from us about becoming a judge, here's what you will need to do! This article delves into the roles and responsibilities of becoming one of our esteemed judges!

What does it mean to be a judge?

Congratulations!

After having reviewed your profile, we have decided that you have what it takes to be a judge!
That means you will now receive additional tasks which can be identified with the title “Evaluation Tasks’.
These will be visible to you within the “Available Tasks” section of your profile.

We rely on your expertise to assess potential translators joining our platform.
These tasks involve evaluating candidates for their translation skills rather than providing translations.
Your evaluation will consist of identifying errors and determining if the candidate meets our quality standards.

Earnings for Evaluation Tasks

Earnings for evaluation tasks will be displayed alongside each task on your dashboard, typically ranging from 4-5 Euros per task.
If multiple tasks are available for evaluation, the total income for the batch will be shown, along with the number of tasks included.
Keep in mind that this total reflects the completion of multiple tasks, as indicated in the image.
If only one evaluation task is available, you will see the total amount for that single task.
Please note: the totals for evaluation tasks will differ accordingly based on the word count.

What factors are there to consider when evaluating?

When evaluating tasks, there are several points to keep in mind to assess incoming translators fairly and professionally:

Avoid basing judgments on language variants such as English UK/US unless specified. For instance, if a task involves translating from German to English without specifying US or UK English, refrain from considering variant spellings.
Ensure to consider all available errors when highlighting using the suggested icons, as explained in the following step.
Remember to share your verdict along with a brief, yet informative description of the perceived quality.
State whether you believe the translator is suitable for tasks.
If you see potential for improvement, feel free to mention this along with specific errors they could enhance.

If you have any doubts, please don't hesitate to contact us at support@tolq.com.

How do I evaluate new translators?

To evaluate a new translator, the process resembles that of a proofreading task, but without the need for corrections.
Please follow the steps outlined below.
Your evaluations help us find the best and most suitable translators for Tolq.
If you prefer not to participate as a judge or have any questions about this process, please contact us at support@tolq.com.

Evaluation Task Layout

Each evaluation task features a clear layout: the original source text on the left and its translated version on the right.
This side-by-side presentation facilitates easy comparison and assessment

Begin highlighting

Start by identify any errors in the target translation
Click on a word/(s) (to highlight it) and select the type of error that that belongs to.
Error categories: Spelling, Punctuation, Terminology, Grammar, fluency accuracy & wrong.
Please remember for these tasks, the importance is largely placed on the final verdict.
Should you receive a task with a great deal of errors, please highlight a few of these as examples and submit a bad verdict.
Avoid spending excessive amounts of time on a translation with many errors.

Complete the evaluation task

After completing all of the highlights, please scroll down to submit the evaluation.

Submit your verdict

Lastly, you may now please provide us with your overall verdict, as well as a brief, yet informative description about your perception as to whether you feel this translator is suitable to receive translation tasks.
In addition, to your verdict we take numerous other factors into account such as their CV's, previous translation experience as well as experiences in other fields, therefore, your final verdict will not entirely determine the final decision.
Your verdict will be used as part of the evaluation process and we count on your expertise to provide us with a fair judgement for these potential translators!