Real, or not.

One message the model wrote, and the audio of it read out loud. Say whether a Tunisian would actually say that.

0 settled0 pending

One message at a time.

Each round is a single message with its own recording, usually five to fifteen seconds. The lines before it are shown above, greyed out, so you can tell what it is answering. Those are context; the message in full size is the one you are judging.

Playing as a guest. Your rounds are saved to this browser.

Signing in attaches everything you have already done to an account. It is not required, and it never blocks a round.

Judge a message
+1 now, +3 if the crowd agrees with you, -1 if it does not
Rewrite a broken one
+2 now, +3 if other people write the same, -2 if nobody does
  • Spaceplay or pause
  • 1real
  • 2wrong
  • Sskip
  • Rreplay

One message at a time.

Each round is a single message with its own recording, usually five to fifteen seconds. The lines before it are shown above, greyed out, so you can tell what it is answering. Those are context; the message in full size is the one you are judging.

Judge the words, not the voice. Real gets one point. Wrong gets one point too, and then the message goes to whoever wants to rewrite it.

It used to be a whole conversation at once, which asked you for one answer about four different sentences. One at a time is faster to judge and far easier to fix.

Ranked on what settled, not on what you pressed.

Pending points are had by pressing a button. Settled ones are had by having been right about something other people judged independently, which is why this table only counts those, and why it cannot be climbed by playing faster.

Reading the board

Two numbers, because one would be a number we cannot stand behind.

A judgement only settles once enough other people have judged the same message. Agree with them and it stands; disagree and it comes back off. That takes days rather than seconds, so the pending number will keep moving after you have stopped playing.

The obvious ones.

Do the points mean anything?

They mean something once other people have judged the same messages. Until then they are a claim, which is why the page shows settled and pending as two numbers instead of adding them up.

Can I just click through it?

You can, and it will not add up to anything. A judgement that settles against everyone else nets zero: what it paid for taking part comes straight back off. A round answered faster than reading it takes is dropped before it scores at all.

Why only one message at a time?

Because that is what you can answer without hedging. A whole conversation asked for one verdict on four different sentences, and a rewrite meant retyping the lot. The pipeline records each message separately, so the game hands them out the same way.

What happens to what I write in fix mode?

It goes into the training data if other correctors, working from the same message and without seeing yours, write something close enough. If nobody does, the disagreement is recorded and the message is left alone.

Do I have to sign in?

No. An anonymous cookie tracks your rounds. Signing in later claims them; clearing your cookies before you sign in loses them.

Where do the conversations come from?

The model writes them as short conversations across everyday topics, and Dido reads each line out separately. Nothing here was written by a person, which is the entire reason it needs checking by one.