The site is finally back up at turingtest.live.

The new site uses a 3-party format where you chat with both a human and an LLM at the same time, and your task is to decide which is which. This setup is closer to Turing's original idea, and we think it will be much harder for the models to pass.

We've also added a range of models, including GPT-4o, Claude, and LLaMA, along with new prompting techniques that allow the models to interact in different ways.

The site will be live every day from 12–1 PM and 8–9 PM GMT (8 AM and 3 PM ET, 5 AM and 12 PM PT). We've done this in the hope of increasing the density of users online at the same time.

Thanks so much to everyone for your help, patience, and support while getting this back going. Please let me know if you have any comments or thoughts on the site as I'll be continuing to make updates. And please feel free to share the site as it works best when we get enough traffic for many people to be live at the same time.

We’re planning to relaunch the site soon and we’re running a pilot test on Friday at 8pm GMT (3pm ET, 12pm PT).

You can access the new site here: 3p.turingtest.live. The pilot will be accessible here on Friday.

Any feedback you can provide about how the site and your interactions work would be greatly appreciated!

If you have any questions or comments, please let me know at cameron@ucsd.edu.

Hi all,

Thank you for your patience and apologies for the lack of updates. I have had to focus on other things over the last months including finishing my PhD and starting a postdoc. However, I am now able to put my full focus on this for the next couple of months. I'm hoping to have the updated experimental design finished by the end of the month and to start collecting data in October.

Thanks again and please let me know if you have any questions!
Cameron

@dominic Thanks very much, Dominic! I'm glad you had a chance to try it out and I appreciate the support!

@Alyssa Thanks so much, Alyssa!

@AntonMakiievskyi Thanks so much Anton! I really appreciate the support.

1. Participants are randomly assigned to be witnesses or interrogators. The lack of humans online is a definite issue, as there were periods where a player would be repeatedly matched with AI if no humans were online. I'm considering only making the game available for ~1hr a day to maximise the density of humans online while keeping costs down.
2. I have applied for OpenAI but didn't hear back. Will try Claude & OpenAI again.
3. This could be a good backstop if we run out of credits again. I'm a little nervous about handling the data but I'm sure there's a secure way to do this.

Yes, I will probably take a couple of weeks to make changes to the site and then hopefully update just before we relaunch. Thanks again and let me know if you have more questions or would like to chat more.

@Austin Thanks very much for your support & thoughtful comments, Austin!