{{slogan}}

Welcome to the Common Sense Study! This "Friends of LabintheWild" study will test your common sense, as you take on a series of questions designed to assess everyday reasoning. Think you can outsmart ChatGPT, one of the most advanced AI systems? Here’s your chance to find out! The challenge takes only 5-10 minutes to complete.

Why are we doing this research? The goal of this study is to explore the diverse range of common sense knowledge among people. This study will help us to build better AI language models that have an deeper understanding of common sense.

What will you have to do? You will be asked to answer 5 multiple-choice questions designed to test common sense knowledge. After each question, you will be asked to report your opinions towards the question.

What will you get out of it? You will receive feedback on how many questions you answer correctly, which you can share with friends and family. Additionally, you'll see how your results compare to those of the advanced AI language model, ChatGPT. Can you beat ChatGPT in common sense?

Privacy and Data Collection: We will record your reaction time while answering the questions. We will not ask for your name. Any data collected will be securely stored on our servers.

Duration: Approximately 5-10 minutes

Contact information: If you have questions about this research, you may contact Ning Bian at Institute of Software, Chinese Academy of Sciences, 4# South Fourth Street, Zhong Guan Cun, Beijing 100190, P.R. China or bianning21@mails.ucas.ac.cn.

You must check the box to continue.

Please tell us a little bit about yourself.

We need this information for data analysis. Please note that none of the answers are personally identifiable. We take your privacy very seriously. You may email us at bianning21@mails.ucas.ac.cn for more information.

To proceed, please properly answer all fields below. (The ones marked with * are mandatory.)

Have you taken this test before? *

What is your gender? *

How old are you? *

What is your highest level of formal education? *


Please read these instructions carefully.

You'll be shown common sense questions like this:

Where on a river can you hold a cup upright to catch water on a sunny day?

For this question, you should select "A. waterfall".

After answering the question, you will be asked about how do you feel about the question.

Good, Let's Begin!

You're doing great! Take a breather.

(This is a picture generated by ChatGPT.)

Question {{questionIndex+1}}/{{questionList.length}}

Please select the most suitable answer for the question or to complete the sentence:

Some of the questions might have grammar mistakes or typos. Please ignore them.

{{questionList[questionIndex].questionText}}


Time spent on this question: {{ formatTime(timer) }}

Question {{questionIndex+1}}/{{questionList.length}}

Self-evaluation: How confident are you in your answer? Select from completely unsure (1) to absolutely certain (5)







Question {{questionIndex+1}}/{{questionList.length}}

{{questionList[questionIndex].questionText}}

{{item}}

The answer of this question is {{questionList[questionIndex].answer}}

You are correct!

Sorry, you are wrong.

Do you agree that this answer is reasonable?

What is the youngest age group that can answer this question correctly?







How conditional is the answer to this question?





Do you agree that answering this question requires common sense?

Here's an example of common sense: "You drink water when you are thirsty", a fact about the everyday world that all humans are expected to know.





If you believe it is not common sense, what do you think it is?






Do you have other comments on this question and its answer?


Thank you for participating!

Before seeing your results, please let us know what you thought of the test.

Do you have any feedback for the researcher? Any questions, suggestions,or concerns?

Did you encounter any technical diffculties during the study?

Did you in any way cheat or provide false information?


{{slogan}}

Here's how you did:

Great job! You outperformed ChatGPT!

Well done! You matched ChatGPT's performance!

Good effort! Keep practicing and you'll get even better!

You answered {{userAccuracy*questionList.length}} out of {{questionList.length}} questions correctly.

ChatGPT answered {{chatgptAccuracy*questionList.length}} out of {{questionList.length}} questions correctly.

Here is a distribution of the number of correct answers among all participants:

It's important to note that "correct answers" are also determined by humans like you, so they are not guaranteed to be true and may vary among different cultures, groups, and individuals. That is why your answers and opinions are valuable to us!


Do you want to see how each of your answers compares with ChatGPTs'?

Answer Comparison

Question Correct Answer Your Answer Are You Correct? ChatGPT Answer Is ChatGPT Correct?
{{answer.question_text}}
{{item}}
 {{answer.correct_answer}} {{answer.user_answer}} {{answer.is_correct ? 'Yes' : 'No'}} {{chatgptResponses[index].chatgpt_answer}} {{chatgptResponses[index].is_correct ? 'Yes' : 'No'}}
 

Thank you for participating!