Vitalik expressed his opinion on the recent GPT-4 Turing test results, stating that the accuracy is not the main focus. The key point is that the development of artificial intelligence has reached a milestone where “AI is no longer useless.” It is important to remember this fact in the future.
Background: What is the Turing test?
Vitalik believes that GPT-4 has passed the Turing test.
The Turing test refers to a computer providing language for humans to test. If humans cannot distinguish whether the text is generated by a human or a computer, then the language model has passed the Turing test.
Although the Turing test is not a necessary or sufficient condition for defining intelligence, it is still an interesting benchmark in the industry.
Just as Oxford University philosopher Toby Ord said, “Although no one believes that AI is a symbol of intelligence, the process of studying its victory over human players in international Go competitions is still very interesting.”
Compared to other “single-dimensional ability” benchmark tests, the Turing test is more widely applicable. For example, the ability to play Go or play a specific video game is not as crucial as the universality of testing AI. The Turing test is an important standard for verifying this issue, which cannot be validated by increasing the number of single tests.
Vitalik seems to be very interested in AI as well and expressed his opinion on whether GPT-4 has passed the Turing test. Although currently, humans only have a 54% probability of correctly identifying GPT-4 in the Turing test, Vitalik believes that this number already holds significance in real life. He considers GPT-4 to have passed the Turing test.
In the current Turing test of GPT-4, the probability of humans being guessed as humans is 66%, while the probability of computers being identified as humans is 54%. Vitalik believes that a 12% difference is small, and this ratio is already close to the probability of “tossing a coin and getting heads or tails.”
Vitalik stated, “The Turing test is a milestone, and the significance behind it is that AI is no longer useless. It is best to always remember that we have crossed this milestone in the world.”
(Apple rumored to collaborate with OpenAI to integrate ChatGPT into iOS 18)
AI
GPT
GPT-4
Vitalik
Further reading:
Vitalik discusses the impact of multidimensional gas pricing to improve Ethereum fee standards.
Account abstraction EIP-3074 becomes a point of debate in the Ethereum community, and Vitalik proposes a new improvement plan, EIP-7702.