An Analysis of Eugene Goostman's Performance on the Turing Test

This essay provides a comprehensive analysis of Eugene Goostman's performance on the Turing Test. It begins with an introduction to the test and its significance in evaluating machine intelligence. The essay delves into the case overview, detailing the test's procedures, rules, and the role of human interrogators. It examines whether Eugene Goostman successfully passed the test, providing evidence and scoring details. Furthermore, the essay explores the Turing Test's origins, development by Alan Turing, and its focus on assessing a machine's ability to exhibit human-like behavior. It also discusses the limitations of the Turing Test in probing intelligence, including issues related to reliability, matrix creation, and unconventional judging techniques. The essay analyzes transcripts of conversations between Eugene Goostman and the judges, highlighting social, demographic, compassionate, logical, and organized features exhibited by the AI. The conclusion summarizes the key findings, emphasizing the challenges and complexities of the Turing Test in the field of artificial intelligence.

Running head: EUGENE GOOSTMAN
EUGENE GOOSTMAN
Name of the Student
Name of the University
Author note

1
EUGENE GOOSTMAN
Table of Contents
Introduction......................................................................................................................................2
Case overview..................................................................................................................................2
Eugene Goostman surpassing qualification.....................................................................................2
Turing test........................................................................................................................................3
Turing intelligence probing.............................................................................................................4
Transcript provisioning....................................................................................................................5
Features of Eugene Goostman.....................................................................................................5
Conclusion.......................................................................................................................................7
Bibliography....................................................................................................................................9

2
EUGENE GOOSTMAN
Introduction
This report will discuss about the over view of the entire case. This will help us in
developing a better understanding of work process methodology of the Turing test. This report
will also discuss about whether Eugene Goostman have passed the Turing test. This report will
also provide a brief understanding regarding the probe of intelligence that provides tests for the
machines. The transcripts and the discussions in between Eugene Goostman and other testers are
provided. Features of Eugene Goostman will also be discussed in this report. This report will be
based on the evidences that are present in the setup system.
Case overview
Transcripts are provided as per the practical series of transcripts that will help in better
understanding of the test undertaken process. The test is performed as per the rules and
regulations of the Royal Society London. Three participants were taking part in the completion
of the project. The transcripts that are present indicates that functioning of the project gets
performed by fooling the interrogator. The case mainly revolves around Eugene Goostman,
being the first machine to pass the exam. The data that are generated during the tests are not
generally posted, but this was the first time that the Royal Society London has published their
reports. This case provides proper transcription of the conversations that took place in between
the entity and judges who were responsible for completion of the tasks. With the help of the
provided transcription data proper evaluation can be made. This evaluation will help in proper
commencing of the system that will be beneficial for better understanding of the project and
hence the process of data management will get performed in a better manner. This will help in

3
EUGENE GOOSTMAN
better understanding of the system and the infrastructural knowledge regarding Eugene
Goostman will be well understood.
Eugene Goostman surpassing qualification
Yes, Eugene Goostman really passed the exam.
Eugene Goostman was the first ever machine to pass the Turing test. Eugene Goostman
was successful in pretending that it is not a machine but a human character. This is one of the
main aspect that leads to passing of the test. Eugene Goostman has performed proper
management set up and the score that was secured by Eugene Goostman was 33%. The
percentage of marks that is required for passing of the test is 30%. Despite this aspect that
Eugene Goostman got 33%, the percentage that is provided was incorrect and the marks that
Eugene Goostman deserves is 43%. The main reason of this choice is tat out of 30 judges 10
judge were sure that Eugene is a human whereas the other judges knew that Eugene Goostman
was a machine. The main concern that arises is that 3 out of the 30 judges were unsure regarding
Eugene Goostman being a human or machine. They have parallel marked Eugene as human and
machine. This section ensures that management of the project gets functional as all the three of
them have provided Eugene Gooston, 100 out of 100 in the field of performing human like
conversation. Hence it can be stated that the projected score would have been 43%. But the score
that was chosen by the head of the organization was 33%. Anyways the change in score has not
affected the acceptance of the project as despite having issue in calculation stage, the achieved
score was higher than that of the passing marks.
Turing test

4
EUGENE GOOSTMAN
Turing test was initially developed by Alan Turing in the year of 1950. The test is mainly
focusses in proposing the intelligence level of the machine. This test process is concerned with
the machines behaviour acting like a human or not the main objective of the process is to
understand whether the machine has the ability to behave the way a human would behave in a
particular situation. This test also takes into consideration the way the machines would talk and
compare their styles with common man speaking. In case the testing team can distinguish, the
judgement is provided. Turing Test includes better processing of human evaluator. This includes
the fact that the judgement in between conversation in between the human and machines
generating human like responses. This process includes proper testing and evaluating as per texts
that are being exchanged among the test takers as per the rendering of words and speech. Turing
test includes aspect that introduction gam e is introduced and used for evaluating of the test.
Artificial Intelligence has been affecting the processing of the Turing test. Artificial Intelligence
is considered as the platform for performing the test. Turing test is considered to be one of the
most controversial test that is present in the commencing of the testing process. Academic
scrutiny has been one of the major aspect for the testing conditions. Despite the usage of the AI
based platform accuracy of the testing result is often questioned. It is expected that in coming
years the accuracy of the testing result will increase. The total number of machines that has
passed the Turing test was nil until Eugene Goostman broke the deadlock and became the first
machine to surpass the requirement of the Royal Society.
Turing intelligence probing
As per today’s circumstances the main advantages that will be ensured is that the
efficiency of the Turing test in probing intelligence is comparatively low. This is one of the
major issue that process suffers from is that the reliability of the test is very low. Another issue

5
EUGENE GOOSTMAN
that is present is that in case of measuring intelligence of the machine requirement of matrix
create is required. Absence of matrix creation technique has led to improper management of the
entire system. The validity in the system is put into question. The judging technique that is used
in the process is also unconventional. The matrix that is used is set by human hence the accuracy
of the results can be questioned. This inaccuracy in judgement technique affects proper
judgement processing of the intelligence system that is possessed in the machines. In case of
processing of the entire system the main issue that is present includes improper evaluation of
mistakes, namely typo error. In case of typo error occurrence, the errors might be due to the
personnel being drunk and the intelligence system of the personnel might not be functioning in a
proper manner. In that case the system that is processed in the system is that the evaluator marks
the communicator as a machine.
Transcript provisioning
Features of Eugene Goostman
Social Characteristics.
Transcript 1 LHS: In the first transcript it is seen that the judge asks about the worst
memory that he had in his life so far, the answer that was provided was that it was unaware of
the of the question and demanded better explanation. The judge again asked of a memory that the
entity had and was painful. Entity answered in a way and said that the question that was asked to
him is tricky and he has been having a good life till then, yet the most painful moment he had
was during his poor performance in the stage of GCE. He also mentioned that at that time he was
quite young. After this answer the judge asked whether the entity had failed or not. Entity replied
that it had failed partially. On this note the judge asked him to explain on the topic. Entity stated

6
EUGENE GOOSTMAN
that few grades were good and the other were quite bad. These features includes better
understanding of the social aspects.
Demographic features.
Transcript 1 RHS: In this case the judge asks entity regarding having of breakfast that he
had. In answer entity replied that whether the question was a third question. This ensured the fact
that the management that the entity did not want to answer the question and the judge respected
his choice. After this section the entity asked the judge regarding the occupation of the judges.
The judge’s seemed to be quite impressed and hence replied that she is an actress and writer.
Then the entity seemed to be having some fun with the judge and then both of them asked them
about their native lands and ended the chat. This ensures that demographic characteristics is
portrayed in this section.
Transcript 2 LHS: In this transcript the judge interrogates thee entity regarding the height,
weight of the entity. The entity replied that h is nearly 6 ft. he also stated that he is almost 10
stones heavy. Gender of the entity was also asked. The entity answered that it was a male.
Transcript 2 RHS: In this case it is seen that the judge again asks the entity regarding the
height of the entity and it is seen that the entity answers the judge in a differential manner. The
judge takes into consideration the fact that weight of the entity was asked but the entity refused
to answer the judge. Asking of gender of the entity was asked and hence the answers were
provided.
Compassionate feature
In transcription 3 LHS, compassionate feature of the entity was also found. The main
advantage of then process includes the fact that the entity asks whether the police is behind some

7
EUGENE GOOSTMAN
one after getting to know the fact that the police was surrounding the truck. He also seem
interested regarding the Queen’s birthday.
Logical feature
In transcription 3 RHS, it is seen that the entity has been well aware of the fact that
people might enjoy the rain at night. He also cracked a joke with the judge regarding wordings
and phrasing of the also said that he is in a good mood today. This proved that he is logically
string enough for bettering the understanding of the entire system.
In transcript 9 RHS, the major aspect that proves that entity is quite logical in nature as
the entity has described himself as an artist who is bothered with the financial aspect. This
indicates that the entity has a vivid knowledge regarding the functioning of the topics he is
working on.
Organized feature
In transcript 9 LHS, the entity was judged by a comedian. He was able to understand his
humour and also stated that he watched Naked Gun, which made the judge feel that he is quite
mature. The entity also initiated the topic of artificial intelligence and computers.
In the transcript 5 LHS, it is seen that both the judge and the entity is discussing
regarding the weather. It is seen that entity is well aware that the weather was gloomy and when
the judge said that he is worried about the guardsman as it was going to rain but the entity replied
that not only the guardsmen will be suffering but also entire mass who will be exposed to the
scene.

8
EUGENE GOOSTMAN
In transcript 8 RHS, the entity starts off by saying that he is pleased to have a chat with
the judge. He also pranks with the judge and after that both of them speaks about the place where
they are staying, a brief discussion regarding London is also made as both of them feel hat it is a
beautiful place to stay.
Conclusion
From the above discussion it can be stated that Turing test is one of the most difficult
tests that occurs as the testing process of Turing is diverged into departments. This is one of the
major aspect that will be provided as per the transcriptions that are provided. After proper
analysis of the transcription results are set out. This imitation process is used for proper testing of
machines and certifying them as per the levee of human level interaction is provide. Chatting of
the machine along with the judges are performed. With the help of proper understanding of the
result of the transcription the main advantage that will be received includes the aspect that proper
evaluation of distinction in between machines and human can be made. The base marks that must
be achieved in the Turning cycle for projecting the machine as a certified human level interaction
machine is 30 %. Eugene Goostman is considered as the first machine that has received the
certification of turning testing.

9
EUGENE GOOSTMAN
Bibliography
Adams, T. (2017). AI-powered social bots. arXiv preprint arXiv:1706.05143.
Barnard, K. (2016). Who is Eugene Goostman anyway?: tech
feature. MoneyMarketing, 2016(Jun 2016), 15.
Castelluccio, M. (2016). After the turing test. Strategic Finance, 98(3), 55-57.
HARTANTO, B. (2018). Instrumentalizing Aspects of Social Robots: A Philosophy of
Technology Perspective. Envisioning Robots in Society–Power, Politics, and Public
Space: Proceedings of Robophilosophy 2018/TRANSOR 2018, 311, 268.
Io, H. N., & Lee, C. B. (2018, April). Understanding the Adoption of Chatbot. In Future of
Information and Communication Conference (pp. 632-643). Springer, Cham.
Koren, O., & Perel, N. (2016). Contextual test: an alternative way to measure computer
ability. AI Matters, 2(3), 6-13.
Kunwar, S. (2018). Artificial Intelligence: Pushing the Frontiers of Machine Intelligence.
Shah, H., & Warwick, K. (2019). Trust and Decision Making in Turing's Imitation Game.
In Advanced Methodologies and Technologies in Artificial Intelligence, Computer
Simulation, and Human-Computer Interaction (pp. 195-210). IGI Global.
Shieber, S. M. (2016). Principles for designing an AI competition, or why the Turing test fails as
an inducement prize. AI Magazine, 37(1), 91-96.
Shieber, S. M. (2016). Principles for designing an AI competition, or why the Turing test fails as
an inducement prize. AI Magazine, 37(1), 91-96.

10
EUGENE GOOSTMAN
Srinivasan, B., & Shah, K. (2019). Towards a unified framework for developing ethical and
practical Turing tests. AI & SOCIETY, 34(1), 145-152.
Subramanian, R. (2017). Emergent AI, Social Robots and the Law: Security, Privacy and Policy
Issues. Subramanian, Ramesh (2017)" Emergent AI, Social Robots and the Law:
Security, Privacy and Policy Issues," Journal of International, Technology and
Information Management, 26(3).
Trust and Decision Making in Turing's Imitation Game. In Advanced Methodologies and
Technologies in Artificial Intelligence, Computer Simulation, and Human-Computer
Interaction (pp. 195-210). IGI Global.
Turner, J. O., Nixon, M., & Bizzocchi, J. (2015). SL-Bots: Automated and Autonomous
Performance Art in Second Life. In New Opportunities for Artistic Practice in Virtual
Worlds(pp. 263-289). IGI Global.
Warwick, K., & Shah, H. (2016). Can machines think? A report on Turing test experiments at the
Royal Society. Journal of experimental & Theoretical artificial Intelligence, 28(6), 989-
1007.