Development of a Mobile Application for Non-Verbal Autistic Children Using Content-Based Image Retrieval

This dissertation proposes a platform that includes an android mobile application and a web admin panel to help non-verbal autistic children communicate and express themselves. The project uses an iterative prototyping methodology and content-based image retrieval (CBIR) to develop a graphical search engine that allows access to various functions including learning concepts, communication, basic mathematics, and socialization. The system will be tested during the prototype stage and evaluated based on the number of ASD users and therapists in the system. The successful mobile application will be deployed into a fully operational system version.

Table of Contents
Introduction.................................................................................................................................................2
Problem statement...................................................................................................................................3
Literature Review........................................................................................................................................4
Methodology...............................................................................................................................................5
Initial Planning........................................................................................................................................5
Planning...................................................................................................................................................5
Requirement............................................................................................................................................5
Analysis...................................................................................................................................................6
Design.....................................................................................................................................................6
Testing.....................................................................................................................................................6
Implementation........................................................................................................................................6
Evaluation................................................................................................................................................6
Maintenance............................................................................................................................................6
Development...........................................................................................................................................6
References...................................................................................................................................................7
Appendices..................................................................................................................................................9
1. Project Proposal...................................................................................................................................9
2. Blueprint............................................................................................................................................19
3. Project Management Plan.................................................................................................................20
4. Questions...........................................................................................................................................21
5. Questionnaire Analysis:.....................................................................................................................22
6. Ethics Section A & B:..........................................................................................................................31

Introduction
The recent years have seen the prevalence of Autism Spectrum Disorder(ASD) increase at
unprecedented rate. So far, the development condition is listed among the major cases of
mental disorders in various parts of the worlds including the UK, US, and India. Note that the
incidence rate in the mentioned regions are 1 in 64, 1 in 68, and 1 in 150 respectively
(Kuriakose & Lahiri 2017). Such realization is quite devastating considering the detrimental
impact of the condition on the autistic child social life. The implications are felt by not only
the autistic individual but also their direct guardians (mainly parents). At this point, the
readers are urged to consider the established facts regarding autism. The lifelong condition is
usually evidenced in the children under the age of 3, and it curtails their ability to
communicate normally, from social relationship, and engage in normal behavior. While this
disorder is barely understood from a casual perspective, most researcher and practitioner
argue that the results from defects in the brain regions dealing with memory retention, motor
skills, and empathy.
Fortunately, the escalation in the prevalence rate is concurrent with the digital revolution.
The modern world is characterized by sophisticated level of Information and Communication
Technology(ICT) advancement that appear instrumental in the alleviation of most of the
communication and socialization challenges faced by autistic children. As far as autism
concerned, major process has been made in the fields of Information Technology and
robotics (Teevan, Dumais, & Horvitz 2017). A range of computer, smartphone, and artificial
intelligence (merged with robotics) software have been developed to help this population
cope with their communication and socialization needs (Golestan, Soleiman, & Moradi
2017). The applications have been tailored to meet the special communication capabilities of
autistic children. Nevertheless, there is too much fragmentation in the emergent intervention
on the same. For this reason, we have been always curious about nonverbal children with
autism, how they express their feelings, needs and thoughts with others surrounding them.
We find it a quite interesting idea to give them a communication medium and see what they
will offer to us. Therefore, this dissertation project proposes we inspire to develop a platform
which include an android mobile application and a web admin panel, together this platform
will help the non-verbal autistic children to communication and give them a way to express
themselves.

Problem statement
By now, it is apparent that different interventions have emerged in attempt to improve the
lives of people spectrum from autism. Some of the common applications include Pocket PC
Picture Exchange Communication System (PECS), Let’s Talk Voice Output
Communications Aid (VOCA), dmTEA, and AUTHIC. Note that the first two focus on
developing the children’s communication skills (Shminan, Sharif, Adzani, & Lee 2017).
dmTEA is a diagnosis tool while AUTHIC improves the autistic child emotional capabilities.
It suite to restate that the mentioned applications are among the various interventions
implemented for autistic individuals. Such a trend demonstrates the problematic state of the
current progress with respect to the disorder. Logically speaking, it is almost impossible for a
single autistic child to benefit from such a fragmented approach. Such a bold sentiment
follows the fact that one cannot access all of the applications regardless of the fact that they
focus on different aspects of ASD. Since here in Oman the unavailability or scarcity of using
application tools in the centers to communicate with the nonverbal and verbal autistic
children.
Perhaps, communication platform of digital content based image retrieval for Autistic
children can solve this problem by enhancing the accessibility of the distinct functions –
includes digital library on a single platform(s).

Literature Review
At the moment, there is a conventional agreement among researchers, academicians, and
practitioners regarding the need to invent large-scope solutions for the growing autistic populace.
(Leroy, Chuang, Huang, & Charlop-Christy 2005) demonstrate their agreement by
acknowledging the fact that ASD is the third most prevalent neurological disorder in the United
States. Similar sentiments are held by (Kuriakose & Lahiri 2017) as they believe that its
prevalence expands beyond the U.S. borders. According to them UK and India are also recording
high incidence rates. Such perspectives are vital in understanding the global status attained by
autism. It is important to know this fact since it supports the idea that the interventions should be
geared towards the attainment of broad needs.
It appears wise to assert that the preceding paragraph does not intend to disregard the current
progress made in the field. For instance, (Kuriakose & Lahiri 2017) propose a VR-based
application that utilizes a simulated environment to teach basic communication and socialization
skills to the autistic children. This innovation can be said to be an extension of Iyer and
Kalbande’s proposed autistic game (2014). Unlike Kuriakose and Lahiri’s invention, the game is
played on a personalized graphical user interface (GUI). At this point, one should reflect on this
project’s thesis: a mobile application -based approach can allow the autistic users to access a
range of interventions from a single application.
When placed into perspective, a huge operating system can be created where both GUI and AR
functions can be accessed by the autistic children. For the sake of this argument, the search
engine concept described by (Zamir, Korn, Fikes, & Lawrence 2010) is quite illustrious: such a
system utilizes a user profile to extract relevant information based on the user’s query. With the
help of the guardian/practitioner, an autistic child can utilize this system to access various
functions including the learning medium (AR or tablet mode), the learning concepts
(communication, basic mathematics, or socialization), and level (based on progress). Of course,
such a platform must adhere to the improvements suggested by (Kodgiwar 2016). According to
her, content based image retrieval (CBIR) allows the system to access data based on graphical
searches. This function is quite beneficial for children spectrum from autism since they are more
efficient with visuals than words (Kamaruzaman & Azahari 2014). In their research, (Agarwal,
Sharma, and Dubey 2016) noted that CBIR can be improved to facilitate sketch image queries.
Such an operating system can only be efficient if it is full of visuals and colorful feature.

Methodology
Iterative Methodology: the system development life cycle to be used is the iterative prototyping
methodology. This was arrived after consideration of the requirements specification, which are
understood and predicted to evolve with time. The process allows the developer to start with a
limited part of requirements and the iteration design gives room to return and add to the
requirements to expand the abilities repeatedly until the system is fully developed, and can be
implemented and later deployed (Anon, n.d).
Initial Planning we will design a mobile application using content based image retrieval (CBIR)
Planning Considering the nature of the investigation, as shown in (Table 1), researcher will
utilize information collected from professionals in the fields of The age of autistic children will
be between 4 to 11 years the status of their situation nonverbal. Case study method of selection
institutions that contain English Speech Language Therapists (SLT), special education Teachers,
child psychologist and autistic children. Number of cases will be between 3 to 5 therapists who
use English language in therapy will be in a groups depend on the number of the institutions.
Number of cases will be between 3 to 5 institutions depending on the availability of those
children and therapists. According to the final statistics gathered by The Ministry of Social
Development the total number of autistic children in Oman around (1242, Figure 1). These
statistics does not show which institution uses English language in their therapy. Case studies
will be taken from the capital area/Muscat governorate because of the density of the institutions
and number of children.
We prefer 3 to 5 therapists from each institution due to the scope of the proposed project: Each
group of the therapists with their assigned autistic children will be having a research designed
using semi structure interview questions from the researcher who will be collecting the response
garnered from the posed research questions will be on both Arabic and the English language.
Once we collect the data in Arabic form will be translated into the English language.
Table 1. Planning methodology of gathering data from the institutions
Group
Type of
Sector Institution Language
Therapis
t Participant age (4 to 11) Observation
1 Private 1 English Male Female Non-verbal
A
B
C
2 Private 2 English D
Requirement the requirements provide an understanding of the proposed system. This established
the main essential requirements, at the best level of knowledge for a start, that is expected to
increase or/ and evolve with the time. Case modeling can be used to identify the products
beforehand like the system specification (Table 2). The requirements will then be classified and

prioritization allocated. They can then be enlisted in vision document or a system charter for
easier reference.
Analysis after collection (Appendance 3 Questionnaires Analysis), the information will be
collated then assessed to enhance the researcher’s gaps of the potential merits and demerits of the
proposed project. It is through this process that applicability of the proposed solution can be
tested before the design and development process begins. Measuring social development by
conducting paper impact of the electronic impact image.
Design as mentioned earlier, the integrated effectiveness of digital content-based image retrieval
application for ASD children will utilize the structure of a typical search engine. The indicators
for observation schedule, and testing emotional expression in the autistic children. The only
difference is that it will be highly graphical due to the content/sketch-based image retrieval
algorithms. While designing the application we will sketch a new image using character 2D
sketch for different ages such as mother, father, grandmother, grandfather…etc. we will be
adding some character with traditional Omani and casual cloths it will be familiar for them.
Testing the software will be tested during the prototype stage. Further, enhancements can be
done only after the prototype proves functionality. Also, testing the functionality of emotional
expression in the participant.
Implementation the system iteration developed inclusive of the evolved and additional
requirements. We will review the code using the therapist’s user feedback received from the
testing and implements the changes and extra functionalities to suit the therapist’s requirements.
Each module will be tested and modified or updated accordingly.
Evaluation the process will be based on the number of ASD users and therapists in the system.
Maintenance once the approved modules will be tested to satisfaction, and the incomplete
modules are redone to full functionality.
Development it is the last stage of development. The successful of mobile application will be
deployed into a fully operational system version. It will necessitate various procedures including
licenses acquisition, prototype development, and network expansion. Each stage demands huge
amounts of financial and human resources. Not to mention the fact that such a project can be
taken up to a six month before completion.
Table 2. Software & Hardware Requirements
Details Software & Hardware SW.Version HW.Version
IDE IDE: Android Studio 3.2
Programming Language Java 1.8 and XML 1.8
Web admin Firebase Cloud Firestore and SDK 17.1.3
Android API 17.1.3
Server Database Firebase Cloud Database 17.1.3
IDE(Integrated development environment) Android Studio 3.2

Android device Support android media framework
References
1. Anon, (n.d.). Iterative Model: What Is It And When Should You Use It?. [online]
Available at: https://airbrake.io/blog/sdlc/iterative-model [Accessed 16 Jan 2019].
2. Anon, (n.d.). SDLC - Iterative Model - Tutorials Point. [online] Available at:
https://www.tutorialspoint.com/sdlc/sdlc_iterative_model.htm [Accessed 16 Jan 2019].
3. Anon, (n.d.). What is iterative development? - Definition from WhatIs.com. [online]
Available at: https://searchsoftwarequality.techtarget.com/definition/iterative-
development [Accessed 17 Jan 2019].
4. Argawal, S., Sharma, R. and Dubey, R. 2016, Sketch-based image retrieval using watershed
transformation. Second International Conference on Computational Intelligence & Communications
Technology, 2.
5. Draw.io. (2019). Flowchart Maker & Online Diagram Software. [online] Available at:
https://www.draw.io/?state=%7B%22ids%22:%5B%221yR0iE0z-BiPBeEdFvEEAMD3u-5LoppCh
%22%5D,%22action%22:%22open%22,%22userId
%22:%22111030580720086588443%22%7D#G1yR0iE0z-BiPBeEdFvEEAMD3u-5LoppCh
[Accessed 22 Jan. 2019]
6. Figure
7. Fulbright, R. (2013). Incorporating Innovation into Iterative Software Development
Using the Inventive Problem Solving Methodology. International Journal of Innovation
Science, 5(4), pp.203-212.
8. Golestan, S., Soleiman, P. and Moradi, H. 2017, Feasibility of using Sphero in rehabilitation of children
with autism in social and communication skills. International Conference on Rehabilitation Robotics
(ICORR), 1
9. Google Docs. (2019). Technologies in communication & Learning of Autism children. [online] Available at:
https://docs.google.com/forms/d/1sWhvRPN_-rQ5CC93X1_NUwwHv6CprO6OjZO-oq5dL-o/
edit#responses [Accessed 23 Jan. 2019].
10. Google Docs. (2019).  في التوحدتدخل التكنولوجيا. [online] Available at:
https://docs.google.com/forms/d/1Bf0CAJp97ot-6Zo0mcVJ7eNEBCHsxkn7MufZTawn9eo/edit [Accessed
23 Jan. 2019].
11. Iyer, S. and Kalbande, D. 2014, Research on educative games for autistic children. International
Conference on Circuits, Systems, Communication and Information Technology Applications (CSCITA), 1
12. Kamaruzaman, M.F. and Azahari, M.H.H. 2014, Form design development study on autistic counting skill
learning application. International Conference on Computer, Communication, and Control Technology, 1.
13. Kodgiwar, V. 2016, Application of content-based image retrieval for e-commerce. World Conference on
Futuristic Trends in Research and Innovation for Social Welfare.

14. Kuriakose, S. and Lahiri, U. 2017, Design of a physiology-sensitive VR-based social communication
platform for children with autism. IEEE Transactions on Neural Systems and Rehabilitation Engineering,
25.
15. Leroy, G., Chuang, S., Huang, J. and Charlop-Christy, M.H. 2005, Digital libraries on handhelds for
autistic children. JCDL 5.
16. Managing Iterative Software Development Projects. (2007). Kybernetes, 36.
17. Prod.teamgantt.com. (2019). TeamGantt. [online] Available at:
https://prod.teamgantt.com/gantt/schedule/?
ids=1383084#&ids=1383084&user=&custom=&company=&hide_completed=false&date_filter=
&color_filter= [Accessed 22 Jan. 2019].
18. Shminan, S.A., Adzani, A.R., Sharif, S. and Lee, N.K. 2017, Autipecs: Mobile Based Learning of Picture
Exchange Communication Intervention for Caregivers of Autistic Children. New York, USA: IEEE.
19. Teevan, J., Dumais, S. and Horvitz, E. 2017, Personalizing search via automated analysis of interests and
activities. ACM SIGIR Forum, 51.
20. Zamir, O.O., Korn, J.L., Fikes, A.B. and Lawrence, S.R. 2010, United States Patent. Patent No.
7693827B2.

Appendices
1. Project Proposal
MSc Project Proposal Form and Ethics Form
MSc Project Proposal Form
Student Number 1623746
Student Name Amna Saleh Nasser Al Araimi
Degree Course MSc Management Information System and
Security.
Supervisor Name Dr. Haiming Liu.
Title of Project
Communication Platform for Non-verbal
Autistic children in Oman using Android
mobile
Description of your artefact
The context:
This project is an extension to the research
conducted by H. Liu, F. Dong, C. Tziraki in
the area of supporting people with
Intellectual Disability (ID) to use Content -
Based Image Retrieval (CBIR) technology
for information seeking in order to assist
them to improve their communication (H.
Liu, et.al).
Autistic children are viewed as ID people
whom are in need for a technological tool
to ease their access and interaction with
CBIR to improve their social interaction
and communication (Zhou, Z., 2006). They
are the subject of this project in Oman.
Aim & objectives of the project
The Aim:
The aim of this project is to tackle
communication dependency of nonverbal
of special needs by providing
a substitutional to verbal communication
with visual communication. We have been

always curious about nonverbal children
with autism, how they express their
feelings, needs and thoughts with others
surrounding them. We find it a quite
interesting idea to give them a
communication medium and see what they
will offer to us. Therefore, we are inspired
to develop a platform which includes an
android mobile application and web admin
panel, together this platform will help non-
verbal autistic children to communicate
and give them a way to express
themselves.
The objectives:
1. To extend the CBIR technology to be
applied on autistics children.
2. Most non-verbal autistic children hardly
express their mood or how they feel
since they lack the natural way of self-
expression.
3. Identified that autistic children can and
will express themselves better through
Image based communication and text-
to- speech application.
4. Understanding by learning what images
represent will help them choose the
images that represent what they want
to communicate.
5. To offer an environment of enjoyable
and attractive communication and
personalization platform.
6. Provide a platform of interaction to the
autistics children, therapists, and
supervisors.
7. Provide performance track record and
measurement indicators for follow up.
8. Children with neurological influenced
communication.
9. Economic accessible
10. Social integrated
11. Home accessible
12. Cultural recognizer using character with
traditional Omani and casual cloth

List of features that the artefact will
include:
1. A database will be created for this
purpose including the following:
a. Autistic profile
b. Therapist profile.
c. Admin profile.
2. An application will be created with
relevant layout for each of the three
users: Autistics, therapists, and admin.
3. CBIR interactive library software will be
integrated with the application for the
three users.
4. Use of identity referencing for each
autistic child (given by the ministry of
social development).
5. Ability to support image formats (jpeg
and png)
6. Ability to support YouTube video
through video URL
7. Ability to share and send data (with the
therapist)
8. Ability to log important data for admin
only.
9. Ability to log important data for admin
user only.
10. Ability to assign different privileges to
different user (such as Therapist)
11. Ability to present report and
performance in an easy to understand.
The added value:
1. There is scarcity of technological tools
of information seeking for ID in general
and for autistics in specific. This project
becomes contributing to solve this
problem.
2. This project will bridge the gap in
communication of autistics children to
information seeking and improve their
social interactions.
3. This project will be a good tool to
examine the impact of using CBIR on

autistic skills.
4. The early intervention is very crucial
in detecting autism. This project will
assist therapists to identify and
overcome communication and
socialization difficulties before
becoming severe.
The intellectual challenges involved:
1. The first intellectual challenge is that
this area of autism is a very specialized
area which requires reading a lot of
theories and practice materials. The
design of a proper suitable and
consisted system to assist autistics will
depend on my exposure to these
martials.
2. It’s difficult to track the progress in
communicating (Paul, R.et.al, 2005),
because these are qualitative issues
and if this system will focus on tracking
the improvement of using CBIR by
autistic it will depend to a certain extent
on the subjective judgement of the
therapists.
3. The major issue the data which
provided has been requested and
collected in the Arabic language which I
need to translate to the English
language.
4. Questionnaire written in both
languages the English and the Arabic.
Which will take more time to translate
the Arabic form result into the English
form result. Gathering and analyzing
those result will take more time to have
accurate result.
5. The data which provided from the
Ministry of Social Development was in
the Arabic language, also need to be

translate into English language.
6. We have to call each institution to ask if
they are providing a speech therapy for
non-verbal autistic children
communicating with the in English
language. Which will take time to call
around 41 institutions. In this case
depending on the person if he/she
answer our call during the working
hours.
What methodology (structured
process) will you be following
to realise your artefact?
Methodology:
1. For the methodology will be using
iterative methodology:
2. Initial Planning: design a mobile
application using content based
image retrieval (CBIR).
3. Planning: group of 3 to 5 institutions
and therapist of 3 to 5.
4. Requirement: based on the
therapist result in the question.
5. Analysis: collecting the requirement
and the data from the questionnaire.
6. Design: including relationship,
forms, quires and reports.
7. Testing: Test and experimentation.
8. Implementation: A plan of
implementation including time and
deliverables of each stage will be
presented to the institution and
signed off before moving to the next
stage.
9. Evaluation: A trial run of the project
will be conducted to solve any
problem affecting the project.
10. Maintainace: to update and fix the
issue in the mobile application.
11. Deployment: Final run of the
project.
How does your project relate to
your degree course and build
upon the units/knowledge you
have studied/acquired
This implementation of the application for
autistic children is closely related to my
MSc course and is very helpful in
understanding the skills that are required
for the purpose of understanding the basic

needs of the application along with
understanding the application in a proper
way.
The course related to Data Madling,
Emerging technology, PPM
Resources
Develop my artefact and establish new
knowledge
I. Read the literature “Peer reviewed sources
– academic journals
II. Attended conferences i.e. attended the 2nd
ISA Oman Section event 28 Feb -1st
March 2018 and read conference paper on
the study area
III. Support Information Seeking for Users with
Intellectual Disability Using Content-Based
Image Retrieval* H. Liu, F. Dong, C. Tziraki.
IV. Zhou, Z.H., 2006, August. Learning with
unlabeled data and its application to image
retrieval. In Pacific Rim International
Conference on Artificial Intelligence (pp. 5-10).
Springer, Berlin, Heidelberg.
V. Tager-Flusberg, H., Paul, R. and Lord, C.,
2005. Language and communication in
autism. Handbook of autism and pervasive
developmental disorders, 1, pp.335-364.
VI. The Library Catalogues / conference
Catalogues
VII. Academic articles IEEE, Google scholar
VIII. Learn the various website developing
process
IX. Visit organization focal points and
discussed face to face research questions
X. Grid 3 updated version 3.0.32, CBIR
google image search (license Google
Custom Search API access)
XI. Software details:
XII. Web admin will be created in Firebase
Cloud Firestore and SDK version 17.1.3.
XIII. Firebase Storage store all media files
(image, sound, and PDF).
XIV. Firebase Authentication. Used for user
authentication and data access
XV. Firebase Rules used for access control
and data security.
XVI. Server: Firebase cloud infrastructure.
XVII. IDE: Android Studio version 3.2
XVIII. Language: Java version 1.8 and XML
XIX. Android API version 17.1.3.
XX. Client Database: SQLite
XXI. Application will support Android version 14

and above.
Note: this form must be accompanied by Ethics Form
Supervisor’s Signature Date:23 Jan 2019
Course Co-ordinator’s
Signature Date

FACULTY OF CREATIVE ARTS, TECHNOLOGIES AND SCIENCE
Form for Research Ethics Projects (CATSethicsform)
1. Student Name Amna Saleh Nasser Al Araimi
2. Student Number: 1623746
3. Degree Pathway: MSc Management Information System
and Security.
4. Supervisor’s name Dr. Haiming Liu.
5. Supervisor Signature
6. Working title of project
Communication Platform for Non-
verbal Autistic children in Oman using
Android mobile
IMPORTANT:
After the proposal form and ethics form have been signed off by both the
Supervisor and Course Co-ordinator, the student must scan both signed
proposal form and ethics form, then upload both of them on in one file.
The original hardcopies of the proposal form and ethics from can then be
submitted to the Faculty Office.
Failure to follow this process will result in the cancellation of the project and
there will be no compensation for any time lost.
SECTION A Ethical Issues
Please summarise below the ethical issues involved in the research proposal and
how they will be addressed. In any proposal involving human participant’s clear
explanation of how informed consent will be obtained, how confidentiality will be
observed, how the nature of the research and the means of dissemination of the
outcomes will be communicated to participants must be provided.
Plagiarism for Section B for answering Q1 and Q2:
1. This project will involve human aspect represented in participants of autistic
children, therapists, and institutions. I have a prior permission will be sought from the
concerned authorities to implement this project (Figure 20)
2. The Ministry of Social Development is the concerned authorities. A letter To Whom
It May Concern issued to proof that the project will be for scientific purpose (Figure
22 and 23).
Plagiarism for gathering requirement and testing: A confidentiality agreement

SECTION B Check List
Please answer the following questions by circling YES or NO as appropriate.
1. Does the study involve vulnerable participants or those unable to give informed consent (e.g.
children, people with learning disabilities, your own students)?
YES NO
2. Will the study require permission of a gatekeeper for access to participants (e.g. schools, self-
help groups, residential homes)?
YES NO
3. Will it be necessary for participants to be involved without consent (e.g. covert observation in non-
public places)?
YES NO
4. Will the study involve sensitive topics (e.g. obtaining information about sexual activity, substance
abuse)?
YES NO
5. Will blood, tissue samples or any other substances be taken from participants?
YES NO
6. Will the research involve intrusive interventions (e.g. the administration of drugs, hypnosis,
physical exercise)?
YES NO
7. Will financial or other inducements be offered to participants (except reasonable expenses or
small tokens of appreciation)?
YES NO
8. Will the research investigate any aspect of illegal activity (e.g. drugs, crime, underage alcohol
consumption or sexual activity)?
YES NO
9. Will participants be stressed beyond what is considered normal for them?
YES NO
10. Will the study involve participants from the NHS (patients or staff) or will data be obtained from
NHS premises?
YES NO
If the answer to any of the questions above is “Yes”, or if there are any other significant ethical issues,
then further ethical consideration is required. Please document carefully how these issues will be
addressed.

Signed (student): Amna Saleh Nasser Al Araimi Date:29/11/2018
Signed (Supervisor): Date:
Signed (Course Co-ordinator): Date:

2. Blueprint
Figure 1 iterative methodology (Draw.io. 2019).

3. Project Management Plan
Table 3. Project Management Plan (Prod.teamgantt.com 2019)
Name / Title Type Start Date End Date By
Weeks
By
Days
Communication and Visual Support for
non-verbal autistic children in Oman
using emerging technology
project 9/16/2018 4/26/2019
Design process of the project group 9/16/2018 4/26/2019 32
Weeks
Initiation Plan task 9/16/2018 9/19/2018 1 Day
Draft proposal task 9/20/2018 9/20/2018 1 Day
Planning task 11/8/2018 11/30/2018 3 Weeks
Interviews milestone 11/2/2018 11/2/2018 1 Day
Draft Interim Report milestone 11/29/2018 11/29/2018 1 Day
Methodology Research milestone 11/17/2018 11/17/2018 1 Day
Requirements task 12/1/2018 1/27/2019 8 Weeks
Interviews with Therapists milestone 12/22/2018 12/22/2018 1 Day
Ethical consideration milestone 12/28/2018 12/28/2018 1 Day
Research design milestone 12/29/2018 12/29/2018 1 Day
Focus group milestone 1/11/2019 1/11/2019 1 Day
General Questionnaire milestone 1/12/2019 1/12/2019 1 Day
Therapists Questionnaire milestone 1/27/2019 1/27/2019 1 Day
Analysis Task task 1/13/2019 2/10/2019 4 Weeks
Analysis of General Questionnaire milestone 1/18/2019 1/18/2019 1 Day
Observation note milestone 2/10/2019 2/10/2019 1 Day
Design task 1/26/2019 2/28/2019 5 Weeks
Design of the tool milestone 2/23/2019 2/23/2019 1 Day
Testing task 2/24/2019 3/30/2019 5 Weeks
Development of the tool milestone 3/30/2019 3/30/2019 1 Day
Implementation task 4/1/2019 4/12/2019 2 Weeks
Evaluation task 4/13/2019 4/20/2019 1 Week
Evaluation of the tool milestone 4/20/2019 4/20/2019 1 Day
Maintenance task 4/21/2019 4/23/2019 2 Days
Deployment task 4/24/2019 4/26/2019 2 Days
Final Report task 4/26/2019 4/26/2019 Day
4. Questions

- Are there any application tools in your center / school used for communication and social
interaction with nonverbal autistic children?
- Are you familiar with PCES?
- Do you apply PCES in your sessions? If yes, how often do you use PCES in your
sessions?
- what do you use PCES for? (social communication, behavior intervention, special
education)
- Are you able to conduct the sessions without PCES? Do you believe in the effectiveness
of PCES?
- Define areas of communication you want the system to assist you in?
- What form of PCES do you use digital or hard copy? If both which one do you think
more effective?
- Have you observed a verbal deficiency in children who are exposed to PCES? How
dependent the student is on PCES?
- How do the SLT communicate with the autistic children?
- What are the roles of people who are involved with an autistic child such as parents,
therapist and the autistic child himself/herself?
- What are the materials used to communicate with autistic children in a private school? Or
government school?
- What type of difficulties does SLP handle with autistic children?
- Is there a specific application used for a specific group age?
- As a specialist, what do you think should be included in the application as a useful tool
for communication?
- Is there a specific application used before which had improved the autistic child?
- Is there a specific methods used for each gender?
- What is the best way to encourage an autistic child to communicate?
- How do you understand what the autistic trying to express or say?
- Does the autistic child have any difficulties in fine motor skills?
- How can you measure communication and social interaction progress of autistic child?
- Is there any assessment report for the autistic child performance?
- What happens in case there is no improvement for communication with an autistic child?
- How much time will you take to start a session using PCES with an autistic child?
- How to schedule a session for an autistic child and how many sessions per week?
- When do you change the current schedule for an autistic child? In which situation? And
why? If the child refuses to continue the session what do you do?
- What kind of events can the autistic child attend?
Those questions after taken 4 interviews with speech language Therapist and psychologist.
Interviews was recorded and upload the file in google drive.

5. Questionnaire Analysis:
All the result has been collected using google form in both languages (English and the Arabic) (Google
Docs, 2019).
Age
25
26 - 30
31 - 35
36 - 40
41 - 45
45 - 50
46 - 50
46- 50
51 - 55
51 and more
Figure 2 Answering by Age (Google Docs 2019)
Accountant
Auditor
Engineer
Internal auditor
Manager Internal Audit
Risk
Speech Theripest
Teacher trainer
Art Teacher
MIS
HSE Manager
Coach Handwork
Professional Rehabilitation Specialist
Government Technical Officer
English Language Teacher
Pharmacist
Staff
Dean
0 0.5 1 1.5 2 2.5 3 3.5
Occupation
Figure 3 Occupation (Google Docs 2019)

Country
Egypt
India
Ireland
Jordan
malawi
none
OMAN
Staff
Sudan
Uganda
Figure 4 Response by Country-wise (Google Docs 2019)
Gender
Female
Male
Figure 5 Response by Gender (Google Docs 2019)

2%
6%
91%
Have you heard about Autism or read about it?
Maybe
No
Yes
Figure 6 Response if they heard about Autism (Google Docs 2019)
4%
32%
64%
Do you know anyone who has the ASD(Autism
Spectrum Disorder)?
Maybe
No
Yes
Figure 7 Response if they knowing anyone having ASD (Google Docs 2019)

0 2 4 6 8 10 12
0
2
4
6
8
10
12
Do you think that the Information and
Communication Technology(ICT) has had an
impact on the growth rate of the number of
individuals having ASD
Figure 8 Information Communication Technology (ICT) (Google Docs 2019)
Autism and PDD Concepts Lite
Other
TOBY Playpad
0 5 10 15 20 25 30 35 40 45
Do you know about the following applications for individuals
with ASD?
Figure 9 Application used for ASD (Google Docs 2019)

53%
4%
43%
Do you think that the digital applications help in
combating against mental disorders like ASDs
Maybe
No
Yes
Figure 2 Response of using Digital Application (Google Docs 2019)
38%
11%
51%
Do you think this technology would help an
individual with autism?
Maybe
No
Yes
Figure 3 Response If the technology will help ASD (Google Docs 2019)

0 2 4 6 8 10 12
0
2
4
6
8
10
12
Overall how favorable will the Augmented
Reality(AR) and CBIR based application be in
your opinion for the individual with autism?
Figure 4 Response of AR & CBIR (Google Docs 2019)
Figure 5 Response of about the idea of the technology (Google Docs 2019)
In Figure 13, the response of most people about the best aspect of the idea using the technology was
having no idea about those technologies.

Figure 6 Response if they like least the idea (Google Docs 2019)
Figure 7 Response of using the application (Google Docs 2019)

Figure 8 Response if they are interest to buy an application (Google Docs 2019)
Figure 9 Response of the amount they will pay for the application (Google Docs 2019)

Figure 10 Response of the important factors (Google Docs 2019)
Figure 19 Response of how individual with Autism made (Google Docs 2019)