Multimodal Text Analysis: Semiotic Systems and Evaluation

This report presents a systematic semiotic analysis of a multimodal text, examining its various components and features. The analysis begins with an introduction to multimodal text and the significance of semiotics in understanding how meaning is created through different sign systems. The re...Read More

Running Head:Multimodal Text
MULTIMODAL TEXT

2
Multimodal Text
Summary
The current study indicates a systematic semiotic analysis of a textbook. This analysis has been
done by developing a multimodal presentation of the book and then it has been analysed. The
pros and cons have been indicated, as well as the areas of further improvement has been
provided at the end of the text. A proper discussion of five dimensions of semiotics has been
developed. Lastly, the proper concluding statement has been provided based on the importance
of the semiotic system in multimodal text analysis.

3
Multimodal Text
Table of Contents
Introduction.................................................................................................................................................3
Explanation of Semiotics.............................................................................................................................3
Identification of five semiotic systems and discussion of features and designs...........................................3
Creation of multimodal text.........................................................................................................................4
Analysis.......................................................................................................................................................5
Analysis of the semiotic system of the multimodal text...........................................................................5
Contraction through inter semiosis..........................................................................................................6
Evaluation of text and explanation the way of improvement...................................................................7
Conclusion...............................................................................................................................................7
References...................................................................................................................................................8

4
Multimodal Text
Introduction
Among all digital text, the multimodal text is achieving high priority, and in the educational
sectors, it is widely using by the educators and teachers. In today's education, multimodal
literacy is highly prioritised. In order to understand the ways how the media are shaped and
designed for promoting communication effectively, this multimodal text education has become
significant. It commonly consisted of all linguistic, alphabetic, audio and visual texts. In the
current study, a systematic analysis has been carried out on multimodal text and application of
semiotics in the learning of books.
 High priority
 Widely used by the educators and teachers
 Multimodal literacy is highly prioritised
 Media are shaped and designed for promoting communication
 Linguistic, alphabetic, audio and visual texts
Explanation of Semiotics
It is the philosophy of symbols and signs which is currently comprehensively used in the
academic field. As per the Saussure's Theory of Semiotic, the perceptible forms of signs can be
understood. Semiotics is the investigation of sign frameworks. It investigates how words and
different signs make meaning (Bal, 2017).With these ideas, general semiotics enables us to
depict any arrangement of signs: writings, pictures, exhibitions, sight and sound preparations,
traffic signals, design, everyday life, and so forth. There are explicit semiotic frameworks that
consider the points of interest in every arrangement of signs. This part is a review of general
semiotics which are associated with multimodal text practices. It is associated with the process of
creation of proper multimodal texts with specific signs. It is also known as an open text, semiotic
square, semiotic triangle, actinia model, isotopy, poetic function, paradigm, referent, signified,
signifier or others (Bezemer& Kress, 2017).
Identification of five semiotic systems and discussion of features and designs
In semiotics, a sign is whatever subs for an option that is other than itself. This exercise has a
significant impact on academic studies and media studies, and it is useful around semantic signs.
The semantic systems are classified into five categories.

5
Multimodal Text
1. Linguistic: Linguistic is constructed with vocabulary for conveying message, metaphor,
which is a figurative technological language like desktop, paste, cut, window and recycle bin.
Along with this, the structure, which is an organisation of presentation, is also used in the
linguistic part. Various model of linguistic presentation is provided like animation, graphics,
video, print and auditory (Buchholz &Pyles, 2018).
2. Visual:Colour plays a significant role for featuring cultural significance, emotion and mood,
perspectives like depth and dimension, vectors to focus attention for directional lines, foreground
for positioning power and background for setting the scene.
3. Audio: a voice like natural speech, own voice, and electronic audio, composed or selected
music, creating or selected sound effects are included in audio which is associated for enhancing
the presentation experience in an effective way (Cahyaningati&Lestari, 2018).
4. Gestural: this is another significant semiotics which is constructed by five components. The
behavioural component is about gestures, the atmosphere is created by senses, the movement and
positioning are showing the body control, by convening feelings emotion are presented, and the
communicable body movements are presented by kinetics (Byrne, 2017).
5. Spatial: this type is developed by three types of forms. The text component interaction shows
ecosystem, landscape and layout are shown by geographical foundation and organisation,
composition as well as construction is developed for an architecturalview (Kohler &Chabloz,
2017).
Creation of multimodal text
Introduction of technology and multimodality
This part has highlighted the practice of writing and presentation by digital forum in future.
The author here discussed the importance of computers in communicating beyond the
schoolcurriculum and intruding in the practical day to day life. The aspect of changing
technologies have been identified and evaluated in the current section of the book. It is also
included the aspects of blaming technology for reducing the literacy of students. Along with
this, the controversy of technology literacy as well as student's practices, are discussed.

6
Multimodal Text
Presentation of the book
The textbook is featuring the act of composing and introduction by advanced discussion in
future. The creator here talked about the significance of computing in imparting past school
educational program and barging in the down to earth everyday life. The part of changed
innovations have been distinguished and assessed in the immediate area of the book. This is
additionally incorporated the parts of reprimanding innovation for lessening education of
understudies. Alongside this, the contention of innovation education just as understudy's
practices are examined. Along with this, the features necessarily used in the primary
classrooms are also mentioned in the current study.
Persuasive text
In the current book, compelling case studieshave been presented to understand the multimedia
usage in multimodal text. It has been noticed, people are using such textual methods in day by
day life, and it has been noticed that with the help of effective communication methods,
students are understanding and learning in a faster way. However, instead of having such usual
appeal of the texts, the students are pushed to use conventional methods in real life.
Analysis
Analysis of the semiotic system of the multimodal text
According to O'Halloran (2008), different types of text patterns are presented in the book, which
is associated with how the multimedia learning pattern helps in comparison with conventional
learning style. The interaction style of the book is quite effectively portrayed. For this reason, in
the first slide, three to four elements of the semiotic system have been presented (Cambriaet al.
2017). The main aim of presenting these semiotic systems is to develop a clear understanding of
the picture, which the textbook is trying to portray.
In comparison with the single-dimensional textbook, the current slide has effectively engaged the
aspect, emotion, mood and environment of the textbook. Apart from this, it has effectively
conveyed different elements such as audio, video animation, textual graphics, pictorial
representation, a gestural background which are providing proper knowledge about the elements.

7
Multimodal Text
In the case of the classrooms, incorporation of sound, music and image effects are necessary to
apply, which helps to enhance the interest of students towards the text. The researcher has also
mentioned the role of Stink Bomb comic illustration, which has used different essential elements
in the book. Therefore, this has been used by the application of different technologies which
have made the text exciting and more learning-friendly in primary school classrooms
(Danielsson&Selander, 2016). This aspect has been incorporated within the slide by portraying
different dynamics of multimodal semiotics. In the present slide, successful contextual analyses
have been exhibited to comprehend the interactive media use in multimodal content. It has been
seen, individuals are utilising such printed techniques in a step by step life, and it has been seen
that with the assistance of successful specialised strategies, understudies are understanding and
learning in a quicker way (Jewitt, Bezemer& O'Halloran, 2016). Be that as it may, rather than
having such regular intrigue of the writings, the understudies are pushed to utilise traditional
strategies, in actuality.
Contraction through intersemiosis
Various kinds of content patters are introduced in the book, which is related to how the media
learning design helps in correlation with regular learning style. The collaboration style of the
book is successfully depicted. Thus, in the main slide, three to four components of the semiotic
framework have been exhibited (Firmansyah, 2018). The principle target is displaying these
semiotic frameworks to build up an away from the image that the course reading is attempting to
depict. In examination with the single-dimensional reading material, the present slide has viably
drawn in the viewpoint, feeling, state of mind and condition of the coursebook. Aside from this,
it has adequately passed on various components, for example, sound, video activity, literary
designs, pictorial portrayal, a gestural foundation which are giving legitimate information about
the components.As per the comments of O'Halloran (2008), in the present slide, adequate,
relevant investigations have been displayed to appreciate the intelligent media use in multimodal
content (Festi& di Belle Arti, 2017). It has been seen, people are using such printed procedures
in bit by bit life, and it has been seen that with the help of fruitful specific systems, understudies
are understanding and learning more speedily.
Nevertheless, as opposed to having such typical interest of the works, the understudies are
pushed to use customary procedures.If there should arise an occurrence of the homerooms, a fuse

8
Multimodal Text
of sound, music and picture impacts are essential to apply, which improves the enthusiasm of
understudies towards the content. The scientist has additionally referenced the job of the case
study, which has utilised necessary diverse components in the book (Insulander, 2019). In this
manner, this has been utilised by the use of various innovations which have made the content
fascinating and all the more adapting inviting in grade school study halls. This angle has been
consolidated inside the slide by depicting various elements of multimodal semiotics.
Evaluation of text and explanation the way of improvement
As opined by O'Halloran (2008), the text is contextually useful for engaging more learning
prospect. The presentation is showing significant features of the text, which is the author has
tried to tell with the text-only. However, the presentation has effectively introduced the nature
and understanding of the text. In order to portray the emotion and findings of the text, the
presentation has been developed as per the textual importance have been focused. In order to do
so, all elements could not be included in the presentation (Lazaridou, Marelli&Baroni, 2017). It
is a significant issue which could have been improved with the help of adding more elements.
On the other hand, in order to make the presentation lucrative and straightforward, proper
addition of all elements could not be done which is a significant limitation of the current study
(Domingues, Zingale& De Moraes, 2017). The introduced writings are depicting the
interrelationship among scrutinising and sending in conveying compositions and reveal the way
of a fuse of various measurements to fathom the ability to make unique learning styles and
different modes, particularly the association among words and pictures, in examining, making
and doing multimodal works.The content is relevantly successful for connecting learning
prospect (Pruekchaikul& Marques, 2018). The introduction is indicating highlights of the
content, which is the creator has attempted to tell with the content as it were. Be that as it may,
the introduction has adequately presented the nature and comprehension of the content. For this
reason, as to depict the feeling and discoveries of the content, the introduction has been created
according to the literary significance have been engaged. Thus, as to do as such, all components
could not be incorporated inside the presentation.
Conclusion

9
Multimodal Text
Henceforth, it can be concluded, the communication method in media science practice can be
improved by more inclusion of all the five elements. There are explicit semiotic frameworks that
consider the points of interest in every arrangement of signs. This part is a review of general
semiotics which are associated with multimodal text practices.The aspect of changing
technologies have been identified and evaluated in the current section of the book. The
contention of innovation education just as understudy's practices are examined. Thus, the
theoretical interpretation is also supporting the idea of multimodal textual usage in education.

10
Multimodal Text
References
Bal, M. (2017). Development of Teacher Candidates' Text-Making Skills in Multimodal Literacy
Framework. Online Submission, 8(25), 218-237. Retrieved on: 13 January, 2019, From:
<https://files.eric.ed.gov/fulltext/ED585084.pdf>
Bezemer, J., & Kress, G. (2017). Young people, Facebook, and pedagogy: Recognising
contemporary forms of multimodal text making. In Global youth in digital
trajectories (pp. 22-38). Routledge. Retrieved on: 13 January, 2019, From:
<http://www.academia.edu/download/33593686/Facebookchapterfinal.pdf>
Buchholz, B. A., &Pyles, D. G. (2018). Scientific literacy in the wild: Using multimodal texts in
and out of school. The Reading Teacher, 72(1), 61-70. Retrieved on: 13 January, 2019,
From: <https://ila.onlinelibrary.wiley.com/doi/pdf/10.1002/trtr.1678>
Byrne, T. (2017). Husserl’s early semiotics and number signs: Philosophy of Arithmetic through
the lens of “On the Logic of Signs (Semiotic)”. Journal of the British Society for
Phenomenology, 48(4), 287-303. Retrieved on: 13 January, 2019, From:
<https://www.tandfonline.com/doi/abs/10.1080/00071773.2017.1299941>
Cahyaningati, D. T., & Lestari, L. A. (2018). THE USE OF MULTIMODAL TEXT IN
ENHANCING ENGINEERING STUDENTS’READING SKILL. International Journal
of Language Education, 2(2), 65-73. Retrieved on: 13 January, 2019, From:
<https://www.researchgate.net/profile/Lies_Lestari/publication/329098165_THE_USE_
OF_MULTIMODAL_TEXT_IN_ENHANCING_ENGINEERING_STUDENTS'_READ
ING_SKILL/links/5c46b87792851c22a3870718/THE-USE-OF-MULTIMODAL-TEXT-
IN-ENHANCING-ENGINEERING-STUDENTS-READING-SKILL.pdf>
Cambria, E., Hazarika, D., Poria, S., Hussain, A., &Subramanyam, R. B. V. (2017, April).
Benchmarking multimodal sentiment analysis. In International Conference on
Computational Linguistics and Intelligent Text Processing (pp. 166-179). Springer,
Cham. Retrieved on: 13 January, 2019, From: <https://arxiv.org/pdf/1707.09538>
Danielsson, K., &Selander, S. (2016). Reading multimodal texts for learning–A model for
cultivating multimodal literacy. Designs for learning, 8(1). Retrieved on: 13 January,

11
Multimodal Text
2019, From: <https://www.designsforlearning.nu/articles/10.16993/dfl.72/?
toggle_hypothesis=on>
Domingues, F., Zingale, S., & De Moraes, D. (2017). What is Next for Design Semiotics
Research? Searching for epistemological answers in design outcomes. The Design
Journal, 20(sup1), S4796-S4798.Retrieved on: 13 January, 2019, From:
<https://www.tandfonline.com/doi/pdf/10.1080/14606925.2017.1352997>
Festi, G., & di Belle Arti, N. A. (2017). TOWARD A SEMIOTICS OF FOOD QUALITY:
PERSPECTIVES AND INTERPRETATIVE CHALLENGES. TICS, 888.Retrieved on:
13 January, 2019, From:
<https://www.academia.edu/download/53525577/Semio2014Proceedings.pdf#page=8881
>
Firmansyah, M. B. (2018). Multimodal Conception in Learning. ISLLAC: Journal of Intensive
Studies on Language, Literature, Art, and Culture, 2(1), 40-44. Retrieved on: 13 January,
2019, From:
<https://pdfs.semanticscholar.org/51fa/08c8e883b3b8a78b30807d5ccc96236aec0d.pdf>
Insulander, E. (2019). Representations of migration, borders and memories in exhibitions: a
multimodal text analysis. Museum & Society, 17(1), 117-132. Retrieved on: 13 January,
2019, From: <http://www.diva-portal.org/smash/get/diva2:1295127/FULLTEXT01.pdf>
Jewitt, C., Bezemer, J., & O'Halloran, K. (2016). Introducing multimodality. Routledge.
Retrieved on: 13 January, 2019, From:
<https://www.taylorfrancis.com/books/9781315638027>
Kohler, A., &Chabloz, B. (2017). Using Signs for Learning and Teaching Physics: From
Semiotic Tools to Situations of Misunderstanding. Interdisciplinary Approaches to
Semiotics, 185. Retrieved on: 13 January, 2019, From:
<https://www.intechopen.com/download/pdf/54308>
Lazaridou, A., Marelli, M., &Baroni, M. (2017). Multimodal word meaning induction from
minimal exposure to natural text. Cognitive science, 41, 677-705. Retrieved on: 13
January, 2019, From: <https://onlinelibrary.wiley.com/doi/pdf/10.1111/cogs.12481>

12
Multimodal Text
O'Halloran, K. (2008). Mathematical Discourse: Language, symbolism and visual images. A&C
Black. Retrieved on: 13 January, 2019, From: <https://books.google.co.in/books?
hl=en&lr=&id=Vc3UAwAAQBAJ&oi=fnd&pg=PP1&dq=o
%27halloran+(2008)+Semiotics+book&ots=L7VboY3_Fy&sig=zxUFwTWYqNEpPxCC
vIeoBBkj0io>
Pruekchaikul, K., & Marques, I. S. (2018). Language and Identity in Multimodal Text: Case
Study of Thailand’s Bank Pamphlet. Linguística: Revista de EstudosLinguísticos da
Universidade do Porto, 12, 155-178. Retrieved on: 13 January, 2019, From:
<https://ojs.letras.up.pt/index.php/EL/article/viewFile/3423/3142>