{"id":710,"date":"2010-06-08T22:00:56","date_gmt":"2010-06-08T20:00:56","guid":{"rendered":"http:\/\/elanguage.net\/blogs\/booknotices\/?p=710"},"modified":"2010-05-11T14:27:53","modified_gmt":"2010-05-11T12:27:53","slug":"perspectives-on-multimodality","status":"publish","type":"post","link":"https:\/\/journals.linguisticsociety.org\/booknotices\/?p=710","title":{"rendered":"Perspectives on multimodality"},"content":{"rendered":"
Perspectives on multimodality.<\/strong> Ed. by Eija Ventola<\/strong>, Cassily Charles<\/strong>, and Martin Kaltenbacher<\/strong>. Amsterdam: John Benjamins, 2004. Pp. x, 250. ISBN 9781588115959<\/a>. \u00a0$143 (Hb).<\/div>\n

Reviewed by Francisco Yus<\/a><\/strong>, University of Alicante<\/em><\/p>\n

Nowadays, \u2018multimodality\u2019\u2014\u2018interdependence of semiotic resources in a text\u2019, as defined by the editors\u2014is attracting a great deal of scholarly attention. This book is an example of this growing interest. It comprises twelve papers by different authors in two parts plus the editors\u2019 introduction. Despite the ubiquity of audio-verbal-visual media in today\u2019s communication, it is relatively recent that the developments of the various possibilities of combining communication modes have forced scholars to think about the particular characteristics of these modes and the way they semiotically function and combine (1).<\/p>\n

Part 1, \u2018Multimodal issues\u2019, starts with \u2018In between modes: Language and image in printed media\u2019 (Ch. 1, by Hartmut St\u00f6ckl<\/strong>, 9\u201330), in which he develops a system network for language and image relationships in printed media. These are sustained in combinations of core modes, medial variants, peripheral modes, sub-modes, and features. In \u2018Modelling multiple semiotic systems: The case of gesture and speech\u2019 (Ch. 2, by Peter Muntigl<\/strong>, 31\u201350) it is argued that linguistic and nonlinguistic semiotic systems (for instance, gestures) share properties and are even similar in grammatical structure (i.e. content and expression planes).<\/p>\n

\u2018Problematising \u2018semiotic resource\u2019\u2019 (Ch. 3, by Victor Linn Fei<\/strong>, 51\u201363) is an analysis of signs within multimodality. As in Ch. 2, it is also claimed that visual signs operate on content and expression planes, but with an emphasis on the degree of arbitrariness between these planes. In \u2018Multimodality and empiricism: Preparing for a corpus-based approach to the study of multimodal meaning-making\u2019 (Ch. 4, 65\u201387), John Bateman<\/strong>, Judy Delin<\/strong>, and Renate Henschel<\/strong> argue that current claims about multimodality are merely informal or interpretative because they are not sustained in empirical support. Therefore, the authors introduce the first steps given in an empirical direction, specifically a multimodal annotated corpus called the GeM (genre and multimodality) model.<\/p>\n

Part 2, \u2018Analyses and applications\u2019, is devoted to innovative multimodal analyses and starts with \u2018On the effectiveness of mathematics\u2019 (Ch. 5, by Kay L. O\u2019Halloran<\/strong>, 91\u2013117), in which the evolution of the language of mathematics (from multimodal discourse to symbolic language) has had an effect on the development of descriptions of the physical world. \u2018Multimodality in language teaching CD-ROMs\u2019 (Ch. 6, by Martin Kaltenbacher<\/strong>, 119\u201336) describes the necessary verbal-visual qualities of teaching CD-ROMs in order to be effective as teaching tools.<\/p>\n

\u2018The multiple modes of Dirty dancing<\/em>: A cultural studies approach to multimodal discourse analysis\u2019 (Ch. 7, by Markus Rheindorf<\/strong>, 137\u201352) deals with how different modes combine in the film Dirty dancing<\/em>, concluding that dancing lies at the heart of how the protagonists build up their semiotic roles. In \u2018Multimodal text analysis and subtitling\u2019 (Ch. 8, 153\u201372), Christopher Taylor<\/strong> analyzes the role that multimodal text analysis plays in subtitling. For instance, the direct reference of text to visual parts of the film is seen as challenging for subtitling.<\/p>\n

\u2018Multimodality in the translation of humour in comics\u2019 (Ch. 9, by Klaus Kaindl<\/strong>, 173\u201392) deals with comics such as Asterix. <\/em>In this study the author stresses the fact that most of the humor in comics arises from visual input, rather than from the text. Then he moves on to suggest eight different strategies for the translation of multimodal humor. \u2018Multimodality in operation: Language and picture in a museum\u2019 (Ch. 10, by Andrea Hofinger<\/strong> and Eija Ventola<\/strong>, 193\u2013209) addresses multimodal issues in designing a museum on the life of composer Amadeus Mozart.<\/p>\n

In \u2018Drawing on theories of inter-semiotic layering to analyse multimodality in medical self-counselling texts and hypertexts\u2019 (Ch. 11, 211\u201326), Eva Martha Eckkrammer<\/strong> addresses what she calls \u2018inter-semiotic layering\u2019 of multimodal texts. In short, verbal and visual input do not provide meaning separately, but through a combination or interaction between the semiotic modes involved. Finally, \u2018On the multimodality of interpreting in medical briefings for informed consent: Using diagrams to impart knowledge\u2019 (Ch. 12, by Kristin B\u00fchrig<\/strong>, 227\u201341) describes visual materials (for instance, diagrams and charts) and their interpretation at hospitals, where there are linguistic barriers and different levels of professional expertise.<\/p>\n","protected":false},"excerpt":{"rendered":"

Perspectives on multimodality. Ed. by Eija Ventola, Cassily Charles, and Martin Kaltenbacher. Amsterdam: John Benjamins, 2004. Pp. x, 250. ISBN 9781588115959. \u00a0$143 (Hb). Reviewed by Francisco Yus, University of Alicante Nowadays, \u2018multimodality\u2019\u2014\u2018interdependence of semiotic resources in a text\u2019, as defined by the editors\u2014is attracting a great deal of scholarly attention. This book is an example […]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[],"tags":[],"_links":{"self":[{"href":"https:\/\/journals.linguisticsociety.org\/booknotices\/index.php?rest_route=\/wp\/v2\/posts\/710"}],"collection":[{"href":"https:\/\/journals.linguisticsociety.org\/booknotices\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/journals.linguisticsociety.org\/booknotices\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/journals.linguisticsociety.org\/booknotices\/index.php?rest_route=\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/journals.linguisticsociety.org\/booknotices\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=710"}],"version-history":[{"count":1,"href":"https:\/\/journals.linguisticsociety.org\/booknotices\/index.php?rest_route=\/wp\/v2\/posts\/710\/revisions"}],"predecessor-version":[{"id":711,"href":"https:\/\/journals.linguisticsociety.org\/booknotices\/index.php?rest_route=\/wp\/v2\/posts\/710\/revisions\/711"}],"wp:attachment":[{"href":"https:\/\/journals.linguisticsociety.org\/booknotices\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=710"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/journals.linguisticsociety.org\/booknotices\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=710"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/journals.linguisticsociety.org\/booknotices\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=710"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}