MLS - Communication Journal

https://www.mlsjournals.com/ MLS-Communication-Journal

ISSN: 2792-9280

(2024) Revista MLS-Comunicación, 2(2), 98-118. 10.69620/mlscj.v2i2.2797.

REALITY STRIKES BACK: PERFORMING SOCIAL CHANGE THROUGH THE NEW FORMS OF TRUTH

Iván Sánchez-López
Red Alfamed (España)
ivan.sl.pro@gmail.com · https://orcid.org/0000-0002-5937-2904

Arnau Gifreu-Castells
Universidad Autónoma de Barcelona (España)
arnau.gifreu@uab.cat · https://orcid.org/0000-0001-7856-1391

Receipt date: 02/05/2024 / Revision date: 27/06/2024 / Acceptance date: 22/07/2024

Abstract: The concept of reality is in crisis. To be more precise, the mediation of reality is in crisis due to issues such as fake news, the emotional dissemination of content that appears to be informative, posturing on social media, the virtualization of experiences, and synthetically generated content. In parallel, new formats, heirs of non-fiction, have emerged in recent years to account for a different relationship with the real. Beyond journalism, there are creative non-fiction narratives, interactives, 360º documentaries, VR documentaries, and documentaries through Instagram Stories. The aim of this research is to delve into the characteristics of these new formats and their relationship with the real through Multimodal Discourse Analysis. The sample includes six avant-garde projects that address topics such as climate change, sexism, cultural repression, suicide, sexual diversity, and identity. It is concluded that most of the analyzed projects present a symbiosis of form and content to enhance their messages. The strongest link to the real lies in the revelation and elevation of the authorial voice. These forms are committed, purposeful, and combative in representing reality, but somewhat conservative in the performativity for change that opens up in the connected digital context.

keywords: Communication, digital media, new formats, social change, non-fiction


LA REALIDAD CONTRAATACA: ACTIVANDO EL CAMBIO SOCIAL A TRAVÉS DE LAS NUEVAS FORMAS DE LA VERDAD

Resumen: El concepto de realidad está en crisis. Para ser más precisos: la mediación de la realidad está en crisis por cuestiones como las Fake News, la difusión emocional de contenidos con apariencia informativa, el postureo en las redes sociales, virtualización de las experiencias y los contenidos generados sintéticamente. En paralelo, nuevos formatos, herederos de la no ficción, han surgido en los últimos años para dar cuenta de una relación diferente con lo real. Más allá del periodismo, se encuentran narrativas creativas de no ficción, interactivos, documental 360º, documental VR, o documentales a través de Instagram Stories. El objetivo de esta investigación es profundizar en las características de estos nuevos formatos y su relación con lo real a través del Análisis Multimodal del Discurso. La muestra incluye 6 proyectos vanguardistas que abordan temas como el cambio climático, el sexismo, la represión cultural, el suicidio, la diversidad sexual y la identidad. Se concluye que la mayoría de los proyectos analizados presentan una simbiosis de forma y contenido para potenciar sus mensajes. El vínculo más fuerte con lo real reside en la revelación y elevación de la voz autoral. Estas formas son comprometidas, propositivas y beligerantes en la representación de la realidad, pero algo conservadoras en la performatividad para el cambio que se abre en el contexto digital conectado.

Palabras clave: comunicación, medios digitales, nuevos formatos, cambio social, no ficción


Introduction

Fake, live, believe

The crisis of truth 

Social networks and their derivative effects show today how it is sometimes complex to discern between what is real and what is not. There are certain projects and movements that go in this direction, making present the device that distorts reality. For example, the project 'Instagram vs reality' shows us two very different faces of reality: the modified one and the real one, without filters. Those two layers are minimally distinguishable still, but we wonder what will happen when that layer overlaps with more perfection and becomes indistinguishable from reality? At some point in the near future, we may lose our ability to distinguish fact from fiction, no matter how many forensic tools we can devise. Thus, we face an immense challenge regarding the propagation of truth and its concept of representation. If we go one step beyond social networks and get into incipient generative AI, we begin to observe how society gives it a 'truth' value that even today's science does not possess, and that conditions the field of reality and questions its 'factual' value.

“There is no worse mistake than to take the real for the real”, states Baudrillard (1993). And he adds: "And it is the media that teach us never again to take the real for the real" (1993). The argumentative belligerence shown by the French philosopher responds to a concrete context, with an innovative 90”s hyperrealism of the television image introducing distant wars, told by Westerners, in Western homes. Baudrillard declares the death of the referent in which the radical value of the sign is denied. With the loss of analog processing, the continuous representation of physical signals disappears. The materiality of content is transformed. The media and social systems themselves are transformed (Sánchez-López, 2021). In this new contemporary wave, the status of "the real" is threatened by a series of multipolar situations/actions, such as:

Faking (the facts)

Sharing (personal beliefs) 

Posing/showing off (the daily)

Virtualizing (the existence)

Synthesizing (the truth)


 

The 5 vectors of contemporary simulacrum

The concern about the dissemination of false information is recurrent in academic research, rather than a novel phenomenon (Finneman and Thomas, 2018). There is a long history of hoaxes designed and disseminated by media actors. The journalistic profession is nevertheless presented as an epistemic authority as a guarantor of truth (Carlson, 2017). The introduction of social networks and websites in the information flow has propelled an increase in the consumption of news through these channels (Gottfried and Shearer, 2016), eroding the journalistic role as a verifying mediator. This is coupled with self-interested uses that ‘fabricate and disseminate information with the intention of misleading and confusing the population” (McGonagle, 2017). This leads to a ‘new wave of fake news that has different levels of factuality and intent” (Tandoc et al., 2018).

In the new media landscape, content and news are not only broadcasted and received, they are also shared. And in this action of sharing, there are two key factors: personal beliefs and emotions. According to Lewandowsky et al. (2012), people share information that evokes an emotional response, regardless of whether it is true or not. In Vosoughi et al. (2018), it is found that fake news spread faster and more.

Furthermore, the democratization of media uses causes an increase in the dimensions of reality that can be narrated. Under the cover of social media, and following a prosumer logic (Aparici and García-Marín, 2018), personal and social media exposure reaches new quotas. One of the underlying currents is digital posing (Livingston et al., 2020), which can generate a dissociation between idealized exposed events (and bodies) and the everyday reality.

With gradual digitalization, virtualization extends into personal and social environments, with a projection towards surrealism in which the physical and virtual worlds eventually merge, representing ‘the final stage of the coexistence of physical-virtual reality” (Lee et al., 2021). A projection that predetermines the existence of a new type of sign devoid of referent, a sign-referent, with an autonomous spatial-temporal existence. In addition to the effects of virtualization, the phenomenology of truth is altered by the generative capacity of AI. As Bucknall and Dori-Hacohen states: “AI-powered synthetic media – including, but not limited to, deep fakes – pose an entirely new level of challenge that society has yet to fully reckon with” (Bucknall and Dori-Hacohen, 2022). AI is capable of generating synthetic reality. And it can adjust it to the forms of truth: “erroneous references, content, and statements, may be intertwined with correct information, and presented in a persuasive and confident manner, making their identification difficult without close inspection and effortful fact-checking” (Bubeck et al., 2023). 

Social networks and their derivative effects show today how it is sometimes complex to discern between what is real and what is not. There are certain projects and movements that go in this direction, making present the device that distorts reality. For example, the project 'Instagram vs reality' shows us two very different faces of reality: the modified one and the real one, without filters. Those two layers are minimally distinguishable still, but we wonder what will happen when that layer overlaps with more perfection and becomes indistinguishable from reality? At some point in the near future, we may lose our ability to distinguish fact from fiction, no matter how many forensic tools we can devise. Thus, we face an immense challenge regarding the propagation of truth and its concept of representation. If we go one step beyond social networks and get into incipient generative AI, we begin to observe how society gives it a 'truth' value that even today's science does not possess, and that conditions the field of reality and questions its 'factual' value.


 

The real as mediated representation

This crisis of reality that is currently occurring and will be accentuated in the near future has its origin in the concept of reality and its mechanisms of representing it, that is, of generating the nexus with the indexical footprint. The relationship between these two dimensions has been widely discussed by semioticians and structuralists. Peirce (1974) himself suggests that reality can only be known through the sign, because it is already semiotized. In addition to the journalistic tradition, there is another media modality that has been persistently concerned about its link with reality: the documentary genre. It is a complex, elusive relationship. With a certain consensus around a macro categorization that presents itself as an opposition: nonfiction. "A negative category that designates a terra incognita, the extensive unmapped zone between conventional documentary, fiction and experimental", explains Weinrichter (2004). 

One of the major concerns of documentary discourse and in general the genres and formats of narrative nonfiction has been the relationship between what it represents and what is represented, understanding that we are referring to discourses of reality and sobriety in relation to the representation of the world. The indexical trace or index in nonfiction narrative establishes the direct relationship between the representation (what is being represented) and the real object (that which is represented). On an indexical level, we refer to the image of a person, a place, or an event, for example. One of the major concerns is how to detect and differentiate the 'indexical trace' and its associated veracity and documentary evidence (Plantinga, 1997). Documentary veracity is essential to maintain the integrity of the documentary genre and for the public to trust the information. Documentary evidence is the visual and auditory evidence that supports and sustains the claims and representations made in the documentary (images, archive, interviews, data and statistics). 

According to Genette, "the event (history) in the communicative act, for the speaker and for the listener, is always reborn in the form of discourse. Discourse creates reality, orders and organizes the experience of the event" (1966). Furthermore, the biotechnological evolution between orality and digitality has taken place. Media modalities have proliferated. Each new form implies a re-telling, or a trans-telling. Access to reality is not neutral, and mediations add layers of form and content. Nichols elaborates on the idea of representation of reality, stressing that the power of documentary lies in its ability to make timeless issues seem like burning issues to us. "We see images of the world and what they put before us are social issues and cultural values, current problems and their possible solutions, situations and specific ways of representing them" (1997). A link that is not neutral. The documentary is the record of a particular gaze, of an authorial vision. With a direct implication. And in this discourse, "the style bears witness not only to a vision or perspective on the world, but also to the ethical quality of this perspective and the argumentation behind it" (1997). Within this framework, the objective of this research is to analyze and characterize new contemporary formats that pursue the narration of reality, delving into the relationship established between these forms of telling and social change. 

Numerous studies have approached the social transformations brought about by the advent of social media and the Internet (Firth et al., 2024; Evans-Zepeda, 2020). There are also various attempts to catalog new formats for addressing reality, especially in journalism (Das & Upadhyay, 2024; Pérez-Seijo & Silva-Rodríguez, 2024) and documentaries (Borjan, 2020). However, specific work integrating formats that address reality and their link to social transformation is practically nonexistent.


Methodology

To achieve this objective, the selected methodological approach has been the technique of ADM (Multimodal Discourse Analysis (MDA). This paradigm extends the study of language in its combination with other resources such as images, music or sound. O'Halloran (2011) specifies that it deals with "the theory and analysis of the semiotic resources and semantic expansions that take place as, in multimodal phenomena, different semiotic options are combined". Also, the inter-semiotic options. The basic model used is the one employed by Pauwels (2012) for the analysis of cultural expressions, but adapted and focused on the objective of this research. For data extraction and categorization, the Atlas.TI tool has been used, which facilitates the processing of information in qualitative research.

The ADM will be built upon Grounded Theory along with the CCM (Constant Comparative Method). Grounded Theory is a data analysis methodology that uses a set of systematically applied methods to generate an inductive theory about a substantive area (Glaser, 1992). Through the CCM, inductive categorization and simultaneous comparison of units of meaning are conducted (Glaser and Strauss, 1967). Following an initial review and general annotation, patterns were traced, and categories were identified using Atlas.TI software. In a second review, main categories of significant convergence across projects were established, allowing the generation of a common analytical framework. In a third iteration, peculiarities of each work were sought for this convergent framework. In the final version of the analysis, these categories were labeled as "Mise en Scène Keys", "Aesthetics Keys", "Discourse Keys", and "Link to reality".

For the selection of the sample, non-probabilistic sampling was introduced. Specifically, what Corbetta (2007) calls ‘subjective sampling by reasoned decision”, in which the sample units are chosen according to their characteristics. A list of 50 projects was drawn up and screened (https://acortar.link/O329Es) according to the main criterion determined by the objective: 

- A. New multimodal formats that narrate reality.

And a series of conditioning factors to offer a plural perspective in the display: 

- B. Authorial diversity. 

- C. Thematic plurality. 

- D. Productions from different territories and socio-economic realities. 

- E. Variety in media modalities.

After filtering the 50 initial projects, the final sample consisted of the representation showed in Table 1:

Table 1 

Projects filtered for the application of MDA

Title

Author

Selection criteria (Form and content)

HomestayPaisley Smith, 2018

Creative non-fiction narrative that uses a 3D video game engine to reflect on cultural codes and suicide.

A, B, C, D, E. 

Cómo el machismo marcó nuestra adolescenciaJuan Manuel Cuéllar, Paloma Torrecillas, 2023

Interactive web project that shows explicit sexist content from the media according to the user's year of birth.

A, B, C, D, E. 

Fogo Na FlorestaTadeu Jungle, 2017

360º documentary video about the indigenous population of the Waurá and their issues with fire and deforestation.

A, B, C, D, E. 

ReeducatedSam Wolson, 2021

VR animated documentary about China's re-education camps in the Xinjiang region.

A, B, C, D, E. 

OtherlyMirusha Yogarajah, Em Yue, Jess Murwin, Tristan Angieri, Grace An, Joanne Lam, Jackie! Zhou, 2021

Short documentaries in Instagram stories format that delve into identity and social issues, with love, inclusion and loss at the core.

A, B, C, D, E. 

Do not trackBrett Gaylor, 2015

Interactive web documentary series that analyzes the phenomenon of tracking based on the personal use of the Internet by the receiver and voices of experts.

A, B, C, D, E. 


Results

To facilitate the reading of the results of the MDA, a series of summary files have been elaborated. These summarize the information obtained, categorized according to the different fields related to the objective.

Homestay

Homestay constitutes a multifaceted experiment that leverages state-of-the-art VR technology to advance the domain of interactive narratives within an audiovisual framework. The meticulously designed paper-craft world symbolically represents the garden visited by the narrator, Paisley Smith, during a period of mourning for the loss of a friend and "family member." This representation underscores the inadequacy of cultural symbols in encapsulating the full complexity of individuals. The data file shown in Table 2 summarizes the findings following the implementation of Multimodal Discourse Analysis.

Figure 1

Excerpts from “Homestay” project (for research purposes only). 
All rights reserved to the owners (Paisley Smith/NFB Canadá)

Table 2 

Summary of MDA applied to the “Homestay” Project 


 

Link

https://www.nfb.ca/interactive/homestay/

Creators

Paisley Smith

Producer

NFB Canada

Platforms

HTC Vive and Oculus Rift 

Format

Creative non-fiction narrative

Year

2018

MISE EN SCÈNE KEYS

* Immersive subjective shot.

* Interaction with the environment makes the oral discourse to advance.

* Internal movement inside the frame + movement of the frame. 

* User sometimes loses control of events.


 

AESTHETICS 

KEYS

* Japanese garden (Nitobe Memorial Garden (HS1). 

* Paper-craft, Origami style (HS3). 

* Music: minimalist. 

* Subjective voice, emotional adequacy. 

* Effects: 

· Expressive use for interactions. 

· Expressive recreation of sounds of the reel. 


 

DISCOURSE KEYS

* Aesthetic symbolism appeals to the loss that runs through the story. Also, to the incomprehension between cultural codes (HS2). 

* Ambience and reactions to interactions recreate emotional states and connect with deep reflections. 

* Interaction (or the impossibility of interaction) tells something.


 

LINK TO REALITY

* Tragic event as a point of connection with the emotional and deep. 

* Respect for the event. 

* Non-fiction is used as a memorial space.


 

Cómo el machismo marcó nuestra adolescencia (How Sexism Shaped Our Adolescence)

Media have been and are a window to the world. During our adolescence, TV, radio, magazines (and now, the Internet) gave us a glimpse of adult life as we discovered who we were. However, many of the messages we received were not innocent: they tried to create a model of woman into which we had to fit. "Cómo el machismo marcó nuestra adolescencia" is an interactive project where each user, after entering his/her year of birth, can relive the cultural impacts that marked him/her. In Table 3, the key filtered data derived from the analysis is presented. 

Figure 2

Excerpts from “Cómo el machismo marcó nuestra adolescencia” project (for research purposes only). All rights reserved to the owners (J.M. Cuéllar y Paloma Torrecillas/RTVE Lab)

Table 3 

Summary of MDA applied to the “Cómo el machismo marcó nuestra adolescencia” Project 

Link

https://lab.rtve.es/8m-machismo-adolescencia/

Creators

Juan Manuel Cuéllar

Paloma Torrecillas

Producer

RTVE Lab

Platforms

Web

Format

Interactive

Year

2023

MISE EN SCÈNE KEYS

* Static homepage with interaction. 

* Scroll down with text driven story.

* Archive content inserted as multimodal elements (MA2).

* Constant movement through animation


 

AESTHETICS 

KEYS

* Recognizable design: typography, color, graphic elements. Identity. 

* Purple Text and grids. 

* Patterns and graphic elements vary by content block. Design evokes the era (MA3). 

* Combination of cropped stock photography with hand drawing (digital collage). 

* GIFication of the proposal. 

* Language points, denounces, evidences, demands.


 

DISCOURSE KEYS

* Archive directed from an incisive, scathing and formative textual script that evidence sexism and its temporal and multipolar extension. 

* Starting point: interaction based on a personal trait (date of birth). (MA1). 

* Aesthetics of photography + collage connects with the historical uses of this technique associated with activism/social demands. 

* A new discourse is elaborated from the connection and contextualization of multimodal archival elements.


 

LINK TO REALITY

* Archive material: multimodal media content contextualized and recontextualized from the present. 

* Documentary value of the archive materials. 

* Appeal to a shared reality between creators and users based on their common media consumption. 

* New significance of the contemporary reality from: 

- The awareness of the incidence through the memory with an emotional character (adolescence).

- The directed and intentional historical perspective.


 

Fogo Na Floresta

The film, made with indigenous people, is composed of 360-degree scenes that take the viewer inside the daily life of the indigenous community and presents a threat that hovers over the Waurá and all the peoples of the Amazon: uncontrolled fire. Managed for millennia by the indigenous people in the opening of their subsistence plots, fire now advances over the forests in an uncontrolled way, due to the deforestation of the surroundings of the Xingu and to climate change. The data file about this project is compiled in Table 4. 

Figure 3

Excerpts from “Fogo na floresta” project (for research purposes only). All rights reserved to the owners (Tadeu Jungle/ISA, Academia de Filmes)

Table 4 

Summary of MDA applied to the “Fogo na Floresta” Project


 

Link

https://apps.apple.com/us/app/fire-in-the-forest/id1230093632?ls=1

Creators

Tadeu Jungle

Producer

ISA and Academia de Filmes 

Platforms

Appstore, google play, Youtube

Format

360º Documentary short film

Year

2017

MISE EN SCÈNE KEYS

* The camera moves to the territory, emphasizing actions and events that the director considers relevant (FF2). 

* The 360º offers amplitude to the view of the space. Although only in certain shots is used its expressive potential, as in the one in which the components of the community surround the device (FF1). 

* The voice-over directs the discourse over the visual story or the voices of the community.


 

AESTHETICS 

KEYS

* A subjective shot is not recreated: there are unusual points of view, such as a counterplane at ground level. 

* Possible control of the viewer's angle of vision within each sequence. 

* The ellipses are maintained, but the out-of-frame is transformed. 

* There is a desire to reinforce the evocative condition of the territory and traditions, glimpsing a certain aesthetic tension confronted with everyday life.


 

DISCOURSE KEYS

* Empathy is positioned on the villagers and their territory in the face of the threat of fire due to deforestation and climate change. 

* The message is reinforced by a voice from outside the community in a scripted speech.


 

LINK TO REALITY

* The real territory penetrates the digitized images (FF3). 

* The direct sound testifies to a past presentiality, recorded and reproduced. 

* The combination of both offers a testimonial value. 

* The purpose of the discourse, which is based on a real event (the threat of fire), directs the actions on the film. 


 

Reeducated

This virtual-reality documentary immerses spectators into the confines of one of Xinjiang's "reeducation" camps, providing a guided narrative based on the reminiscences of three individuals—Erbaqyt Otarbai, Orynbek Koksebek, and Amanzhan Seituly—who shared imprisonment at a facility in Tacheng. Over recent years, governmental authorities have systematically transformed Xinjiang, the largest region in China, into a highly sophisticated police state, ranking among the most advanced globally. Data highlights are represented in Table 5. 

Figure 4

Excerpts from “Reeducated” project (for research purposes only). All rights reserved to the owners (Sam Wolson/The New Yorker).

Summary of MDA applied to the “Reeducated” Project


 

Link

https://www.newyorker.com/news/video-dept/reeducated-film-xinjiang-prisoners-china-virtual-reality

Creators

Sam Wolson

Producer

The New Yorker

Platforms

Oculus, Carboard Viewer, Phone or Tablet, Computer

Format

VR documentary

Year

2021

MISE EN SCÈNE KEYS

* The immersion places the viewer in a Chinese "re-education center", but the telepresence is not from a subjective plane; the experience is shared from a certain privileged position, with a sensorial participation and a possible intervention through the manipulation of the camera movement. 

360° "camera" positioning to emphasize the dramatic and expressive value of the story (RD1). 

* The narrative events provoke the movement of the user's privileged gaze (and interaction).


 

AESTHETICS 

KEYS

* Use of drawing and animation for the reproduction of an experience and the aestheticization of an emotional state. 

* Visual identity, black and white drawing and image, yellow letters and extradiegetic graphics (RD2). 

* Recreation of visual and sound ambience with a strong expressive value and creative licenses in the sequential composition to reproduce a story and an emotional state endorsed in the oral testimony.


 

DISCOURSE KEYS

* The voices of the testimonies are the driving force of the discourse on the experiences lived in a "re-education center" in Xinjiang. 

* An experience lived in the past is retold to inform about a present situation. 

It is told in an integrated way: the emotional component envelops the informative narrative. 


 

LINK TO REALITY

* The voice of the memory of a real experience has a testimonial value. 

* The video of the bodies of the people (protagonists) in their new inhabited spaces connect with a non-re-created story. 

* The creative licenses grant a value of dramatized presence to the memory (RD3). 

* The aestheticized documented recreation acquires a value of truth - dependent on the validity of the sources.

Otherly

Debuting on Instagram Stories, Otherly represents a collection of seven concise documentaries exploring the quest for identity in the 21st century. Employing universal themes such as love, inclusion, and loss as narrative entry points, these seven creators have produced films that are simultaneously timeless yet inherently ephemeral due to their form. Tailored for Instagram users, the Otherly project amplifies perspectives from a cohort of underrepresented creators, specifically focusing on women, non-binary, and genderqueer identifying individuals. Main analyzed data is exposed in Table 6. 

Figure 5

Excerpts from “Otherly” project (for research purposes only). All rights reserved to the owners (Mirusha Yogarajah, Em Yue, Jess Murwin, Tristan Angieri, Grace An, Joanne Lam, Jackie Zhou/NFB and POV Spark)

Table 6

Summary of MDA applied to the “Otherly” Project 

Linkhttps://www.instagram.com/otherlyseries/
Creators

Parked: Seeking Refuge in Our Cars
by Mirusha Yogarajah

Elaine Is Almost
by Em Yue

Love Is the First Sacred Lesson
by Jess Murwin

Integrate.Me
by Tristan Angieri

Papier Accordéon
by Grace An

A Portrait of Tracy
by Joanne Lam

FaceTime
by Jackie Zhou 

ProducerNational Film Board of Canada and POV Spark.
PlatformsInstagram stories
FormatShort documentaries
Year2021
MISE EN SCÈNE KEYS

* Multiple.

* Evidences the authorial vision in a collective project. 

* Shared styles: highlights the personal voice (off, interview), aestheticism of the composition, portrait in image or metaphorical, strong presence of the self.


 

AESTHETICS 

KEYS

* Multiple. 

* The diffusion platform conditions the verticality and the cut between stories (OT2). 

* The real image, the testimony of the self, is combined with the expressive (poetic) representation of uprooting and the search for identity (OT1). 

* The image (video and animation) tends to be suggestive and connotative, rather than explicit and denotative.


 

DISCOURSE KEYS

* Love, otherness, identity search, inclusion and loss are the main subjects. 

* It loses its theoretical ephemeral idiosyncrasy when preserved.

* Different formulas are used to reveal deep, personal truths. 

* The expression of otherness seems to function as a cathartic element in the search for identity.


 

LINK TO REALITY

* Authorial truth: commitment and care with the representation of the self (OT3), of what is loved and what is feared. 

* Authenticity arises from the expression of the intimate, the personal and the profound. 

* There is an emotional respect for the issues being addressed. 

* Self-expression as truth: honesty. 

 

Do not Track

This documentary series delves into the mechanisms of data collection and utilization pertaining to individuals. Biweekly, personalized episodes were unveiled, each dedicated to investigating distinct facets of the contemporary web as an evolving landscape where actions, expressions, and identities are progressively documented and monitored. Table 7 highlights the main results of the analysis. 

Figure 6

Excerpts from “Do not Track” project (for research purposes only). All rights reserved to the owners (Brett Gaylor/Upian, Arte, NFB Canadá, Bayerischer Rundfunk with the participation of Radio-Canada, RTS, and AJ+).

Table 7

Summary of MDA applied to the “Do Not Track” Project 


 

Linkhttps://donottrack-doc.com/en/intro/
CreatorsBrett Gaylor
ProducersNational Film Board of Canada, Upian, Arte and Bayerischer Rundfunk with the participation of Radio-Canada, RTS and AJ+
PlatformsComputer-web
FormatPersonalized documentary series
Year2015
MISE EN SCÈNE KEYS

* Combination of idiosyncratic materials from the Internet and content produced ad-hoc to transfer authorial experiences or professional criteria. 

* Self-produced materials combine traditional formal aspects of the documentary (talking heads) with cuts recorded on cell phones or from the computer camera. 

* Voice-driven storytelling, determined by interaction. 


 

AESTHETICS 

KEYS

* Aesthetic mimesis and Internet rhythm. 

* Use of web materials: Gif's, memes, popular culture. 

* Music reinforces rhythm and tone of the discourse. 

* Graphics for real-time data representation. 


 

DISCOURSE KEYS

* Metanarrative: the tracking experience is told by tracking the user. 

* Personalization of the user experience and adaptation of the discourse based on the tracking (also of the voice-over). 

* The chapters are concatenated, each one delving into a specific aspect of the subject, with cliffhangers that give continuity to the experience. 

* The language is apparently light-hearted, but it leads to shock with the revelation of information about the subject matter. 


 

LINK TO REALITY

* Synthetic truth: visualization of real time data exposed through tracking algorithms and programs. 

* Prescriptive description by experts. 

* Exposition of facts by quotation of founts. 

* Interactive information reveal: data is offered through the exchange user-project”s interaction. 


Discussion and Conclusions

From the in-depth analysis of the sample, a series of common tropes emerge in the new formats inherited from the non-fiction tradition. In the formal dimension, it is worth highlighting the use of multimodality in all its extension with purposes that move away from banal aestheticization to pursue the reinforcement of the message. Here we can appreciate a tendency towards expressive and poetic composition, moving away from the notion of neutral objectivity, beyond the threat of the loss of realism from indexically-based photography referenced by Borjan (2020), and appealing to the narrativity of the formal factor (Sánchez-López, 2020). At this point, technologies that are usually employed for instrumental purposes, acquire an expanded semiotic value. For example, this happens in the use of 360º in "Reeducated", increasing empathy towards the testimonies from the immersive reproduction of their experiences. In general, there is a symbiosis of form and content to achieve the purpose of each work. Exceptions are found in the verticality of the format in “Otherly”, or the use of 360º in "Fogo na Floresta", where the form does not add significant extra value to the discourse.

The emphasis on current problems, and social and cultural issues to which Nichols alludes (1997), remains a constant. Also, the will to leave a testimony, the search for social awareness and the promotion of action for change. Here, however, and in contrast to the experimentation in mise en interface, a version of performativity anchored in the principles of Web 2.0 is registered. Beyond the reference to a web page, the possibilities of the connected digital environment for mobilization and social change (Themba, 2018) or transmedia activism (Ortuño and Villaplana, 2017) are practically obviated (except in the case of "Do not Track", which executes a performativity for change by skillfully integrating interactivity).

Without the pursuit of neutral objectivity, how is the link with reality generated in these new non-fiction formats? The first, and most obvious, is through the revelation and the elevation of the authorial voice. It is assumed that there is someone behind the storytelling. There is no kidnapping or substitution of the real, as Baudrillard (1993) would denounce. There is a person responsible for a discourse and its vocation of truth. And this responsibility is linked to ethics, honesty, respect and, in cases such as "Otherly", even to care and self-care. In this sense, the dramatization and the environmental and emotional recreation of a story is not treated as a distancing from the facts, but as a way of figurative approximation. 

In addition, there are some traditional resources typical of documentary genre, such as expert testimony, direct testimony of experiences, archival material, or the record in territory (not so the subsequent editing) that continue to maintain their induced status of "truth", highlighting the need for verification of the source, along the lines of fact checking of journalistic texts (Ufarte-Ruiz et al., 2018). It is interesting, however, to observe how these settled conventions are handled. In the case of "Cómo el machismo marcó nuestra adolescencia", the archaeological recontextualization of archival materials deploys a dialogic path with the editorial line of the project, impacting on the user's interpretation, and resignifying the content itself. New sources of veracity are also incorporated, arising from algorithmic processing in real time. It is a synthetic, hyper-quantified truth that responds to the invasive (and accepted) monitoring of our uses of technology. 

The new order of the real is brewing with a whole series of tensions at its core. Fake News, emotional sharing, social media posing, virtualization, synthetic generated content, etc. The contemporary crisis of the real is, in fact, a crisis of the media systems inherited from the twentieth century (combined with the emergence of multiple new media systems). Especially, of the monopoly of truth of journalism and big media companies (as said in Levitskaya and Fedorov, 2020). The field of non-fiction, however, has continued in its dynamic of confronting the mediation of reality from a constant experimentation, both in the formal and discursive dimensions (Gifreu-Castells, 2015). Beyond the use as a strategy for survival in the media market, as noted by Das & Upadhyay (2024), we observe here proposals that, through their aesthetic and narrative construction, manage to enhance their communicational objectives.

Summarizing, we could state that the new forms of the real remain belligerent in their representation, but somewhat more conservative in their factual performativity for change. In any case, if we were to take for granted the axiom of "Les travellings sont affaire de morale" (Godard, taking up Moullet in Domarchi et al., 1959), we could assert that these new media forms would address reality as an aesthetic representation of an author creative commitment and responsibility as mediator of facts.

The main limitations of this study are related to the number of projects included in the sample and the reference model used for conducting the MDA. Among the lines of future research, it would be advisable to expand the sample to include a greater number of projects and formats that address reality in contemporary times. A review and validation of the applied MDA model would also lead to more relevant results in relation to the stated objectives.

Agradecimientos y financiaciones

Investigación financiada a través de la Ayuda Margarita Salas del Ministerio de Ciencia, Innovación y Universidades del Gobierno de España y el programa Next Generation EU.


References

Aparici, R., y García-Marín, D. (2018). Prosumers and emirecs: Analysis of two confronted theories. Comunicar, 55, 71-79. https://doi.org/10.3916/C55-2018-07 

Baudrillard, J. (1993). No tomar lo real como real. Chasqui, 44(83). https://dialnet.unirioja.es/ejemplar/336746 

Borjan, E. (2020). Challenges of Documentary in the Age of New Media. Filozofska istrazivanja, 40(4). https://doi.org/10.21464/fi40403 

Bubeck, S., Chandrasekaran, V., Eldan, R., Gehrke, J., Horvitz, E., Kamar, E., Lee, P., Tat-Lee, Y., Li, Y., Lundberg, S., Nori, H., Palangi, H., Tulio-Ribeiro M., & Zhang, Y. (2023). Sparks of Artificial General Intelligence: Early experiments with GPT-4. arXIV:2303.12712. https://doi.org/10.48550/arXiv.2303.12712 

Bucknall, B., y Dori-Hacohen, S. (2022). Current and near-term AI as a potential existential Risk Factor. In AIES '22: Proceedings of the 2022 AAAI/ACM Conference on AI, Ethics, and Society. https://doi.org/10.1145/3514094.3534146 

Carlson, M. (2017). Legitimating News in the Digital Era. Columbia University Press. 

Corbetta, P. (2007). Metodología y técnicas de investigación social. McGraw Hill.

Das, D., & Upadhyay, A. K. (2024). Deconstructing complexities in the adoption of new forms in news media: a systematic literature review. Cogent Arts & Humanities, 11(1). https://doi.org/10.1080/23311983.2024.2303819 

Domarchi, J., Doniol-Valcroze, J., Godard, J-L., Kast, P., Rivette, J., & Rohmer, E. (1959). Hiroshima, notre amour. Cahiers du cinema, (97), 1-18.

Evans-Zepeda, C.A. (2020). Technology, Activism, and Social Justice in a Digital Age. Journal of Communication, 70(2), E11–E13. https://doi.org/10.1093/joc/jqz037 

Finneman, T., y Thomas, R. (2018). A family of falsehoods: Deception, media hoaxes and fake news. Newspaper Research Journal, 39(3), 350–361. https://doi.org/10.1177/0739532918796228 

Firth, J., Torous, J., López-Gil, J.F., Linardon, J., Milton, A., Lambert, J., Smith, L., Jarić, I., Fabian, H., Vancampfort, D., Onyeaka, H., Schuch, F.B. and Firth, J.A. (2024), From “online brains” to “online lives”: understanding the individualized impacts of Internet use across psychological, cognitive and social dimensions. World Psychiatry, 23, 176-190. https://doi.org/10.1002/wps.21188 

Genette, G. (1966). Fronteras del relato. En E. Verón (Ed.), Análisis estructural del relato (pp. 193-208). Tiempo Contemporáneo.

Gifreu-Castells, A. (2015). Evolución del concepto de no ficción. Aproximación a tres formas de expresión narrativa. Obra digital, 8, 14 – 39. https://doi.org/10.25029/od.2015.54.8 

Glaser, B. (1992). Basics of grounded theory analysis: Emergence versus forcing. Sociology Press.

Glaser, B. G., y Strauss, A. L. (1967). The discovery of grounded theory: Strategies for qualitative research. Aldine.

Gottfried, J., y Shearer, E. (2016). News Use Across Social Media Platforms 2016. Pew Research Center. 

Lee, L-H, Braud, T., Zhou, P., Wang, L., Xu, D., Lin, Z., Kumar, A., Bermejo, C. y Hui, P. (2021). All one needs to know about metaverse: a complete survey on technological singularity, virtual ecosystem, and research agenda. Journal of latex class files, 14(8). https://doi.org/10.13140/RG.2.2.11200.05124/8 

Levitskaya, A., y Fedorov, A. (2020). Analysis of Manipulative Media Texts: World Media Literacy Education Experience. Media Education, 60(3), 430-442. https://doi.org/10.13187/me.2020.3.430 

Lewandowsky, S., Ecker, U., Seifert, C., Schwarz, N., y Cook, J. (2012). Misinformation and Its Correction: Continued Influence and Successful Debiasing. Psychological Science in the Public Interest, 13(3), 106-131. https://doi.org/10.1177/1529100612451018 

Livingston, J., Holland, E., y Fardouly, J. (2020). Exposing digital posing: The effect of social media self-disclaimer captions on womens body dissatisfaction, modo, and impressions of the user. Body image, 32, 150-154. https://doi.org/10.1016/j.bodyim.2019.12.006 

McGonagle, T. (2017). Fake news: False fears or real concerns? Netherlands Quarterly of Human Rights35(4), 203-209. https://doi.org/10.1177/0924051917738685 

Nichols, B. (1997). La representación de la realidad: cuestiones y conceptos sobre el documental. Paidós. 

O’Halloran, K. (2011). Multimodal Discourse Analysis. En K. Hyland y B. Paltridge (Ed.), Companion to discourse (pp. 120-137). Continuum.

Ortuño, P., y Villaplana, V. (2017). Activismo Transmedia. Narrativas de participación para el cambio social. Entre la comunicación creativa y el media art. Obra digital: revista de comunicación, (12), 123-144. 

Pauwels, L. (2012). A multimodal framework for analyzing Websites as cultural expressions. Journal of computer-mediated communication, 17(3), 247 – 265. https://doi.org/10.1111/j.1083-6101.2012.01572.x 

Peirce, C. (1974). La ciencia de la semiótica. Nueva Visión.

Pérez-Seijo S, Silva-Rodríguez, A. (2024). Innovation in Digital Media beyond Technology: The Audience-Centered Approach and Pending Challenges. Journalism and Media, 5(1), 311-324. https://doi.org/10.3390/journalmedia5010021 

Plantinga C. R. (1997). Rhetoric and Representation in Nonfiction Film. Cambridge UP.

Sánchez-López, I. (2020). Narrativas en la era digital. Mediaciones del relato y empoderamiento creativo en la Generación Z [Doctoral Dissertation, Arias Montano]. https://bit.ly/3oHId0t 

Sánchez-López, I., Bonilla-del-Río, M., y Soares, I. de O. (2021). Digital creativity to transform learning: Empowerment from a com-educational approach. Comunicar, 69, 113-123. https://doi.org/10.3916/C69-2021-09 

Tandoc Jr. E., Lim, Z. W., y Ling, R. (2018). Defining fake news: A typology of scholarly definitions. Digital Journalism, 6(2), 137–153. https://doi.org/10.1080/21670811.2017.1360143 

Tandoc Jr. E., Thomas, R., y Bishop, L. (2021). What Is (Fake) News? Analyzing News Values (and More) in Fake Stories. Media and Communication, 9(1), 110-119. https://doi.org/10.17645/mac.v9i1.3331 

Themba, B. (2018). Social Media Activism: Limitation and Benefits. International Network Organization for Scientific Research, 4(1), 30-37. 

Ufarte-Ruiz, M. J., Peralta-García, L. y Murcia-Verdú, F. J. (2018). Fact Checking: un nuevo desafío del periodismo. El Profesional de la Información, 27(4), 733-741. https://doi.org/10.3145/epi.2018.jul.02 

Vosoughi, S., Roy, D., y Aral, S. (2018). The spread of true and false news online. Science, 359(6380), 1146-1151. https://doi.org/10.1126/science.aap9559 

Weinrichter, A. (2004). Desvíos de lo real. El cine de no ficción. T&B Editores.