Skip to content
Primary Menu

Education, Presentation, Publication

Funding & Recognition

Finding the Narrative Grammar in Storygames

Summer 2026


Project Background

In the same way that syntax is the collection of rules to organize words in textual sentences, a "narrative grammar" is the collection of rules to organize images into "visual sentences" like comic strips. To date, we have discovered that narrative grammars rely on the same four elements that can be arranged in a variety of ways: (1) Establishers, which introduce settings and characters, (2) Initials, which mark the beginning of actions or events, (3) Peaks, which represent the climax or turning point of actions or events, and (4) Releases, which provide closure and help transition to the next narrative segment. These elements, discovered by studying more than 1,000 comics, serve as the visual analogues of "noun phrases" and "verb phrases".

This research project investigates whether the rules of narrative grammar that we have discovered so far can also apply to interactive filmic narratives, specifically story-based video games. Video games are a highly visual medium, and - despite their prevalence - they remain wicked to design. Games educate, inspire, and entertain in long-lasting ways, but this research is needed because predicting these cognitive effects is currently not possible, which makes deliberately eliciting them in audiences a matter of trial-and-error. Understanding how we as people parse storygames is therefore a critical step toward making game development less accidental, and more intentional.

Student Role

The chosen student will study video games published by Tell Tale Games, which are highly visual narrative video games in order to identify how well narrative grammars can be applied to understand their construction. Specifically, the student will use linguistic diagnostic tests (e.g., deletion and substitution) to identify narrative components and compare different narrative branches (e.g., saving a love interest vs. saving a group of strangers) to explore how player choices affect perceptions of narrative grammatical structure.
Specifically, students will:
  1. Analyze interactive narrative sequences using Visual Narrative Grammar theory.
  2. Apply diagnostic tests to identify narrative components.
  3. Compare branching narrative paths and their structural implications.
  4. Assist in coding and categorizing narrative elements from gameplay footage.
  5. Write and present findings on the application of visual narrative grammars to storygames, and what those findings mean for narrative comprehension and user engagement.
Students ought to have an interest in narrative theory or storytelling in media, a basic understanding of visual media (comics, games, film), experience with basic video editing, and excellent analytical thinking and attention to detail. A background in game design and/or cognitive science is a plus!

Student Learning Outcomes and Benefits

By the end of this experience, the student will:
  1. Understand how to conduct interdisciplinary research at the intersection of cognition, narrative, media, and design.
  2. Execute qualitative and quantitative analysis oriented toward the application of narrative theory to interactive media.
  3. Assess how visual cognition is shaped based on interactive storytelling and user experience design
  4. Be prepared to conduct graduate-level research in game design and cognitive/computational science
This experience will prepare students for future academic or professional work in:
  1. Graduate studies in communication, cognitive science, or human-computer interaction
  2. Careers in game design, interactive storytelling, or user experience research
  3. Research roles involving narrative theory, visual media, or human-computer interaction

 

Apply Here

Rogelio E. Cardona-Rivera

Assistant Professor
Architecture & Planning
Division of Games

My approach to mentoring is inspired by one of the fundamental problems in my research on storygames: the "narrative paradox"-a tradeoff between the demands of narrative coherence (resulting from well-structured stories) and the demands of the player whose playful actions may run contrary to the intended narrative, resulting in an incoherent experience. So too there is a need to balance the demands of a Research Experience for Undergraduates, which ought to cover a coherent research experience, with the demands of a student who is interested to explore beyond it.
My mentoring philosophy is thus anchored on two beliefs:
1. Students are essential co-creators of their educational experience. Thus, every student requires some adaptation in terms of teaching, learning, and advising methods; and
2.Instructors are responsible for scaffolding the evolution of their students' mental models. My role is to carefully guide the evolution of my students' mental model of whatever we are discussing from novice to expert, much like storygame design requires guiding the evolution of a player's mental model of the narrative from the introduction to the conclusion.
Grounded in these beliefs, I take a constructivist approach to mentoring; I invite students to create artifacts that concretize ideas and expose new ambiguities that arise from the need to be precise.
Students can expect:
1. Weekly one-on-one meetings with me and my graduate students to discuss progress, challenges, and insights.
2. Guided training in narrative grammar theory and diagnostic methods.
3. Support in analyzing gameplay, segmenting scenes, and coding narrative elements.
4. Feedback on written analysis, presentation skills, & research reporting.