Chapter 9: The future of closed captioning

This supplemental website includes all of the media clips discussed in Reading Sounds (University of Chicago Press, 2015). Purchase your copy of Reading Sounds today in paperback or e-book.

Figure 9.1. Blending form and content in closed captioning.

In this clip from The Three Musketeers, a few lines of dialogue are manipulated to appear like they sound — as an echo. The clip features Athos (Matthew Macfadyen), one of the Musketeers, who has just been poisoned, sitting on the floor, looking down, while clutching the scrolled document he was bargaining for before being poisoned. Constantin Film, 2011. DVD. Echo effect produced by the author with Adobe After Effects. Featured caption: “Inactive until it came in contact with the liquid.”

Source: The Three Musketeers, 2011. DVD. Enhancements to the captions were created by the author in Adobe After Effects.

Source: The Three Musketeers, 2011. DVD. Original DVD captions.

Pop-up bubbles and enhanced episodes



Source: VH1’s Pop Up Video, featuring REM’s “Losing My Religion.”


Source: VH1’s Pop Up Video, featuring Jewel’s “Who Will Save Your Soul.”

A frame from an enhanced episode of Lost. Three characters interact in what looks like an old medical or army clinic.Source: A frame from an enhanced episode of Lost featuring the enhanced subtitle: “The satellite phone on the island was broken…”

A frame from an enhanced episode of Lost. A close up of a woman's face as she stares almost directly at the viewer.Source: A frame from an enhanced episode of Lost featuring the enhanced subtitle: “as foretold by Desmond.” A small image of Desmond is superimposed at the bottom left of the screen.

A frame from an enhanced episode of Lost. A close up of Jack, wearing a dark suit, seated with the California flag behind him. He's most likely in a courtroom.Source: A frame from an enhanced episode of Lost featuring the enhanced subtitle: “Jack is not telling the truth…”

Easter eggs in captioning

Easter eggs, while rare in captioning, may nevertheless increase the level of interest in captioning among the general public. Dawn Jones, who runs the “I Heart Subtitles” blog, writes about a 2013 episode of BBC’s Sherlock that included, in the upper left corner of the subtitle track, “letters that acted as clues to viewers and was part of the promotion to encourage repeated viewing and speculation about the new series” (“Sherlock — The Clue is in the Subtitles,” 2013). As the letters H-I-S appeared one at a time over the course of the episode, they spelled out a hint that only viewers who were watching with captions could see.

“Caption fail” videos


Source: Rhett and Link, “CAPTION FAIL: Lady Gaga Putt-Putt Rally”


Source: Rhett and Link, “CAPTION FAIL: Jamaican Vacation Hoax”

Animated GIFs that rely on open subtitles or captions

An animated reaction gif featuring Ron Burgundy (Will Ferrell) from Anchorman saying, I don't believe you.

An animated reaction gif featuring George (Ellen Muth) from Dead Like Me saying, I dunno. Yeah. Maybe.

An animated reaction gif featuring Dwayne Johnon in The Other Guys saying, No comment, but yes.

Parody videos that rely on open subtitles

Bad Lip Reading Videos


Source: “The Walking (And Talking) Dead” — A Bad Lip Reading of The Walking Dead.


Source: “MORE WALKING (AND TALKING) DEAD: PART 1” – A Bad Lip Reading of The Walking Dead Season 4.

Literal Music Videos


Source: Dustin McLean’s 2008 literal music video for Aha’s “Take On Me” was the first example of this meme/genre.


Source: Total Eclipse of the Heart Literal Video Version.

Downfall parody videos


Source: Aaron Barber, The original source from Downfall.


Source: Jamnospam, “Real Estate Downfall.”


Source: Hitler Rants Parodies, “Hitler Finds Out About the Downfall Parodies.” The parody becomes self-referential as Hitler finds out about the Downfall parodies.

Subtitle-delivered parody in an analysis of a talk show host’s limited vocabulary

Source: CBS Early Show, 2009. Cable TV. Created in Adobe After Effects by the author.

Creative, unusual, or humorous closed captioning

A frame from an Ikea commercial featuring a young boy riding a child's trike. A caption from the previous program lingers on the screen: [Sexual moaning]Source: A reddit user (jeredhead 2013) posts a screenshot that features a closed caption from The Tudors (a Showtime series rebroadcast on Hulu Plus) lingering on the screen during a commercial for IKEA. The commercial features a small boy on a four-wheeled baby scooter. Lingering on the screen is the inappropriately humorous caption: [Sexual moaning].

Four frames from a nature show featuring close-up shots of Colobus monkeys in a tree. The captions tell us that the process of digesting large amounts of leaves creates an inevitable by-product of gas. Two frames feature captions: (COLOBUS MONKEYS FART) and (COLOBUS MONKEYS CONTINUE FARTING)
Source: A Reddit user (secularflesh 2013) describes waking his girlfriend with his “adolescent giggling” after reading a captioned description of a bodily function in a documentary: (COLOBUS MONKEYS FART) and (COLOBUS MONKEYS CONTINUE FARTING).

Other popular captions posted to social media sites include [silence] and [silence continues] from The Artist (2011). Silence captions call into question our assumptions about the very nature of captioning itself and thus raise awareness of captioning’s potential complexity and value.
A frame from The Artist. Smoke billows from the hood of a 1935 Cadillac Convertible Sedan that has hit a tree. The driver (Bérénice Bejo) is running away from the car and towards the viewer. The camera looks down upon the scene from a second floor vantage point.
Source: The Artist, 2011. DVD. Caption: [silence].

A frame from The Artist. An over the shoulder shot of George Valentin (Jean Dujardin) as he embraces Peppy Miller (Bérénice Bejo).
Source: The Artist, 2011. DVD. Caption: [silence continues].


Source: “Fleetwood Mac – Landslide.” Captioned by Accurate Secretarial as part of The Closed Captioning Project. According to the description that accompanies this video: “Created this option of closed captioning to attempt to show both Stevie Nicks’s phrasing as well as presenting the entire lyric. The spectra serves both form and function in representing the music in a thematic way.”


Source: “Schoolhouse Rock – A Noun is a Person, Place or Thing.” Captioned by Accurate Secretarial as part of The Closed Captioning Project. According to the description that accompanies this video: “Demonstrating the greater capabilities of closed captioning.”

Fictional captions and Internet memes

Fictional captions and internet memes call attention to the cognitive work that captions perform. The “[Intensifies]” meme can help us think through the problem of how to adequately describe modulating noise (see Know Your Meme, “[Intensifies]”). But the “[Intensifies]” meme, which often makes use a vibrating GIF image and static subtitle, describes actions that aren’t clearly linked with sounds at all.

A  vibrating image of Shrek Donkey from the Shrek movie. The image of the characters becomes increasingly distorted.
Source: An example of the “[Intensifies]” meme featuring Shrek and Donkey from the Shrek movie. Caption: [Shrecking Intensifies].

A  vibrating image of the Tardis phone booth from Doctor Who
Source: An example of the “[Intensifies]” meme featuring the Tardis from Doctor Who. Caption: [TARDIS INTENSIFIES].

Fictional captions continue this theme of describing actions and playing on characters’ personality quirks or traits: an image of a distraught Spock (Leonard Nimoy) from Star Trek [sobbing mathematically]; an image of an emotional Eleventh Doctor (Matt Smith) from Doctor Who as he [angrily fixes bow tie]; and an animated image of a seething John Dorian (Zach Braff) from Scrubs as he [screams internally]. These examples are intended to be playful and even absurd. In some cases, they don’t provide access to sounds to all. In others, they exploit characters’ personality or sartorial traits.

An image of Spock (Leonard Nimoy) from Star Trek with a pained expression on his face. Caption: [SOBBING MATHEMATICALLY]

An image of the Eleventh Doctor (Matt Smith) from Doctor Who grimacing as both of his hands pull on his bow tie. Caption: [ANGRILY FIXES BOW TIE]

An image of J.D. (Zach Braff) from Scrubs, dressed in blue doctor's scrubs. Caption: [screams internally]. The image is an animated gif that shows J.D. moving his mouth and head slightly.

Occasional English subtitles in English language programming

On the DVD for Snatch (2001), viewers can select a “pikey” track, which only displays subtitled translations of the hilariously thick English accent of Mickey O’Neil (Brad Pitt).

Source: Snatch, 2001. DVD. A excerpt from the “pikey” track, which only includes subtitles for Brad Pitt’s impossibly thick English accent.

On Swamp People (2013), an American reality TV series that follows a group of alligator hunters in Louisiana, the English but accented speech of these Cajun hunters is sometimes accompanied with hard-coded subtitles.

Source: Swamp People, “No Tomorrow,” 2013. Cable TV (History Channel). An example of English subtitles that are added occasionally to the English (albeit accented) speech of the Cajun alligator hunters.

On season 12 of Project Runway (2013), one of the contestants, Justin LeBlanc, wears a cochlear implant, identifies himself as deaf, and is accompanied on the show by a sign-language interpreter. His speech is also subtitled early in the season, much to the confusion of some viewers who didn’t feel his clear English speech warranted English subtitles.

Source: Project Runway, “Let’s Go Glamping,” 2013. Hulu Plus. Uncaptioned. English subtitles accompany Justin’s speech — and only Justin’s speech — in early episodes of Season 12.

Source: Project Runway, “Let’s Go Glamping,” 2013. Hulu Plus. Captioned. English subtitles accompany Justin’s speech — and only Justin’s speech — in early episodes of Season 12. When the captions are enabled, the open subtitles essentially duplicate the captions.

Medium awareness and direct references to the subtitles

Source: Dairy Queen TV commercial, 2013.

Source: Loaded Weapon, 1993. DVD.

Source: Austin Powers in Goldmember, 2002. DVD.

Source: The Man with Two Brains, 1983. DVD.

Source: Fatal Instinct, 1993. DVD.

Source: Bugsy Malone, 1976. DVD.

Source: Wayne’s World, 1992. DVD.

Source: Portlandia, “Baseball,” 2011. Cable TV (IFC).


Source: Lynn Kiang, “Closed Captions, Setting the Site.”


Source: “Subtitled Arab”

Animated captioning and 3D subtitling

Animated subtitles in Anime

An animated gif from NouCome, an anime television series, features two young characters greeting each other. The girl's extended helloo climbs up the side of the frame: helloooooooooooooooo

In this animated gif from an anime program, a line of Japanese dialogue enters the screen from the right and, when it comes into contact with the English subtitles, knocks them at an angle

In this animated gif from an anime program, a line of subtitles appears to stick to the speaker. As she spins around, the line of subtitle moves with her.

In this animated gif from an anime program, the subtitle -- Everyone, combine! --  is covered over when the screen is divided into thirds, and the left and right frames are superimposed over the original, middle frame.

Enhanced subtitles

Check out my blog post on “Subtitles as visual art” in Night Watch (2004).

Buy Reading Sounds in paperback and ebook from Amazon.com