Search
The search found 2 results in 0.01 seconds.
Search results
-
Mining Linguistic Content from Vast Audio and Video Archives for Multimodal Poetry
This 20-minute presentation highlights research conducted as a Fellow in the MIT Open Documentary Lab developing a methodology and software for parsing linguistic and semantic information from vast quantities of audio and video files for playback and synchronization across networked computers. The presentation will focus on the expressive potential of this methodology to create new forms of multi-modal digital poems. The goal of this research is to extend recent advances in computational text analysis of written materials to the realm of audio and video media for use in a variety of different language centered media production contexts. This methodology and software provides the ability to parse vast quantities of audio and video files for topics, parts of speech, phonetic content, sentiment, passive/active voice and language patterns and then playback the video or audio content of the search for consideration in an aesthetic context. Queries that are intriguing can be saved and sequenced for playback as a poetic remix of linguistic patterns on one or multiple monitors.
Vian Rasheed - 14.11.2019 - 01:25
-
option drag
Four monitors are placed in a row on the wall. As you walk closer an exhaled breath is heard, then a mouse click, a sigh. A voice commands, “then drag up”; a different voice, “like this”. Excerpts of Youtube typography tutorials populate the screens, complete with Photoshop, Maya, Illustrator, GIMP, etc. interfaces along with the type that is being carefully constructed. A rhythm emerges, “Rotate left, pull down, move forward, like that”. In this piece, a multimodal digital poem forms from the aural language of making visual language. Fragments of descriptive phrases are heard over looping patterns of mouse clicks, exhales, sighs and keyboard strokes amplifying the language of micro-gestures. The unseen role of the body in the circuit of human-computer interaction is ever present in this installation exposing the analog labor of creating digital type and the articulation of the physical process of making digital words. The work humorously explores the physicality of creating visual communication and calls attention to the human, social and cognitive labor behind the typography we take for granted in our daily lives.
Vian Rasheed - 18.11.2019 - 01:07
