This is the narrative text for an NEH Digital Humanities Start-UP grant we just applied for.
Narrative
With the advent of the cd-rom in the late 80s, a few pioneering humanities scholars began to develop a new vocabulary for multi-layered, multi-modal digital publications. Since that time, the internet has emerged as a powerful engine for collaboration across peer networks, radically collapsing the distance between authors and readers and creating new communal spaces for work and review.
To date, these two evolutionary streams have been largely separate. Rich multimedia is still largely consigned to individual consumption on the desktop, while networked collaboration generally occurs around predominantly textual media such as the blogosphere, or bite-sized fragments on YouTube and elsewhere. We propose to carry out initial planning for two ambitious digital publishing projects that will merge these streams into powerfully integrated experiences.
Although the locus of scholarly discourse is slowly but clearly moving from bound/printed pages to networked screens, we’ve yet to reach the tipping point. The printed book is still the gold standard of the academy. The goal of these projects is to produce born-digital works that are as elegant as printed books and also draw on the power of audio and video illustrations and new models of community-based inquiry -? and do all of these so well that they inspire a generation of young scholars with the promise of digital scholarship.
Robert Winter’s CD Companion Series (Beethoven’s Ninth Symphony, Stravinsky’s Rite of Spring, Mozart’s Dissonant Quartet, Dvorak’s New World Symphony) and the American Social History Project’s Who Built America? Volumes I and II were seminal works of multimedia scholarship and publishing. In their respective fields they were responsible for introducing and demonstrating the value of new media scholarship, as well as for setting a high standard for other work which followed.
Although these works were encoded on plastic cd-roms instead of on paper, they essentially followed the paradigm of print in the sense that they were page-based and very much the work of authors who took sole responsibility for the contents. The one obvious difference was the presence of audio and video illustrations on the page. This crucial advance allowed Robert Winter to provide a running commentary as readers listened to the music, or the Who Built America? authors to provide valuable supplementary materials and primary source documents such as William Jennings Bryan reading his famous “Cross of Gold” speech, or moving oral histories from the survivors of the Triangle Shirtwaist fire of 1911.
Since the release of these cd-roms, the internet and world wide web have come to the fore and upended the print-centric paradigm of reading as a solitary activity, moving it towards a more communal, networked model. As an example, three years ago my colleagues and I at the Institute for the Future of the Book began a series of “networked book” experiments to understand what happens when you locate a book in the dynamic social space of the Web. McKenzie Wark, a communication theorist and professor at The New School, had recently completed a draft of a serious theoretical work on video games. We put that book, Gamer Theory, online in a form adapted from conventional blog templates that allowed readers to post comments on individual paragraphs. While commenting on blogs is commonplace, readers’ comments invariably appear below the author’s text, usually hidden from sight in an endlessly scrolling field. Instead we put the reader’s comments directly to the right of Wark’s text, indicating that reader input would be an integral part of the whole. Within hours of the book’s “publication” on the web, page margins began to be populated with a lively back-and-forth among readers and with the author. As early reviewers said, it was no longer simply the author speaking, but rather the book itself, as the conversation in the margins became an intrinsic and important part of the whole.
The traditional top-down hierarchy of print, in which authors deliver wisdom from on high to receptive readers, was disrupted and replaced by a new model in which both authors and readers actively pursued knowledge and understanding. I’m not suggesting that our experiment caused this change, but rather that it has shed light on a process that is already well underway, helping to expose and emphasize the ways in which writing and reading are increasingly socially mediated activities.
Thanks to extraordinary recent advances, both technical and conceptual, we can imagine new multi-mediated forms of expression that leverage the web’s abundant resources more fully and are driven by networked communities of which readers and authors can work together to advance knowledge.
Let’s consider Who Built America?
In 1991, before going into production, we spent a full year in conversation with the book’s authors, Steve Brier and Josh Brown, mulling over the potential of an electronic edition. We realized that a history text is essentially a synthesis of the author’s interpretation and analysis of original source documents, and also of the works of other historians, as well as conversations in the scholarly community at large. We decided to make those layers more visible, taking advantage of the multimedia affordances and storage capacity of the cd-rom. We added hundreds of historical documents -? text, pictures, audio, video -? woven into dozens of “excursions” distributed throughout the text. These encouraged the student to dig deeper beneath encouraged them to interrogate the author’s conclusions and perhaps even come up with alternative analyses.
Re-imagining Who Built America? in the context of a dynamic network (rather than a frozen cd-rom), promises exciting new possibilities. Here are just a few:
• Access to source documents can be much more extensive and diverse, freed from the storage constraints of the cd-rom, as well as from many of the copyright clearance issues.
• Dynamic comment fields enable classes to produce their own unique editions. A discussion that began in the classroom can continue in the margins of the page, flowing seamlessly between school and home.
• The text continuously evolves, as authors add new findings and engage with readers who have begun to learn history by “doing” history, adding new research and alternative syntheses. Steve Brier tells a wonderful story about a high school class in a small town in central Ohio where the students and their teacher discovered some unknown letters from one of the earliest African-American trade union leaders in the late nineteenth century, making an important contribution to the historical record.
In short, we are re-imagining a history text as a networked, multi-layered learning environment in which authors and readers, teachers and students, work collaboratively.
Over the past months I’ve had several conversations with Brier and Brown about a completely new “networked” version of Who Built America?. They are excited about the possibility and have a good grasp of the challenges and potential. A good indication of this is Steve Brier’s comment: “If we’re going to expect readers to participate in these ways, we’re going to have to write in a whole new way.”
Discussions with Robert Winter have focused less on re-working the existing CD-Companions (which were monumental works) than on trying to figure out how to develop a template for a networked library of close readings of iconic musical compositions. The original CD-Companions existed as individual titles, isolated from one another. The promise of networked scholarship means that over time Winter and his readers will weave a rich tapestry of cross-links that map interconnections between different compositions, between different musical styles and techniques, and between music and other cultural forms. The original CD-Companions were done when computers had low-resolution black and white screens with extremely primitive audio capabilities and no video at all. High resolution color screens and sophisticated audio and video tools open up myriad possibilities for examining and contextualizing musical compositions. Particularly exciting is the prospect of harnessing Winter’s legendary charismatic teaching style via the creative, yet judicious use of video.
We are seeking a Level One Start-Up grant to hold a pair of two-day symposia, one devoted to each project. Each meeting will bring together approximately a dozen people -? the authors, designers, leading scholars from various related disciplines, and experts in building web-based communities around scholarly topics -? to brainstorm about how these projects might best be realized. We will publish the proceedings of these meetings online in such a way that interested parties can join the discussion and deepen our collective understanding. Finally, we will write a grant proposal to submit to foundations for funds to build out the projects in their entirety. The work described here will take place over a five-month period beginning September 2008 and ending February 2009.
Some of the questions to be addressed at the symposia are:
• what are new graphical and information design paradigms for orienting readers and enabling them to navigate within a multi-layered, multi-modal work?
• how do you distinguish between the reading space and the work space? how porous is the boundary between them?
• what do readers expect of authors in the context of a “networked” book?
• what new authorial skill sets need to be cultivated?
• what range of mechanisms for reader participation and author/reader interaction should we explore? (i.e. blog-style commenting, social filtering, rating mechanisms, annotation tools, social bookmarking/curating, personalized collection-building, tagging, etc.)
• how do readers become “trusted” within an open community? what are the social protocols required for a successful community-based project: terms of participation, quality control/vetting procedures, delegation of roles etc.
what does “community” mean in the context of a specific scholarly work?
• how will scholars and students cite the contents of dynamic, evolving works that are not “stable” like printed pages? how does the project get archived? how do you deal with versioning?
• if asynchronous online conversation becomes a powerful new mode of developing scholarship, how do we visualize these conversations and make them navigable, readable, and enjoyable?
Relevant websites
Video Demo for Who Built America? (circa 1993)
Video Demo for the Rite of Spring (circa 1990)
Introduction to the CD Companion to Beethoven’s Ninth Symphony (circa 1989)
Category Archives: cd-rom
truth through the layers
Pedro Meyer’s I Photograph to Remember is a work originally designed for CD ROM, that became available on the Internet 10 years later. I find it not only beautiful within the medium limitations, as Pedro says on his 2001 comment, but actually perfectly suited for both, the original CD ROM, and its current home on the internet . It is a work of love, and as such it has a purity that transcends all media.
The photographs and their subject(s) have such degree of intimacy that forces the viewer to look inside and avoid all morbidity or voyeurism. The images are accompanied by Pedro Meyer’s voice. His narration, plain and to the point, is as photographic as the pictures are eloquent. The line between text and image is blurred in the most perfect b&w sense. The work evokes feelings of unconditional love, of hands held at moments of both weakness and strength, of happiness and sadness, of true friendship, which is the basis of true love. The whole experience becomes introspection, on the screen and in the mind of the viewer.
IPTR was originally a Voyager CD ROM, and it was the first ever produced with continuous sound and images, a possibility that completes, and complements, image as narration and vice-versa. The other day Bob Stein showed me IPTR on his iPod and expressed how perfectly it works on this handheld device. And, it does. IPTR is still a perfect object, and as those old photographs exist thanks to the magic of chemicals and light, this exists thanks to that “old” CD ROM technology, and will continue to exist inhabiting whatever medium necessary to preserve it.
I’ve recently viewed Joan de Fontcuberta’s shows in two galleries in Manhattan; Zabriskie and Aperture,) and the connections between IPTR and these works became obsessive to me. Fontcuberta, also a photographer, has chosen the Internet, and computer technology, as the media for both projects. In “Googlegrams,” he uses the Google image search engine to randomly select images from the Internet by controlling the search engine criteria with only the input of specific key words.
These Google-selected images are then electronically assembled into a larger image, usually a photo, of Fontcuberta’s choosing (for example, the image of a homeless man sleeping on the sidewalk reassembled from images of the 24 richest people in the world, Lynddie England reassembled from images of the Abu Ghraib’s abuse, or a porno picture reassembled from porno sites.). The end result is an interesting metaphor for the Internet and the relationship between electronic mass media and the creation of our collective consciousness.
For Fontcuberta, the Internet is “the supreme expression of a culture which takes it for granted that recording, classifying, interpreting, archiving and narrating in images is something inherent in a whole range of human actions, from the most private and personal to the most overt and public.” All is mediated by the myriad representations on the global information space. As Zabriskie’s Press Release says, “the thousands of images that comprise the Googlegrams, in their diminutive role as tiles in a mosaic, become a visual representation of the anonymous discourse of the internet.”
Aperture is showing Fontcuberta’s “Landscapes Without Memory” where the artist uses computer software that renders three-dimensional images of landscapes based on information scanned from two-dimensional sources (usually satellite surveys or cartographic data.) In “Landscapes of Landscapes” Fontcuberta feeds the software fragments of pictures by Turner, Cézanne, Dalí, Stieglitz, and others, forcing the program to interpret this landscapes as “real.”
These painted and photographic landscapes are transformed into three-dimensional mountains, rivers, valleys, and clouds. The result is new, completely artificial realities produced by the software’s interpretation of realities that have been already interpreted by the painters. In the “Bodyscapes” series, Fontcuberta uses the same software to reinterpret photographs of fragments of his own body, resulting in virtual landscapes of a new world. By fooling the computer Fontcuberta challenges the limits between art, science and illusion.
Both Pedro Meyer and Joan de Fontcuberta’s use of photography, technology and the Internet, present us with mediated worlds that move us to rethink the vocabulary of art and representation which are constantly enriched by the means by which they are delivered.