Category Archives: multimedia

.tv

People have been talking about internet television for a while now. But Google and Yahoo’s unveiling of their new video search and subscription services last week at the Consumer Electronics Show in Las Vegas seemed to make it real.
Sifting through the predictions and prophecies that subsequently poured forth, I stumbled on something sort of interesting — a small concrete discovery that helped put some of this in perspective. Over the weekend, Slate Magazine quietly announced its partnership with “meaningoflife.tv,” a web-based interview series hosted by Robert Wright, author of Nonzero and The Moral Animal, dealing with big questions at the perilous intersection of science and religion.
life_banner_mono.gif
Launched last fall (presumably in response to the intelligent design fracas), meaningoflife.tv is a web page featuring a playlist of video interviews with an intriguing roster of “cosmic thinkers” — philosophers, scientists and religious types — on such topics as “Direction in evolution,” “Limits in science,” and “The Godhead.”
This is just one of several experiments in which Slate is fiddling with its text-to-media ratio. Today’s Pictures, a collaboration with Magnum Photos, presents a daily gallery of images and audio-photo essays, recalling both the heyday of long-form photojournalism and a possible future of hybrid documentary forms. One problem is that it’s not terribly easy to find these projects on Slate’s site. The Magnum page has an ad tucked discretely on the sidebar, but meaningoflife.tv seems to have disappeared from the front page after a brief splash this weekend. For a born-digital publication that has always thought of itself in terms of the web, Slate still suffers from a pretty appalling design, with its small headline area capping a more or less undifferentiated stream of headlines and teasers.
Still, I’m intrigued by these collaborations, especially in light of the forecast TV-net convergence. While internet TV seems to promise fragmentation, these projects provide a comforting dose of coherence — a strong editorial hand and a conscious effort to grapple with big ideas and issues, like the reassuringly nutritious programming of PBS or the BBC. It’s interesting to see text-based publications moving now into the realm of television. As Tivo, on demand, and now, the internet atomize TV beyond recognition, perhaps magazines and newspapers will fill part of the void left by channels.
Limited as it may now seem, traditional broadcast TV can provide us with valuable cultural touchstones, common frames of reference that help us speak a common language about our culture. That’s one thing I worry we’ll lose as the net blows broadcast media apart. Then again, even in the age of five gazillion cable channels, we still have our water-cooler shows, our mega-hits, our television “events.” And we’ll probably have them on the internet too, even when “by appointment” television is long gone. We’ll just have more choice regarding where, when and how we get at them. Perhaps the difference is that in an age of fragmentation, we view these touchstone programs with a mildly ironic awareness of their mainstream status, through the multiple lenses of our more idiosyncratic and infinitely gratified niche affiliations. They are islands of commonality in seas of specialization. And maybe that makes them all the more refreshing. Shows like “24,” “American Idol,” or a Ken Burns documentary, or major sporting events like the World Cup or the Olympics that draw us like prairie dogs out of our niches. Coming up for air from deep submersion in our self-tailored, optional worlds.

pulitzers will accept online journalism

Online news is now fair game for all fourteen journalism categories of the Pulitzer Prize (previously only the Public Service category accepted online entries). However, online portions of prize submissions must be text-based, and the only web-exclusive content accepted will be in the breaking news reporting and breaking news photography categories. Pulitzer.jpg But this presumably opens the door to some Katrina-related Pulitzers this April. I would put my bets on nola.com, the New Orleans Times-Picayune site that kept reports flying online throughout the hurricane.
Of course, the significance of this is mainly symbolic. When the super-prestigious Pulitzer (that’s him to the right) starts to re-align its operations, you know there are bigger plate tectonics at work. This would seem to herald an eventual embrace of blogs, most obviously in the areas of commentary, beat reporting, community service, and explanatory reporting (though investigative reporting may not be far off). The committee would do well to consider adding a “news analysis” category for all the fantastic websites, many of them blogs, that help readers make sense of the news and act as a collective watchdog for the press.
Also, while the Pulitzer changes evince a clear preference for the written word, it seems inevitable that inter-media journalism will continue to gain in both quality and legitimacy. We’ll probably look back on all the Katrina coverage as the watershed moment. Newspapers (some of them anyway) will figure out that to stay relevant, and distinctive enough not to be pulled apart by aggregators like Google or Yahoo news search, they will have to weave a richer tapestry of traditional reporting, commentary, features, and rich multimedia: a unique window to the world.
Nola.com didn’t just provide good, constant coverage, it saved lives. It was an indispensible, unique portal that could not be matched by any aggregator (though harnessing the power of aggregation is part of what made it successful). The crisis of the hurricane put in relief what could be a more everyday strategy for newspapers. The NY Times currently is experimenting with this, developing a range of multimedia features and cordoning off premium content behind its Select pay wall. While I don’t think they’ve yet figured out the right combination of premium content to attract large numbers of paying web subscribers, their efforts shouldn’t necessarily be dismissed.
Discussions on the future of the news industry usually center around business models and the problem of solvency with a web-based model. These questions are by no means trivial, but what they tend to leave out is how the evolving forms of journalism might affect what readers consider valuable. And value is, after all, what you can charge for. It’s fatalistic to assume that the web’s entropic power will just continue to wear down news institutions until they vanish. The tendency on the web toward fragmentation is indeed strong, but I wouldn’t underestimate the attraction of a quality product.
A couple of years ago, file sharing seemed to spell doom for the music industry, but today online music retailers are outselling most physical stores. Perhaps there is a way for news as well, but the news will have to change. Dan Gillmor is someone who has understood this for quite some time, and I quote from a rather prescient opinion piece he wrote back in 1997 when the Pulitzers were just beginning to wonder what to do about all this new media (this came up today on the Poynter Online-News list):

When we take journalism into the digital realm, media distinctions lose their meaning. My newspaper is creating multimedia journalism, including video reports, for our Web site. We strongly believe that the online component of our work augments what we sometimes call the “dead-tree” edition, the newspaper itself. Meanwhile, CNN is running text articles on its Web site, adding context to video reports.
So you have to ask a simple question or two: Online, what’s a newspaper? What’s a broadcaster?
Suppose CNN posts a particularly fine video report on its Web site, augmented by old-fashioned text and graphics. If the Pulitzer Prizes are o pen to online content, the CNN report should be just as valid an entry as, say, a newspaper series posted online and augmented with video.
And what about the occasionally exceptional journalism we’re seeing from Web sites (or on CD-ROMs) produced by magazines, newsletters, online-only companies or even self-appointed gadflies? Corporate propaganda obviously will fail the Pulitzer test, but is a Microsoft-sponsored expose of venality by a competitor automatically invalid when it’s posted on the Microsoft Network news site or MSNBC? Drawing these lines will take serious wisdom, unless the Pulitzer people decide simply to ignore trends and keep the prizes the way they are, in which case the awards will become quaint – or worse, irrelevant.

I’m also intrigued by another change made by the Pulitzer committee (from the A.P.):

In a separate change, the upcoming Pulitzer guidelines for the feature writing category will give ”prime consideration to quality of writing, originality and concision.” The previous guidelines gave ”prime consideration to high literary quality and originality.”

Drop the “literary” and add “concision.” A move to brevity and a more colloquial character are already greatly in evidence in the blogosphere and it’s beginning to feed back into the establishment press. Employing once again the trusty old Pulitzer as barometer, this suggests that that most basic of journalistic forms — “the story” — is changing.

IT IN place: muybridge meets typographic man

walk4.gif
slate.jpg
Alex Itin, friend and former institute artist-in-residence, continues to reinvent the blog as an art form over at IT IN place. Lately, Alex has been experimenting with that much-maligned motif of the early web, the animated GIF. Above: “My Bridge of Words.”

multimedia vs intermedia

Dick Higgins performing Danger Music No. 17
One of the odd things that strikes me about so much writing about technology is the seeming assumption that technology (and the ideas associated with it) arise from some sort of cultural vacuum. It’s an odd myopia, if not an intellectual arrogance, and it results in a widespream failure to notice many connections that should be obvious. One such connection is that between the work of many of the conceptual artists of the 1960s and continuing attempts to sort out what it means to read when books don’t need to be limited to text & illustrations. (This, of course, is a primary concern of the Institute.)

Lately I’ve been delving through the work of Dick Higgins (1938–1998), a self-described “polyartist” who might be most easily situated by declaring him to be a student of John Cage and part of the Fluxus group of artists. This doesn’t quite do him justice: Higgins’s work bounced back and forth between genres of the avant-garde, from music composition (in the rather frightening photo above, he’s performing his Danger Music No. 17, which instructs the performer to scream as loudly as possible for as long as possible) to visual poetry to street theatre. He supported himself by working as a printer: the first of several publishing ventures was the Something Else Press, which he ran from 1963 to 1974, publishing a variety of works by artists and poets as well as critical writing.

Click to see a larger version of Dick Higgins poetry intermedia poster“Betweenness” might be taken as the defining quality of his work, and this betweenness is what interests me. Higgins recognized this – he was perhaps as strong a critic as an artist – and in 1964, he coined the term “intermedia” to describe what he & his fellow Fluxus artists were doing: going between media, taking aspects from established forms to create new ones. An example of this might be visual, or concrete poetry, of which that of Jackson Mac Low or Ian Hamilton Finlay – both of whom Higgins published – might be taken as representative. Visual poetry exists as an intermediate form between poetry and graphic design, taking on aspects of both. This is elaborated (in an apposite form) in his poster on poetry & its intermedia; click on the thumbnail to the right to see a (much) larger version with legible type.

Higgins certainly did not imagine he was the first to use the idea of intermedia; he traced the word itself back to Samuel Taylor Coleridge, who had used it in the same sense in 1812. The concept has similarities to Richard Wagner’s idea of opera as Gesamkunstwerk, the “total artwork”, combining theatre and music. But Higgins suggested that the roots of the idea could be found in the sixteenth century, in Giordano Bruno’s On the Composition of Signs and Images, which he translated into English and annotated. And though it might be an old idea, a quote from a text about intermedia that he wrote in 1965 (available online at the always reliable Ubuweb) suggests parallels between the avant-garde world Higgins was working in forty years ago and our concern at the Institute, the way the book seems to be changing in the electronic world:

Much of the best work being produced today seems to fall between media. This is no accident. The concept of the separation between media arose in the Renaissance. The idea that a painting is made of paint on canvas or that a sculpture should not be painted seems characteristic of the kind of social thought–categorizing and dividing society into nobility with its various subdivisions, untitled gentry, artisans, serfs and landless workers–which we call the feudal conception of the Great Chain of Being. This essentially mechanistic approach continued to be relevant throughout the first two industrial revolutions, just concluded, and into the present era of automation, which constitutes, in fact, a third industrial revolution.

Higgins isn’t explicitly mentioning the print revolution started by Gutenberg or the corresponding changes in how reading is increasingly moving from the page to the screen, but that doesn’t seem like an enormous leap to make. A chart he made in 1995 diagrams the interactions between various sorts of intermedia:

higgins_intermedia_chart.gif

Note the question marks – Higgins knew there was terrain yet to be mapped out, and an interview suggests that he imagined that the genre-mixing facilitated by the computer might be able to fill in those spaces.

“Multimedia” is something that comes up all the time when we’re talking about what computers do to reading. The concept is simple: you take a book & you add pictures and sound clips and movies. To me it’s always suggested an assemblage of different kinds of media with a rubber band – the computer program or the webpage – around them, an assemblage that usually doesn’t work as a whole because the elements comprising it are too disparate. Higgins’s intermedia is a more appealing idea: something that falls in between forms is more likely to bear scrutiny as a unified object than a collection of objects. The simple equation text + pictures (the simplest and most common way we think about multimedia) is less interesting to me than a unified whole that falls between text and pictures. When you have text + pictures, it’s all too easy to criticize the text and pictures separately: this picture compared to all other possible pictures invariably suffered, just as this text compared to all other possible texts must suffer. Put in other terms, it’s a design failure.

A note added to the essay quoted above in 1981 more explicitly presents the ways in which intermedia can be a useful tool for approaching new work:

It is today, as it was in 1965, a useful way to approach some new work; one asks oneself, “what that I know does this new work lie between?” But it is more useful at the outset of a critical process than at the later stages of it. Perhaps I did not see that at the time, but it is clear to me now. Perhaps, in all the excitement of what was, for me, a discovery, I overvalued it. I do not wish to compensate with a second error of judgment and to undervalue it now. But it would seem that to proceed further in the understanding of any given work, one must look elsewhere–to all the aspects of a work and not just to its formal origins, and at the horizons which the work implies, to find an appropriate hermeneutic process for seeing the whole of the work in my own relation to it.

The last sentence bears no small relevance to new media criticism: while a video game might be kind of like a film or kind of like a book, it’s not simply the sum of its parts. This might be seen as the difference between thinking about terms of multimedia and in terms of intermedia. We might use it as a guideline for thinking about the book to come, which isn’t a simple replacement for the printed book, but a new form entirely. While we can think about the future book as incorporating existing pieces – text, film, pictures, sound – we will only really be able to appreciate these objects when we find a way to look at them as a whole.

An addendum: “Intermedia” got picked up as the name of a hypertext project out of Brown started in 1985 that Ted Nelson, among others, was involved with. It’s hard to tell whether it was thus named because of familiarity with Higgins’s work, but I suspect not: these two threads, the technologic and the artistic, seem to be running in parallel. But this isn’t necessarily, as is commonly suuposed, because the artists weren’t interested in technical possibilities. Higgins’s Book of Love & Death & War, published in 1972, might merit a chapter in the history of books & computers: a book-length aleatory poem, he notes in his preface that one of its cantos was composed with the help of a FORTRAN IV program that he wrote to randomize its lines. (Canto One of the poem is online at Ubuweb; this is not, however, the computer-generated part of the work.)

And another addendum: something else to take from Higgins might be his resistance to commodification. Because his work fell between the crevices of recognized forms, it couldn’t easily be marketed: how would you go about selling his metadramas, for example? It does, however, appear perfectly suited for the web & perhaps this resistance to commodification is apropos right now, in the midst of furious debates about whether information wants to be free or not. “The word,” notes Higgins in one of his Aphorisms for a Rainy Day in the poster above, “is not dead, it is merely changing its skin.”

elements of style

On NPR’s “Morning Edition” (11/2/2005) Lynn Neary reported on the multimedia new life that The Elements of Style by E.B. White and William Strunk Jr. has been going through. The classic manual on writing and usage in American English first published in 1919 has sold millions of copies, and has been the guide for practically all writers from the 1950’s on. The authors advocated a simple and direct way of expressing ideas in a manual full of witty sentences that serve as examples on how to use those rules.
Maira Kalman, illustrator of children’ books and “The New Yorker” found the book at a yard sale and immediately knew she wanted to illustrate it. She saw the visual potential not in the rules but in the examples the authors used to illustrate them. She saw humor, eccentricity and an interesting combination of beauty and truth in their sentences, and felt compelled to draw them. The result is an illustrated, humorous and eccentric manual of style.
After illustrating the book, Kailman decided to create an opera. She commissioned Nico Muhly to create operatic songs with lyrics from The Elements of Style. The music was recently played at the New York Public Library. The songs are beautiful and convey the book’s sense of humor and eccentricity, at the same time they make it uncannily contemporary.
Examples of illustrations and songs are at NPR.

electronic literature collection – call for works

The Electronic Literature Organization seeks submissions for the first Electronic Literature Collection. We invite the submission of literary works that take advantage of the capabilities and contexts provided by the computer. Works will be accepted until January 31, 2006. Up to three works per author will be considered.
The Electronic Literature Collection will be an annual publication of current and older electronic literature in a form suitable for individual, public library, and classroom use. The publication will be made available both online, where it will be available for download for free, and as a packaged, cross-platform CD-ROM, in a case appropriate for library processing, marking, and distribution. The contents of the Collection will be offered under a Creative Commons license so that libraries and educational institutions will be allowed to duplicate and install works and individuals will be free to share the disc with others.
The editorial collective for the first volume of the Electronic Literature Collection, to be published in 2006, is:
N. Katherine Hayles
Nick Montfort
Scott Rettberg
Stephanie Strickland
Go here for full submission guidelines.

questions and answers

in 1980 and 81 i had a dream job — charlie van doren, the editorial director of Encyclopedia Britannica, hired me to think about the future of encyclopedias in the digital era. eb image.jpg i parlayed that gig into an eighteen-month stint with Alan Kay when he was the chief scientist at Atari. Alan had read the paper i wrote for britannica — EB and the Intellectual Tools of the Future — and in his enthusiastic impulsive style, said, “this is just the sort of thing i want to work on, why not join me at Atari.”
while we figured that the future encyclopedia should at the least be able to answer most any factual question someone might have, we really didn’t have any idea of the range of questions people would ask. we reasoned that while people are curious by nature, they fall out of the childhood habit of asking questions about anything and everything because they get used to the fact that no one in their immediate vicinity actually knows or can explain the answer and the likelihood of finding the answer in a readily available book isn’t much greater.
so, as an experiment we gave a bunch of people tape recorders and asked them to record any question that came to mind during the day — anything. we started collecting question journals in which people whispered their wonderings — both the mundane and the profound. michael naimark, a colleague at Atari was particularly fascinated by this project and he went to the philippines to gather questions from a mountain tribe.
wikipedia_logo.jpg anyway, this is a long intro to the realization that between wikipedia and google, alan’s and my dream of a universal question/answer machine is actually coming into being. although we could imagine what it would be like to have the ability to get answers to most any question, we assumed that the foundation would be a bunch of editors responsible for the collecting and organizing vast amounts of information. we didnt’ imagine the world wide web as a magnet which would motivate people collectively to store a remarkable range of human knowledge in a searchable database.
on the other hand we assumed that the encylopedia of the future would be intelligent enough to enter into conversation with individual users, helping them through rough spots like a patient tutor. looks like we’ll have to wait awhile for that.

ways of seeing, ways of writing – a conversation

The following discussion about a proposed exercise for a high school or college class began in an email exchange yesterday with Bob, Virginia Kuhn and Karl Stolley (Virginia and Karl are both teachers of rhetoric and composition and great intellectual partners of the institute). We thought it was getting interesting so we decided to slap it up here on the blog as a thought experiment. Please join in the discussion in the comment stream.
Bob Stein wrote:
karl and virginia:
this is an idea for an exercise for a high school or college class. i’m wondering if you think it would be interesting/valuable for both students and for those of us interested in understanding the relation of different media types.
*Ways of Seeing, Ways of Writing*
class is divided into four sections. one given pad and pencil. one given digital still camera. one given audio recorder. one given video camera*
the class is asked to “write” about a place (local historical site, downtown street corner, mall, supermarket, cemetary, etc. etc. )
or asked to “write” a response to a question, e.g. “was the response of the federal govt. to the rescue of New Orleans residents affected by the fact that the people needing rescue were mostly poor and black.”
each group “writes” their description of the place or answer to the question using the particular media assigned to their group.
the class reviews all responses, then each group is asked to make a synthesis piece using media captured by all groups.
*if resources aren’t a problem, it would be great if each of the groups with electronic capture devices has more than one.
Karl Stolley replies:
Hmmm…this assignment does offer interesting possibilities. But I guess I’d be interested in the rationale behind splitting the media-producing and -capturing activities between groups. On the one hand, from a teacherly point of view, it’s quite convenient. But viewed from the analogy of a cooking class, it would be like giving each group a set of ingredients plus a kitchen appliance, and then asking each group to take some of the results and make a dish out of it. I know that’s riddled with all kinds of logical holes, but I have to try and interrogate this somehow.
The thing that bothers me most about the assignment is that there is a serious disconnect between the artful choices required to both capture/produce AND compose/orchestrate, as though those activities can be discreet and separate (that disconnect is what tends to make a lot of multimedia assignments feel like the old Surrealist “exquisite corpse” drawing game; if that’s the rhetorical goal, then fine–but that’s limited to a particular kind of stance towards orchestration).
Instead, wouldn’t it be better to give students the question, and then consider which kind of media would be most effective to capture based on the rhetorical situation they’ve been confronted with, have the groups delegate that task amongst themselves? Beginning with the distribution of media before the question is putting the media/genre cart before the rhetorical horse, I think.
Bob replies:
karl,
thank you for your very thoughtful reply. before make specific comments, perhaps i should explain the origin of the idea.
ashton (girlfriend) and i try to spend as much time at her godmother’s place in sardinia as possible. one of the big draws is an island, actually a big hunk o’ dolomite – two miles long and 1500 feet high- that dominates the view from the shoreline. because tavolara’s rockface is mostly white and gray it changes color all day with the sun. (a few photos from recent vist here.) i literally can sit and watch it for hours. it’s been a dream to bring a group of artists to capture its beauty. this year i was thinking that it might be interesting to bring a writer (think someone like john mcphee), a painter, a photographer, a video artist or filmmaker, and an experimental interactive artist like mike naimark or josh portway and let them all have a go at it. my guess is that each would be inspired and the results while quite different would all get at some aspect of the beauty.
at the same time i was thinking about capturing tavolara in various media, i was thinking a lot about the increasingly nettlesome text vs. image (especially moving image) debate. i’m pretty sure the solution is not to give up words in favor of images, but rather begin to appreciate the value of all media and work toward new forms of _expression which call on different media types at different points or which merge them in useful new ways. i was also thinking about how the insitute might start to play a more active role.
thus the idea of coming up with a series of exercises that might be used in college and high school which helped students begin to understand the relative value and utility of different media types and also begin to experiment with how to use them together.
Specific comments:

Hmmm…this assignment does offer interesting possibilities. But I guess I’d be interested in the rationale behind splitting the media-producing and -capturing activities between groups. On the one hand, from a teacherly point of view, it’s quite convenient. But viewed from the analogy of a cooking class, it would be like giving each group a set of ingredients plus a kitchen appliance, and then asking each group to take some of the results and make a dish out of it. I know that’s riddled with all kinds of logical holes, but I have to try and interrogate this somehow.

i think a better kitchen analogy would be giving everyone the same ingredients (in the sense that tavolara or a question is the same ingredient) but ask one group to use a grill, one group to use a pan on a stove, one group to use only a cuisinart etc. but anyway, the pedagogical reason to get the students to use one media type is so that they can appreciate its properties on its own.

The thing that bothers me most about the assignment is that there is a serious disconnect between the artful choices required to both capture/produce AND compose/orchestrate, as though those activities can be discreet and separate (that disconnect is what tends to make a lot of multimedia assignments feel like the old Surrealist “exquisite corpse” drawing game; if that’s the rhetorical goal, then fine–but that’s limited to a particular kind of stance towards orchestration).

my instincts are that one of the problems with “multimedia” is that few of us really understand the components, that is we don’t really know what the different types can do on their own. i guess i don’t think we are so far advanced that we can conceive of a new media type which is multimedia. e.g. i don’t think people intuitively grasp how impt. sound is to a movie until it’s pointed out and they have an oppty to focus on it.

Instead, wouldn’t it be better to give students the question, and then consider which kind of media would be most effective to capture based on the rhetorical situation they’ve been confronted with, have the groups delegate that task amongst themselves? Beginning with the distribution of media before the question is putting the media/genre cart before the rhetorical horse, I think.

i’m not wedded to my schema, but it still seems like there would be some fantastic discussions in the classroom as students look at the different results and debate the advantages and disadvantages. it seems that experience would be helpful when they later start to create full multimedia projects.
and then of course there is the issue of interactivity which complicates everything exponentially.
b.
The conversation continues in the comment stream.