Talk to Me, And Tell Me What On Earth You Are, Little Plastic Doohickey

Photos by Me, July 25

I’ve been asked by an academic journal to write a review of MoMA’s “Talk to Me: Design and the Communication Between People and Objects” exhibition. But because this is academic publishing we’re talking about, that review probably won’t see the light of day for at least another year. Given how incongruous that temporality is with the instantaneity defining the objects in this exhibition, I figured I’d take advantage of this forum right here, a means for more immediate communication, to post my initial thoughts.

*     *     *     *     *

We’re greeted, loudly, by Talking Carl, a “box-shaped creature” grown famous through smartphone apps, whom the younger museum-goers delight in tickling, spinning, prodding, and bouncing via a wall-mounted control pad. The long hallway leading to the third floor’s eastern gallery is lined with flatscreen monitors featuring what seem to be the more “performative” projects in the show: a “real human interface,” a talking chair, interactive public art projects. Also here we find a project I know well: Timo Arnall, Einar Sneve Martinussen, and Jack Schulze’s (of the fantastic BERG group) “Immaterials: Ghost in the Field,” a visualization — and, more importantly, an explanation of the significance of this visualization — of RFID interactions.

Immaterials: the ghost in the field from Timo on Vimeo.

[Side note: I can’t help but point out a comical rhetorical stretch in the sponsorship text, which is printed in the exhibition catalogue and, I think, posted on wall text in the entry corridor. Hyundai Card, “Korea’s leading issuer of credit cards,” indicates that they, too, “introduce an element of style” into their financial services. “Our credit cards are not merely a payment tool: we scour the world for distinguished artists and designers to create premium, distinctive credit cards that provide access to rich cultural experiences.” While the connection a bit forced, it is interesting to consider the connections between credit, speculation, and excess in some of the projects on display. See, for example, Mayo Nissen’s Visualizing Household Power Consumption and the awesome Feltron Annual Reports. Or consider the fact that the exhibition involves 80 flatscreen TVs, which contributed to the need to install 22 additional electrical circuits in the gallery, according to the WSJ.]

Speaking of energy consumption… Lights inside and outside the building

A cordon with sign directs those who wish to engage with the video works to stay to the right, and those who wish to pass through to the gallery to stay to the left. Few heed the sign, rendering the entire hallway an obstacle course. Perhaps we should take this communication failure as our first clue: physical text-based signage is obsolete. This is the land of locative media and QR codes, which appear on each object’s wall text, linking viewers to additional information online.

For an exhibition that is so self-consciously futurist, the pixelated font on all exhibition graphics seemed an odd choice to me. Was this some ironically retro aesthetic, or an appropriately timed (given the centenary of McLuhan’s birth just three days before the show opening) homage to early Wired, which planted the conceptual seeds for much of what we were about to see in the gallery?

Fittingly, a “global village” contributed to the development of both the exhibition’s content and form. Since March 2010, curators Paola Antonelli and Kate Carmody maintained a “Talk to Me” blog where they solicited and sorted through recommendations for objects to include in the show (whittling down 1500 suggestions to roughly 200), discussed installation ideas, etc. Conversational prompts on the blog indicate that the curators initially conceived of the exhibition in terms of format or genre: computer games, data visualization, interfaces, installations, etc.

The organizational scheme that emerged from the year and a half of deliberation, however, was less defined by object form or format than by the scale, nature, or directionality of the object’s communicative processes or content. The show was organized into five categories: Objects “give feedback on their status, on how they are feeling, on what is happening nearby and far away, on whether or not we have accomplished the tasks they set for us.” Bodies “moves from the communication between people and objects to the communication between people by means of objects.” Life examine how communicative objects and processes, like visualization design, aid with “synthesis and description” of “enormous and profound” concerns tied to the “meaning of life.” The projects in City examine how designed objects can “enhance clarify, civility, and engagement [in cities] by engaging citizens in maintaining the codes that keep the city alive,” how they can “stimulate the flow of communication that is the vital lymph of the urban organism.” Scaling up, Worlds investigates how technologies ranging from “God games” to data visualization to perception-altering apparatuses, can “add layers of understanding [to] and communication [within]” a seemingly shrinking world. Finally, the wildcard Double Entendre section looks at how designers use “scripted” misunderstandings, and increased “complexity and possibility,” to help us think through “negotiations of privacy and anonymity, the vehemence and violence abetted by the ability to hide behind false identities, the promise of new and unregulated means of expressions, connectivity, and revenue generation and the responsibilities that go with them.” (all quotations from TTM catalogue)

Some of these categories focus on who or what is communicating, and how. Others are oriented toward the scale, or the subject or content, of communication. What ontology is implied by this rather tangled taxonomy of object-human-communication? Or maybe it doesn’t matter. The age of interaction has supposedly rendered ontologies obsolete. Now, it’s supposedly all about links and tags — and there are links and tags aplenty in this hybrid physical/virtual exhibition.

In your typical exhibition, visitors can engage with the works on display with or without heeding the curators’ conceptual or thematic categories (most of the time they’re quite a stretch anyway). Here, you can’t help but want some guidance — because the objects themselves are so perplexing. I found myself relying on these one-word themes to help me navigate and make sense of what I was seeing. And I found myself playing with these concepts in my own mind and wondering why certain objects were classified as they were.That may very well just be me, though; I’m sure plenty of other visitors were able to simply enjoy the 200 objects for what they were: 200 awesomely clever thingamajigs.

The implication is that each of these categories represents a different type of communication. Those differences lie not only, as the curators suggest, in who’s talking to whom, but also in how they conceive of what communication is. Are hand-drawn maps; finger implants; ATM interfaces; biometric machines; Marguerite Humeau’s Lucy from Back…, which recreates the voices of extinct animals; Sputniko!’s Menstruation Machine; and Gerard Rallo’s Devices for Mindless Communication, which recognizes patterns in our everyday conversations and coaches us through “small talk,” all engaged in the same activity? Is “communication” a sufficiently expansive concept to encompass this widely diverse activity?

Antontelli writes in the exhibition catalogue that the exhibition “thrives on [an] important late-twentieth-century development in the culture of design, which can be described as a shift from the centrality of function to that of meaning, and on the twenty-first-century focus on the need to communicate in order to exist” (7). “Meaning” is central to certain conceptions of communication, like semiotics. But meaning is bracketed out of others, like Shannon and Weaver’s mathematical theory of communication, which is all about signals passing through channels, from sender to receiver, dodging noise in the process. It’s hard to know what “meaning” means in some of these projects — and across these projects, in the exhibition as a whole. Regardless, how might this supposed shift to meaning, and the near-ubiquity of interaction, be altering what we mean by “communication”?

Antonelli claims that “the key to effective and elegant communication is choosing the right [medium or channel], the right interpreter. The most recent technology, in other words, may not be the most appropriate” (9). I’m not sure that a gallery exhibition was the “right interpreter” for much of this work — in large part because the objects themselves rarely “effectively and elegantly” communicate what they are. A display case full of iPod-esque gadgets, metal canisters, and expressionless plastic toys is reduced to a case full of “stuff” — unless one puts in the effort to read the lengthy text panels and watch the accompanying videos.

What’s that? A dowsing stick, a hand-knit beehive, and a bunch of chocolates?

These “captions” serve, in Barthesian fashion, to both “anchor” the object — to explain what, exactly, that rubber doodad does — and “relay” its connection both to the other geegaws and widgets in the case, and to its thematic unit within the exhibition. Antonelli quotes Alice Rawsthorn, who notes that “the appearance of most digital products bears no relation to what they do” (quoted on 10). The “objects” themselves often fail to talk to us formally, and require more traditional language-based media to “interpret” for us what they are.

All this translation requires an immense investment of time on the part of the visitor. Not to mention the “noise” created by the traditional museum interferences: oblivious tourists cutting off your view of the video screen, your own back and feet screaming at you to sit down already!

The same group of people <ahem> always seemed to be standing right in front of what I wanted to see.

I scanned quite a few QR codes in the hopes of continuing my exploration later on, from the comfort of my own couch. Those QR links led to the Stamen-designed “Talk to Me” website, which collated text, images, and videos — often the same videos I stood and watched on a screen in the gallery — that provided a composite picture of what each object is. And I wondered why I hadn’t just experienced the exhibition through the website all along, rather than code-switching between wall text, flat-screen video, QR code, etc. The website’s a much more “effective and elegant” means to provide the contextual information required to make these objects (audiovisually and textually) communicate their function. (Plus, I would’ve spared myself the hassle of jostling with tourists for two hours.)

The catalog contains project images and descriptions and, in some cases, QR codes.

The exhibition of course talks to us formally, materially. Only an on-site viewing of the real object allows us to perceive its textures and scale, to observe its blinking lights, to appreciate just how loud and chilling its squeals and squawks can be. But all this is just stimulus until we know what those textures and blinking lights mean, what they denote and connote. That’s where the “captions” — texts, videos, etc. — come in, but these captions don’t lend themselves to easy consumption in the gallery space. I also wonder if the objects’ meaning might’ve been even more effectively and elegantly translated if the museum had created opportunities for users to either experience first-hand, or observe first-hand, the objects in action. Communication is a process — not a thing. Perhaps a series of live performances of these objects talking, communicating, might’ve better suited the ethos, the experience, of interaction design.

Total brain dump. I’ll have to majorly cut this down and tighten it up.


Spatial Humanities

Plate of Wards 23 & 25, City of Brooklyn, Via NYPL Maps:

Today’s New York Times featured an article about the emergence of a “new” field of study called the “Spatial Humanities.” “Like the crew on the starship Enterprise,” the Times‘ Patricia Cohen writes, “humanists are exploring a new frontier of the scholarly universe: space.” I hope the fearsome “Temporal Humanist” gang learns to get along with these new kids.

The Spatial Humanities, despite what its rather peremptory name might lead you to believe, doesn’t have a monopoly on all things spatial. Such a claim would be silly. Scholars — in the humanities and the social and hard sciences — practitioners, artists, etc., have long focused their attention on space.

What these humanist Trekkies are doing that’s different is using digital mapping tools, particularly GIS, and developing new ways to “spatialize” their research material — e.g., plotting the scenes of a narrative on a map, or posting historical photos and audio clips to a map — to address both timeless and new questions in the humanities. The Times article quotes geographer Ann Kelly Knowles, who says: “Mapping spatial information reveals part of human history that otherwise we couldn’t possibly know… It enables you to see patterns and information that are literally invisible.” I’d prefer a slightly more modest claim: creating maps using a combination of GIS, historical maps, sensor data, and other resources, we could possibly see spatial dimensions of history, or of contemporary reality, that might otherwise be difficult to discern. And layering this “data,” then analyzing the intersections of those layers, could enable us to identify meaningful patterns that might be “literally invisible” — they could be created by sounds, or atmospheric conditions — or they could be merely immediately unobservable.

I think it’s important to maintain a degree of modesty in these pursuits: Spatial Humanists certainly aren’t the first people making the “spatial turn,” nor are they the first group to turn a critical eye to maps and mapping technologies, or to use those technologies as valuable research tools. Geographers have been at this for quite a while. Archaeologists and architects and other folks, too.

Yet there are some really exciting potentials in this work. For me, the potential for simultaneity — for layering resources, “data,” arguments, etc., and giving users the option of turning those layers on and off — allows both those creating the maps and those reviewing the completed maps to appreciate the “overdeterminedness,” the richness, the convergence of forces, that make things happen…in space and time. These are, as David Brodenhamer puts it in the Times article, “’deep maps,’ which can capture more than one perspective.” Historical events, demographic shifts, climatic changes — all, if plotted out on a map, show themselves to be highly spatio-temporally complex phenomena, hard to sum up, hard to pin down in a linear narrative.


Before the tribunal of the world I submit the following / document:…

– “California Plush,” Frank Bidart, 1973

It’s finished! 4410 pages, 140 dividers, 5 three-ring binders, and 5 flash drives. It’s a little less aesthetically daring than I would’ve liked — largely because my color printing necessitated heavier-weight paper, which meant I was sized out of the 3″ binders. The world of 4″ binder options is, sadly, quite limited.

Oh, the minutiae that have consumed my thoughts for the past couple months.


Pedagogical Maneuvers Through Space and Time

Aw, that’s just a fancy way of saying, I’m organizing the semester schedule for the big “intro to grad studies”-ish lecture course I’m teaching this fall — the same one I taught last semester, but this time with three times as many students.

I figured the easiest way to work out the schedule would be to post everything here, where I can update regularly so everyone knows what dates have been spoken for and which are still available. So let me do that:

  • October 3?: Short presentation on “how to read theory”?
  • October 10?: Short presentation on methods?

Focus Area Presentations – available dates:

  • October 17: Social Media & Social Change (Geert Lovink)
  • October 24: Media & International Affairs (Carol Wilder + Vietnam Program Students)
  • October 31: Film Form (Student Guests)
  • November 14: Doc Studies (Deirdre Boyle)
  • November 21: Sound Studies & Acoustic Environments (Barry Salmon + Guests TBD)
  • November 28: Media Management (Paul Hardart + External Guest TBD)
  • December 5: Media & the Urban Environment (Me + Alumni Guests)

Back in the spring, we took some time in our April 11 class to discuss the students’ experience in the course, and to solicit their recommendations for how the class could be revised to better serve them. I got some well-meaning-but-not-really-feasible recommendations (no, you can’t submit a video project in lieu of your literature review), as well as some really-insightful-and-totally-feasible suggestions, most of which I plan to work into the fall syllabus. The Instructors and I also met for a debriefing after the semester ended, and they, too, offered some fantastic recommendations. Here are some of the changes I plan to implement:

  • When students submit their abstract assignment, we’ll ask them also to submit 5-7 keywords that will guide their research for the rest of the semester. This forces them to define their database search terms early on, so the Instructors and I can make sure they’re using language that will enable them to conduct the most effective searches.
  • Incorporate a “stepping stone” assignment between the abstracts and the lit review. This seemed to be too big of a conceptual and methodological leap for most students. We’ll now include an annotated bibliography — which is essentially a list of abstracts, which will then be “processed” into a lit review — in-between the two existing assignments.
  • Rather than leaving all the intro “research basics” lectures to myself and waiting until the second half of the semester to bring in most of the guest presenters, I’ll weave in some mini guest lectures on “research basics” topics during some of our early classes. That way, students will still be exposed to the “how to research, read, and write like a grad student” stuff they need to hear early on, but they’ll get to hear it from people other than me. This diversity of presenters will expose students to others’ research models — but it’ll demonstrate that the need to think critically about research, starting early on in one’s grad career, is something that all faculty agree upon.
  • I’ll bring in more advanced current students to talk about their experiences in the program and to offer advice. My first-semester students asked for this in the spring, so, in the final three weeks of the semester, I whipped together an “Ambassador” program, which involved ten advanced students visiting the five discussion sections. These visits would be better scheduled at the middle of the semester, before students choose their spring courses, so for the fall, I’ll organize the visits for mid- to late October.
  • Some weeks the Instructors and students said they had little to discuss in their discussion sections. So we’ll just eliminate the superfluous discussion section meetings in the second half of the semester, when students are for the most part working independently on their own literature reviews and final projects. We agreed that we’ll meet weekly during the first half of the semester and, for the second half, every other week.
  • I’ve always tried to reinforce the point that research is not a concern or practice that’s exclusive to academics. Our discussions of research design pertain to producers and artists, too — particularly producers and artists who are developing their “craft” within the context of a liberal arts-oriented MA program. Yet some more professionally-oriented students still have trouble making the connection, so I’m aiming to include even more examples of artists whose work is clearly theoretically informed and/or research based, and producers whose work involves serious research.
  • I’ve also posted “tips” sheets for both our guest presenters and the discussion section Instructors. I had several versions of these documents floating around, so I figured I might as well just put it online and update it each semester as needed.



882 Pages

That’s how long my tenure dossier has turned out to be. After weeks of list-making (listing committees, listing courses, listing conferences, listing advisees, etc.), feedback-soliciting (thanks to Julia, Liz, Ted, and Dave!), sentence-polishing, and “evidence”-gathering, I’ve finally pulled everything together into one massive pdf.

Rather than showing a pile of paperwork — which would be totally expected! — here’s a hometown-Pennsylvania cornfield I walked through last week. Knee-high by the fourth of July!

I thought most of the hard work was done once I had a draft of my personal statement and a nice collection of materials for the appendices, but all those final “book-making” matters — cross-referencing appendix materials, referencing appendices within the text, getting the pages arranged nicely so things print out as I want them to, on either odd- or even-numbered pages, etc. — took an awful lot longer than I thought they would. That might just be because I’m stupidly particular; I bet most other people don’t fret over all these nitpicky things.