Curious Rituals

Curious Rituals is a project about gestures, postures and rituals people adopt when using digital technologies. It’s both a book documenting gestures we observed, and a design fiction film that speculates about their evolution

Location: Los Angeles, USA
Years: Summer 2012
Leader: Nicolas Nova
Method: Ethnography and prototyping

Curious Rituals was a research project conducted at Art Center College of Design (Pasadena) in July-August 2012 by Nicolas Nova (The Near Future Laboratory / HEAD-Genève), Katherine Miyake, Nancy Kwon and Walton Chiu from the media design program.

The project was about gestures, postures and digital rituals that typically emerged with the use of digital technologies (computers, mobile phones, sensors, robots, etc.): gestures such as recalibrating your smartphone doing an horizontal 8 sign with your hand, the swiping of wallet with RFID cards in public transports, etc. These practices can be seen as the results of a co-construction between technical/physical constraints, contextual variables, designers intents and people’s understanding. We can see them as an intriguing focus of interest to envision the future of material culture.

The aim of the project was to envision the future of gestures and rituals based on:

  1. A documentation of current digital gestures in a book format
  2. The making of a design fiction film that speculate about their evolution

“Curious Rituals” was produced as part of a research residency in the Media Design Program at Art Center College of Design in Pasadena, California.

A Screen-y FutureScape-y 2025

[pullquote author=”FutureScapes”]FutureScapes is all about imagining what the world of 2025 will look like and the role technology could play in our lives.[/pullquote]

Sony put up these FutureScape videos — little design fiction films that introduce us to a conflicted world in the year 2025. This is design fiction par excellance at least insofar as we are effectively transported to this world as best as can be done for a little film. There is narrative punctuation that leads us through various epic events that have happened — we don’t need to know the intimate details of these events. Suffice it to say that political, economic and other struggles have swerved things as they always do. There are events, loosely referred to as “2021” — that are this future’s “9/11”. Etc.

As narrative, this sort of thign works. It does something to gradually get me out of the contingent moment and into the fun bits of the story so I can take it all in and see what that world might be like.

And, of course — it’s Sony so there’s going to be some technology. That part sorta sucks, I have to say. The technology is a bit much. It’s more than a prop; it’s a demo. And it’s all screens. Screens screens screen screens screens. Touch touch touch touch touch.

Okay. Fine. I’m the guy who’s looking for the other, other near futures. The one’s where we’ve moved along or took a swerve towards other interaction modalities. The future of UX and UI design seems to be stuck on a rail and no one is looking for anything else. I’m not saying that there *has to be something else; but what good is design if it doesn’t explore other interaction idioms? If it just makes fonts bigger and puts interactions on cupboards and walls? Seriously? Doesn’t that sound like fun? To challenge the existing dominant paradigm, if only to explore uncharted, unknown unknown territories?

I think the technology is fetishized way too much here. The tools are easy *and optimized for rendering and animating a specific kind of technology — touch screens/surfaces/planes. That optimization determines what will go into these design fictions. The tools predetermine the technological surround of these near future worlds that FutureScapes has produced.

But..that’s me. I’m sensitive to these sorts of things — the lineages of outcomes like this, where you wonder — how’d we get to this world of touch interaction? Was it because some films made it possible to cohere a speculative idea because some decision makers were enthralled with a visual spectacle and decided — hey, that’s the strategy. Touch-interactive cupboards and shelves!

You find this all the time. Poorly considered ideas that find their way in the world *somehow — and investigating the *somehow is useful. So too is realizing that you’re complicit in crap ideas if you get enthralled by a tool and over use it to the degree that someone assumes that this is the way things should be. I had a call with an engineer who thought our interaction design was too simple — one button — and should be ‘made better’ by adding a mobile phone interaction where you touch the mobile to the thing and, using NFC, the phone and the thing would connect and then a browser window pops open on the mobile and then you interact with the thing using the browser on the mobile to control the thing over Bluetooth so that anyone can do it.

*shrug.

Nip that sort of thing in the bud. What are the alternatives to consider besides what you see everywhere, or what you take for granted, or what is considered “hygiene” in your industry, or what cool new drop-down feature AfterEffects CS12 has, or what everyone else is doing, or what you think Steve or Sir Jony would do because you can get off their teet.

The other thing to say here is that the VFX amateurs are going bonkers with planar tracking. They love to track something in a scene and then put some semi-transparent animations of UI’s on it. They LOVE it. And then they move the camera a bit so it looks *real — like the UI is actually there in the thing and maybe it’s compelling enough that people think — huh, wow..is that real? At some point the VFX animation of planar tracked surfaces simply jumped the shark and now people do it cause they can. The VFX have determined the design. That’s bad design. Doing it cause you can, not cause you should.

And that, friends, is why we end up with a world of screen-based interactions. Because the folks at Imagineer System made the wonderful and wonderfully over-used Mocha Pro — a relatively inexpensive tool that anyone can use and — lo! — comes bundled with AfterEffects. There’s a criteria in there — when a tool becomes a *tool, rather than a bespoke, handcrafted workflow, then it’s sorta jumped the shark. I don’t blame them – Imagineer Systems. Maybe I blame Adobe a little. But, either way — I would expect more from those who use it to pull back a bit from making everything a planar interactive surface.


Continue reading A Screen-y FutureScape-y 2025

The iPod Time Capsule – Notes on Listening + Time + Design of Things That Make Sound

Over the week’s end I was in the back studio tearing down and rebuilding the wall of photos for the Hello, Skater Girl “side” book project. I was tasked with this particular endeavor by the guy I hired to do the book design. I knew I’d have to do it all along which is why I had put up sound board many, many months ago.

It was going to be an all-afternoon-into-the-evening effort, which is fine. Making a book is hard fun work. I needed music but I didn’t want to suffer the tyranny of choosing or even curating a list of things. I just wanted music to come out of the stereo.

And then I remembered — I have my old dear friend’s ancient 2004 iPod. She gave it to me when she upgraded and I’ve never even looked at it. It’s just followed me around from city to city and house to house. There it was.

I plugged it in and it booted up just fine. And then I just pressed play and got to work.

It was a sea of past era music. Not super past — early 2000s. Perfectly fine. Some songs I may not have chosen. Some songs I didn’t know. Whatever. It was somewhat enthralling to realize I was listening to a frozen epoch of sound, incapsulated in this old touch wheel iPod. I sorta wish I had my original iPod. As it is, I still use my 80gb model, although that’s becoming a bit obsolete as a device in this era of having all-the-music-in-the-world-in-the-palm-of-your-cloud-connected-device.

I find it a bit incredible that this thing still works. I mean, it’s a hard drive with a little insect brain — so there aren’t firmware drivers to suffer incompatibilities with a future it was never destined for. Even though it has become obsolete in the consumer electronics meaning of obsolete — it can still work and sound just comes out of it the way an audio device should function.

That’s significant as a principle of audio and sound things, so I’ll say it again sound just comes out of it — and it does. The old trusty 3.5mm jack delivers amplitude modulated signaling in a way that is as dumb as door knobs — and that is as it should be. Not every signal should or needs to be “smart”..just like every refrigerator need not be smart. It’s back to basics for very good reason, I would say. (Parenthetically, I’ve been assaying a fancy new mixed-signal oscilloscope which can take an optional module to specially handle audio signaling — there are audio processing…)

What’s the future of that for the collective of things? How many things will work beyond their time? What are the things that won’t need an epic support system of interfaces, data, connectivity to *just work* after their time in the light? What of the cloud? When it breaks, grows old, has an epic failure that makes us all wonder what the fuck we were thinking to put everything in there — will my music stop coming out of my little boxes?

As I pinned up lots of little photos and every once and again checked the iPod to see what was playing, I thought about some stuff related to the design of audio and design of things that make sound.




iPods and music players generally are great single-purpose devices from the perspective of their being time capsules of what one once listened to. You’ll recall the role the iPod played in the apocalyptic tale “The Book of Eli” — it becomes a retreat to a past life for the the messianic title character. And despite the end of the world (again) the device will still work with a set of headphones the (potentially unfortunate) propriety dock connection and means to charge it through that dock connection. Quite nice for it to show up as a bit of near future design fiction.

What will happen to the list of music, which already seems to be a bit of a throw-back to hit parades and top 100s sorts of thigns. Those are relics from the creaky, anemic, shivering-with-palsy, octogenarian music industry which gave you one way to listen and one thing to listen to — broadcast from the top down through terrestrial radio stations that you could listen to at the cost of suffering through advertisements.

Now music (in particular, lets just focus ont that) comes from all over the place, which is both enthralling and enervating. Where do you find it? Who gets it to you and how? How do you find what you don’t even know is out there? Are there other discovery mechanisms to be discovered? Is this “Genius” thing an algorithmic means of finding new stuff — and who’s in charge of that algorithm? Some sort of Casey Kasem AI bot? Or the near future version of a record play graft scam? Or do we tune by what we like to listen to?

And despite the prodigious amount of music on this flash-frozen iPod from some years ago — now kids are growing up in a world in which many orders of magnitude *more music is available to them just by thinking about it..almost. It’s all out there. Hype Machine, Spotify, Last.fm, Rdio, Soundcloud..in a way YouTube — new music players and browsers like Tomahawk, Clementine — whatever. These new systems, services, MVC apps or whatever you want to call them — they are working under the assumption that all the music that is out there is available to you, either free if you’re feeling pirate-y or for a 1st world category “small fee” if you want to cover your ass (although probably still mug the musicians.) The licensing guys must be the last one’s over the side on this capsizing industry.

Listening rituals must be evolving as well, I’d guess. Doing a photography book about girl skaterboarders means that you end up hanging out with girl skateboarders and you end up observing what and how they listen to music. What I’ve noticed is that they do lots of flipping-through. They’ll listen to the hook and then maybe back it up and play it again. And then find another song. It’s almost excruciating if it weren’t an observation worth holding onto. I wonder — will a corner of music evolve to nothing but hooks?


Spotify Box project on IxDA awards thing is interesting to consider. I love the way the box becomes the thing that sound just comes out of. And the interaction ritual of having physical playlists in those little discs is cute. The graduate student puppy love affair with Dieter Rams is sweet in an “aaaahhh..I remember when..” sorta way. It’s a fantastic nod to the traditions and principles of music. And the little discs — well, to complete the picture maybe they should be more evocative of those 45 RPM adapters some of you will remember — and certainly plenty of 23 year old boys with tartan lumber jack flannels and full-beards are discovering somewhere in Williamsburg or Shoreditch or Silver Lake. They’ll love the boo-bee-boo sound track that the project video documentation comes with. Great stuff. Lovely appearance model. For interaction design superlativeness — there’s some good work yet to be done.

Okay. So…what?

It is interesting though to think of the evolution of things that make sound. And I suppose there’s no point here other than an observation that lists are dying. I feel a bit of the tyranny of the cloud’s infinity. If I can listen to *anything and after I’ve retreated to my old era favorites — now what? The discovery mechanisms are exciting to consider and there’s quite a bit of work yet to be done to find the ways to find new music. It definitely used to be a less daunting task — you’d basically check out Rolling Stone or listen to the local college radio. Now? *Pfft. If you’re not an over eager audiophile and have lots of other things to do — you can maybe glance around to see what friends are listening to; you could do the “Artist Radio” thing, which is fine; you could listen to “artist that are like” the one you are listening to. Basically — you can click lots of buttons on a screen. To listen to new music, you can click lots of buttons on screen. And occasionally CTRL RIGHT-CLICK.

Fantastic.

In an upcoming post on the design of things that make sound, we’ll have a look at the interaction design languages for things that make sound.

Before so, I’d say that clicking on screens and scrolling through linear lists have become physically and mentally exhausting. Just whipping the lovely-and-disruptive-at-the-time track wheel on an old iPod seems positively archaic as names just scrolled by forever. The track wheel changed everything and made the list reasonable as a queue and selection mechanism.

But, can you imagine scrolling through *everything that you can listen to today? What’s the future of the linear list of music? And how do we pick what we play? What are the parametric and algorithmic interaction idioms besides up and down in an alphabetically sorted list of everything?

Good stuff to chew on.

More later.

Why do I blog this? Considerations to ponder on the near future evolution of things that make sound and play music in an era in which the scale of what is available has reached the asymptotic point of “everything.” What are the implications for interface and interaction design? What is the future of the playlist? And how can sound things keep making sound even after the IEEE-4095a standard has become obsolete. (Short answer — the 3.5mm plug.)

Continue reading The iPod Time Capsule – Notes on Listening + Time + Design of Things That Make Sound

Whittling Away at Audio

Audio Whittling

I’ve become almost over-interested in audio as a new, untapped frontier for IxD and UX. In contrast to what our quite busy, jealous, overburdened screens offer us audio has the opportunity to form a kind of interaction experience and engagement with “stuff” (sorry early days…not sure how to be more precise..) and other people seems woefully antique. Could be some good wheels-on-luggage insights and opportunities to do design that makes things better — and makes what we have now embarrassing.

This is an unfolding theme and there have been some “observations” of things that just seem like they were never really designed so much as bolted on without a care or a concern that could be done better.

Some considerations:

I need a category of aspects of audio and it’d also be nice to become a bit more expert at audio and sound and the variances, cultures and interstices of the terrain.

Screens are all well and good, and HD audio may possibly become *more HD and surround-y, but even the small, low-hanging simple stuff is super interesting, like..

* Kitchen appliances that beep like a yelping puppy what that just got its tail stepped on
* Car horns and their abusive honk when you just want a chime to summon a friend or lightly remind that sleeping wanker at the head of the red light queue to move on
* Cars and their noises in the era of purring-whirring barely noticeable electric engines — I know this is a terrain that’s being actively explored
* Audio processing to make sound more expressive — are there alternatives and extensions to volume and tone control as ways of manipulating sound without getting goofy?
* What’s the Instagram of sound?
* What would a proper sound designer do if given a brief to design the audio experience for an operating system? Or a microwave oven? Or an airplane cabin interior?
* Consider that the high water mark of sound design for devices and the like are start up tones, beeps on notifications, &c. That’s not much — there could be more.

What would the world be like if proper, thoughtful sound designers came into the UX/IxD mix?

What’s the Design Fiction for the world in which, in some future/historical moment humans have enormous ears and pin-hole eyeballs..and they needed design work done? In other words — if we were more reliant on our ears rather than our eyes what would “X” (computer/smart device/car/chair/bicycle) look & behave like?

* Software to learn more about audio:

* Max/MSP (I end up using this about once every year anyway — and now it seems like it can “talk” to Abelton Live..need to figure out why this is interesting)
* Reaktor
* Logic
* Abelton Live

These are audio making softwares, mostly tilted towards making music or composing sound into rhythmic melodic assemblages or something like that. While the idea of being a DJ with throbbing thumping crowds manipulated by my expert mixing and all that sounds like fun, I’m actually more interested in the ways these tools and playthings can help design audio experiences of other sorts — like even mundane moments of sound..a new car horn, for example — or an intriguing car alarm that brain paralyzes the would-be car-jacker into doing the polka. ((I don’t know why I’m fixated on car sounds – maybe it’s LA getting to me..))

World's Largest Max/MSP Patch
ScreenLive
ScreenReaktor

A curious side note to this world of audio software you’ll notice from those screen shots above: it’s entirely baroque in its UI design, which is both super intriguing and somewhat annoying, but actually more intriguing than annoying.

An experiment:

I’m *trying to make a DIY small, portable, audio mixer with a variety of stereo and mono inputs and some “effects sends” so that I can experiment with mixing multiple sound sources and sound sensors while on the go — walking and riding around.

Seems simple enough but I’m having a bear of a time with it. More about that in a subsequent post.

That’s it. Rough early days. I can say that its super exciting. And nice to be tagging along with Russell as he experiments with some similar questions. (cf. Secondary Attention and Little Boxes of Sound, Secondary Attention and The Background Noises. I especially like the idea in the latter post about the “Ghost Box” concept of a thing that inserted sound effects, effectively into the environment.

Why do I blog this? Because if I didn’t, I’d forget what I was doing in the past when I’m in the future. Also it’s good to share things that are going on because then you hear from other people who are working on similar threads and friends should know what friends are thinking about even when separated by the Internet.

Continue reading Whittling Away at Audio