Wednesday, June 01, 2011

PATTERN RECOGNITION IN AUDIO

For the purpose of this article, I'm going to define 'pattern' as a series of repeating sets, with each set containing at least one thing or concept that act or are positioned according to an identical and recognizable logic, so that the sets might said to share a corresponding relationship with one another.

(Click the link in the following sentence, however, if you'd like to read a more formal definition of the concept from Wikipedia.)

A linear pattern can be defined as series of points on a graph (or notes on a staff), but a pattern that expresses itself across several different platforms can seem to resist linear graphing, because it is assembled from a matrix of multidimensional data. Even more difficult if one platform is exists in a the physical world, and the other is a conceptual platform manifest in our brains.

PATTERN RECOGNITION

For instance, if we watch the weather or the stock market, we arrive at a specific numeric value on a daily basis, the temperature or the Dow. We can then plot that value on a graph and over time analyze the graph for patterns. But we cannot extrapolate what it means to experience a drop in atmospheric pressure or the market from a mere number.

Likewise, a notated melody conveys information about a series about pitches. In this regard it is like any other pattern plotted on a plot/staff. But melody may also present itself as a carrier for emotional or semiotic content, and it must be performed if it is to be properly understood, decoded and (hopefully) replicated by listeners.

So it may be said that while a plot capably presents data, it is a poor delivery platform for experience. However, one reason why plot analysis remains intriguing is because by identifying and studying patterns we might learn how to reverse engineer an experience, the way a musician interprets a score in order to convey something about the human condition for a given audience.

So, really the identification of patterns in audio must be expressed as more than a series of sounds that share some relative relationship. We must also inquire as to patterns which evoke an emotional response. It sounds difficult to do, but in fact, musicians, composers, beat makers, songwriters and sound designers do this everyday, albeit with varying degrees of awareness.

MEMETICS + SEMIOTICS

In musical memetics, we analyze a work in order to identify patterns which lend themselves to such reproduction. A series of two or three notes sharing a particular intervallic and rhythm structure can describe a motif; a motif being a repeated meme throughout a given work, and which if it is successful is also scattered throughout or embedded in the culture.

Memes suggest a relationship to biology. Yet, in specific regards to the application of memetic theory to sound, sound predates biology. It is pre-biotic and pre-linguistic. What is new is for an organic sensor to respond by triggering an emotional reaction to this incoming data set. And also, our capacity to organize it in a cognate way no animal before us seems quite capable of doing, the infinite sounds of songbirds notwithstanding. This is to say, we understand how to charge sound with both feeling and meaning.

I sometimes think that if a dog's ignorance of our language is indicative of what some define as a diminutive cognitive ability, then what does inability to understand what dogs say, say about our own brains?

This still young study of music memetics suggests an expanded study of motif, which when combined with a knowledge of semiotics, appears to promise a deep, sophisticated tool kit for the sound designer interested in using audio as a carrier of symbolic data, and not just as a confirmation of an onscreen event.

ZOMBIE MAKING MEMES

I think we should not remain content, however, to accept 'meme' as synonymous with 'idea', as is often suggested. Because, what would be the point? By this definition every point on a graph is a idea and a meme, and how does that help us?

Nor should we accept that a meme is simply an idea that replicates, and therefore one memetic structure shares equivalency with another. In other words – all viruses exhibit viral properties, and so what, unless they somehow impact our lives in a significant manner. For as it happens, some viruses pass through our bodies without our ever knowing of their presence, while others will kill you.

The fact is all ideas once ignited into a network spread, and by that definition every single word, every letter is a meme –is a replicating idea. Maybe so in the broadest sense, but that knowledge alone will not necessarily help us achieve creative assets that reach and engage a broad audience.

It may not even be correct to say that an idea is appropriated, because a brain once exposed impresses upon itself real, physical and structural changes to the brain matter itself. So, it may be truer to say that ideas appropriate humans.

Far be it from me to suggest that your ideas are not your own, but in fact, that might be exactly the truth.

Perhaps the key is to investigate whether an idea appears to be replicated or is replicating. What is the distribution method? Is something popular because people know about it, or do people know about it because it's popular. These are purely a semantic questions because, ultimately, all ideas spread in much the same manner, from one human to another.

IDENTIFY THE PATTERN: IDENTIFY THE MEME

More to the point, by asking such questions we are reminded that before we advance further, we will need to limit our definition of meme to certain, mutually agreeable, parameters. In music, it needs to be defined as more than just a single note. But as Richard Dawkins, the originator of the concept even inquires, is a meme an entire work, or a portion of a work? Is it a hit song or just the hook? Can it be a cadence?

In this practice, I suggest we identify a meme as a thing, a fully formed construct, formed from more than one idea (or point), and which together can be said to behave like an earworm. This notion suggests not a single impulse, but a fully mapped pattern composed in such a way that it distributes culturally relevant data and concludes where it begins, forming a cognitive loop.

That is why some do say a meme is simply an idea that wants to replicate, and leave it at that, because we perceive the thing as replicating within our own brains as though by some sort of self generating cognitive cell division.

However, in the system proposed here, the pitch center 'A' 440 may be considered an idea that has been replicated, while the melody for Twinkle Twinkle Little Star (or the hook of any popular song) is a meme.

QUANTUM AUDIO: SMALLER THAN A MEME

From catch phrase to catchy melody, memes are generally linear in our perception of them. Those involved expanding the field will no doubt attempt to invent theories that establish memes in texture, timbre and dynamics. But I think that such pursuits describe another branch of study, belonging to Quantum Audio, because texture, timbre and dynamics color the meme, but are not distinct patterns that follow and independent and individual trajectory. That is, patterns they may be, but they are entirely dependent on a carrier.

Without a melody or readily apparent pattern to shade, they do not exist. They could said to find a parallel in inflection, and are therefore akin to sub particles, or behaviors, perhaps more closely related to internally manifest, God-made, or Nature-made, archetypes than the externally man made concepts we call memes.

So, for the purposes of Quantum Audio Theory, a meme represents a small cohesive compositional unit, but not the smallest musical unit, examples of which include note and pitch, even if such units are the result of a replicated and much used concept. Music itself will be said to represent a man-made, organized means of communication while any given work a single sonic event, the same way 50,000 words can be identified as a book.

FROM MEMETICS TO MULTIMEDIA

One might reasonably argue that just because something can't be seen without a microscope (or telescope) doesn't mean it doesn't exist. This is true, but it is equally true to suggest that such things lack cultural significance, although their discovery and replication of that knowledge might indeed be the result of an external cultural impulse to explore or investigate.

The bacterium Yersinia pestis is not a meme.
But the pattern of habits that allowed the Plague to spread through Europe is.

A love for the music of Beethoven (or Coltrane or Julie Feeney) is not a meme. But the hook or motif that seems set to psychologically irresistible internal repeat, leaving ecstatic holes in your brain is (although certain, obsessive ways by which admiration and fandom is made manifest might indeed be defined as memetic).

–With one important caveat:

MEME, EARWORM OR BOTH?

If we further narrow the definition of meme as only popular phenomenon that serves as the smallest carrier unit for cultural information, then we must expand our notion to include not mere melodies, but melodies that deliver according to that rule. Thus a hook may be quite catchy, but not contain enough information to be a substantive cultural carrier. Indeed, many melodies appear culturally neutral.

To put it another way, a given melody is equally capable of sounding like nursery rhyme as it is a section of a work of Heavy Metal. Thus we may conjecture that what any single, linear melody expresses is not necessarily inherent to the pitch pattern sequence, but the result of an individual Quantum Audio overlay.

And regardless of Quantum Audio overlay, an earworm, for instance, might say nothing of its point of cultural origin, but that doesn't stop your brain from repeating the thing over and over again with a kind of memetic madness.

Apart from memes, Quantum Audio particles, therefore, represent information carriers smaller than a meme, of sentient or inanimate origin, regardless of their capacity to be copied or self replicate (though note that units of inanimate origin have their meaning projected upon them by yet to be understood biological processes). And however minute these structures they may be, they nevertheless present us with a valuable area for analysis, if our goal is the creation of content, such as sonic branding, for instance, which is intended to scan along a 'multi dimensional', multi platform, mixed media matrix.


* * *

Photo Collage by Terry O'Gara

No comments: