Last week, our reading assignment for To Remember and To Forget included Cracking the Brain’s Codes and The Importance of Feelings. The lecture was a review of the anatomy of the brain and an exploration of emotions and memories through neuroscience, through film (we watched a clip of Her), and through smell.

Cracking the Brain’s Codes reveals some of the newer developments in understanding how we think, remember, and feel by decoding the brain. The brain’s coding works through neural spikes. Different spike patterns based on functions, senses, and perceptions create different meanings. What matters is the rates of spikes; they represent variations in brightness, speed, distance, orientation, color, pitch, etc. This is especially interesting to me because I was just starting to learn about and work with serial communication in Physical Computing. The analogy here is very obvious: different computers are like different neurons, to communicate with one another two computers must establish a common pulse rate, common voltage level, and common voltage meaning. Taeyoon had mentioned in class in the past that it’s very tempting to find similarities between the computer and the brain, but there are many differences that sets the two apart. However, with the little that I know of either subject, it’s very hard for me to not compare the two. Even the article stated similarities of the Brain’s code to computer code, e.g. ASCII, pixels, and vector are made up of different patterns of code like patterns of neurons. I wonder if there is something innately structured in our brain that makes this comparison inevitable. And after all, the computer is created by the human brain; shouldn’t the creation share some similarities with its creator? Personally, it’s very attractive to think that by learning how computers communicate and how to code it to do different things, I’m also learning how the brain works. Perhaps because this belief ameliorates some of my existential dread, I find it very motivating.

A common topic in both readings focus on the importance and difficulty of understanding how networks of neuron spikes work. This is important because any complex thoughts or emotions that we may have is dictated by the structuring and wiring of these networks, instead of one off spikes between neurons. For instance long term knowledge or skills, such as driving a car, is learned through rewiring network of small groups of neuron that encode things it encounter over and over again. The construction of sentences is another example. Each group of neuron means simpler concepts, such as specific words. If we can understand these networks and work backwards, think of what science fiction-like utopia/dystopia we would create. We would be able to learn new things without having gone through the repetition of experiences. Computers would be able to create and make complex decisions. We would be able to alter the way we perceive our existence.

The difficulty in understanding these networks lies in the complexity of the brain, the lack of technology for better observations, and what Cracking the Brain’s Codes author calls the “noise” in the signal. The latter triggered yet another comparison. Nate Silver also wrote about the noise and the signal, but around the topic of big data. This seems to be an ongoing theme in our contemporary world: more information but stagnant growth of understanding in how the information are connected to find meaning and use. Nate Silver’s solution is to combine computer processing power with human intuition and experience, for the nuance and complexities in the given field, plus a bit of good luck. I think this is probably encouraging for neuroscientists, because we are studying the human brain after all and we, more than anyone else, possess the intuition and experience of our own complexed and nuanced emotions. Perhaps working with people who are more connected with with their personal emotions and feelings, such as artists and poets, would aid in the quest for decoding the brain.

On the third class at ITP Ziv was in To Remember and to Forget.

Memories are often purposeful, sometimes to confirm, to identify, to justify, to bond, to understand ourselves and others. But once in a while I have a flashback triggered by something I see or hear or smell or maybe feel at a given moment. I don’t know why I remember such events. They have no purpose. They come and go as they please without any of my conscious efforts. Usually they come as a short scene, like a clip from a movie I’ve seen long ago.

Someone in some place at some time doing something or saying something.

Can I capture these memories in a system as it happens or at least right after it happened, so that it leaves a darker mark in my subconscious. Can I add to it, by allowing others present to add details, to even alter this memory? Can I embed a memory of an event that I didn’t even notice at the time?

In this project I attempt to capture details of an event from multiple people from multiple sides and recombines details into different narratives of the same event. The categories for these details are seemingly rigid and conventional: who, what, where, when. But it is really as rigid and conventional as language and as the people involved can be. For instance “when” can be “September 26th, 2014” or it can be “when she passed slowly by my desk” (which can also be a what depending on the person). The only restriction is that there is no more than six details for each category. These details are then assembled back together by a rubix cube, fitting disparate elements into one narrative or pattern, then repeating this over and over to produce different memories of the same event.

I tried this very quickly in class when I presented the project: to remember that moment as an event to be saved in my memory. I think it was a success. I actually can recollect a lot of details from that seemingly mundane moment. I remember everyone who had wanted to be added to the “who” category, even though I had never spoken to any of them in the past, aside from Taeyoon. I remember seemingly random details from that class, like Taeyoon wondering about whether mice have an innate fear of cats. And these memories in turn altered my interaction with the people that I remember.