{"id":577,"date":"2015-04-13T20:02:33","date_gmt":"2015-04-13T20:02:33","guid":{"rendered":"http:\/\/itp.fromjia.com\/?p=577"},"modified":"2015-04-20T04:58:28","modified_gmt":"2015-04-20T04:58:28","slug":"aoac-final-idea-augmenting-social-interactions","status":"publish","type":"post","link":"http:\/\/itp.fromjia.com\/?p=577","title":{"rendered":"AOAC final idea: augmenting social interactions"},"content":{"rendered":"<p><strong>Fish and Carrier Frequencies<\/strong><\/p>\n<p>What do we experience when we\u00a0are in the physical presence of other people?\u00a0Do we experience joy or fear? Can we augment this experience by altering what you see and hear?<\/p>\n<p>These are some of the things\u00a0I want to explore with\u00a0my AOAC final project. Jason and I will be working together to create an &#8220;augmented social&#8221;\u00a0experience utilizing BLE connections between smartphones and smartphones\/beacons. We have two ideas, both involve multiple participants, wearing\u00a0<a href=\"https:\/\/www.google.com\/get\/cardboard\/\">Cardboard\u00a0<\/a>to augment their sight\u00a0and headphones to augment their hearing.<\/p>\n<p><strong>Fish<\/strong>:\u00a0The experience we create would simulate a school of fish interacting with each other underwater. Each participant would represent\u00a0a fish in the experience.<\/p>\n<ul>\n<li>Each person\/fish triggers\u00a0a different oscillator\u00a0that has\u00a0an unique sound.<\/li>\n<li>As one person\/fish gets closer to another person\/fish, they would hear the other&#8217;s sound and corresponding visuals.<\/li>\n<li>The visuals they see in Cardboard would be a filtered view from the camera, that changes based on the closeness of other people\/fish.<\/li>\n<li>Each person\/fish can also speak into their microphone to add more audio queues to the whole group&#8217;s experience.<\/li>\n<li>The direction the person\/fish is facing can also change the audio or visual experience.<\/li>\n<\/ul>\n<p><strong>Carrier Frequencies: <\/strong>Experiencing other people only through their devices&#8217; frequencies. The details of this idea is similar to the Fish idea, but conceptually focusing on the connection between our devices over our actual social interactions.<\/p>\n<ul>\n<li>Every participant emits a \u201ccarrier\u201d frequency, which has parameters like amplitude, filter frequency.<\/li>\n<li>Parameters are modulated by proximity to other people. So other people act as \u201cmodulators.\u201d<\/li>\n<li>The frequencies are both sonified and visualized.<\/li>\n<\/ul>\n<p><strong>Getting technical<\/strong><\/p>\n<p>To measure the physical relationship\u00a0between each person\/device, we will use BLE connection between devices or connection between devices and iBeacons placed around the room.<\/p>\n<p>We&#8217;ve\u00a0tested with <a href=\"http:\/\/estimote.com\/\">iBeacons<\/a>. The distance measured is not very accurate, but the audio produced from the frequencies are pretty cool.<\/p>\n<p><iframe loading=\"lazy\" src=\"https:\/\/player.vimeo.com\/video\/124856693?byline=0\" width=\"500\" height=\"281\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/p>\n<p><iframe loading=\"lazy\" src=\"https:\/\/player.vimeo.com\/video\/124856694?byline=0\" width=\"500\" height=\"281\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/p>\n<p>I&#8217;m also trying to connect devices through BLE. There are two Phonegap\u00a0plugins (<a href=\"https:\/\/github.com\/petermetz\/cordova-plugin-ibeacon\">this <\/a>and <a href=\"https:\/\/github.com\/bcsphere\/bluetooth\">this<\/a>) that would set an iPhone as a peripheral, but I&#8217;m not having much luck with them. There are definitely more options in Objective-C. I&#8217;ll have to look into this more.<\/p>\n<p><strong>UPDATE:<\/strong><\/p>\n<p>We received a lot of great feedback from the class after we presented the ideas. Here are some of the feedback notes we collected.<\/p>\n<p><a href=\"http:\/\/itp.fromjia.com\/wp-content\/uploads\/2015\/04\/Screen-Shot-2015-04-20-at-1.09.00-AM.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-large wp-image-590\" src=\"http:\/\/itp.fromjia.com\/wp-content\/uploads\/2015\/04\/Screen-Shot-2015-04-20-at-1.09.00-AM-1024x439.png\" alt=\"Screen Shot 2015-04-20 at 1.09.00 AM\" width=\"730\" height=\"313\" srcset=\"http:\/\/itp.fromjia.com\/wp-content\/uploads\/2015\/04\/Screen-Shot-2015-04-20-at-1.09.00-AM-1024x439.png 1024w, http:\/\/itp.fromjia.com\/wp-content\/uploads\/2015\/04\/Screen-Shot-2015-04-20-at-1.09.00-AM-300x129.png 300w, http:\/\/itp.fromjia.com\/wp-content\/uploads\/2015\/04\/Screen-Shot-2015-04-20-at-1.09.00-AM-1200x514.png 1200w\" sizes=\"auto, (max-width: 730px) 100vw, 730px\" \/><\/a><\/p>\n<p><a href=\"http:\/\/itp.fromjia.com\/wp-content\/uploads\/2015\/04\/Screen-Shot-2015-04-20-at-1.09.12-AM.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-large wp-image-591\" src=\"http:\/\/itp.fromjia.com\/wp-content\/uploads\/2015\/04\/Screen-Shot-2015-04-20-at-1.09.12-AM.png\" alt=\"Screen Shot 2015-04-20 at 1.09.12 AM\" width=\"444\" height=\"774\" srcset=\"http:\/\/itp.fromjia.com\/wp-content\/uploads\/2015\/04\/Screen-Shot-2015-04-20-at-1.09.12-AM.png 444w, http:\/\/itp.fromjia.com\/wp-content\/uploads\/2015\/04\/Screen-Shot-2015-04-20-at-1.09.12-AM-172x300.png 172w\" sizes=\"auto, (max-width: 444px) 100vw, 444px\" \/><\/a><\/p>\n<p><a href=\"http:\/\/itp.fromjia.com\/wp-content\/uploads\/2015\/04\/Screen-Shot-2015-04-20-at-1.09.22-AM.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-large wp-image-592\" src=\"http:\/\/itp.fromjia.com\/wp-content\/uploads\/2015\/04\/Screen-Shot-2015-04-20-at-1.09.22-AM-1024x398.png\" alt=\"Screen Shot 2015-04-20 at 1.09.22 AM\" width=\"730\" height=\"284\" srcset=\"http:\/\/itp.fromjia.com\/wp-content\/uploads\/2015\/04\/Screen-Shot-2015-04-20-at-1.09.22-AM-1024x398.png 1024w, http:\/\/itp.fromjia.com\/wp-content\/uploads\/2015\/04\/Screen-Shot-2015-04-20-at-1.09.22-AM-300x117.png 300w, http:\/\/itp.fromjia.com\/wp-content\/uploads\/2015\/04\/Screen-Shot-2015-04-20-at-1.09.22-AM-1200x466.png 1200w\" sizes=\"auto, (max-width: 730px) 100vw, 730px\" \/><\/a><\/p>\n<p><a href=\"http:\/\/itp.fromjia.com\/wp-content\/uploads\/2015\/04\/Screen-Shot-2015-04-20-at-1.09.40-AM.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-large wp-image-593\" src=\"http:\/\/itp.fromjia.com\/wp-content\/uploads\/2015\/04\/Screen-Shot-2015-04-20-at-1.09.40-AM.png\" alt=\"Screen Shot 2015-04-20 at 1.09.40 AM\" width=\"730\" height=\"412\" srcset=\"http:\/\/itp.fromjia.com\/wp-content\/uploads\/2015\/04\/Screen-Shot-2015-04-20-at-1.09.40-AM.png 772w, http:\/\/itp.fromjia.com\/wp-content\/uploads\/2015\/04\/Screen-Shot-2015-04-20-at-1.09.40-AM-300x169.png 300w\" sizes=\"auto, (max-width: 730px) 100vw, 730px\" \/><\/a><\/p>\n<p><a href=\"http:\/\/itp.fromjia.com\/wp-content\/uploads\/2015\/04\/Screen-Shot-2015-04-20-at-1.10.04-AM.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-large wp-image-594\" src=\"http:\/\/itp.fromjia.com\/wp-content\/uploads\/2015\/04\/Screen-Shot-2015-04-20-at-1.10.04-AM-1024x733.png\" alt=\"Screen Shot 2015-04-20 at 1.10.04 AM\" width=\"730\" height=\"523\" srcset=\"http:\/\/itp.fromjia.com\/wp-content\/uploads\/2015\/04\/Screen-Shot-2015-04-20-at-1.10.04-AM-1024x733.png 1024w, http:\/\/itp.fromjia.com\/wp-content\/uploads\/2015\/04\/Screen-Shot-2015-04-20-at-1.10.04-AM-300x215.png 300w, http:\/\/itp.fromjia.com\/wp-content\/uploads\/2015\/04\/Screen-Shot-2015-04-20-at-1.10.04-AM-1200x859.png 1200w, http:\/\/itp.fromjia.com\/wp-content\/uploads\/2015\/04\/Screen-Shot-2015-04-20-at-1.10.04-AM.png 1694w\" sizes=\"auto, (max-width: 730px) 100vw, 730px\" \/><\/a><\/p>\n<p><a href=\"http:\/\/itp.fromjia.com\/wp-content\/uploads\/2015\/04\/Screen-Shot-2015-04-20-at-1.10.25-AM.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-large wp-image-595\" src=\"http:\/\/itp.fromjia.com\/wp-content\/uploads\/2015\/04\/Screen-Shot-2015-04-20-at-1.10.25-AM-609x1024.png\" alt=\"Screen Shot 2015-04-20 at 1.10.25 AM\" width=\"609\" height=\"1024\" srcset=\"http:\/\/itp.fromjia.com\/wp-content\/uploads\/2015\/04\/Screen-Shot-2015-04-20-at-1.10.25-AM-609x1024.png 609w, http:\/\/itp.fromjia.com\/wp-content\/uploads\/2015\/04\/Screen-Shot-2015-04-20-at-1.10.25-AM-178x300.png 178w, http:\/\/itp.fromjia.com\/wp-content\/uploads\/2015\/04\/Screen-Shot-2015-04-20-at-1.10.25-AM.png 792w\" sizes=\"auto, (max-width: 609px) 100vw, 609px\" \/><\/a><\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Fish and Carrier Frequencies What do we experience when we\u00a0are in the physical presence of other people?\u00a0Do we experience joy or fear? Can we augment this experience by altering what you see and hear? These are some of the things\u00a0I want to explore with\u00a0my AOAC final project. Jason and I will be working together to [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[8],"tags":[],"class_list":["post-577","post","type-post","status-publish","format-standard","hentry","category-always-on-always-connected"],"_links":{"self":[{"href":"http:\/\/itp.fromjia.com\/index.php?rest_route=\/wp\/v2\/posts\/577","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/itp.fromjia.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/itp.fromjia.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/itp.fromjia.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/itp.fromjia.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=577"}],"version-history":[{"count":5,"href":"http:\/\/itp.fromjia.com\/index.php?rest_route=\/wp\/v2\/posts\/577\/revisions"}],"predecessor-version":[{"id":596,"href":"http:\/\/itp.fromjia.com\/index.php?rest_route=\/wp\/v2\/posts\/577\/revisions\/596"}],"wp:attachment":[{"href":"http:\/\/itp.fromjia.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=577"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/itp.fromjia.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=577"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/itp.fromjia.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=577"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}