Session 1: Today we will continue looking at examples of physical computing projects. The last few weeks of class with be spent primarily helping each of you with your final projects in preparation for our Creative Coding Exhibition during the finals period. However, it is also a good time to examine a few examples of creative coding a little more closely. Let’s start with looking at examples from SYNTAX, a project that was presented at the 2022 International Computer Music Conference in Ireland this summer in collaboration with Mike Hodnick (AKA Kindohm).
Session 2: Today we’ll examine more examples during lab time. Specifically we will look at the Audiovisual Grain Machine (AVGM) a performance tool I developed using Max. I have used AVGM for nearly a dozen performances in Prague CZ, Ireland, and the US. The software allows the performer to live loop and granulate (as in granular synthesis) audio and corresponding video in real time.
Lab 1: If you’re interested in using any example of machine learning for your final project, the best place to start is with ml5.js. This library has pre-defined models for hand tracking, body tracking, a face mesh, image and sound recognition. You can also train your own models for more specific tasks. Please be prepared to share your work in progress with small groups for critique and feedback.