DAD 492: Programming for Sound Designers on DAD 492: Programming for Sound Designers

Schedule

Sat, 02 Jan 2021 00:00:00 +0000

Lessons

Week 1 (8/22) - Introduction to coding and creativity

Tuesday

Review syllabus and expectations in class. Please note: that this syllabus is subject to change.
Web Audio Examples

Thursday

Why Interaction? - Why code, interact, why use the web?
Interaction examples of interactions with music in space and on the web.
Assignment 1: Manifesto Project

Week 2 (8/29) - Score as code, code as score

Tuesday

Intro to JavaScript - Numbers, Strings, Arrays, Objects, Functions, and Variables, scope
- Free Code Camp basic javascript
Show the console.

Thursday

Web audio basics and sound file players - slides

Week 3 (9/5) - Interfaces

Tuesday

Manifestos are graded - lots of inspiring ideas in there
Audio Effects

Project 1: Sampler - Due 9/13 - build a sampler and perform your score, reference back to your manifesto for inspiration

Thursday

Interfaces and scores

Musical Interfaces
HackPact
Audio Plugin Interface analysis - let’s pick a few plugins and discuss how they meet the standards we just mentioned
Extra interface options in p5.js - DOM

Week 4 (9/12)

Tuesday

First project debugging

Thursday

30 Minutes of project debugging and finishing
- at 1:30 turn in your project and we’ll spend the rest of class playing each others instruments
Project list

Week 5 (9/19)

Tuesday

Intro to synthesis - slides, textbook

Thursday

Class Canceled - DSU Days of Service

Week 6 (9/26) - more synthesis

Tuesday

Keep working on synth user interface assignment from last week
- show dealing with the DOM more effectively in p5.js
Turn in work at the end of class.

Thursday

Finish the interface

Week 7 (10/3)

Tuesday

Making synthesizers from scratch - slides

Project 2 - Creating a synthesizer from scratch - DUE October 13 Use Guitar Land for inspo.

Thursday - adding to the synth

Look at the MonoSynth in more detail
work on project in class

Week 8 (10/10)

Tuesday

Work more on MonoSynth project in class

Thursday

Work more on MonoSynth project in class

Project 2: MonoSynth remake Due

Week 9 (10/17)

Tuesday

You should have your MonoSynth remake turned in
Scheduling signals and LFOs - slides
In class - add an LFO module to your MonoSynth project

Thursday

Implement a step sequencer on your synth project using setValueAtTime to change the frequency of each step as you hold down the key. Create sliders that allow the user to modify the notes each step plays. Also, allow the user to pick the step count and step speed.
Things to know: for loops (and nested for loops), arrays, frequency to MIDI conversion

Week 10 (10/24)

Tuesday

continue building the arp
turn in what you have by tonight at midnight

Thursday

Build a step sequencer with Tone.Loop

Week 11 (10/31)

Tuesday

Sequencing notes

Thursday

Sequencing Notes - pt 2

Week 12 (11/7)

Tuesday

Sequencing Notes - pt 3

Final project proposal - Due Monday

Final project

Thursday

Generative music -

Week 13 - Final project start

Tuesday

start working on individual projects, i’ll bring in examples based on what each person wants to do
Creating a Read ME for the
- this will include a link to the project and your written reflection
Deploying your project to GitHub.
Layouts - relative layout, css grid

Thursday

In class work on final project - everyone is still required to attend
Using UserMedia for live audio
Control - Tweakpane - if you want to be able to hide controls
LocalStorage - storing data for users locally - example
More UI elements - NexusUI - Envelope Example
Webmidi.js - example - requires chrome

Week 14, 15

More in class work on final
Should have something built by now and start testing it and making it better.

Week 16

Final: Thursday, December 8th, 1 pm - 3 pm

Syllabus

Fri, 25 Jan 2019 00:00:00 +0000

Download

« Previous Next » Page: /

Examples

Mon, 01 Jan 0001 00:00:00 +0000

Instruments

Apotome - Created by Khyam Allami and Counterpoint. A browser-based generative music environment based on octave-repeating microtonal tuning systems and their subsets (scales/modes).

Leimma - A browser-based tool for exploring, creating, hearing, and playing microtonal tuning systems.

Groove.pizza - Musedlab from NYU Music Experience Design Lab

LudoTune - LudoTune is a 3D musical toy for making music with cubes!

The Infinite Drum Machine by Manny Tan & Kyle McDonald | Experiments with Google - Thousands of everyday sounds, organized using machine learning.

iO-808 - 808 drum machine - Vincent Riemer

Roland 808303.studio - Roland 808303.sutdio - Yuri Suzuki and a tutorial

Bongo Cat - cat play bongos

Music videos

Neuhaus.world - Neuhaus.world is a participatory, interactive music video for Rotterdam based artist Jo Goes Hunting. All photographs are taken by the visitors of neuhaus.world

Interactive music videos or visualizations

Porter Robinson - Look at the sky - Interactive 360° audiovisual experience to stream Porter Robinson’s new album “Look at the sky”. To use on mobile phone or webVR device.

Compositions

Jazz.Computer - Yotam Mann

Generative.fm - Ambient Generative Music by Alex Bainter - code

microscale - Ales Tsurko

Distributed smartphone speaker-arrays

Cellular Chorus by Patricia Wolf - a work of spatialized aleatoric music using smartphones to bring people physically closer to have an interactive and collective experience with light and sound.

Web-based sound art

Data based

L-Drones - Tero Parvianen - and others on his website

Interactive

Patatap - tap your keyboard

Recently added support for MIDI input, use with ableton: https://www.youtube.com/watch?v=o5igwpQIpi4

Synesthesia - A realtime music and graphic experiment by Rikard Lindstrom (deskop only) - Synesthesia is an audiovisual experiment combining real-time graphics and audio to create graphic and musical phrases. Playable on your computer keyboard.

Visualization

Inside Music - Google webvr expriment

Song Exploder Presents: Inside Music

Audio Fabric - Taylor Baldwin

audiofabric

Sonification

FORMS

Final Project

Mon, 01 Jan 0001 00:00:00 +0000

Your final project will be a performable instrument or interactive musical experience. You will use Tone.js for sound and p5.js for the GUI and possible extra visuals.

Projects should include the following:

Implementation

Tone.js

Synthesized sound with one of the instruments
Sampled sound with Tone.Player
At least two effects
Some type of sequencing, using Loop, Part, Pattern, Sequence, or ToneEvent

p5.js

A clear graphical user interface with
Labeled controls
Some text explaining how to use the project if necessary

Written response

Write three to five paragraphs describing your project. Talk about your design choices and goals for the project. Did you meet those goals? What challenges did you run into that hindered you in the process?

Post this description with your final project in your GitHub project as a ReadMe.

Presentation

During presentations you will spend a minute or two describing the project your intentions for creating it. After that your classmates will preform or play with your project. The instrument’s interface and design must be intuitive enough for someone else to learn it’s function in a short amount of time. If you classmates can’t figure out how your project works it will negatively effect your grade.

Deployment

Your project will be deployed to the web using GitHub and GitHub pages. We’ll talk about how to do with in class. In this GitHub project you’ll add the Read ME with your project description and a link to a working version of the project.

Student Projects

Jason - Deathaxe-deth/KaiserFinale: Created with CodeSandbox
Colton - cl3470/csb-zm0qur
Jake - JacobHoffer/csb-kvbprk
Caleb - CalebGeb/csb-o10lrw
Angela - agmiller20/csb-psltev
Hannah - HannaM1401/csb-ueyg1x
Tomas - tomas924/csb-zh9erf
Martin - RottenWhaleCarcass/csb-8nh0br

Instrument projects

Mon, 01 Jan 0001 00:00:00 +0000

Manifesto

Mon, 01 Jan 0001 00:00:00 +0000

This assignment was adapted from and inspired by Salome Asega and Yotam Mann.

All artists have an implicit or explicit “manifesto” of design values/ideas/axioms that, sometimes loosely, sometimes closely, help guide and direct their work. Having such principles/axioms helps artists keep their voice; helps them resist pressures (primarily commercial); gives their work a more critical edge. This exercise is designed for beginning developing an artist manifesto that’s not necessarily rooted in your current practice but somewhat related to how you see yourselves in, say, 1, 5, 10, 20, or 40 years.

For this assignment, write 3-5 paragraphs on some principles and ideas that motivate and direct your practice. This can be difficult, but clarifying your thoughts in writing will help you compose and create with intention and purpose throughout the semester.

Post your manifesto D2L before next week.

More examples

Mon, 01 Jan 0001 00:00:00 +0000

(Source - Yotam Mann)

Tracking

Firewall - Aaron Sherwood, Mike Allison

Great example of mapping pressure and dynamics in an interesting way.

Trechery Of Sanctuary - Chris Milk

Chris Milk’s piece effectively employs sound to heighten the experience of the piece. The forceful sound of the flapping wings slows the user down and makes them embody the bird.

Instrument

Reactable - Sergi Jordà, Marcos Alonso, Martin Kaltenbrunner and Günter Geiger

A table with a camera underneath tracks fiducial markers on blocks. The placement and rotation of the blocks controls music music or sound effects.

Playing the Building - David Byrne

Byrne connected a piano keyboard to trigger motors and actuators around the building. Great use of space and materials.

Environmental

Subway Symphony - James Murphy

A proposed project which puts a lot of musical attention to the sound design of the New York Subway system.

Strings - Monica Bate, Johann Diedrick, Luisa Pereira Hors

Very architecturally striking design. Maps string plucks / stretches to samples and synthesis.

21 Balançoires (21 Swings) - Daily tous les jours

Playful public installation where swinging on swings generates music. Clear mapping and lots of variation in rhythm and melody.

Piano Stairs - Remo Saraceni

Not great sound design / composition (IMO), but very clear mapping.

Voice Array - Rafael Lozano-Hemmer

Participants record a short audio segment which is stored for later listeners.

Global String by Atau Tanaka (2000)

Connected via the Internet. real time sound synthesis.

What are the affordances/constraints that an art has versus a web based project?

Web

Human Record Player

Ticket - Morgan Packard & Josh Ott - 2010

Four interactive “songs”
Corresponding computer generated visuals
Touch and accelerometer interactions

Bloom - Brian Eno & Peter Chilvers - 2008

Low drone
Looped touch notes
Has “default” mode which makes sound even when the screen is not touched

Plink - Dinahmoe - 2011

WebSocket connected multiplayer jam
Every person person plays an instrument and can control start/stop and note

Patatap - Jono Brandel - 2014

Sample player
Triggering with corresponding visuals
Two.js visuals

Location Based

National Mall - BlueBrain

Project 1: Sampler Playback

Mon, 01 Jan 0001 00:00:00 +0000

For this assignment, the goal is to create a sketch that does the following:

loads at least 8 unique sounds into the sketch with Tone.Players()
playback of the sounds can be triggered by clicking a button
at least 4 audio effects are applied to the sounds in sequence
Each audio effect can be altered by a slider

Remember the goal is to be able to trigger multiple sound effects using Tone.Players(), and apply an effect ot them with the use of on-screen sliders. If you felt that using buttons was simple, try and map the sound playback to various keyboard buttons as well.

Use this as a template if needed.

Create a piece of music using your sampler instrument. Your realization should be around 1 minute in length.

Items to Submit:

the CodeSandbox link to your project
screen recording of your performance
a paragraph about the form of the piece and how you realized it with your instrument. What sorts of decisions did you make with your interface in order to create the piece that you wanted?

Project 2: Synth from scratch

Mon, 01 Jan 0001 00:00:00 +0000

Recreate the MonoSynth instrument from Sources and Components. The user should have control over the sound of the synthesizer. For example the ability to choose different oscillator types, filter types, filter cutoff and envelope ADSR. The user should also be able to choose between presets. When the user picks a preset, the user interface should reflect those changes in parameters.

To make your MonoSynth use the following diagram:

Make sure to use the correct envelope type for the amplitude and frequency envelopes.

Use the AudioKeys library to turn your computer keyboard into a musical keyboard. Use the example from the last time we used AudioKeys to see how to add it to your project.

We will build our synthesizer modeled off of the free TAL-NoiseMaker.

Allow the user to change the ADSR of the amplitude and filter envelopes.

Make it look nice!

Here is a working example of the project:

DUE October 13th