songcode

The sound of Songcode

Our engine is packed with 380 different sounds, and zero generative audio models.

technologyunder the hood5 min read

Songcode has no audio model and it never will. Our songs are written in ode code, a text file, and our proprietary audio engine that powers Songcode Studio and our MCP turns an ode file into sound right your browser. Every sound the engine can play comes from one of two places.

1, The engine makes it from numbers while the song plays (synths)

  1. The engine plays a short recording of one sound, such as a piano note or a drum hit (sampler)

Today Songcode Studio’s sound picker about 380 sounds. About 155 of them are recordings of real instruments. The other 225 or so are made by the engine. We add new synths and samples nearly every week (so by the time you’re reading this, there’s probably even more). We’re also planning expansion of our instrument set in two other important ways:

  1. Users will be able to bring their own synths and samples and use them as they please. Our engine will work these into every generation in an intelligent way, makeing it very plug-and-play without having to wrestle with getting ode to work with your audio library.
  2. We’re pursuing partnerships with artists and producers to create high-quality instruments to add right into Songcode Studio. More on this to come.

Synths

These sounds are code. When a note plays, the engine builds it from oscillators, noise, filters, envelopes and FM, then mixes it, adds the effects the song asks for and sends it to your speakers.

  • All the core synths: 28 synth basses, 28 leads and plucks, 25 pads and choirs, and the stabs and chords.
  • 25 of the 32 drum kits. Each is a few numbers that set how low and long the kick is, how much of the snare is tone and how much is noise (and how gritty the whole kit is).
  • Likenesses of acoustic instruments we have no public domain recording of (yet). The nylon and steel string guitars, the mandolin, the oud, the sitar, the koto, the kora and a dozen more plucked strings are a modelled string that the engine plucks, and their descriptions in the picker say “string model”. The erhu, the bagpipes, the bandoneon, the theremin and the handpan are synth patches written to sound like the instrument. These aren’t perfect, and are prime candidates for replacement with sampled instruments down the road.
  • The electric pianos, the drawbar and transistor organs, the clav and the tape keyboard’s flute, strings and choir.
  • Every sound effect: risers, impacts, sirens, game sounds, a heartbeat, a clock.
  • The ambience beds: rain, a record’s surface, tape hiss, birdsong, crickets, a stream, the sea, a fire and thunder. Each one is filtered noise and many small events (a drop, a click, a chirp) scattered by a seeded random stream. Another prime candidate to be moved over to samples when the time presents itself.
  • The raw waveforms: sine, sawtooth, square, triangle, pulse and a stack of detuned saws.

The waveforms are worked out from formulas when the engine boots up each time you open Songcode Studio. The engine has no wavetables in the sense of sampled waves. Our reverb is computed too, with no recording of a real room behind it. We built things lean like this on purpose, but are working on exploration of improvement of these ideas as the platform grows (with your feedback of course!).

Sampled instruments

shelfrecordingsmade by the engine
Drum kits7: live, rock, brush, jazz, dusty, concert, epic25, such as club, boom and warm
Pianosall 7none
Keyboardsharpsichords, music box, three FM keyboard patcheselectric pianos, clav, clavichord
Organs4 pipe and chamber organs6 electric and reed organs
Basses14 electric, upright and orchestral basses2
Guitars11 electric and archtop guitars4
Stringsviolins, violas, cellos, contrabass, sectionserhu, hurdy-gurdy, bagpipes, plucked strings
Harps and zithers5koto, dulcimer
World and folkbanjo, accordion15 lutes, fiddles, squeezeboxes and toys
Woodwindsall 18none
Brass92 synth brass
Mallets and bells159
Hand and orchestral percussionall 38none
Risers and hitsorchestra hit, reverse cymbal, taiko7
Noise and found sound9, such as breaking glass, chains and a bowed cymbal8, such as wind, thunder and the noise colors
Synths, pads, leads, effects, ambience, singersnoneall

We trimmed and levelled every recording, retuned some, and built a few sounds from several of them all layered together in fun ways. The rock guitars were recorded straight from the guitar;; we created our own amplifiers for them to use. A few instruments are played by a close relative (for now, as we grow our library): a strumstick plays banjo and a fretted bass plays fretless_bass (sorry). Three keyboard sounds (fm_piano, fm_clav and digital_piano) are recordings of patches froom a hardware FM synthesizer, which makes its own sound by synthesis. A whole other topic for another blog post.

Bringing them together

The structure of ode and our engine encourage generations to incorporate both synths and samples, leading to vibrant and diverse songs in the Studio. Here’s an example of both kinds together in one generated loop. The kit, the bass and the piano are recordings. The pad and singer are made by the engine.

ode
title "both kinds"
tempo 84
key d minor
form loop 4
chords [Dm9 | Bbmaj7 | Gm9 | A7]

// recorded: brushes on a jazz kit
stem drums: brush {
  kick  [x... .... ..x. ....]
  snare [.... x... .... x...]
  ride  [x.xx x.xx x.xx x.xx]
  velocity [80 45 60]
}

// recorded: a double bass
stem bass: big_upright {
  rhythm [x... ..x. x... ....]
  tones  [root]
  octave 2
}

// recorded: a grand piano
stem keys: piano {
  rhythm [..x. .... ..x. ....]
  tones  [all]
  octave 4
}

// made by the engine
stem pad: warmpad {
  rhythm [x... .... .... ....]
  tones  [all]
  octave 3
}

// made by the engine: a formant singer
stem voice: alto {
  line [r/4 a4/8 a4 f4/4 a4 | g4/4 f4/4 g4/2 | r/4 bb4/8 a4 g4/4 f4 | e4/2. r/4]
  lyrics 2bars {
    "ev-ery sound is writ-ten down"
    "noth-ing here was learned"
  }
  reverb 30%
}

mix {
  drums -6db
  bass  -4db
  keys  -8db
  pad   -14db
  voice -2db
}

Open any song in the Studio and every stem is named. Look that name up on the sounds page of the docs and on songco.de/licenses, and you can trace any note you hear to either code or to a credited CC0 recording.

Describe a song.
Get it in code.

Open Songcode