The sound of Songcode
Our engine is packed with 380 different sounds, and zero generative audio models.
Songcode has no audio model and it never will. Our songs are written in ode code, a text file, and our proprietary audio engine that powers Songcode Studio and our MCP turns an ode file into sound right your browser. Every sound the engine can play comes from one of two places.
1, The engine makes it from numbers while the song plays (synths)
- The engine plays a short recording of one sound, such as a piano note or a drum hit (sampler)
Today Songcode Studio’s sound picker about 380 sounds. About 155 of them are recordings of real instruments. The other 225 or so are made by the engine. We add new synths and samples nearly every week (so by the time you’re reading this, there’s probably even more). We’re also planning expansion of our instrument set in two other important ways:
- Users will be able to bring their own synths and samples and use them as they please. Our engine will work these into every generation in an intelligent way, makeing it very plug-and-play without having to wrestle with getting ode to work with your audio library.
- We’re pursuing partnerships with artists and producers to create high-quality instruments to add right into Songcode Studio. More on this to come.
Synths
These sounds are code. When a note plays, the engine builds it from oscillators, noise, filters, envelopes and FM, then mixes it, adds the effects the song asks for and sends it to your speakers.
- All the core synths: 28 synth basses, 28 leads and plucks, 25 pads and choirs, and the stabs and chords.
- 25 of the 32 drum kits. Each is a few numbers that set how low and long the kick is, how much of the snare is tone and how much is noise (and how gritty the whole kit is).
- Likenesses of acoustic instruments we have no public domain recording of (yet). The nylon and steel string guitars, the mandolin, the oud, the sitar, the koto, the kora and a dozen more plucked strings are a modelled string that the engine plucks, and their descriptions in the picker say “string model”. The erhu, the bagpipes, the bandoneon, the theremin and the handpan are synth patches written to sound like the instrument. These aren’t perfect, and are prime candidates for replacement with sampled instruments down the road.
- The electric pianos, the drawbar and transistor organs, the
clavand the tape keyboard’s flute, strings and choir. - Every sound effect: risers, impacts, sirens, game sounds, a heartbeat, a clock.
- The ambience beds: rain, a record’s surface, tape hiss, birdsong, crickets, a stream, the sea, a fire and thunder. Each one is filtered noise and many small events (a drop, a click, a chirp) scattered by a seeded random stream. Another prime candidate to be moved over to samples when the time presents itself.
- The raw waveforms: sine, sawtooth, square, triangle, pulse and a stack of detuned saws.
The waveforms are worked out from formulas when the engine boots up each time you open Songcode Studio. The engine has no wavetables in the sense of sampled waves. Our reverb is computed too, with no recording of a real room behind it. We built things lean like this on purpose, but are working on exploration of improvement of these ideas as the platform grows (with your feedback of course!).
Sampled instruments
| shelf | recordings | made by the engine |
|---|---|---|
| Drum kits | 7: live, rock, brush, jazz, dusty, concert, epic | 25, such as club, boom and warm |
| Pianos | all 7 | none |
| Keyboards | harpsichords, music box, three FM keyboard patches | electric pianos, clav, clavichord |
| Organs | 4 pipe and chamber organs | 6 electric and reed organs |
| Basses | 14 electric, upright and orchestral basses | 2 |
| Guitars | 11 electric and archtop guitars | 4 |
| Strings | violins, violas, cellos, contrabass, sections | erhu, hurdy-gurdy, bagpipes, plucked strings |
| Harps and zithers | 5 | koto, dulcimer |
| World and folk | banjo, accordion | 15 lutes, fiddles, squeezeboxes and toys |
| Woodwinds | all 18 | none |
| Brass | 9 | 2 synth brass |
| Mallets and bells | 15 | 9 |
| Hand and orchestral percussion | all 38 | none |
| Risers and hits | orchestra hit, reverse cymbal, taiko | 7 |
| Noise and found sound | 9, such as breaking glass, chains and a bowed cymbal | 8, such as wind, thunder and the noise colors |
| Synths, pads, leads, effects, ambience, singers | none | all |
We trimmed and levelled every recording, retuned some, and built a few sounds from several of them all layered together in fun ways. The rock guitars were recorded straight from the guitar;; we created our own amplifiers for them to use. A few instruments are played by a close relative (for now, as we grow our library): a strumstick plays banjo and a fretted bass plays fretless_bass (sorry). Three keyboard sounds (fm_piano, fm_clav and digital_piano) are recordings of patches froom a hardware FM synthesizer, which makes its own sound by synthesis. A whole other topic for another blog post.
Bringing them together
The structure of ode and our engine encourage generations to incorporate both synths and samples, leading to vibrant and diverse songs in the Studio. Here’s an example of both kinds together in one generated loop. The kit, the bass and the piano are recordings. The pad and singer are made by the engine.
ode
title "both kinds"
tempo 84
key d minor
form loop 4
chords [Dm9 Bbmaj7 Gm9 A7]
// recorded: brushes on a jazz kit
stem drums: brush {
kick [x... .... ..x. ....]
snare [.... x... .... x...]
ride [x.xx x.xx x.xx x.xx]
velocity [80 45 60]
}
// recorded: a double bass
stem bass: big_upright {
rhythm [x... ..x. x... ....]
tones [root]
octave 2
}
// recorded: a grand piano
stem keys: piano {
rhythm [..x. .... ..x. ....]
tones [all]
octave 4
}
// made by the engine
stem pad: warmpad {
rhythm [x... .... .... ....]
tones [all]
octave 3
}
// made by the engine: a formant singer
stem voice: alto {
line [r/4 a4/8 a4 f4/4 a4 g4/4 f4/4 g4/2 r/4 bb4/8 a4 g4/4 f4 e4/2. r/4]
lyrics 2bars {
"ev-ery sound is writ-ten down"
"noth-ing here was learned"
}
reverb 30%
}
mix {
drums -6db
bass -4db
keys -8db
pad -14db
voice -2db
}Open any song in the Studio and every stem is named. Look that name up on the sounds page of the docs and on songco.de/licenses, and you can trace any note you hear to either code or to a credited CC0 recording.