
"This book investigates digital signal processing, its application to sound, and how its effects on sound can be used within music. The first edition developed in association with the annual International Conference on Digital Audio Effects, and this book have been critical in the advancement of the field, both in research and industry. Rapid development in different fields of Digital Audio Effects has led to new algorithms, and this new edition will combine these with improved presentation of the basic concepts and discussion of the related technology. It will cover filters and delays, modulators and demodulators, nonlinear processing, spatial effects, time-segment processing, time-frequency processing, source-filter processing, spectral processing, time and frequency warping musical signals, as well as completely new chapters on the recent developments in virtual analog effects, automatic mixing, and sound source separation. Each effect description will begin with a presentation of the physical and acoustical phenomena, followed by an explanation of the signal processing techniques to achieve the effect, and some musical applications and the control of effect parameters"
Also [2] is a decent book for overall dsp concepts.
[1] DAFX - Digital Audio Effects (Second Edition) Edited by Udo Zölzer https://dafx.de/DAFX_Book_Page_2nd_edition/index.html
[2] Understanding Digital Signal Processing, Richard Lyons
——
The founder, and sole developer of Mutable Instruments (a well known modular audio/synth maker) wrote about her recommendations on how to get started in audio programming here [0]. Much recommended for the cited books, and general/business advice on making a hardware audio product.
[0] https://modwiggler.com/forum/viewtopic.php?p=2858814#p285881...
——
My own post about this was from a mini thread on HN about programming sound that may also interest you:
https://news.ycombinator.com/item?id=20491766
——
Last note! Another synth maker personally recommended the same DSP book as noted in the comment above (on Modwiggler), so it’s probably worth checking out!
Udo Zolzer's "DAFX"
The Computer Music Tutorial by Curtis Roads is a good companion here if you want inner workings. You might be able to snag a PDF copy online to see if it's for you.
Audio Programming Book is entirely in C and can be a bit of a pain to get things working in C if you're new to programming (although highly worth the initial struggle if you're looking at it with a career in mind), although I'd still recommend stepping from Max/MSP into MATLAB/Python, which focuses on functionality rather than programming itself.
Python is also bit more beginner friendly, although C++ will probably end up being your long term bet.
I'd pick up the Pyo library for python, and/or a tutorial like this one, after dabbling with Max/MSP a bit: https://python.plainenglish.io/build-your-own-python-synthes...
Then if you want to get even deeper into the DSP, you could go with pretty much any of the other resources the others have mentioned here. My personal faves are the Steven Smith DSP book, Julius Smith's resources (with its runnable MATLAB scripts), and DAFX book by Udo Zolzer.
If you want a really great approach to noise gating, a fixed threshold is fine but it works better when you apply it to the difference of two envelope followers - one with a short attack, long release (tracks input) and long attack, short release (tracks noise floor). Takes a bit to set it up, but it's a stupid simple way to get extremely effective gating and is easy to fine tune for your application. A lot of Voice Activity Detection (VAD) works this way; it's just a matter of tuning the coefficients and thresholds for your input.
Also useful reference for envelope following are the DAFX text [2], Will Pirkle's textbook on audio in C++ [3] and Zölzer's text [4]
[1] https://github.com/m-hilgendorf/rusty-compressor
[2] https://www.amazon.com/DAFX-Digital-Effects-Udo-Z%C3%B6lzer/...
[3] https://www.amazon.com/Designing-Audio-Effect-Plugins-C/dp/1...
[4] https://www.amazon.com/Digital-Audio-Signal-Processing-Z%C3%...
(pdfs can be found around the internet)
