Concatenative: Introduction

Henrik von Coler

Concatenative synthesis is an evolution of granular synthesis, first introduced in the context of speech synthesis and processing (Charpentier, 1986; Hamon, 1989).

Concatenative synthesis for musical applications has been introduced by Diemo Schwarz. Corpus-based concatenative synthesis (Schwarz, 2000; Schwarz 2006) splices audio recordings into units and calculates audio features for each unit. During synthesis, unit selection can be performed by navigating the multidimensional feature space and selected units are concatenated.

/images/Sound_Synthesis/concatenative/concatenative-flow-1.png

Fig.1: (Schwarz, 2006)

/images/Sound_Synthesis/concatenative/concatenative-flow-2.png

Fig.2: (Schwarz, 2006)

References

2017

Grimaldi, Vincent and Böhm, Christoph and Weinzierl, Stefan and von Coler, Henrik. Parametric Synthesis of Crowd Noises in Virtual Acoustic Environments. In Proceedings of the 142nd Audio Engineering Society Convention. Audio Engineering Society, 2017.
[details] [BibTeX▼]

@inproceedings{grimaldi2017parametric,
    author = "{Grimaldi, Vincent and Böhm, Christoph and Weinzierl, Stefan and von Coler, Henrik}",
    title = "{Parametric Synthesis of Crowd Noises in Virtual Acoustic Environments}",
    booktitle = "{Proceedings of the 142nd Audio Engineering Society Convention}",
    year = "2017",
    organization = "Audio Engineering Society",
    location = "Berlin, Germany"
}

Christian Knörzer. Concatenative crowd noise synthesis. Master's thesis, TU Berlin, 2017.
[details] [BibTeX▼]

@mastersthesis{knoerzer2017concatenative,
    author = "Knörzer, Christian",
    title = "Concatenative Crowd Noise Synthesis",
    school = "TU Berlin",
    year = "2017"
}

2016

Vincent Grimaldi. Parametric crowd synthesis for virtualacoustic environments. Master's thesis, IRCAM, 2016.
[details] [BibTeX▼]

@mastersthesis{grimaldi2016parametric,
    author = "Grimaldi, Vincent",
    title = "Parametric crowd synthesis for virtualacoustic environments",
    school = "IRCAM",
    year = "2016"
}

2006

Diemo Schwarz. Concatenative sound synthesis: The early years. Journal of New Music Research, 35(1):3–22, 2006.
[details] [BibTeX▼]

@article{schwarz2006concatenative,
    author = "Schwarz, Diemo",
    journal = "Journal of New Music Research",
    number = "1",
    pages = "3–22",
    publisher = "Taylor \\& Francis",
    title = "{Concatenative sound synthesis: The early years}",
    volume = "35",
    year = "2006"
}

Diemo Schwarz, Grégory Beller, Bruno Verbrugghe, and Sam Britton. Real-Time Corpus-Based Concatenative Synthesis with CataRT. In In DAFx. 2006.
[details] [BibTeX▼]

@inproceedings{Schwarz2006realtimecorpus,
    author = "Schwarz, Diemo and Beller, Grégory and Verbrugghe, Bruno and Britton, Sam",
    booktitle = "{In DAFx}",
    title = "{Real-Time Corpus-Based Concatenative Synthesis with CataRT}",
    year = "2006"
}

2000

Diemo Schwarz. A System for Data-Driven Concatenative Sound Synthesis. In Proceedings of the COST-G6 Conference on Digital Audio Effects (DAFx-00). Verona, Italy, 2000.
[details] [BibTeX▼]

@inproceedings{schwarz2000,
    author = "Schwarz, Diemo",
    title = "{A System for Data-Driven Concatenative Sound Synthesis}",
    booktitle = "{Proceedings of the COST-G6 Conference on Digital Audio Effects (DAFx-00)}",
    year = "2000",
    address = "Verona, Italy",
    journal = "{Proceedings of the COST G-6 Conference on Digital Audio Effects (DAFx-00)}"
}

1989

C. Hamon, E. Mouline, and F. Charpentier. A diphone synthesis system based on time-domain prosodic modifications of speech. In International Conference on Acoustics, Speech, and Signal Processing,, 238–241 vol.1. May 1989. doi:10.1109/ICASSP.1989.266409.
[details] [BibTeX▼]

@inproceedings{hamon1989adiphone,
    author = "{Hamon}, C. and {Mouline}, E. and {Charpentier}, F.",
    title = "A diphone synthesis system based on time-domain prosodic modifications of speech",
    booktitle = "International Conference on Acoustics, Speech, and Signal Processing,",
    year = "1989",
    pages = "238-241 vol.1",
    month = "May",
    doi = "10.1109/ICASSP.1989.266409",
    issn = "1520-6149",
    keywords = "speech synthesis;diphone synthesis system;time-domain prosodic modifications;time-domain algorithm;text-to-speech synthesis;diphone concatenation;pitch-synchronous overlap-add;PSOLA;natural speech;frequency-domain transformations;pitch synchronous cut-and-splice operations;speech waveform;CNET diphone synthesis multilingual system;French;Italian;German;Speech synthesis;Time domain analysis;Signal synthesis;Wideband;Natural languages;Distortion;Testing;Synthesizers;Concatenated codes;Frequency domain analysis"
}

1986

F. Charpentier and M. Stella. Diphone synthesis using an overlap-add technique for speech waveforms concatenation. In ICASSP '86. IEEE International Conference on Acoustics, Speech, and Signal Processing, volume 11, 2015–2018. April 1986. doi:10.1109/ICASSP.1986.1168657.
[details] [BibTeX▼]

@inproceedings{charpentier1986diphone,
    author = "{Charpentier}, F. and {Stella}, M.",
    title = "Diphone synthesis using an overlap-add technique for speech waveforms concatenation",
    booktitle = "ICASSP '86. IEEE International Conference on Acoustics, Speech, and Signal Processing",
    year = "1986",
    volume = "11",
    pages = "2015-2018",
    month = "April",
    doi = "10.1109/ICASSP.1986.1168657",
    keywords = "Speech synthesis;Signal synthesis;Linear predictive coding;Control system synthesis;Speech analysis;Filter bank;Signal analysis;Databases;Telecommunication control;Speech coding"
}