8 Likes

Thank you!
I’m glad you have enjoy!

Also, am enjoy this thread, myself, thanks for starting!

1 Like

Great things Paul!

big favorite is pink trombone
I sample this often in my digitakt for make weird wobbly
synths.
I love play with it when listen to music also, is like the uncanny valley
of robot vox! I imagine a poorly render robot comes to town singing
all your favorite medieval hits!
aaaaaaaw waaaw wawawa lalaaa llaa la!

2 Likes

So if I were to make a series of samples for these purposes, what would people like? Syllables? Rare phonemes?

1 Like

There is a very cool device that is exploring those concepts: Pocket Operator PO-35 speak. It’s maybe overly minimalistic to make entire tunes in but as an immediate voice sampler with vocoding, vowel synthesis, and autotune it’s rather impressive.

Playing with it enables you to employ some of the creative strategies that @PaulBatchelor talked about above. If you’d like I can record a demo.

There’s a pretty good interview with the creator of the device that includes some technical detail:

1 Like

There is some similar discussion on the topic in this thread

1 Like

In case you want to go animal crossing style (in the browser!) :smiley: https://acedio.github.io/animalese.js/

2 Likes

Bitspeek and the PO-35 use Linear Predictive Coding, is another fun way to do computer speech.

Some time ago, I found an open source implementation of the LPC10 codec, which I believe is very similar to the LPC ICs found on the speak-n-spell.

I built a little filter around this in soundpipe that takes in a streaming input signal (assumed to be speech), and converts it to a that computer sound via openlpc.

Here’s what it sounds like (original plays first, followed by the LPC-processed output):

5 Likes

I was obsessed with LPC with RTCmix in the 1990s and then i had some bad-ass LPC externals for MAx which i think are only 32bit

It’s such a nerdy sound i cant resist it, i went down a huge rabbit hole with bytebeat too which is in the same universe for me sonically …lol

2 Likes

This is the one
Paul Lansky – of RadioHead Fame was our Composer in Residence and he showed us this
piece and he played to a group of grads and undergrads the first .mp3 of a file
and then he sent it to everyone in a mail and we all were floored …hahahaha

1 Like

I just wanted to say thank you for the Diana Deutsch link - very interesting to me! I’ve been experimenting with singing poetry in the past year or so, and this experiment really resonates - it seems a very clear example of how deeply linked song & speech seem to be.

I experienced the effect of the non-repeated phrase seeming to “sing out” in the second example - but somehow I can’t think of the effect as necessarily illusory - it feels to me more like an exaggeration of something that is already there, that the initial repetition sensitises one to the musical/tonal quality already inherent in the speech, only occluded by our habit of just focusing on the words, as it were… maybe it’s our usual way of hearing speech that’s the illusion. :upside_down_face:

(It reminded me also of an experiment/workshop-thing I have a recording of John C Lilly doing, which is a single word (“cogitate” in this instance) looped over & over - doesn’t take long before most people start hearing a whole range of different words/short phrases.)

(& random things about whistled/tonal languages, mythical stories about the secret wisdoms of birds, and contented gorillas humming happy songs to themselves as they eat, eatc)

2 Likes

what do you think about Arnold Schoenberg’s “Pierrot Lunaire” and sprechgesang? i think that’s the term i always found it poetic and very compelling

In the speech synthesis world, sampling a voice is sometimes referred to as “voice banking”. I’ve never done it, but I’ve heard it can be rather labor intensive. This PDF on building a voice bank in UTAU. There could be some hints there.

For a less surgical approach, recording snippets of interesting languages could suffice. In Star Wars, Ben Burtt created the Ewok language by basically sampling the language of an isolated nomadic tribe in Russia.

“Rare Phonemes” gave me a good chuckle. Looking up IPA phonemes on wikipedia can be a bit of a rabbit hole. I particularly enjoy listening to the Voiced Epiglottal Trill, which I think sounds just like Homer Simpson drooling.

6 Likes

I used these online speech generators quite a few times in tracks submitted to the Disquiet Junto a couple years ago - either reading a book section, or computer-generated lyrics from another site, or saying phonetics to use as beat elements. they’re here on bandcamp:

2 Likes

Hey, thanks for the prompt - I’ve come across Schoenberg’s name since exploring the further reaches of electronic music these past few years but not got round to listening to his music yet. Maybe that’s tantamount to heresy or something in circles like these?

Anyway I watched a performance of “Pierrot Lunaire” (this one: https://youtu.be/bd2cBUJmDr8) whilst stuffing pasta into my face this lunchtime (just to hammer home what a philistine I am). It took approximately 2 minutes and 30 seconds for me to shed my first tear. Compelling indeed.

Having done some cursory research I believe the term you refer to is “sprechstimme” (literally “speech-singing” apparently). In his foreword to the score Shoenberg talks about it a little, saying about how the performer should have the melodic precision of singing married to the sort of natural rise & fall of speech - i.e. not sustaining notes like in singing. It sort of reminded me, in theory, of how it feels when I try to speak a poem I’ve been singing a while - though Schoenberg’s admonition that the performer should do anything but lapse into a singsong speech pattern is bracing. I’m not at all skilled in any classical way like these people, but am certainly able to relate on a kind of intuitive/essential level, and do find it edifying.

The deepest part of why or how this kind of thing works for me personally, is in reinforcing the whole constellation of meaning and making it exponentially more powerful/impacting. This is how it started for me this year, already being into Blake (like any good hippy), but then starting to take a closer look - seeing how the decoration of the poems, the forms & the colours around them, basically gave them more life - made them more vivid & energetic - & then learning that he used to sing them too… & all this being a response to my own disillusion at the way that sometimes precious words or special feelings, put down in words - well sometimes they just seem empty & ridiculous… I’m not sure any art is immune to this kind of nihilistic crisis, and I guess such is part of the motivation of enough of it - but certainly great art resists or rises above it more resolutely.

So it would be easy to scoff at, what was it, something about “the scent of ancient fairy-tales”, or the black butterflies of night having eaten the sun, but when it’s really delivered like that there’s just nothing you can do but feel it, and it’s marvellous.

Also I’m not sure I really got atonality before, but something in that piece really got to me, and I love that I can’t remember a single melody from it, some 2 hours later… maybe if I spoke German that’d be different tho.

Some time back I had a fun morning fake dialoguing with my computer, making hir respond to my daily existential crisis in Amiga voice, but the tune I did to accompany it was a bit too messy and I gave up, but I might try and salvage it one of these days soon, made me chuckle at least.

1 Like

Diemut Strebe’s art Installation, “The Prayer”

https://theprayer.diemutstrebe.com/

3 Likes

clicking ‘preview’ loads of times is fun :smiley:

EDIT: slowing the wav down also fun, turns into some nonspecific-european-accented robot

Tom Jenning’s work as World Power Systems was a big influence on me, here’s a speech synth art turing machine he built - https://www.sr-ix.com/Objects/Story-Teller/index.html

Somewhere I have a mix CD i made circa 200X of all the circuitbent/videogame/chip music I could find which begins with this thing reading Burroughs :slight_smile:

EDIT because I can’t self-reply :frowning: -

Accidentally discovered today that a touch-controlled simple 555 oscillator thru the TC Helicon VoiceOne = ultra playable free improv duck voice. Definitely going to have to experiment further!

2 Likes

4 Likes

Love it! Any more details for this?