Author Topic: Festival for text to speech, and crowd-sourced virtual voice actors (models?)  (Read 7324 times)

0 Members and 1 Guest are viewing this topic.

Offline dsockwell

  • 23
  • Your mother, trebek
Festival for text to speech, and crowd-sourced virtual voice actors (models?)
So someone asked in IRC if there were any alternative TTS voices for FSO, because Microsoft Sam sounds like he's stuck in the '90s. And he is.

So. I propose two things.

One is the inclusion of Festival ( http://www.cstr.ed.ac.uk/projects/festival/morevoices.html ) for text-to-speech, since it's actually a modern engine. I haven't looked into the details but it's the type of thing that should be easily called by FSO.

The second is that people (like myself) who don't have time to voice-act a campaign might release Festival voices trained with a minimum of two hours of recorded talking. This should open up a variety of virtual voice actors for whatever campaign that doesn't have the resources for real ones.

The cool thing about Festival voices is that if you're careful in training them, you can give them different moods. You'll see on the demo page I linked that one voice can be happy or angry. One voice model could release a number of voices - for instance, bored, calm, tense, and DIVEDIVEDIVE HIT YOUR BURNERS PILOT

Edit: Coders may find this interesting - http://www.cstr.ed.ac.uk/projects/festival/manual/festival_28.html#SEC132

Edit: And it's X11 licensed - http://www.cstr.ed.ac.uk/projects/festival/manual/festival_2.html
« Last Edit: September 27, 2012, 05:22:28 am by dsockwell »

 

Offline z64555

  • 210
  • Self-proclaimed controls expert
    • Steam
Re: Festival for text to speech, and crowd-sourced virtual voice actors (models?)
Looks interesting. The voices are smoother speaking than the ol' Sam and much easier on the ears, but it's still obvious TTS.  :P
Secure the Source, Contain the Code, Protect the Project
chief1983

------------
funtapaz: Hunchon University biologists prove mankind is evolving to new, higher form of life, known as Homopithecus Juche.
z64555: s/J/Do
BotenAlfred: <funtapaz> Hunchon University biologists prove mankind is evolving to new, higher form of life, known as Homopithecus Douche.

 

Offline dsockwell

  • 23
  • Your mother, trebek
Re: Festival for text to speech, and crowd-sourced virtual voice actors (models?)
True. These are the boring voices from a british linguistics lab. Specialized voices for freespace might be jazzed up somewhat.

 

Offline Luis Dias

  • 211
Re: Festival for text to speech, and crowd-sourced virtual voice actors (models?)
I have a problem listening to these things: they are always interrupted by one or two harsh quick sounds. Anyone has any idea why?

 

Offline dsockwell

  • 23
  • Your mother, trebek
Re: Festival for text to speech, and crowd-sourced virtual voice actors (models?)
which voice profile did you use, and what text did you enter?

 

Offline Colonol Dekker

  • HLP is my mistress
  • 213
  • Aken Tigh Dekker- you've probably heard me
    • My old squad sub-domain
Re: Festival for text to speech, and crowd-sourced virtual voice actors (models?)
Anna (HTS 2011) 

Quote

Oooh, you are so handsome Dekker!


:yes:
Campaigns I've added my distinctiveness to-
- Blue Planet: Battle Captains
-Battle of Neptune
-Between the Ashes 2
-Blue planet: Age of Aquarius
-FOTG?
-Inferno R1
-Ribos: The aftermath / -Retreat from Deneb
-Sol: A History
-TBP EACW teaser
-Earth Brakiri war
-TBP Fortune Hunters (I think?)
-TBP Relic
-Trancsend (Possibly?)
-Uncharted Territory
-Vassagos Dirge
-War Machine
(Others lost to the mists of time and no discernible audit trail)

Your friendly Orestes tactical controller.

Secret bomb God.
That one time I got permabanned and got to read who was being bitxhy about me :p....
GO GO DEKKER RANGERSSSS!!!!!!!!!!!!!!!!!
President of the Scooby Doo Model Appreciation Society
The only good Zod is a dead Zod
NEWGROUNDS COMEDY GOLD, UPDATED DAILY
http://badges.steamprofile.com/profile/default/steam/76561198011784807.png

 

Offline chief1983

  • Still lacks a custom title
  • Moderator
  • 212
  • ⬇️⬆️⬅️⬅️🅰➡️⬇️
    • Skype
    • Steam
    • Twitter
    • Fate of the Galaxy
Re: Festival for text to speech, and crowd-sourced virtual voice actors (models?)
I've been wanting a cross-platform TTS engine dropped in for some time so we could get it working on *nix too.  That's one I've had my eye on.
Fate of the Galaxy - Now Hiring!  Apply within | Diaspora | SCP Home | Collada Importer for PCS2
Karajorma's 'How to report bugs' | Mantis
#freespace | #scp-swc | #diaspora | #SCP | #hard-light on EsperNet

"You may not sell or otherwise commercially exploit the source or things you created based on the source." -- Excerpt from FSO license, for reference

Nuclear1:  Jesus Christ zack you're a little too hamyurger for HLP right now...
iamzack:  i dont have hamynerge i just want ptatoc hips D:
redsniper:  Platonic hips?!
iamzack:  lays

 

Offline Herra Tohtori

  • The Academic
  • 211
  • Bad command or file name
Re: Festival for text to speech, and crowd-sourced virtual voice actors (models?)
Having different characters use different voices would be quite excellent too. Possibly as specified by the mission creator. :nervous:
There are three things that last forever: Abort, Retry, Fail - and the greatest of these is Fail.

 

Offline chief1983

  • Still lacks a custom title
  • Moderator
  • 212
  • ⬇️⬆️⬅️⬅️🅰➡️⬇️
    • Skype
    • Steam
    • Twitter
    • Fate of the Galaxy
Re: Festival for text to speech, and crowd-sourced virtual voice actors (models?)
If mods could include their own voicesets, I'm sure that would be beneficial.
Fate of the Galaxy - Now Hiring!  Apply within | Diaspora | SCP Home | Collada Importer for PCS2
Karajorma's 'How to report bugs' | Mantis
#freespace | #scp-swc | #diaspora | #SCP | #hard-light on EsperNet

"You may not sell or otherwise commercially exploit the source or things you created based on the source." -- Excerpt from FSO license, for reference

Nuclear1:  Jesus Christ zack you're a little too hamyurger for HLP right now...
iamzack:  i dont have hamynerge i just want ptatoc hips D:
redsniper:  Platonic hips?!
iamzack:  lays

 

Offline Colonol Dekker

  • HLP is my mistress
  • 213
  • Aken Tigh Dekker- you've probably heard me
    • My old squad sub-domain
Re: Festival for text to speech, and crowd-sourced virtual voice actors (models?)
Would it not be better to  have a (for instance) 10 voice pack, like MediaVPs, that's optional, each voice pack (depending on the engine) is a few hundred meg right? Rather than each mod presenting it's own dozen or so voice sets (easily a GB+ additional unnecessary data) when they can change the pitch and speed on a communal core selection? (Maybe via "modname_TTS_cast".tbm?)

Ivona TTS is quite good, in a beta stage right now. But i digress :/
Campaigns I've added my distinctiveness to-
- Blue Planet: Battle Captains
-Battle of Neptune
-Between the Ashes 2
-Blue planet: Age of Aquarius
-FOTG?
-Inferno R1
-Ribos: The aftermath / -Retreat from Deneb
-Sol: A History
-TBP EACW teaser
-Earth Brakiri war
-TBP Fortune Hunters (I think?)
-TBP Relic
-Trancsend (Possibly?)
-Uncharted Territory
-Vassagos Dirge
-War Machine
(Others lost to the mists of time and no discernible audit trail)

Your friendly Orestes tactical controller.

Secret bomb God.
That one time I got permabanned and got to read who was being bitxhy about me :p....
GO GO DEKKER RANGERSSSS!!!!!!!!!!!!!!!!!
President of the Scooby Doo Model Appreciation Society
The only good Zod is a dead Zod
NEWGROUNDS COMEDY GOLD, UPDATED DAILY
http://badges.steamprofile.com/profile/default/steam/76561198011784807.png

 

Offline MatthTheGeek

  • Captain Obvious
  • 212
  • Frenchie McFrenchface
Re: Festival for text to speech, and crowd-sourced virtual voice actors (models?)
Your request is equivalent to ask that the MVPs include the Raynor and the Karuna because they're widely used ships.

That's not what the MVPs are for. And as long as trained voicesets are freely available - and will potentially evolve, due to the whole training thing- there is absolutely no point in putting them in such an inadapted and fixed place as the MVPs.
People are stupid, therefore anything popular is at best suspicious.

Mod management tools     -     Wiki stuff!     -     Help us help you

666maslo666: Releasing a finished product is not a good thing! It is a modern fad.

SpardaSon21: it seems like you exist in a permanent state of half-joking misanthropy

Axem: when you put it like that, i sound like an insane person

bigchunk1: it's not retarded it's american!
bigchunk1: ...

batwota: steele's maneuvering for the coup de gras
MatthTheGeek: you mispelled grâce
Awaesaar: grace
batwota: oh right :P
Darius: ah!
Darius: yes, i like that
MatthTheGeek: the way you just spelled it it means fat
Awaesaar: +accent I forgot how to keyboard
MatthTheGeek: or grease
Darius: the killing fat!
Axem: jabba does the coup de gras
MatthTheGeek: XD
Axem: bring me solo and a cookie

 

Offline Colonol Dekker

  • HLP is my mistress
  • 213
  • Aken Tigh Dekker- you've probably heard me
    • My old squad sub-domain
Re: Festival for text to speech, and crowd-sourced virtual voice actors (models?)
 :nono:


I didn't say MVP's, I meant a TTS vp containing the core syntax files for the various voices. Any behavioural
updates would be in the kilobyte range.
Campaigns I've added my distinctiveness to-
- Blue Planet: Battle Captains
-Battle of Neptune
-Between the Ashes 2
-Blue planet: Age of Aquarius
-FOTG?
-Inferno R1
-Ribos: The aftermath / -Retreat from Deneb
-Sol: A History
-TBP EACW teaser
-Earth Brakiri war
-TBP Fortune Hunters (I think?)
-TBP Relic
-Trancsend (Possibly?)
-Uncharted Territory
-Vassagos Dirge
-War Machine
(Others lost to the mists of time and no discernible audit trail)

Your friendly Orestes tactical controller.

Secret bomb God.
That one time I got permabanned and got to read who was being bitxhy about me :p....
GO GO DEKKER RANGERSSSS!!!!!!!!!!!!!!!!!
President of the Scooby Doo Model Appreciation Society
The only good Zod is a dead Zod
NEWGROUNDS COMEDY GOLD, UPDATED DAILY
http://badges.steamprofile.com/profile/default/steam/76561198011784807.png

 

Offline dsockwell

  • 23
  • Your mother, trebek
Re: Festival for text to speech, and crowd-sourced virtual voice actors (models?)
why not make individual voices separate from mods, or mods unto themselves? that way you can say that X mod depends on Y and Z voices, so there's no duplication.

 

Offline dsockwell

  • 23
  • Your mother, trebek
Re: Festival for text to speech, and crowd-sourced virtual voice actors (models?)
also those 190MB voices are a lot more complex than i imagine freespace voices would be - they're compiled to be as complete as possible, given a ****load of recording. A vanity voice is not going to have any ****loads of recording, it will be at most 12 hours of the same person.

 

Offline dsockwell

  • 23
  • Your mother, trebek
Re: Festival for text to speech, and crowd-sourced virtual voice actors (models?)
at a few kilobits

 

Offline chief1983

  • Still lacks a custom title
  • Moderator
  • 212
  • ⬇️⬆️⬅️⬅️🅰➡️⬇️
    • Skype
    • Steam
    • Twitter
    • Fate of the Galaxy
Re: Festival for text to speech, and crowd-sourced virtual voice actors (models?)
I didn't say don't release a basic set, I'm just saying that instead of solely hardcoding it to a few voices, make it something that a mod could supplement.
Fate of the Galaxy - Now Hiring!  Apply within | Diaspora | SCP Home | Collada Importer for PCS2
Karajorma's 'How to report bugs' | Mantis
#freespace | #scp-swc | #diaspora | #SCP | #hard-light on EsperNet

"You may not sell or otherwise commercially exploit the source or things you created based on the source." -- Excerpt from FSO license, for reference

Nuclear1:  Jesus Christ zack you're a little too hamyurger for HLP right now...
iamzack:  i dont have hamynerge i just want ptatoc hips D:
redsniper:  Platonic hips?!
iamzack:  lays

 

Offline dsockwell

  • 23
  • Your mother, trebek
Re: Festival for text to speech, and crowd-sourced virtual voice actors (models?)
http://festvox.org/cmu_arctic/cmuarctic.data

prompt list for prospective voice models

 
Re: Festival for text to speech, and crowd-sourced virtual voice actors (models?)
Bear in mind that the TTS engine used to make Anna is not part of Festival proper, but is a separate program that uses Festival for text analysis. The TTS engine is found here, but some parts of it may be incompatible with the license for the FS2 codebase. The two engines that I know are part of Festival either a) sounds much like the MS speech API, or b) has large voice files and sounds like someone spliced up wav files to make the voice (which it kinda does).

If the HMM engine can be used, keep in mind that it takes the better part of 2 or 3 days to actually make a voice; the compiling will take on the order of 12 to 36 hours.

 

Offline Tomo

  • 28
Re: Festival for text to speech, and crowd-sourced virtual voice actors (models?)
IANAL, but the HTS licence sounds ok to me - it's a BSD licence, which boils down to:
"Do what you will, but don't claim this code is yours and don't claim we endorse your product"

So I don't think that's a barrier, just the fun and games of actually using it and training it.

As chief said, getting something cross-platform is certainly a worthwhile project!

 

Offline jr2

  • The Mail Man
  • 212
  • It's prounounced jayartoo 0x6A7232
    • Steam
Re: Festival for text to speech, and crowd-sourced virtual voice actors (models?)
dsock, use "modify" button on your post, double-posting is frowned upon here.  ;)