Author Topic: Voice recognition build  (Read 35022 times)

0 Members and 1 Guest are viewing this topic.

Offline RandomTiger

  • Senior Member
  • 211
Voice recognition build
Hi there, this is still a bit of a work in progress but I thought you guys might want to have a look.

BEFORE RUNNING THIS YOU MUST TRAIN THE VOICE SYSTEM.
This feature is for the PC only and is activated with -voicer in the command line.
cvs isnt up to date because Im having problems connecting to it.

In XP (and possibly 2000) in control panel there should be a Speech->Speech Recognition option. Run through 'Configure mic' and 'Train Profile'. Non XP users might have to download the SAPI SDK.

The system has limitations, it only understands set commands (most in the menu) and most greek alphabeta wing names.
So no custom ship names are going to be understood.
Also running this may slow down the game as it as to spend CPU time processing your speach.

Sometimes the menu pops up with stuff it shouldnt but I've found the speech recognition to be fairly good and Im not even using a proper mic, just headphones plugged into the mic socket.

Let us know how you get on.

http://www.randomtiger.pwp.blueyonder.co.uk/freespace/fs2_open_r.zip

To be clear, this is what it should understand:

      </L>
      <O>wing</O>

      <P VAL="0">Alpha</P>
      <P VAL="1">Beta</P>   
      <P VAL="2">Gamma</P>   
      <P VAL="3">Delta</P>
      <P VAL="4">Epsilon</P>
      <P VAL="5">Zeta</P>
      <P VAL="6">Eta</P>
      <P VAL="7">Theta</P>
      <P VAL="8">Iota</P>
      <P VAL="9">Kappa</P>
      <P VAL="10">Lambda</P>
      <P VAL="11">Mu</P>
      <P VAL="12">Nu</P>
      <P VAL="14">Omicron</P>
      <P VAL="16">Rho</P>
      <P VAL="17">Sigma</P>
      <P VAL="18">Tau</P>
      <P VAL="19">Upsilon</P>
      <P VAL="23">Omega</P>
      </L>
      <L PROPID="VID_Number">
      <P VAL = "1">one</P>
      <P VAL = "2">two</P>
      <P VAL = "3">three</P>
      <P VAL = "4">four</P>
      <P VAL = "5">five</P>
      <P VAL = "6">six</P>
      <P VAL = "7">seven</P>
      <P VAL = "8">eight</P>
      <P VAL = "9">nine</P>
      
         <P VAL="VID_Ships"      >Ships</P>
         <P VAL="VID_Wings"      >Wings</P>
         <P VAL="VID_AllFighters">All Fighters</P>
         <P VAL="VID_AllWings"   >All Wings</P>

         <P VAL="VID_Reinforcements">Reinforcements</P>

         <P VAL="VID_SupportShip">Support ship</P>
         <P VAL="VID_SupportShip">Rearm</P>
         <P VAL="VID_SupportShip">Repair</P>
         <P VAL="VID_AbortSupport">Abort</P>

         <P VAL="VID_Cancel">Cancel</P>
         <P VAL="VID_Command">Command</P>
   
         <P VAL="VID_DestoryTarget">Destroy my target</P>
         <P VAL="VID_DisableTarget">Disable my target</P>
         <P VAL="VID_DisarmTarget" >Disarm my target</P>

         <P VAL="VID_DestroySubsys">Destroy subsystem</P>

         <P VAL="VID_ProtectTarget">Protect my target</P>
         <P VAL="VID_IgnoreTarget" >Ignore my target</P>
         <P VAL="VID_FormWing"     >Form on my wing</P>
         <P VAL="VID_CoverMe"      >Cover me</P>
         <P VAL="VID_EngageEnemy"  >Engage Enemy</P>
         <P VAL="VID_EngageEnemy"  >Attack</P>
         <P VAL="VID_Depart"       >Depart</P>



 

Offline DaBrain

  • Screensniper
  • 212
    • Shadows of Lylat board
Re: Voice recognition build
Wow, that is an awesome feature!  :yes:

I'll have to search for my mic. It's a quite decent headset. :)
--------------------------------------------------
SoL is looking for a sound effect artist
Please PM me in case you want to apply
---------------------------------
Shadows of Lylat - A Freespace 2 total conversion
(hosted by Game-Warden)
----------------------------------

 

Offline redmenace

  • 211
Re: Voice recognition build
How about those of us with Dual Core Systems. Can we make the other processor handle the recognition?
Government is the great fiction through which everybody endeavors to live at the expense of everybody else.
              -Frederic Bastiat

 

Offline RandomTiger

  • Senior Member
  • 211
Re: Voice recognition build
Edit: misunderstood the question.

No idea, havent seen anything on that.
Probably not without a new SDK.

Let get it working for everyone first eh? :)

 

Offline redmenace

  • 211
Re: Voice recognition build
lol, well.
You might want to get your avatar back as well
Government is the great fiction through which everybody endeavors to live at the expense of everybody else.
              -Frederic Bastiat

 

Offline Taristin

  • Snipes
  • 213
  • BlueScalie
    • Skelkwank Shipyards
Re: Voice recognition build
Umm... my P3 OEM FS1 had the ability to do voic recognition command... :wtf:
Freelance Modeler | Amateur Artist

 

Offline MetalDestroyer

  • Starwars reborn!
  • 210
Re: Voice recognition build
Wouaw, Is it working ? We only just need to improve a little the AI behavior and we'll got a really bad ass Fs 2 :D

 

Offline RandomTiger

  • Senior Member
  • 211
Re: Voice recognition build
Works for me, not perfect but it works.
Now I need you guys to have a go and give me some feedback :)

 

Offline starfox

  • 28
Re: Voice recognition build
I didn't quite understood what I should do...
The build is working fine alright, but I can't get Voice Rec. to work.
Any ideas ?

With the -Voicer enabled, I get the following error
"Failed to create the command recognition content"
And the next error message is:
"Failed to init voice rec"
« Last Edit: January 06, 2006, 12:20:39 pm by starfox »
Rig:
A8N-SLI Premium
AMD 64 X2 4200+
GF 7950 GT
X-FI ExtremeMusic
HEC 550W
2 Gt RAM
Win XP

 

Offline RandomTiger

  • Senior Member
  • 211
Re: Voice recognition build
Hi there, thanks for your feedback.
What OS are you using?
Is your mic plugged in and turned on?

If XP make sure you have trained the voice recognition system in control panel.
Otherwise you might have to install the API: http://download.microsoft.com/download/speechSDK/SDK/5.1/WXP/EN-US/speechsdk51MSM.exe

 

Offline starfox

  • 28
Re: Voice recognition build
I'm using Windows XP
Mic is working and turned on...
Culprit could be the Voice Rec. System..
I will also install API, to see if it would be any help...

Oh, and I'm using Logitech headset with attached Mic.
« Last Edit: January 06, 2006, 01:25:26 pm by starfox »
Rig:
A8N-SLI Premium
AMD 64 X2 4200+
GF 7950 GT
X-FI ExtremeMusic
HEC 550W
2 Gt RAM
Win XP

 

Offline starfox

  • 28
Re: Voice recognition build
Umm, where do you install that .exe-file ?
Rig:
A8N-SLI Premium
AMD 64 X2 4200+
GF 7950 GT
X-FI ExtremeMusic
HEC 550W
2 Gt RAM
Win XP

 

Offline RandomTiger

  • Senior Member
  • 211
Re: Voice recognition build
If you have XP you really shouldnt need to install anything.
Doesnt matter where you install it.

I've nevered coded anything like this before so Im not exactly going to be able to give you guru type advise on any of this.
Have you trained the voice system in control panel?

 
Re: Voice recognition build
RandomTiger, you might just have started something tham might be impossible to stop.  It may take a year or Sundays or more but I cant wait for the time where you can bark into your mic "All fighters take out those turrets, all bombers form on me and commence your bombing runs against those forward beam cannons and for God's sake get out of the way when command tells you!"
Find me as Hojo Norem elsewhere...

butter_pat_head... a name picked in sheer desperation more than 10 years ago from some super obscure Red Dwarf reference.

 

Offline MetalDestroyer

  • Starwars reborn!
  • 210
Re: Voice recognition build
RandomTiger, you might just have started something tham might be impossible to stop.  It may take a year or Sundays or more but I cant wait for the time where you can bark into your mic "All fighters take out those turrets, all bombers form on me and commence your bombing runs against those forward beam cannons and for God's sake get out of the way when command tells you!"

Muhahahaha  :lol: But it seems it is possible to do that, UT2007 propose this kind of features.

 

Offline knn

  • 28
Re: Voice recognition build
Voice control is older than you think. Actually, you can already voice command your squadmates with Game Commander(commercial, custom engine) or Shoot(free, MS engine).
However, having it in FSO is good because you can now link anything to a voice command with a little coding, instead of just keypresses.
"Don't try to be a great man, just be a man and let history make its own judgments." -- Zefram Cochrane

 

Offline RandomTiger

  • Senior Member
  • 211
Re: Voice recognition build
Thats interesting knn, not having looked at this area before I didnt know about these solutions existing already. Still, I didnt spend much time on it. If you have used them yourself you could give my implementation a try and see how it measures up.

If this kind of thing becomes standard a new era of gaming will start, people like MetalDestroyer all over the world screaming orders at their computers.

 

Offline knn

  • 28
Re: Voice recognition build
Thats interesting knn, not having looked at this area before I didnt know about these solutions existing already. Still, I didnt spend much time on it. If you have used them yourself you could give my implementation a try and see how it measures up.

:sigh: My mic is crap, and I don't have a headset :(. Most of the time the game would be responding to the output from the speakers, probably slowing down the computer a lot.
Besides, I haven't used Shoot before, only Game Commander with ST Bridge Commander - That was cool (I had a headset then)
'Helm - Engage!'  :D

What would've been even more cooler: e.g. the ability to say 'Set course for <systemname>' instead of 'Set course one' (first system in the drop down list).

Quote
If this kind of thing becomes standard a new era of gaming will start, people like MetalDestroyer all over the world screaming orders at their computers.

Snipes: 'DIVE DIVE DIVE! Hit your burners pilot'
Player: 'Down! Down! DOWN! Afterburner! I said AFTERBURNER!!'
WHAM!
;)
"Don't try to be a great man, just be a man and let history make its own judgments." -- Zefram Cochrane

 

Offline RandomTiger

  • Senior Member
  • 211
Re: Voice recognition build
Oh, one point you dont have to bring the menu up to use these commands.
You can just say:

All fighters.....   attack my target.

 
Re: Voice recognition build
Quote
Muhahahaha   But it seems it is possible to do that, UT2007 propose this kind of features.

Do UT2007 try to give a good impression with that ? (they'll need much more than that). I believe that was old history when the N64 game "Hey, you Pikachu!" was released in 2000, you can't play that game without a Microphone, it's a minimun requirement, otherwise you can't order your Pokemon to attack, defend, evade, and do other multiple moves. An intent to make the Game, as playable as the Series is, through Voice orders.

This feature is, and would be excellent for FS2/FSSCP (....if I only would have a Microphone....)
« Last Edit: January 14, 2006, 01:18:47 am by Shadow0000 »