Author Topic: (Un)official testing group thread  (Read 1613 times)

0 Members and 1 Guest are viewing this topic.

Offline WMCoolmon

  • Purveyor of space crack
  • 213
(Un)official testing group thread
I don't want to go through the additional trouble of setting up a testing tracker when it's not needed.

So here's my idea: Commission a fairly informal group of bug testers with two main objectives:

Make detailed reports
This is pretty obvious, and pretty simple to do actually; make a page of your usual computer set up and stick it on a page somewhere. Get used to taking screenshots and an image editting program, and figure out some way to upload images quickly and easily. If you can, FRED a mission to examine the whatever-it-is in more detail.
The point of the detailed results is to make the problem reproducable for anyone using it.

Break stuff
This is why QA gets paid. When a coder posts a new build, it's usually because it's got a new feature, or feature(s). These need to be broken. How? Purposely do weird stuff. Stress-test the feature. If it lets you put in a numerical value that should be positive, try negative numbers. Try the feature every which way you can.
But all in all, what really needs to be done is for the feature to be used and tested, right then, before it's a couple months later and everyone's moved on.
This is also a great way to learn how to mod through experimentation, because whatever you do wrong is only helping; if it's an understandable mistake, it should be documented and fixed.


It's not necessary for every individual to bugtest every build; if there were only three people bugtesting, one doing the first of every three builds, the next doing the second of every three builds, the third doing the third, but each tested every feature thoroughly, the quality of fs2_open would leap dramatically.

Another thing that could be done is, while some testers were doing the rotating thing, other testers tried to break values in various tables and detailed what worked and what didn't. (This would be things like trying a ship name that's too long, an afterburner image that doesn't exist, ridiculously high values, etc). Invalid table values that crash FS2 are usually notoriously easy to fix, but make things much more moddable because you can quickly throw in a warning telling the modder what exactly went wrong, rather than insulting their mother and popping up an opton to tell Microsoft about it (Or whatever their particular OS does to tell them it crashed)

So, thoughts? Anyone still interested in volunteering? ;)

Inqui, is there any chance of getting a tester-only QA forum set up on indiegames?
-C

 

Offline Bobboau

  • Just a MODern kinda guy
    Just MODerately cool
    And MODest too
  • 213
(Un)official testing group thread
everyone who becomes a tester, the first thing you do is subscribe to the new builds forum.
Bobboau, bringing you products that work... in theory
learn to use PCS
creator of the ProXimus Procedural Texture and Effect Generator
My latest build of PCS2, get it while it's hot!
PCS 2.0.3


DEUTERONOMY 22:11
Thou shalt not wear a garment of diverse sorts, [as] of woollen and linen together

 

Offline Inquisitor

(Un)official testing group thread
Yes there is :)

I'll do that and make it tester only and create a tester group.

I htink I can even make you able ot manage it :)
No signature.

 

Offline Nuke

  • Ka-Boom!
  • 212
  • Mutants Worship Me
(Un)official testing group thread
usually when i had tested a feature in the past i had reported my results directly to the programmer via im or on the board somewhere. unfortunately im abit busy with work and the new g/f. sence i work seasonally i will probibly resume regular feature testing and modding around august.
I can no longer sit back and allow communist infiltration, communist indoctrination, communist subversion, and the international communist conspiracy to sap and impurify all of our precious bodily fluids.

Nuke's Scripting SVN

 

Offline Inquisitor

(Un)official testing group thread
Created forum. We already had/have a TESTERS group, gonna make you a moderator for it.

Basically you can use the group to spam emails to the testers and control what they have access to, you could, if you wanted, make certain downloads only available to that group, but I dont; see why you would want to :)
No signature.