Are you sure the memory doesn't need to be installed in pairs?
I believe so, maybe you can help me understand pairs more. I have 4 RAM slots each with a 1 gig stick. Two 1 gigs came with my computer and I added 2 more one gigs. All have matching RAM speeds, can't remember right now what the speed was.
If this constitutes installing in pairs then I have done just that.
The 2 RAM pieces I bought are a little different looking but I'm not sure if that matters forgive my ignorance if it does

yeah, check the documentation on your mobo. If you can run with one stick at a time, then try each stick individually to find the bad one.
Alright. But shouldn't my computer still be beeping if I hadn't removed the bad one yet? Because after the first one I removed I was no longer beeping but it wouldn't go any further than the blue HP loading screen until I removed the second. Sorry, I don't know if I'm making any sense.

EDIT: I looked at my Mother board specs and I have 4 DIMM slots so I'm guessing that since they are DIMM and not RIMM they don't have to be installed as pairs right?