That is funny but quite true. A couple of my friends said something similar that they couldn't understand why it's always a rush for most guys (not like the guys are always cheated with some married women, whose husbands on the way home). If you're with someone beautiful who you love, you should really take your time and admire what you have 
Historically, humans are polygamous; not so much as say, a gorilla, but not monogamous either. (Incidentally, the general trend seems to be that the more polygamous a species are, the greater the size difference between in male and female - believed due to the intensity of male competition). In any case, males are wired up that way; there's a theory (Evolutionary psychology) that a lot of human brain development and consequences (art, language, etc) can be placed down to sexual selection rather than natural selection. And polygamy - males with multiple partners and hence more offspring - is really required for sexual selection to have a significant effect. Such as in hnter-gatherer type tribes; the females will have 6-8 or so children, the males dozens as the result of polygamy.
Still bloody rude to do it, though. Particularly because there are pressures towards monogamy (namely the need of newly borns for parental or societal care - although this can exist in a sort of communcal support system for small tribes).
I've been reading
The Mating Mind by Geoffery Miller, which covers sexual selection (advocates it, really). Interesting book.