I know that, for me, I can say or do something really bloody stupid, and then not realise for about 2 days that it was, and then spend years having the memory leap out and mug me.
I can be walking down the street and suddenly, for absolutely no reason, remember events from my past, things I've said or done in ignorance, and simply want to curl up into a ball and die. I still beat myself up over things I did 20 years ago, even though I know I would never do then now. I can write music and literally burst into tears whilst listening to the playback because of the emotions it invokes, that's given me trouble in the past, and tends to make me more or less abandon any kind of social life.
If Aldo or Wild Fragaria were here, they met me once, the only time I've ever met someone from either here or SG, and they met me when I was on the high point of the cycle, they'd be able to tell you that I'm not entirely in control at those points, fortunately for everyone, I try not to be around people on a low, but I'm sure if people searched through my posts, they'd be able to find at least a few that would hint at my emotional state at that point.
I'm just saying that this may go beyond simple self-esteem issues, and it may be relatively simple to do something about it if you are willing to talk to the right people about it.