I can see why people decide to stay away, it is crap supporting us most of the time. Weekends ruined, partners fallen out with because of the performance of a football team!
However, that's not for me. I don't think it makes you more of a supporter that you refuse to not attend a game and to be honest I think it's better for you, the other fans and the team that you stay away if it makes you miserable.