I stopped going to away matches after witnessing the kind of behaviour that you describe and worse. I now go to a few select away games and try to keep away from any fences that may separate us with the home supporters.
Up at Aberdeen, I've witnessed fans from both clubs basically shouting at each other instead of watching the match, I don't understand that either. One Aberdeen fan was pointing to the "Stone Island" logo on the sleeve of his sweater before spreading his arms out in a "C'mon, let's be 'aving you" gesture before pointing to his "Stone Island" logo again! Complete and utter stupidity and probably from a guy who wouldn't say boo to a Pomeranian without his mates to back him up!
Then witnessing some of our supporters wearing balaclavas was the decider not to go to as many away games. Keep all that stuff, along with flares for the Glasgow mobs, it's not welcome amongst the St. Mirren support.