You're thinking I'm one of those wise-ass California vegetarians who is going to tell you that eating a few strips of bacon is bad for your health. I'm not. I say its a free country and you should be able to kill yourself at any rate you choose, as long as your cold dead body is not blocking my driveway.
I made the choice to be vegan because I will not eat (or wear, or use) anything that could have an emotional response to its death or captivity. I can well imagine what that must feel like for our non-human friends - the fear, the terror, the pain - and I will not cause such suffering to a fellow living being.
The symbolism of meat-eating is never neutral. To himself, the meat-eater seems to be eating life. To the vegetarian, he seems to be eating death. There is a kind of gestalt-shift between the two positions which makes it hard to change, and hard to raise questions on the matter at all without becoming embattled.