Let me give my two cents on this controversial issue. I am generally biased towards non-vegetarianism, therefore that would be reflected in my outlook in the below paragraphs.
A person's preference in food is a result of mental conditioning resulting from the environment that they have grown up in or the experiences that they have experienced over the years. This is not very different from a person's preference in ,say ,music. But this has nothing to do with belief or religion, just plain old conditioning. We adopt behaviour patterns and other habits, not from instinct but by watching others and our elders. Our family has as much effect on our behaviours, habits and preferences as much as peer pressure does. Aborigines in Australia are known to consume grub, Chinese people are known to consume Octopi and dogs, basically foods that fall outside an Indian's sensibility of food. But if an Indian were to consume those food, would there be any grievous harm? No. You may gag and puke, but eating dog meat won't kill you, neither would eating Octopus meat, at least not unless you have some form of severe allergy to such foods. Similarly, if you are a vegetarian and you were to consume non-vegetarian food at some point, nothing happens. If you feel bad about the animals killed for their meat, that is just you. Only one stopping you is you and not your religion, beliefs, or anyone else.
That being said, animal meat is just that: Proteins, a complex compound of carbon, hydrogen and oxygen among others. If you consume it, it helps build and maintain your body. If you choose not to consume it, no problem, its a free country. But if you are a vegetarian ask yourselves this, if you were born and brought up in a non-vegetarian household, would you be bashing non-vegetarian food and non-vegetarians right now? If you consider yourself lucky to be born in a vegetarian family, its actually just that, luck. It is luck that we are all born in our family, society, city, state or country. If your consciousness could have manifested anywhere in the world and you could have adopted the food of the place of our birth, so what is the importance of our preference of food in the grand scheme of things?
PS: I am generally targeting vegetarians here because most of them tend to judge non-vegetarians a little too harshly and I find myself most of the time defending myself against them. Also, it tends to be a one way argument since non-vegetarians also consume vegetarian food but generally it does not work the other way around.
PPS: This was written in a hurry so there might be logical fallacies, so point them out and I will clarify.