People call me ignorant because I'm Agnostic?

I'm agnostic, but I've read the Bible, the Torah, parts of the talmud, parts of the Quran, Tao Te Ching, The Mahabharata, and have spoken to people of all of those religions, and more to find out about them. however, any time that I get in a discussion with my friends about religion or philosophy, I'm told that I don't have a place in the argument because I'm not religious. This isn't said when I have an inaccurate comment, it's said before I get a chance to say anything, or before I get a chance to defend my argument. If I've studied religions, spoken to and listened to religious services of these religions, and if I respect these religions, why am I ignored in these conversations? If you were involved, would you assume I had no idea what I was talking about because I'm Agnostic?