Good question, and honestly, no I would not against a Christian church, Jewish temple, or a Hindu/Buddist temple.
There are two Christian Churches already next to it Trinity and St. John's, but this is not the reason I'd vote no.
I don't have numbers; I am not lumping all Muslims together; and generally, I would not vote no to mosques being built anywhere else. Hell, build one right next door to my house, school, job, etc., BUT, don't build one next to Ground Zero.
On this infamous dates, many Muslims were photographed celebrating the collapse of the Twin Towers. Radical Muslims have declared Juhad (sic) on the USA and the west, and we are at war with Al Queda.
Am I being prejudice? ON THIS ISSUE, HELL YES. Ground Zero is scared, and to build a mosque near it would award those idiots who attacked us.
Sorry