Well, I can fully understand. Here's my point of view, let's say I go up to you and say, "Hey, join my church!" and I didn't know you would say, "No." That's fine. But, if I go two, three times up to you, and do it too, that's where I overstep the boundaries. However, sometimes, you might get asked by several diffrent people of the same religion, and, I don't think they knew your stance on it.
So, yeah, there ya go.