My intent in looking is a valid consideration. If I see a person who is attractive(because I'm actually tiring of limiting this to just women, cute dudes are cute too), and I look at them in an appreciative manner, with no ill intent, then their assuming I'm a creeper for looking at them is just as offensive to me as they have taken my looking to be.