Yes, you are paranoid. They might look at you, but you don’t know what, if anything, they see. They might just let their eyes roam the area, without noticing anything.
Why not start using burqa or niqab right now?
When I moved from Sweden’s second-largest city to a much smaller town, I sensed that people were suddenly LOOKING at me. First I thought I had something on my shirt, but it was a little too often. Then it dawned on me that they were just checking if they knew me. In my old city, with around a million people in or around it, you saw very few people you knew, so you weren’t actively looking at people all the time, you just kept your thousand-yard-stare. But in a municipality with below 30 000 people, with 13 000 of those in the town I live in, you see people you know all the time. Even I, who have lived here only about 10 years now, see people I know every week. In Gothenburg it could go months and months between spotting a known face.