I feel that way about certain stores and parts of a town I used to live in

It correlates to PTSD entirely, it's called a trigger, they can get pretty weird and more triggers can show up from repressed memories especially the weirder ones that you don't run into every day. It can be people, places, things, phrases, pretty much anything. I have C-PTSD so some of my triggers cause minor hallucinations on top of the anxiety and flashbacks. Usually to treat it you figure out if its easier to avoid entirely or to go through exposure therapy or some other kind of therapy to get you refamiliarized and comfortable with the trigger again.

Yeah that's just PTSD