Caught Smoking Weed by Neighbor

Had anxiety so I smoked a little weed just now at 3am (which I rarely do) and got caught by one of my neighbors. He didn’t recognize me but he said “that’s my neighbors house” as a way to say he was looking out for them and wanted to know what was I doing there, but I told him I lived there and he seemed to not believe me but I feel like he’s gonna tell my grandparents (who I live with) and I’m so embarrassed and don’t want them to know because they will flip. Hopefully he doesn’t say anything. I just had anxiety all day today and my thoughts wouldn’t let me sleep last night or tonight so I really needed it but now I feel shame and nervousness. Definitely won’t smoke around my own house again.