Zoning Out During Conversations

I feel that way all the time and it gets worse if I'm nervous or stressed. I normally can have a hard time hearing people and I'm so quiet it annoys people to the point they don't want to talk to me because they have to keep asking what I'm saying. When I'm nervous a lot of the times I can't understand what someone is saying as if they're speaking gibberish, it's like I forgot English just like that and my ears plug up to make it worse, if I'm around someone I'm comfortable with I'll look at them and ask, "what did they say" because it's like they're the only one I can understand and hear. This also for me leads to panic attacks in public places which makes it worse because of my social anxiety but I'm good at hiding it, the last thing I want is a stranger asking if I'm okay because they'll make it worse

Only when there like other conversations or music playing background idk why but my brain can only focus on one sound at a time