Dealing with Hearing Loss and Frustration with Doctors

Since I was very little I had a lot of ear infections and just recently back in 2019 I found out I have 31% hearing loss in my right ear. Just these last two years I been wearing a hearing aid. But I have noticed even when I don't wear it to charge it I still have hard time hearing. I am afraid of telling my ENT due to the last time I got my hearing test done the doctor told me my hearing isn't gonna improve its just gonna get worse. But before I was diagnosed with 31% hearing loss in 2015 I had my last ear surgery due to my ear infections caused me to have a couple times surgeries on my ears. But I had to went years since 2015 not to see an ENT cause that one doc p*$$ me off by saying that I had no hearing loss after my recovery time. When I knew there was. But she even mentioned to me that there wasn't cause there was a miscommunication from my brain to my ear. Honestly I need advice here should I see my newest ENT I saw in 2019 again? Or should I just let it be. Cause I already have accepted at the most part if I go deaf I go deaf. At least I know ASL already.