As someone who has struggled a ton with college I will say it isn't for everyone and that's okay. If you truly don't want to go to college because the field you want to work in doesn't have a degree that's totally fine, lots of people don't and are super successful. If by chance you do want to go to college but are afraid, here is what I've learned.
1) Taking time off or not starting right away is perfectly fine, turns out not that many people care. I'm 23 and still have a few semesters to go. If you need to take time off in the middle or something that's also totally fine. Everyone in college understood. Work on your own timeline, not one that is traditionally thought of.
2) Find out what accomodations your school may offer through disability services. At first I didn't think I would qualify because I was applying for mental health reasons only. I do qualify though and they have been super helpful. Also it can be helpful to see what the minimum credit hours are to be a full time student or even take less than that at a time. You don't need to take 18 credit hours at a time. I burnt out trying to do that and had to take time of.
At the end of the day, whether you want to go to college or not is your decision. Fuck what anyone else thinks. I think a lot of the pressure comes from people being afraid someone they care about won't be successful without a degree. Sometimes you just need to get on the ground floor and work your way up. Sure, in lots of fields having a degree may allow you to start at a higher level, but it might not. Do what you think is best for you, not what someone else does. There will always be people disappointed no matter what you choose just don't let yourself be one of them.