Fractured Foot Not Healing Properly

So on July 4th, I jumped up and landed on the side of my foot before hitting the ground entirely. At first I thought I just sprained it so I wore a brace and took pain meds -- I went for a doctor's appointment last week and had it x-rayed while there. She said I had fractured the side of a metatarsal and put me in a cam boot. I called to ask how long I was meant to wear the boot and they said that the radiologist had cleared me to not wear it. The problem is I'm at four weeks after the fall and my foot hurts just as bad, even worse sometimes. The swelling and bruising went away but it doesn't feel any better and walking without the boot causes pain to shoot up my leg after a while. Should I get a second opinion? There has to be something wrong there