Wedding called off... help

Okay, so I was supposed to get married in June. I was having really bad anxiety about being around so many people and being the center of attention. I was also going through so many changes at once, graduating nursing school, moving into a new home, FH graduating and studying for exams, etc. I would come home everyday having a panic attack just thinking of such a big wedding. My FH and I talked and decided to have something smaller or go to the courthouse, everything was perfectly fine. A few days later, his family completely turned on me and started telling him it’s obvious I didn’t love him or want to marry him or I’d be running down the aisle to him. They told him this was supposed to be a happy and exciting time. He quickly sided with his family and told me to move out that we were over, so I did. His family will not speak a word to me, they have completely shunned me. Only one of his cousins have spoke to me and she told me “the family decided I didn’t love him enough” like they know anything about our relationship and like it is for them to decide? My FH and I never argued, we got along great. I do think this is not normal considering we have been together for years and we were still getting married just after exams and something SMALLER. So about 3 weeks after the break up, we went no contact for 1 week. Since then, we’ve talked every day.. HE calls me. I do not contact him first. He tells me he loves me, misses me but he tells me he is not in a good place right now for a relationship with everything that has happened. He says he knows he is hurting me and he wants to be with me but he’s not in a good place. He won’t tell his family we talk and see each other. It’s almost like he’s hiding me. Since the break up, he has spent all of his time studying and then I went on vacation and he left for vacation the day after I got home. So we haven’t spent too much time together. He returns this weekend and I have a whole week to figure things out before I start my new job. What should I do? Should I be patient or end it? I’m confused.