And then he said "maybe we just shouldn't get married"

We got engaged 10 months ago. I've been hesitant about setting a date, because honestly, being married scares the shit out of me. But I have an amazing partner and I've been in therapy to deal with the 10 year affair that my "perfect" father had on my mother. So yesterday we sit down, have a very special heart to heart moment ...and set a date. I'm elated. It's all I can think about for the next 18 hours. Then.....after mentioning how we're going to have to hustle and work out butts off (we live on Maui.....it's EXPENSIVE and all we're doing is having a party in my moms yard), he gets offended by what I said and says "maybe we just shouldn't get married". I'm crushed. I've told the few people I told that realizing how expensive it is, we're going to end up changing the date, and a few other excuses. I'm ready to give him back his ring. That's the worst thing he could have said. Not even 24 hours after setting a date. And we've got 9 more months of that?! No thanks.