Need advice on cancelling wedding

My fiancé and I have been engaged since the fall of 2019. We were planning on having a long engagement and our wedding has been planned for awhile for April 17, 2021. It’s a destination wedding in Florida, and was always going to be small (50 tops). A lot of people who said - promised - they would be there are now backing out since they “thought things would be better by now”, or they are planning on waiting until the last minute to RSVP. My fiancé has two people coming from his side, and his best man backed out. I’m so exhausted and frustrated from working all the time and this wedding is just making me so unhappy and even more frustrated. What’s the point of spending all this money? We could have bought a car or invested in a house instead of it going towards a wedding that no one is coming to. And I don’t want to postpone it. I’m just so disappointed about everything and frankly I’m disappointed in a few friends who have traveled massless during the pandemic but still can’t make it to wedding.
I feel like I can’t talk to anyone about this either because they all seem to have their own interests involved. I don’t know what the right thing to do is. Part of me wants to cancel while I still can.