Anniversary party...is it okay or silly?

My husband and I got married a few years ago, and while I am so thrilled I got to marry him, the wedding itself is an unhappy memory for me.
We had quite a lot of bad luck leading up to the big day. I know things could have been MUCH worse, but my bridal salon went out of business about 10 weeks before the wedding leaving me with no dress (long story in and of itself), I had to put my dog down just four weeks before the big day, my uncle passed away thee weeks before, I got bronchitis the week of, etc. etc. but the worst part... was that right around the time we got engaged, I took over a small business for a very sick family member. The business was in tremendous debt. Trying to get that business back on its feet became two years of 90+ hour work weeks, exhaustion, and misery. On my wedding day I was emotionally exhausted, sleep deprived, and practically broke (as had been the case for months) and I felt in a daze for all of it. When the flowers arrived and they were the wrong order, it didn’t even phase me. I (usually a big cryer at weddings) didn’t shed a tear during the ceremony. I felt tired and mentally “gone”.

Anyway I am SO sorry for the rent but I wanted to give context. I know things could have been MUCH worse. I know I shouldn’t complain. I’m embarrassed that I still care, several years later. But the fact is that I do care. I’m angry at myself for not postponing the wedding. I’m disappointed that although I think the guests had a nice time, I felt completely absent.

Recently we saw several aunts and uncle who all said they were dying to go back to Florida (we had a semi-destination wedding - a few hours for most of our guests) and wanted to know if we would be planning an anniversary party anytime soon. I was surprised! I started wondering if, since the business is now very stable and we could afford to do so, I could have a chance to essentially relive the weekend? I wouldn’t renew our vows. I think after just 5 years that’s nothing huge, and people will feel like we were JUST there. But I would love to throw a big party and treat our guests to some of the details that we had to drop last time...like fancy welcome bags, etc.

Is this stupid? Am I going to be annoying family members by inviting them to this? Is there a way to word invitations (or maybe even just verbal invites via phone?) so that people understand there is no pressure to attend, we just want another fun weekend in FL with extended family and close friends? Is there anyone else with a similar situation? Sorry for clogging up bridal forums with this. I didn’t know who else to ask for unbiased feedback :/