Late invites - rude or okay?

Hello all! I recently posted about our guest list going down from 230ish to 106ish and now I need a little more advice My fiance thinks that we should invite some more local friends, but for some reason I feel like it comes off as rude...like "hey sorry we didn't invite you before, but now no one can come so you can!" (OBVIOUSLY I wouldn't word it like that haha). I was just wondering if anyone has invited more people later and, if so, how do you word it without it coming off like they're second tier... Honestly, we have HUGE families so a majority of our guest list (and no's) came from them so these are mostly just friends around the area. Thoughts? Thanks!