When we first sent our STDs, FH and I agreed to invite all of his grandparents. His grandmother married twice and divorced both of them. Both of his grandfathers are now remarried and we only see them at Christmas (needless to say, we're not very close). But we didn't want to offend them by not inviting them since word would spread through family that there is a wedding.
After STDs were sent my FMIL had a fight with her biological dad's wife and is now not talking to them. She doesn't want us to invite them to the wedding because she doesn't want to see them. Her mother as well doesn't want to see either of her exes (we originally planned to see them all far away from each other). But the STD has already been sent. I feel it would be completely rude to not send an invitation at this point but I don't want there to be tension at the wedding either.
The grandparents didn't show up at Christmas this year either so we missed seeing them though they might not have been invited over.