Church Wedding vs Barn Wedding

Opinions needed!

y fiancé and I have decided on a barn venue for our ceremony and reception. To us, this is the best fit for our lifestyle (I grew up on a farm raising animals, and him a farmer), so the rustic feel is what we are going for! For my family (aunts and uncles), they view this as a set up for a doomed marriage, saying we only have a 20% survival rate of not getting a divorce since it will not be held in a church setting. My fiancé and I are not very religious, although my extended family which includes my aunts and uncles are religious. Of course this day is about us and what we want, but do I bother inviting or celebrating with people who do not approve of our marriage just because it is not going to be at a church, and talk badly behind our backs about our wedding? And throw the “but they’re family” out the window?