How far is too far?

I found a barn venue that is exactly what I want, for our rehearsal dinner, wedding ceremony, and reception. It’s better than any options closer to our house, however it is 40 minutes away from our place. My fiancé is worried, and now making me worried, that it’s too far for people to travel. About 1/2 of guests will be traveling about 40-60 minutes with 1/4 traveling 2 hours and the other 1/4 traveling farther from different states. Is that too far? Do I need to adjust our expectations and or budget for a closer place for the 1/2 guests (which would make it 20-30 minutes longer for the guests traveling 2+ hours)..?