What time should a Saturday wedding start?

A little background, we are renting an entire estate with a house, cliff for ceremony, and barn for reception Thursday-Tuesday the week of our wedding and have complete run of the grounds during the whole time so no venue restrictions at all. Mosy of our guests will be driving 1.5-3 hours to attend. There are many options for accommodations there but we are sure many will still drive back that night. For that reason, we had the ceremony starting at 2 and reception everything at 8 to give people time to get home before midnight. But the more I talk to people, the more they say that it's odd to have a Saturday wedding so early and that our guests who want to drive can leave early if it gets too late. For me, the later the better. I want sunset photos and sunset doesn't even start until 7:20 that day. So whaaaat do you think? 4 or 5 instead of 2?