Alcohol at an afternoon wedding

My FH and I are going to have a Sunday afternoon wedding with the ceremony starting at 1 or 1:30 the ceremony will probably be about a half hour and then we are thinking we will have a light almost "high tea" reception with some finger sandwiches and cake, cookies and other goodies with some punch, lemonade and teas for our summer wedding. The reception will be over at 4pm. Here is the problem...my fh's family drinks but my family does not approve of alcohol. While my FH and I drink on occasion we do not enjoy the taste of wine, beer, and champagne. His family is also big on drinking beer. I however do not feel it is appropriate to serve alcohol at this point in the day. My FH thinks that we need to have it to make his fam more comfortable. My problem is that it will make mine uncomfortable. Is it appropriate to serve alcohol at this time in the day and if so any suggestions?