Cutting down the guest list

We have booked our venue recently and we are trying to come up with a rough draft of the guest list. My fiance wants to invite everyone and their mothers, but I would like to keep it smaller to cut down on some costs. I want to keep it to family and close friends. What's an easy way to make a smaller list without making people upset?!!!