A way to save some dollars is to get married on a Friday or Sunday. If a Sunday is selected, then make sure a holiday Monday follows it to ensure your guest will stay longer.
If there is an option to have the ceremony and reception at the same location that can save time of commuting and places often give discounts since the couple are having both events at the same place.
Having a buffet at the reception instead of a sit-down dinner will save money for the couple. Even if that is too much of a cost then appetizers can be served instead of a whole buffet. Brunch and lunch can be served instead of dinner to save on money.
Having liquor at the reception can be a high cost. It is more economic to have beer and wine at the reception and it can be done for a few hours or done the whole night unless the couple decides to do a paid bar.
Sometimes weddings are just for a small group of folks and it can be held at a restaurant. There is no need to pay for a rental space but only for the food and drink. Some restaurants have private rooms that may be reserved at no cost or a small fee.
An Officiate can help you with your budget or go over it. In California, officiants range from 250 to 500 dollars for the ceremony. And that does not even cover if they need extra audio for the ceremony if the venue does not provide it. In certain states, friends and family can be ordained and perform the ceremony. Please check if your state allows this.