1. Use a burr grinder to grind your beans just before brewing.
2. Use filtered water (a Brita pitcher works fine).
3. Use the right grounds/water ratio (another commenter went into depth about this).
4. Use tasty beans. This is personal preference, try a bunch of different roasters & levels of roast until you are happy. It's perfectly OK to enjoy the store brand or even Starbucks, it's your coffee.
The next level of "fancy" is using the correct water temperature.
If you're going to use a drip machine, do some research on which machines actually get to temperature and maintain it during brewing. Off the top of my head, both the Bonavita Connoisseur and Technivorm Mokccamaster are good.
If you're doing french press/pour over/aeropress, get an electric hot water pot with accurate temperature control (these usually have a cute gooseneck for precise pouring of water over the grounds).