If your on Public Water I would go with a "Reverse Osmosis" setup, The setup can go under your kitchen sink. It takes out a lot of crap, you need to read more about it.
If your on well water a simple filter should do the trick of you have sediment in your water. If your water is good, leave it...