Depends on what level of anonymity and who you would like to be anonymous from? Hiding from advertisers and the like is quite easy using browser ad blocks; hiding from your ISP is much more difficult.
For starters, get an OS like TAILS or build your own linux box using LFS, install only what...