Yeah, you might get the chlorine (Cl2) /chloramines (Cl2NH3) out, but all the other heavy metals and other garbage that is in tap water will remain. Sorry, there is no good substitute for a cheap RO system from a home and garden center.
Plus, RO water saves a ton of money on bottle water.
If you are still too lazy to do that, get some activated carbon to remove the some of the garbage inside of RO.
PS water dechlorinator for tropical fish is kinda out of the question, because it just binds it into a different inert form while it still remains in solution.
So opt for RO water filter, they are cheap. 100 dollars or so and you save a ton of money in the long run/produce good product.