While bottled water is bad for the enviroment, try a bpa free reusable bottle or a Klean Kanteen, because it is hard to get those disposable bottles completely clean even with a bottle scrubber. Always filter your water (you can do this both at the entrance of water to your home/ at the faucet with a filter).
You might have to filter your house water several times, that is why they have extenter pipes, but you can absolutely get fine tasting water by filtering it. Plus it reduces the stuff in your laundry, which can cause allergies, stuff your pets ingest, stuff that gets on your skin when you bathe, etc.