I have 3 tanks I recently set up and I'm shaking my head at this entire thread.
10 gallon tanks aren't worth keeping. There are very few things, besides plants, that can thrive in that small of an environment. Not to mention that small of an environment is very delicate. Any little change can completely wipe out everything and force you to restart.
Starting small is NOT the best thing to do for a beginner to this.
I have a 20 gal, 60 gal, and 125 gal tank right now. I have been using the advice of friends who have been keeping fish for decades along with all those fun sites out there such as aquacentral, plantedtanks, and monsterfishkeepers.
For a beginner get a decent size tank. 55 gal is best, but 29 can be doable without many problems. 20 gal is the bare min for anyone unless you doing plants or a single 10 gal betta setup.
This "hobby" is not cheap and shouldn't be considered it. Just to start out with you'll need the tank, adequate substrate, adequate filtration, and a complete testing kit to start with. To know what is adequate all depends on the size of your tank and what you plan on putting in the tank. Some stuff is more expensive that others.
You shouldn't be losing any fish if you've planned accordingly and done your homework. And taken the time to cycle your tank properly as well.