Stove:
http://jwbasecamp.com/Articles/SuperCat/index.htmlI know it seems hokey, but they are super light, super dependable, and super cheap. So easy to make, a group of boy scouts could easily make their own stoves and do it successfully. Go to the ABC store and get one of the small plastic flasks of whiskey to use as fuel storage, mine holds about 8oz and fits in a side pocket of my pack and takes up barely any room (Make sure you mark it FUEL so you don't drink it!!!).
I most of the time use a Jetboil, and it's worth every penny, but I'm learning to get used to a home made alchohol stove because they are light, easy, dependable, and cheap to operate.
As far as the GPS is concerned, I really really think it is important first and foremost to get used to using a map and compass. It's intimidating at first, but once it starts clicking you will think to yourself "Why the heck did that seem so hard to me?" Save the GPS for once you are familiar with using a compass and map. Compass and Maps do not fail if you take proper care to store them while hiking. GPS can get wet, batteries can die, you can drop and break it, etc. I've even seen one taken out of a pack and the screen had cracked from pressure in the pack pocket. If you are dependant on it, then you are screwed. Plus most great trails are marked well enough that it's not worth it to invest the money in a GPS. Unless you are going bushwacking in Montana, you should be fine. I'm not saying you shouldn't get one, but for now consider the alternatives. A GPS system doesn't help you if something happens to it. Having a map and compass available and the ability to use it in case the GPS fails is a comfort in the worst case scenario.
I will NEVER depend on a GPS as my primary navigation device. I've been navigating with compass and map since scouts. Why pay hundreds for a GPS when I can buy a $20 compass, and a $5 map and go anywhere at any time with no fear of getting list? I've gotten good enough with map reading I don't really have to even use a compass anymore. In the military I went to the navigation course, grabbed the map, plotted the locations of the points of interest, gave the NCOIC back the compass, laughted and ran off to go to my points. I found my points and got back to base 45 minutes faster than the next fastest individual.
As far as the rest of your backpacking gear is concerned, what do you already have that you will be using? What are you missing from your kit? What are your intended goals? I've been backpacking off and on for around 23 years, and have gone from one extreme to the next with exception of Alpine backpacking as I have no interest in camping in snow fields. Me and my current wife are eyeing the future and slowly training up for a Through Hike of the AT.