I sympathize with the anti-Apple sentiments, but the Zune may not be a great way to go. Surprise.
I used an Archos Gmini 402 camcorder for about 2 years, and loved it until the battery decided to randomly become engorged and break out of the casing. Archos wanted $80+ to fix it, I wanted to know what the hell happened. Bad battery, they claimed. Really.
Conversely, I got an ipod shuffle for Christmas this year, and the second time I tried to upload a playlist, I found 160+ megs of "other files" that I couldn't remove or find -- a not uncommon problem, apparently. The thing that really irks me about it, however, was Apple's lack of an explanation. They simply suggest restoring the ipod. Which, really, is what I've always disliked about Apple -- the whole "user friendly" attitude that supersedes my nerdy desire to understand my machine. I guess hippies love it though, so *shrug*.
Moral of story: my old Emerson CD player with built-in FM transmitter ($20) is still the sexiest piece of music hardware I've ever owned. Lasted 6 years before the motor finally couldn't turn discs anymore.