This was discussed within the previous 3 months on here, so you might want to search for that post. There was a lot of good information that you are lookin for in there.
I had a guy give me a CH Products USB yoke one time, and I always enjoyed using it in FS2004. It had a very realistic feel to it (you might have to tweak your program settings a bit to achieve that) and whether it was flying a Lear, King Air, or a Cessna 172 it behaved and handled just like the real thing. Everywhere I've seen thats the brand that people recommend, and they are built rugid and sturdy. The yoke has functionality of: Trim wheel (elevator and rudder), gear handle, flap handle, prop lever, throttle lever, mixture lever, couple push buttons you can customize to your liking (set up autopilot disconnect, braking, clear out panel, change screen, etc.).
I'd warn you off of buying the additional rudder pedals. There as expensive as the yoke, and they are for the most part useless. FS2004 has an option for "auto-rudder" and it removes the need for it. Even if you dont use that function, the airplanes don't fly that much different without.
More information on the product can be found here:
http://www.chproducts.com/retail/y_fsyusb.html
Here's Amazon's link to the product - will run you about $105:
http://www.amazon.com/gp/product/B000056SPM/103-0267326-6030275?v=glance&n=172282
And just heads up, Microsoft is releasing a new version of their simulator, Flight Simulator X, around "the 2006 holiday season". I probably wouldn't hold out that long for it, but just thought I'd throw that in here.
If you've never used FS2004 before, it's an awesome IFR platform for keeping current and up to speed with instrument procedures in all kinds of custom weather - at practically no cost.
.
.