Saitek Cyborg Evo is known for offering reasonably good quality on very affordable prices ($20-30 these days I think) and in general Saitek sticks are the same, even the HOTAS setups are somewhat cheaper than comparatible setups from CH or Thrustmaster.
I have used Cyborg Evo for years with very satisfying results, although I have done some modifications on it; first of all the return spring gimbal mechanism loosens up in use and the stick's mechanical centering zone gets looser. Problem solved by removing all the return springs from the stick, both the main gimbal and the twist handle spring. This also helped in flight simulators because while I keep my hand on the stick I can use it for trim much more effectively than pressing against the springs all the time.
Also, the mechanical durability of the primary trigger on Cyborg Evo is rather questionable.
On a bit more sophisticated side, Saitek Aviator has dual throttles and buttons in switch form, and it might be my next aquisition... Although Saitek has also released a new Cyborg X stick which has two throttle levers as well and looks pretty sweet. That is, if I don't decide to go all out and get the X-52 HOTAS setup and pedals. If I ever get the money.
But yeah, in general I have had only bad experiences regarding Logitech sticks. Their electronic integrity seems to be very very questionable, which is a damn shame because mechanically and ergonomically they are in fact very good. Saitek sticks in general don't seem to have as sturdy bases and the cosntruction is mechanically lighter - but ergonomics and mechanical durability will not help at all if the stick's electronics returns huge amounts of noise, jitter and other erroneous inputs to the system. Also, as I took apart one terminally dead Logitech stick and my previous Saitek stick in need of repair, I discovered this:
...take two guesses which of these potentiometres is used by Saitek and which came from Logitech.
The pots are tiny, and I think they oxidize very easily and start giving inaccurate feedback.
So, yeah. Saitek sticks are pretty much the starting point if you want a stick with reasonable quality and durability with limited monetary resources. If you have money to spare, then you might want to consider something like CH or Thrustmaster... although I have to say that I would feel very strange flying FreeSpace 2 with pedals. Twist handle feels more intuitive in a space sim, pedals have more advantage in flight sims. And I don't know if CH or Thrustmaster even offer any twist handle sticks.
And regarding force feedback... my opinion is that it's just not worth it. I once tried Saitek's Cyborg Force, which was a lot better than Force3D Pro or Wingman Force3D as far as the notched axis phenomenon went, but it still was distracting and still didn't feel quite real anyway.