There are other factors involved besides horizontal resolution of the screen. Contrast, black levels, color accuracy and saturation also play as important a role (maybe even more so) as does resolution in the image you're seeing. Add to that the distance you normally sit from your TV--for example, in order to see a noticeable difference (a subjective call for sure, depending on how critical an eye you have--some viewers might see no difference whatsoever) on a 50" screen, you'd have to sit approximately 7-8 feet from it (that drops to 4 feet for a 32"). Any further away and, all other factors being equal, you'll be hard-pressed to discern between the two, insofar as the quality of the image is concerned. Of course, when examined closely (and playing 1080p content), the difference becomes more apparent--move further away and that difference diminishes rather quickly. Even up close, the amount of difference may not be worth the premium price you'll be paying for 1080p.


Also, there's the distinct possibility that as display technology advances, current 1080p content may be outpaced by even higher resolutions, in which case you're back in the same boat you tried to avoid in the first place by buying into 1080p.
It's worth remembering too that a good percentage of people upgrading their televisions don't do so for higher resolution, but instead, for a larger screen size. Keeping that in mind, make sure 32" is (and will be) adequate and satisfactory for the foreseeable future, regardless of your final choice of 720p or 1080p.
How To Find The Perfect HDTV