I too was looking @ the phone in a VZW store and got the same impression as the OP, it's not polished and has a way to go, but at the same time I am confident that it will get there in time. This OS has huge potential and I believe it will take off.
One of the biggest complaints that I've seen so far is the problems with exchange integration. It was announced that the Droid had native exchange sync support which is not working well at all. So there are folks who ditched their blackberries for the droid who are stuck. There's a issue on the Android code issue board and there are a lot of upset folks, and rightfully so seeing as this phone was supposed to have exchange integration.
I'll probably wait a while and then spring for the Droid or a newer Android 2.x device down the line. At the same time, the Storm 2 is looking pretty promising for my corporate device.