I think you have to sync with Outlook, delete the contact in Outlook, and then re-sync your address book. I have the same situation. The second I clicked on the .vcf card I was hosed with that contact. Some strange error message crops up when I try to modify it, saying "contact updated externally. changes will be lost..."
Man, I HATE this!