Originally Posted by mister.zero
Not certain if this will get rid of the voicemail notification, but it might, so try Phone ->Options ->Call Logging: None.
This still has the voice memo still showing up in the messages folder. I don't believe there is a way to keep the voicemail out of the messages folder. (if you find a way please post it)