I found what I was looking for, its something called ABC, ABC Amber BlackBerry Editor.
You backup your blackberry, then you can use this software to edit the contacts in the backup file. Then you restore it. Perfect! It doesn't look like it supports groups, so I still have to do that on the device itself, but this makes adding all the contacts a lot easier. Free download ABC Amber BlackBerry Editor, edit contacts in IPD files