When the phone shuts down and boots up there is a giant display of AT&T logo. I am not on AT&T and don't like seeing their logo on my phone (it's unlocked for T-Mobile)
How can I change that boot screen logo?

You can't change it. It's burned into the ROM.

Just look away from the screen at that point if it bothers you.