Mine did the same thing and it annoyed me, so I rolled up a piece of scotch tape and put it between the inner-side of the back cover and the battery. No movement anymore!
Remember folks, if it moves and it shouldn't use duct tape; if it doesn't move and it should, use WD-40.