You may need a new battery, but I would try inserting a piece of heavy paper between the battery cover and the battery to see if that helps. A cut up manilla file folder can work well to prevent the battery from moving around.

Note that if the battery is moving away from the contacts you may have to shim the opposite edge of the battery to keep it pressed against the contacts.