If the battery is in then yes that means it's probably a bad battery or you don't have the battery connected properly. Normally that icon comes up when the battery isn't connected whatsoever.

Make sure you have the battery connected correctly, and then try charging the phone. If the problem persists then I suggest purchasing a new battery of the same type.

You could try software updates as well.