I had a similar problem when pressing on the center button. Turns out it was too much solder on the battery connector. I had to disassemble again and used some solder wick to lower the solder blobs. I suspect that the back plate must not be completely flat for you.
iPod Touch第4代电池更换
