Toniebox running on battery or charger but not both

Hi there,

I got myself one of those defective boxes and now I am trying to fix it. I already got the battery running again, but I get some strange effects when I put the box on the standard charger (from a different box).
After putting it on it plays the startup sound instead of the charging sound and afterwards I have to unplug and replug the battery to run it without the charger.
My guess would be a shortcircuit somewhere around the charger port, but if anyone has seen this effect and can point me towards some parts to measure first that would be a great help.