@hellomiakoda what was the starting voltage when you plugged the battery in and approximately how quickly does it drop to 3.39V? The fast change is concerning but I'd still expect that to be in the working voltage range.
The fact that your controller seems to be working when plugged in, if it were me, I'd try replacing the battery first.