I am sure the battery is just old and tired. When a battery is in doubt and discharging, you can disconnect one side and then see if it still discharges.
Your code 34 might have been from the chip losing its settings due to the bad battery...or it may not have been. Fix the battery problem and then see what happens. Electrical stuff gets strange sometimes