The problems of replacing PS/2 and PS/1 batteries are well-covered on this page: http://www.tavi.co.uk/ps2pages/battery.html
... but what may not be as well known are the problems that having a bad battery can cause with other components. I had a PS/1 (Model 2011 - early, proprietary design)...