If you later need to move back to an 'internal' battery, then I am pretty sure that you would need to put the jumper back on.
Yes you do. I'm pretty certain the jumper connects the positive leg of the 'internal' battery to the positive side of the clock/bios circuit. By having it there it prevents you from connecting an external battery while the internal battery is in circuit (and possibly causing damage).