A little late for me to chime in but, yeah, it never had a ball, that weird splined end that looks like the end of a driveshaft is what they all looked like from the factory.
It’s been 40 years so take this memory with a grain of salt, but I remember it being my favorite joystick for a while, ugly shaft and all, because it had a really short throw and positive action compared to the rubbery stock 2600 sticks… but it was murder on your hands for long play sessions. Both hands, because the rough little stub of a stick would chew up the base of your thumb (the shape of that thing encourages you to kind of just nestle it between your thumb and the side of your palm, and its small size eventually cramped up the hand you held it in.