I have been serving as an unofficial parts depot and adoption agency for PCjr parts for about 6 or 7 years now. (I've posted about quite a few free machines here, but nobody ever responds.) Believe it or not, I'm running out of the desirable stuff. To get an IBM memory sidecar I'll have to start cannibalizing machines.
A lot of the stuff I rescued locally from people who were giving their old junk away. That was around 10 years ago and they were happy to have their stuff leave the closet. Another stash came from the Eugene, Oregon PCjr club which was actively supporting the machine up until about seven years ago. (Those guys were gems - a real "old school" computer club.) And quite a bit was purchased on eBay - if I saw stuff cheap I purchased it and put it in the stockpile. I've even spent evenings while on business trips procuring parts where I was traveling - yep, imagine going through an airport with sidecars. ;-0 (Erik helped me ship the rest of that stash home.)
If you think you are going to be in this for the long haul, scan eBay and don't let the cheap stuff go without bidding on it. I picked up a lot of my personal collection that way over the last 10 years. But in the last two or three years I've not had the stomach for it anymore; eBaying is a hassle and I think I have everything I'll need for a while. My priorities have changed - I'm really enjoying the programming part which isn't limited to a specific machine.
Snap up what you can cheap. Scan Craigs list. And don't throw anything away - if it's not working it can probably be repaired fairly easily.
As for the IBM memory sidecar, I'll keep an eye open. But you know, in all of my years with the machine I've not needed that much memory on one. (That's right - I haven't don that modification, nor plan on it. But I can help you when the time comes to do yours.)