I have never seen a dingus to go from a 286 directly to a 168-pin 486, but I have seen modules that let you go from a 286 to a 386DX or 486DLC. In theory if you could remove the CPU, you could upgrade it further with something like a Cyrix DRx2 or a SXL2. There are also adapters that let you go from a 386 to a 486, but it's likely that using two of these adapters together wouldn't work, and it would be quite bulky.
The best direct upgrade I've seen is the Evergreen modules that upgrade you to a 486SLC2-66, but I haven't been 100% successful getting mine to work properly.
A board replacement is of course way easier, but also not nearly as fun.