If it has a good seal to the shaft, and I assume it has, I would be tempted to try hydraulics. Tap the end of the adapter to
take a grease nipple, fill the void with some kind of oil, insert grease nipple, and pump it up with a gun.
Can't tell from the pic if the hole in the end of the adapter goes all the way to the shaft, if not, drill it out carefully first.