Do/are the rubber sleeves supposed to just pull out? Is there a trick?
Yes there is. The "tunnel" that the rubber sleeves fit into is not perfectly square all the way. (Probably due to the fact that these bumpers were a retrofit for the US cars.) About 3 or 4 inches in, that tunnel widens a bit. Over the years, especially if the car has been in hot weather, the rubber starts to reshape and fill in this wider area. The result is that the sleeve feels loose and does not seem to be attached by anything but half way down its length it is stuck in its tunnel.
The only solution I could find is to take a long hacksaw blade and cut a quarter inch wide channel out of the bottom of the length of the sleeve. Then I inserted a long screwdriver on the side of the tunnel to push the rubber side inward enough that could pull the whole sleeve out past that wider area with the help of some pliers.
Hope that makes sense.
BTW, try not to butcher those sleeves too much bc you will need them again to insert the new adapters for your early bumpers. (Search "pamp brackets" for details.)
Crappy photo of the sleeve after being wrestled out. You can see that the back end (closer to camera in this shot) is wider than the front which made it hard/impossible to get out easily.