I having a bit of trouble understanding the problem... or remembering exactly the details. Have you fully withdrawn all the bolts? There may be a split journal that the tip of a screwdriver, driven in a bit, would help....?
If there are a number of miles on this vehicle, I would ask you to consider replacing the whole steering rack. It is worn internally, you can be sure ... and with a remanufactured rack you get a good tight steering .... all new boots and seals ... and new inner tie ends.
I never rebuild/replace inner tie ends anymore.