Seat belt height adjustment knob

I have a 98 Grand Cherokee. A while back I needed to remove some panels for some wiring modification. I needed to remove the seat belt adjuster for the back seat to access the panel behind it. Could not for the life of me figure out how to remove the adjustment knob. I was able to remove the panel without removing the knob; but can not re install this way. Please; someone tell me how to remove this knob. I have about an hour of time in this and have almost broke it at least twice. PLEASE HELP!