Center Console Lid / Arm Rest Remoal

On my center console the plastic hinge broke a while ago and now the plastic switch hook that holds it in place finally broke and it's time to replace it. I tracked down an old stock OEM console lid and ordered it today. I was going to remove the old 3 section hinge setup that was still stuck in the base but I'm not quite sure how to get it out. I started prying it but it doesn't seem to want to pop out. I was wondering if there is a trick to getting it out or if I just need to pry the crap out of it. I just don't want to leave any broken plastic in the base.