I am sure Rick can get your access back for you. You might want to submit a Support Ticket.
If you don't want you Admins. to have access to the CP, you make the Global Mods instead of Admins. Global Mods have access to all the threads and don't have to be assigned to an area like a normal Mod.
I trust the people that I have made Admins. with the CP. I want someone other than myself to have access to the control panel.