You can limit the rights/access of your moderators.
It just depends on what you want to allow a moderator to be able to do.
For instance
Group Management ยป CP Permissions
for moderators
set to 0
Can edit users
Has full access to the control panel.
They can still moderate the forum they are assigned to.
They just won't have access to the control panel.