How do I disallow moderator's from having access to forums that I do not want them to?

Example, I have a moderator moderating one forum (posting, etc.), yet they can post in forums that I have restricted to just me.

Thanks,
- GSH -