I'll assume you're using the latest licensed version since you haven't specified.
Go into the CP, Forum Settings, Details for the relevant forums, and mark them private.
That will restrict them to admin users, moderators of those forums (if any), and any other authorized user, as designated by you. The other registered users will not have access.
Graeme