I think that you can only do this if the forums are set as Teaser forums.
Then go to CP > Display Options > General > Primary tab > Forum Summary Options and remove the check from 'Show latest post in teaser forum'.
Show latest post in teaser forum
Enabling this option will show the latest post for teaser forums. Otherwise, a message stating the forum is private will be added.