What I did for this was create a group non pm's. I copied the same permissions from user group than removed pm access. When a member we want removed from having pm's I unchecked their user permission from user and check the one that says non pm's.
I have not had a problem yet.
