Unfortunately I haven't really used the Subscription Groups feature (which would allow users to pay via PayPal for inclusion into a group), so just a simple search here would give you about all of the information that I'd be able to get access to.
I'd mention the Postcount Groups article on wiki, but the settings there would have little to do with a Subscription Group.