I would use the setting defaulted in my_huge.cnf. Not so sure in version 4 of MySQL but if you allowcate to much memory for paging, indexing etc.. it can have an adverse effect. we are working with standard table types here not innodb.
I have always had good luck with the defaulted settings in version 4. I run Version MySQL 5 now.