I switched to the GD2 option in "Attachments" and now the pixel size is being reduced to the chosen settings. I'm able to get 800 pixel images at 80% compression and still get nice optimized file sizes.

Always thought ImageMagick did a little nicer optimization, so I hope the bug can be resolved.

Thanks!