Are you specifying the full path to the directory? You need to make sure it's the full path from the server root. It should look something like the PATH setting from the DB & Paths & URLs section of the control panel.