If you decline them with no reason specified, they do not get notified. If you put in a reason they are being declined it will notify them along with the reason.