Yes, just get in touch with your employers payroll department to stop further payments.