Yes, you can and you only have to pay interest earned back to the bank. If you want to close the account before the due date, you have to bring along the certificate.