You only have to pay penalties for filing late if you owe taxes. If you are due a refund you won’t have to pay any penalties at all.