If your payment is more than 15 days overdue, first and second late payment penalties apply.
https://www.gov.uk/guidance/how-late-payment-penalties-work-if-you-pay-vat-late