Yes – but this should be one of the last things you do as part of the cessation process.
You should keep your company bank account open until you have completed and agreed your cessation accounts, settled all your company liabilities and withdrawn any final amounts you are entitled to do so either as dividends or as a capital distribution based on your circumstances. Once this has been done, you can then close your company bank account.
Whilst undertaking the cessation process for your limited company, there are a number of processes which necessitate you having a functioning bank account. For instance, you may be waiting for a refund from HMRC. In these circumstances, we would not advise that you to close your company bank account until you receive all funds due to your company and completed all aspects of the cessation process.