This post describes how to recreate your public website. This is probably only necessary then you have created it in work language. You will always get a default homepage when you’re done.
First of all, open your SharePoint Admin Center, select the public facing website, and delete it.
Wait a few seconds, refresh your browser, and then press New à Public Website
Then fill the form with some logical information, and simply press OK.
If you receive a warning saying that you have this site in your Recycle bin, just check the box, and confirm the deletion. This is, if you are really sure that you don’t need anything from the old site.