The Delete Note Button appears in the Toolbar when editing a note that has already been saved.

When you click the button, you are prompted to make sure you really want to delete the note. Click OK to delete the note or Cancel to not delete the note.