First make sure the Circles tab is selected by clicking it.
Then right click on a circle, and select “Delete circle.”