To delete public folder, login to the MSPControl and click on Public Folders,
or go to Organization > Exchange > Public Folders.
You will see all public folders you have. Check the one or several folders you want to delete in the left and click Delete Selected Folders.
Click OK when prompted.