You can now "Archive" labels which will permanently remove them from the Jolt UI. Just open the more options menu (three dots) on the top right hand corner of the screen when you are looking at the label details page in the Jolt Web Portal.

Once Archived, the label will still be recoverable if you contact Jolt support but other than that, it is essentially deleted and it is removed from the UI completely.