Calendar items which are part of contract confirmations can not be deleted.
Calendar items which are added manually can be deleted. Go to the calendar item. On the row of the calendar item, on the far right is a trash-bin. By clicking on it you will get a modal asking you if you are sure if you want to delete the item.