Could you add inline delete at some point and have this as a seperate security setting from normal delete (in fact could you also split inline add/edit from the normal ones as well?)
Inline delete would just add a wastebasket or similar beside each item.
It would be useful though to be able to enable/disable this functkionality on a per group basis.