Shift + Delete
to permanently delete a selected item, bypasses the Recycle Bin.