Delete from disk (ctrl+delete) does not delete the original file. I still need to navigate to the folder in the file explorer to delete it manualy.

Has Ctrl+Delete ever worked inside Premiere?

The only way i know to do the same inside Premiere is to use the Make Offline command and check the Media Files Are Deleted.