I believe you only get the Cancel all changes and dismiss Camera Raw dialog when pressing the Cancel button or Esc key if you actually did some editing to the image.
If you just open a Camera Raw file, then press either Cancel or Esc you won't get the Cancel all changes and dismiss Camera Raw dialog because you didn't change any settings.
I would reset the Camera Raw preferences to get the Cancel all changes and dismiss Camera Raw dialog back
