I have seen no real solutions to this over the years so I am assuming there might be a technical reason Adobe doesn't do this. 3rd party app SageThumbs is no longer actively updated and I tried several others unsatisfactorily with Windows 11.
Possibly one solution for those with Creative Cloud would be for Adobe to add a "Open this Folder in Bridge" option in Windows Explorer. At least you wouldn't have to navigate to the folder, realize you can't see the PSD and PSB thumbs and then open Bridge and navigate.
I've tried all the other fixes, several utilties, the preview pane etc etc. This seems to me to be at least a workable solution. It is a pain in the butt when you work with mixed files including Photoshop, and getting everyone in the office to use to Bridge to solve what should be a simple ask like viewing a thumbnail isn't likely to happen.