I am not sure if Adobe understands this issue, reportedly fixed in 13.0.4 but to me still an issue.
Maybe I am doing something wrong.
I have about 100 files in a folder marked RAW and about the same number in a folder marked JPG.
If I select the last file in the RAW folder panel, then navigate in the folder panel to the JPG panel, then navigate back to the RAW folder in the folder panel, the panel jumps to the first file in the RAW folder.
This slows down my workflow as I have to scroll down to the needed file.
I know exactly what you're talking about, and it's a pain-in-the-lower-half.
Similarly, if I have a folder with many files and types of files (e.g., files and folders), If I scroll down and open a folder as a new window, when I close that new window, Bridge has self-scrolled back up to the top. Same issue, same pain.
Hopefully, Adobe sees this thread and fixes it.
I have logged it the bugs list.