Hover Scrub not working in certain project bins

I have hover scrub enabled, yet for some reason it will randomly stop working only for specific bins in my project panel. For exemple, one bin of footage from one camera will allow me to hover scrub but another will not. This happens totally randomly and only seems to fix if I close out premiere and restart, only for it to stop working again an hour later. 

Is there a something I am doing wrong? I rely on hover scrub to help me edit at a faster pace and having to constantly restart premiere is not helping...