Search order. How to not search pasteboard first?

I'm constantly opening old projects and searching for content to reuse. 

It is incredibly annoying that InDesign always first searches through the useless crap I have on my pasteboard and only then what I actually want... the stuff that's actually visible in print.

Is it possible to change that?