Panel on the left side is always open

Whenever I selecting something (if only to arrange it), the corresponding panel on the left side opens. This is taking away my screen estate and it's distracting. I know how to open the panels. Please don't automatically open them.