When I want to draw on a layer and select it for that purpose, Illustrator always selects all the objects on that layer. When zoomed in and no empty place on the artboard, this might get irritating.
Maybe there could be a deselect option in the task bar? The deselect all keyboard shortcut is not obvious (but thankfully works)