Thank you for reporting this issue. How many layers do you have in the Timeline when it takes 2 seconds for them all to be selected? And do you have any third-party panels running at the same time? This type of performance degradation is often made worse by third-party panels that watch for selected layers.
Thanks for reporting this issue and for any further information you can provide,
- John, After Effects Engineering Team