Hey! I had the SAME problem... solved in 30 minutes because I had put CC on my laptop and the Quick Selection tool is fast, but on my Mega-fast desktop (16gb, 4.2Ghz, blah, blah) Photoshop CC was DRAGGING BUTT.
The difference is I loaded the desktop from scratch. The Laptop had CS5 prviously, and PS copied the settings from Edit/Preferences/Performance that existed in CS5... it was all about the History & Cache section. Hit "Big and Flat" for the 1024K cache tile size, and it set the cache states to 6. I backed that up to 4... eh whatever 
You are welcomed 
(I was about to uninstall the PS CC! It's all good now... BTW - I even yanked out the Nvidia GTS450 thinking it was a driver issue, but there was no difference with the onboard Intel HD Haswell i5 4th gen graphics... so, don't do that!)
[edited] I just did some experimenting, 8 levels with a small cache size works too... so, just get out of the 2 levels at 128k if that is what you are set at. I am at Big and Flat which is 6 levels/1024K.
Tim