When editing the color of a Character Style - takes forever to change the color

This is a recently thing, as I often change the main colors of a template's character styles. Now, when I try to edit the color of a character style and I normally drag the color indication circle from black to white. When that is done now, all the colors of all the styles in the prototype change while I'm busy dragging the color indicator. This causes a huge slow-down and the colors on the entire mockup takes about 1-3 seconds to change from black to white.