Path won't pick up library colours - sometimes

I've got some colours saved in various libraries and most of the time I can select an object and click on the library swatch to select that colour, and the object picks it up as expected. But sometimes, it just won't pick up the colour. Sometimes within the same file one object will work with the library colours whilst others won't. Anyone know why?

: )