Yes, Bojan is right. This is all dependent on the lighting. They have to be shot in identical lighting, and they have to be shot in very diffuse light to avoid reflections and deep shadows.
In the studio I'd do this with large soft boxes and possibly a light tent - but outside on an overcast day usually works pretty well. Just be a bit careful and use your eyes, you can still get direct light source reflections. The red bag has a lot of it, and you need to change the angle to get rid of the most of it.
There's no way to do this numerically. The values change with the angle to the light. Any meaningful comparison will have to be made on surfaces with exactly the same angle to the light.
Also be aware that different colors have different inherent brightness. You can't change a bright yellow to a dark purple just by changing the color component - you have to rebuild the whole tonal curve. It's a lot harder than most people think.

Just to get a baseline for neutral light and exposure, you can use a Colorchecker:

Oh, and use a poarizer. They can be surprisingly effective:

Thank you, was afarid of that 🙂 Means we have to build samples in the other colors to make them correct.
Appreciate the feedback.