How to select swatch color from the color picker

I've taken the time to figure out the Hex codes for the most common colors the colorization neural filter is creating so that I can choose colors photoshop is already creating when I edit color in the "focal points" panal of the colorization window. By doing this, I'm adding in colors that work with the colors the Photoshop A.I. is already producing. So for instance, if the A.I has missed some body parts that should be flesh color, the points I add will match the other parts of the flesh that the A.I. did properly. The problem is when I click on the "focal point" image that's presented, the color picker comes up and I can only figure out how to get to the color I want by entering the Hex code which is more difficult than simply choosing my color from my custom swatches. How do I secect from my custom swatches from the color picker?