Procreate> Photoshop > Character Animator - Coloring layer not connected to line layer in scene mode

So I drew a character in procreate, exported it as a PSD, edited the layer structure in photoshop, saved it and then imported it into character animator. Most everything works fine except the color layer. In Procreate I painted in/colored my character as a separate layer so as not to draw over the outlines I made. But when I open scene mode in Ch the line art separates from the color layer and you get this sort of "peel away" look when I move the character. I tried to simply place the colored layer in Ps into the body layer group to see if it would "attach" to the lines, but it didn't work. Is there another way to merge both the line art and color layers?

I think that the workaround for this may be to just go into Ps, duplicate the color layer for each body part, then maks out the color to each body part specifically and then merge each color and line layer for each body part individually so that the color is permanently attached to each body part. This would be a lot of extra work though so I'm hoping there is an easier way.