Filling "Complex" vector with background image

I have a line image drawing that I would like to fill with a camouflage type pattern that I currently have in .png. I understand that by using clipping mask on a simple vector I can fill a simple vector path with my pattern, so by applying that concept I converted my line drawing to a vector, which is now a combination of multiple paths by using image trace, ignoring white to get rid of the bound box. I then make a compound path, selecting place to add my pattern to the tab, send my pattern to the back using arrange, and then selecting both layers with my vector in front I apply clipping mask. Instead of the inside of the vector being filled with the pattern, it turns the lines that were black into the camo pattern. I must be missing something obvious, but I'm fairly new to illustrator so any help is much appreciated!