Vector trimming

I drew with the vector brush. I then made a pencil layer on top to later trace back on my vector layer. When I use the touch modifier to trim out overlapping lines it erases my entire drawing. The touch modifier works perfectly if I just stay on layer and edit. Is this how its suppose to be, draw first with vector, edit that layer with trimming, add sketch layer then come back and do adjustments to new vector lining?