Deleting component code in /apps deletes its references in content pages

I have deleted a component and its coresponding java files. When I do a build to my local instance, the component is deleted as expected.
But in our QA environment found the references of this component in pages is also deleted (verified the page node structure in CRXDE).
Any idea, what is happening here?