How to Convert Smart Object to layers & preserve transforms

Hey everyone,

I am doing a digital painting of a city where each facade/face is painted flat, and then converted into a smart object and warped in my illustration.

Each window/brick has its own separate layer.

How can I convert this from a smart object BACK into a regular layer while preserving the layers & the transformation? This is so I can continue painting and adding details to the windows, bricks, etc in my document.

At the moment I get this message when trying to convert to layers:

After which it undoes my transformation.

Thanks!