Position and scale in 3D not working well

Hi, so I created this illustration I wanted to animate as a 3D. I moved the position of the wall to 1000 but it does not allow me to scale back to the original position without looking like that. Picture above. Please help if you have a solution


