Removing white box from background

Hi

I'm just learning to use Illustrator, and when I open a new file there is always a white square in the background. The delete button won't work to remove it. Can someone advise how to get rid of this? I imagine this is very basic, but I'm only a couple of hours into learning.