Pattern Issue

There are several reasons for the large gaps. The large gaps tend to appear a lot more often when you create a pattern not using the pattern editor. At the end of the video I'm showing how I would make that pattern with the pattern editor and the appearance panel.

But if you are not using the pattern editor then you need the invisible rectangle and even if you have an invisible rectangle it can go wrong.