How to remove the foreground of a video clip

Dear friends,

I have footage of a tennis match. I had to film it from behind a fence. It was not allowed to be on the court itself.

The fence itself is 3 meters high and has square openings of about 7 x 7 cm and obstructs a good sight of the court and the ongoing game.

Can anybody tell me how I can rcompletely can remove this fence from my film? On the internet I only found found tools and-or software to remove the background which I do not need at all.

Many thanks in advance.