Slow connections (100+) when changing shared object

We have a flash media server 3 running that we mainly use for the shared object functions.
When we run the server with less then 100 connections everything runs fine, but when the connections are over the 100 and the shared object is changed the problems begin. All clients recieve the update of the shared object very slow and are not in sync anymore.

We are running 3.0.7 r202 on a P4 with 4 GB of ram with a 100mbit internet connection on a linux machine. The system load is NOT over 1 when running in to the problems, also the CPU use is not more then 20% and the memory use not more the 25%. Bandwidth of the server is up to 5 mbit.

The core, edge and master logs are clear, no errors at all.

We also have no extra configurations made in the configs, all is default.