Livestream CORS issue on random .ts files

We have AMS set up on our site and we have it set up so that livestreams can run on any domain. The issue is , during livestream playback in our html5 player, random .ts files will have a CORS issue. Not all of them, just 1 every now and then. Generally the stream can be viewed on any domain. Just segments of the stream seem to run into a CORS issue. 

In our player we are laodng up a HLS .m3u8 url to the stream over https. 

In the webroot of the AMS we have a crossdomain.xml file set up using 

<cross-domain-policy>

        <site-control permitted-cross-domain-policies="master-only"/>

        <allow-access-from domain="*"/>

        <allow-http-request-headers-from domain="*" headers="SOAPAction"/>

</cross-domain-policy>

We also have our .htaccess file allowing CORs by using 
<IfModule mod_headers.c>
Header set Access-Control-Allow-Origin *
</IfModule>

Then in our Apache2.4 we have our config files

(httpd)

both using 

Header set Access-Control-Allow-Origin "*"

Does any one have any ideas why a random .ts file would have a CORS issue? Has any one else run into this issue before??