Stream.play on server side makes video choppy

Sure

I'll try to break it down a bit. Sorry if I miss any essential lines in the prosess

client side:

//Really basic.. Connection to rtmp and so on.
nc = new NetConnection();
nc.connect("rtmp://mydomain/application");
-------------------------------------------------------------------------------------------
   //OnNetStatus -> connecting NetStream to Video and playing a live stream: "myStream"
   private function onNetStatus(e:NetStatusEvent):void {
        if (e.info.code == "NetConnection.Connect.Success") {
           
            vid = new Video();
            videoHolder.addChild(vid);
            ns = new NetStream(nc);
            ns.addEventListener(NetStatusEvent.NET_STATUS, onNetStatus, false, 0, true);
        
            vid.attachNetStream(ns);
            ns.play("stream");
        } 
    }
-------------------------------------------------------------------------------------------
//On some event -> call server side function providing the stream name for the file on the same server.
nc.call("switchStreamRecorded", null, fileStream);

Really basic. NetConnection connection to my rtmp and so on..

Server side:

//Getting the right stream and playing my file on that stream
Client.prototype.switchStreamRecorded = function(fileToPlay) {
    trace("playing file: " + fileToPlay);
    application.myStream = Stream.get("stream");
    application.myStream.play(fileToPlay, 0, -1, true);
};

Let me know if there's anything else of my code you would like to see, but I think this is the basic.

This works great for live streams. I've been using the example for Stream.play for chaining streams between servers from adobe and no problem with that. Don't get why this should be a problem.