Skip to main content
July 25, 2014
Question

HLS Live Streaming / LivePkgr issues

  • July 25, 2014
  • 4 replies
  • 5526 views

Greetings!

We just began using AMS for live streaming with HLS and we encouter some serious issues. Our first commercial live event is scheduled to next Wednesday and we cannot afford to lose our customer so your help is greatly appreciated.

We have two issues which are probably related :

  1. When we start streaming all goes well for the first couple minutes but passed that point the stream gets less fluid. In the video player you can see a pause - dropped frames? - then the stream resumes fines. Then after say 30 seconds another pause and so on. If we stream for long enough the player finally goes black and the stream cannot be resumed.
  2. We experience some random AMS service shutdown every other day or so. The server just stops streaming for an unkown reason. Please have a look at our edge log below. Looks like we have some recuring "bind failed" errors but I have no idea if they are related.

Again your help is greatly appreciated. On a side note we would be happy to purchase per-incident support from Adobe to solve the issue asap but it looks it's not available anymore. Anybody from the staff feel free to PM me about it.

Link : http://www.webtv.coop/group/Test-WebTV/f9b9c899885569fa901a787fcdb08568

User : test

Pass : test

Thanks a bunch,

Ph.

edge.00.log

#Version: 1.0

#Start-Date: 2014-07-25 00:02:45

#Software: Adobe Media Server 5.0.3 r3029 x64

#Date: 2014-07-25

#Fields: date   time    x-pid   x-status        x-ctx   x-comment

2014-07-25    00:02:40        28648   (i)2581173    Host: videodb.webtv.coop IPv4: 10.2.2.8 -

2014-07-25    00:02:40        28648   (i)2631180    Info from AccessAdaptor: Access Adaptor started /opt/adobe/ams/modules/access/libconnect.so.    -

2014-07-25    00:02:40        28648   (e)2631013    Failed to create listener for adaptor backup_defaultRoot_, IP localhost, port 19350: TCCommBridge::createListener 127.0.0.1:19350/v4: bind failed!!!.   -

2014-07-25    00:02:40        28648   (e)2631013    Failed to create listener for adaptor backup_defaultRoot_, IP , port 1935: TCCommBridge::createListener 0.0.0.0:1935/v4: bind failed!!!.        -

2014-07-25    00:02:40        28648   (e)2631114    Failed to start listeners for adaptor backup_defaultRoot__edge1.        -

2014-07-25    00:02:40        28648   (e)2791225    Failed to start edge : backup_defaultRoot__edge1        -

#Date: 2014-07-25

#Fields: date   time    x-pid   x-status        x-ctx   x-comment

2014-07-25    00:04:50        28847   (i)2581173    Host: videodb.webtv.coop IPv4: 10.2.2.8 -

2014-07-25    00:04:50        28847   (i)2631180    Info from AccessAdaptor: Access Adaptor started /opt/adobe/ams/modules/access/libconnect.so.    -

2014-07-25    00:04:50        28847   (e)2631013    Failed to create listener for adaptor backup_defaultRoot_, IP localhost, port 19350: TCCommBridge::createListener 127.0.0.1:19350/v4: bind failed!!!.   -

2014-07-25    00:04:50        28847   (e)2631013    Failed to create listener for adaptor backup_defaultRoot_, IP , port 1935: TCCommBridge::createListener 0.0.0.0:1935/v4: bind failed!!!.        -

2014-07-25    00:04:50        28847   (e)2631114    Failed to start listeners for adaptor backup_defaultRoot__edge1.        -

2014-07-25    00:04:50        28847   (e)2791225    Failed to start edge : backup_defaultRoot__edge1        -

#Date: 2014-07-25

#Fields: date   time    x-pid   x-status        x-ctx   x-comment

2014-07-25    00:07:00        29817   (i)2581173    Host: videodb.webtv.coop IPv4: 10.2.2.8 -

2014-07-25    00:07:00        29817   (i)2631180    Info from AccessAdaptor: Access Adaptor started /opt/adobe/ams/modules/access/libconnect.so.    -

2014-07-25    00:07:00        29817   (e)2631013    Failed to create listener for adaptor backup_defaultRoot_, IP localhost, port 19350: TCCommBridge::createListener 127.0.0.1:19350/v4: bind failed!!!.   -

2014-07-25    00:07:00        29817   (e)2631013    Failed to create listener for adaptor backup_defaultRoot_, IP , port 1935: TCCommBridge::createListener 0.0.0.0:1935/v4: bind failed!!!.        -

2014-07-25    00:07:00        29817   (e)2631114    Failed to start listeners for adaptor backup_defaultRoot__edge1.        -

2014-07-25    00:07:00        29817   (e)2791225    Failed to start edge : backup_defaultRoot__edge1        -

#Date: 2014-07-25

#Fields: date   time    x-pid   x-status        x-ctx   x-comment

2014-07-25    00:09:10        30014   (i)2581173    Host: videodb.webtv.coop IPv4: 10.2.2.8 -

2014-07-25    00:09:10        30014   (i)2631180    Info from AccessAdaptor: Access Adaptor started /opt/adobe/ams/modules/access/libconnect.so.    -

2014-07-25    00:09:10        30014   (e)2631013    Failed to create listener for adaptor backup_defaultRoot_, IP localhost, port 19350: TCCommBridge::createListener 127.0.0.1:19350/v4: bind failed!!!.   -

2014-07-25    00:09:10        30014   (e)2631013    Failed to create listener for adaptor backup_defaultRoot_, IP , port 1935: TCCommBridge::createListener 0.0.0.0:1935/v4: bind failed!!!.        -

2014-07-25    00:09:10        30014   (e)2631114    Failed to start listeners for adaptor backup_defaultRoot__edge1.        -

2014-07-25    00:09:10        30014   (e)2791225    Failed to start edge : backup_defaultRoot__edge1

core.00.log

#Version: 1.0

#Start-Date: 2014-07-25 09:56:08

#Software: Adobe Media Server 5.0.3 r3029 x64

#Date: 2014-07-25

#Fields: date   time    x-pid   x-status        x-ctx   x-comment

2014-07-25    09:56:08        18327   (w)2581173    /opt/adobe/ams/applications/livepkgr/events/_definst_/canal91event/Event.xml does not exist or is invalid.    -


master.00.log


#Version: 1.0

#Start-Date: 2014-07-25 00:00:33

#Software: Adobe Media Server 5.0.3 r3029 x64

#Date: 2014-07-25

#Fields: date   time    x-pid   x-status        x-ctx   x-comment

2014-07-25    00:00:30        17555   (i)2581226    Edge (28097) is no longer active.    -

2014-07-25    00:00:30        17555   (w)2581255    Edge (28097) backup_defaultRoot__edge1 experienced 1 failure!        -

2014-07-25    00:00:30        17555   (i)2581224    Edge (28338) started, arguments : -edgeports ":1935" -coreports "localhost:19350" -conf "/opt/adobe/ams/conf/Server.xml" -adaptor "backup_defaultRoot_" -$

2014-07-25    00:02:40        17555   (i)2581226    Edge (28338) is no longer active.    -

2014-07-25    00:02:40        17555   (w)2581255    Edge (28338) backup_defaultRoot__edge1 experienced 1 failure!        -

2014-07-25    00:02:40        17555   (i)2581224    Edge (28648) started, arguments : -edgeports ":1935" -coreports "localhost:19350" -conf "/opt/adobe/ams/conf/Server.xml" -adaptor "backup_defaultRoot_" -$

2014-07-25    00:04:50        17555   (i)2581226    Edge (28648) is no longer active.    -

2014-07-25    00:04:50        17555   (w)2581255    Edge (28648) backup_defaultRoot__edge1 experienced 1 failure!        -

2014-07-25    00:04:50        17555   (i)2581224    Edge (28847) started, arguments : -edgeports ":1935" -coreports "localhost:19350" -conf "/opt/adobe/ams/conf/Server.xml" -adaptor "backup_defaultRoot_" -$

2014-07-25    00:07:00        17555   (i)2581226    Edge (28847) is no longer active.    -

ams.ini

###########################################################################

# ams.ini contains substitution variables for Adobe Media Server #

# configuration files. Lines beginning with '#' are considered comments. #

# A substitution variable is in the form <name>=<value>. Everything up to #

# the first '=' is considered the name of the substitution variable, and #

# everything after the first '=' is considered the substitution value. If #

# you want a substitution variable to have leading or trailing spaces, #

# enclose the value around double quotes. For example, foo=" bar " #

###########################################################################

###############################################################

# This section contains configurable parameters in Server.xml #

###############################################################

# Username for server admin

# For example:

# SERVER.ADMIN_USERNAME = foo

#

SERVER.ADMIN_USERNAME = admin

# IP address and port Adobe Media Admin Server should listen on

# For example:

# SERVER.ADMINSERVER_HOSTPORT = :1111

#

SERVER.ADMINSERVER_HOSTPORT = :1111

# User id in which to run the process (Linux Only)

# For example:

# SERVER.PROCESS_UID = 500

#

SERVER.PROCESS_UID = 500

# Group id in which to run the process (Linux Only)

# For example:

# SERVER.PROCESS_GID = 500

#

SERVER.PROCESS_GID = 500

# License key for Adobe Media Server

# For example:

# SERVER.LICENSEINFO = XXXX-XXXX-XXXX-XXXX-XXXX-XXXX

#

SERVER.LICENSEINFO = (license goes here)

# LIVE_DIR denotes the full path of sample "Live" application's

# folder for storing any live stream recorded by server. 

# For example:

# LIVE_DIR = <AMS_Installation_Dir>\applications\live

#

LIVE_DIR = /opt/adobe/ams/applications/live

# VOD_COMMON_DIR denotes the full path of sample "VOD" application's

# folder for storing onDemand and Progressive Download .flv/.mp3 files.

# File stored in this folder can be streamed and are also PD-able.

# Note : If you are using the default installation of Apache as a webserver,

# and if you modify VOD_COMMON_DIR, please change the document root

# accordingly in httpd.conf.

# For example:

# VOD_COMMON_DIR = <AMS_Installation_Dir>\webroot\vod

#

VOD_COMMON_DIR = /opt/adobe/ams/webroot/vod

# VOD_DIR denotes the full path of sample "VOD" application's

# folder for storing onDemand only .flv/.mp3 files. Files stored in

# this folder are not PD-able

# For example:

# VOD_DIR = <AMS_Installation_Dir>\applications\vod\media

#

VOD_DIR = /opt/adobe/ams/applications/vod/media

# The maximum size of the FLV cache, in megabytes.

# The default is 500MB.

#

SERVER.FLVCACHE_MAXSIZE=500

# Whether to start and stop the included HTTP server along

# with AMS.

#

SERVER.HTTPD_ENABLED = true

# Whether to start and stop the cache cleaning tool along

# with HTTP server.

#

SERVER.HTCACHECLEAN_ENABLED = true

# The path specifying the cache root for webserver caching.

#

SERVER.HTCACHEROOT = /opt/adobe/ams/Apache2.2/cacheroot

################################################################

# This section contains configurable parameters in Adaptor.xml #

################################################################

# IP address and port(s) Adobe Media Server should listen on

# For example:

# ADAPTOR.HOSTPORT = :1935,80

#

ADAPTOR.HOSTPORT = :1935

# IP (address and) port that Adobe Media Server should proxy

# unknown HTTP requests to. Leave empty to disable proxying.

# With no address, specifies a localhost port.

# For example:

# HTTPPROXY.HOST = webfarm.example.com:80

#

HTTPPROXY.HOST = :8134

#This tag specifies an IP address for the player to use instead of a hostname when

#making the RTMPT connection to AMS. If nothing is specified, AMS will automatically

#determine the IP to use.

#

ADAPTOR.HTTPIDENT2 =

##############################################################

# This section contains configurable parameters in Vhost.xml #

##############################################################

# Application directory for the virtual host

# For example:

# VHOST.APPSDIR = C:\myapps

#

VHOST.APPSDIR = /opt/adobe/ams/applications

####################################################################

# This section contains configurable parameters in Application.xml #

####################################################################

# List of semi-colon delimited paths in which to search for script to load

# For example:

# APP.JS_SCRIPTLIBPATH = C:\scripts;C:\Program Files\Foo\scripts

#

APP.JS_SCRIPTLIBPATH = /opt/adobe/ams/scriptlib

###############################################################

# This section contains configurable parameters in Logger.xml #

###############################################################

LOGGER.LOGDIR =

####################################################################

# This section contains configurable parameters in Users.xml #

####################################################################

# Enable or disable using HTTP requests to execute admin commands. 

# Set to "true" to enable, otherwise it will be disabled. The 

# actual commands permitted for server admin and virtual host admin 

# users can be set in Users.xml. 

USERS.HTTPCOMMAND_ALLOW = true



    This topic has been closed for replies.

    4 replies

    August 6, 2014

    Hi again everyone.

    Thanks Charles for offering a solution but unfortunately still not working. Please see details below.

    Netstat while AMS running :

    [root@videodb ams]# netstat -tulpn

    Active Internet connections (only servers)

    Proto Recv-Q Send-Q Local Address              Foreign Address            State      PID/Program name

    tcp        0      0 0.0.0.0:2049                0.0.0.0:*                  LISTEN      -                

    tcp        0      0 0.0.0.0:5666                0.0.0.0:*                  LISTEN      22502/nrpe        

    tcp        0      0 127.0.0.1:8005              0.0.0.0:*                  LISTEN      19768/java        

    tcp        0      0 0.0.0.0:8134                0.0.0.0:*                  LISTEN      2309/httpd        

    tcp        0      0 127.0.0.1:11110            0.0.0.0:*                  LISTEN      29001/./amsadmin  

    tcp        0      0 0.0.0.0:806                0.0.0.0:*                  LISTEN      8256/rpc.statd    

    tcp        0      0 0.0.0.0:807                0.0.0.0:*                  LISTEN      27760/rpc.rquotad

    tcp        0      0 127.0.0.1:199              0.0.0.0:*                  LISTEN      8765/snmpd        

    tcp        0      0 0.0.0.0:8009                0.0.0.0:*                  LISTEN      19768/java        

    tcp        0      0 0.0.0.0:3306                0.0.0.0:*                  LISTEN      12980/mysqld      

    tcp        0      0 0.0.0.0:1935                0.0.0.0:*                  LISTEN      8690/amsedge      

    tcp        0      0 0.0.0.0:111                0.0.0.0:*                  LISTEN      8123/portmap      

    tcp        0      0 0.0.0.0:8080                0.0.0.0:*                  LISTEN      19768/java        

    tcp        0      0 0.0.0.0:80                  0.0.0.0:*                  LISTEN      2309/httpd        

    tcp        0      0 0.0.0.0:819                0.0.0.0:*                  LISTEN      27776/rpc.mountd  

    tcp        0      0 127.0.0.1:19350            0.0.0.0:*                  LISTEN      8690/amsedge      

    tcp        0      0 0.0.0.0:22                  0.0.0.0:*                  LISTEN      8790/sshd        

    tcp        0      0 0.0.0.0:1111                0.0.0.0:*                  LISTEN      29001/./amsadmin  

    tcp        0      0 0.0.0.0:49209              0.0.0.0:*                  LISTEN      -                

    tcp        0      0 127.0.0.1:25                0.0.0.0:*                  LISTEN      9323/master      

    udp        0      0 0.0.0.0:2049                0.0.0.0:*                              -                

    udp        0      0 10.2.2.8:1935              0.0.0.0:*                              8690/amsedge      

    udp        0      0 127.0.0.1:1935              0.0.0.0:*                              8690/amsedge      

    udp        0      0 0.0.0.0:57615              0.0.0.0:*                              -                

    udp        0      0 10.2.2.8:19350              0.0.0.0:*                              8690/amsedge      

    udp        0      0 127.0.0.1:19350            0.0.0.0:*                              8690/amsedge      

    udp        0      0 0.0.0.0:800                0.0.0.0:*                              8256/rpc.statd    

    udp        0      0 0.0.0.0:161                0.0.0.0:*                              8765/snmpd        

    udp        0      0 0.0.0.0:802                0.0.0.0:*                              27760/rpc.rquotad

    udp        0      0 0.0.0.0:803                0.0.0.0:*                              8256/rpc.statd    

    udp        0      0 0.0.0.0:816                0.0.0.0:*                              27776/rpc.mountd  

    udp        0      0 0.0.0.0:49875              0.0.0.0:*                              10305/avahi-daemon

    udp        0      0 0.0.0.0:5353                0.0.0.0:*                              10305/avahi-daemon

    udp        0      0 0.0.0.0:111                0.0.0.0:*                              8123/portmap      

    udp        0      0 10.2.2.8:123                0.0.0.0:*                              8824/ntpd        

    udp        0      0 127.0.0.1:123              0.0.0.0:*                              8824/ntpd        

    udp        0      0 0.0.0.0:123                0.0.0.0:*                              8824/ntpd


    Stopping server :


    [root@videodb ams]# ./server stop

    NPTL 2.5

    Stopping Adobe Media Server (please check /var/log/messages)

    Server has shutdown...

    Netstat after shutdown (ports 1935 and 19350 are free) :

    [root@videodb ams]# netstat -tulpn

    Active Internet connections (only servers)

    Proto Recv-Q Send-Q Local Address               Foreign Address             State       PID/Program name  

    tcp        0      0 0.0.0.0:2049                0.0.0.0:*                   LISTEN      -                  

    tcp        0      0 0.0.0.0:5666                0.0.0.0:*                   LISTEN      22502/nrpe         

    tcp        0      0 127.0.0.1:8005              0.0.0.0:*                   LISTEN      19768/java         

    tcp        0      0 127.0.0.1:11110             0.0.0.0:*                   LISTEN      29001/./amsadmin   

    tcp        0      0 0.0.0.0:806                 0.0.0.0:*                   LISTEN      8256/rpc.statd     

    tcp        0      0 0.0.0.0:807                 0.0.0.0:*                   LISTEN      27760/rpc.rquotad  

    tcp        0      0 127.0.0.1:199               0.0.0.0:*                   LISTEN      8765/snmpd         

    tcp        0      0 0.0.0.0:8009                0.0.0.0:*                   LISTEN      19768/java         

    tcp        0      0 0.0.0.0:3306                0.0.0.0:*                   LISTEN      12980/mysqld       

    tcp        0      0 0.0.0.0:111                 0.0.0.0:*                   LISTEN      8123/portmap       

    tcp        0      0 0.0.0.0:8080                0.0.0.0:*                   LISTEN      19768/java         

    tcp        0      0 0.0.0.0:819                 0.0.0.0:*                   LISTEN      27776/rpc.mountd   

    tcp        0      0 0.0.0.0:22                  0.0.0.0:*                   LISTEN      8790/sshd          

    tcp        0      0 0.0.0.0:1111                0.0.0.0:*                   LISTEN      29001/./amsadmin   

    tcp        0      0 0.0.0.0:49209               0.0.0.0:*                   LISTEN      -                  

    tcp        0      0 127.0.0.1:25                0.0.0.0:*                   LISTEN      9323/master        

    udp        0      0 0.0.0.0:2049                0.0.0.0:*                               -                  

    udp        0      0 0.0.0.0:57615               0.0.0.0:*                               -                  

    udp        0      0 0.0.0.0:800                 0.0.0.0:*                               8256/rpc.statd     

    udp        0      0 0.0.0.0:161                 0.0.0.0:*                               8765/snmpd         

    udp        0      0 0.0.0.0:802                 0.0.0.0:*                               27760/rpc.rquotad  

    udp        0      0 0.0.0.0:803                 0.0.0.0:*                               8256/rpc.statd     

    udp        0      0 0.0.0.0:816                 0.0.0.0:*                               27776/rpc.mountd   

    udp        0      0 0.0.0.0:49875               0.0.0.0:*                               10305/avahi-daemon 

    udp        0      0 0.0.0.0:5353                0.0.0.0:*                               10305/avahi-daemon 

    udp        0      0 0.0.0.0:111                 0.0.0.0:*                               8123/portmap       

    udp        0      0 10.2.2.8:123                0.0.0.0:*                               8824/ntpd          

    udp        0      0 127.0.0.1:123               0.0.0.0:*                               8824/ntpd          

    udp        0      0 0.0.0.0:123                 0.0.0.0:*                               8824/ntpd

    Restart :

    [root@videodb ams]# ./server start

    NPTL 2.5

    Starting Adobe Media Server (please check /var/log/messages)

    Content of edge.00.log :

    #Version: 1.0

    #Start-Date: 2014-08-06 14:39:17

    #Software: Adobe Media Server 5.0.3 r3029 x64

    #Date: 2014-08-06

    #Fields: date   time    x-pid   x-status        x-ctx   x-comment

    2014-08-06    14:39:12        15099   (i)2581173    Host: videodb.webtv.coop IPv4: 10.2.2.8 -

    2014-08-06    14:39:12        15099   (i)2631180    Info from AccessAdaptor: Access Adaptor started /opt/adobe/ams/modules/access/libconnect.so.    -

    2014-08-06    14:39:12        15099   (i)2631174    Listener started ( backup_defaultRoot__edge1 ) : localhost:19350/v4     -

    2014-08-06    14:39:13        15099   (i)2631174    Listener started ( backup_defaultRoot__edge1 ) : 1935/v4        -

    2014-08-06    14:39:14        15099   (i)2631174    Listener started ( backup_defaultRoot__edge1 ) : 127.0.0.1:19350 (rtmfp-core)/v4        -

    2014-08-06    14:39:14        15099   (i)2631174    Listener started ( backup_defaultRoot__edge1 ) : 10.2.2.8:19350 (rtmfp-core)/v4 -

    2014-08-06    14:39:14        15099   (i)2631509    Public rtmfp-core addresses for listener backup_defaultRoot__edge1 are: 127.0.0.1:19350;10.2.2.8:19350  -

    2014-08-06    14:39:14        15099   (i)2631174    Listener started ( backup_defaultRoot__edge1 ) : 127.0.0.1:1935 (rtmfp)/v4    -

    2014-08-06    14:39:14        15099   (i)2631174    Listener started ( backup_defaultRoot__edge1 ) : 10.2.2.8:1935 (rtmfp)/v4    -

    #Date: 2014-08-06

    #Fields: date   time    x-pid   x-status        x-ctx   x-comment

    2014-08-06    14:39:12        15097   (i)2581173    Host: videodb.webtv.coop IPv4: 10.2.2.8 -

    2014-08-06    14:39:12        15097   (i)2631180    Info from AccessAdaptor: Access Adaptor started /opt/adobe/ams/modules/access/libconnect.so.    -

    2014-08-06    14:39:12        15097   (e)2631013    Failed to create listener for adaptor _defaultRoot_, IP localhost, port 19350: TCCommBridge::createListener 127.0.0.1:19350/v4: bind failed!!!$

    2014-08-06    14:39:12        15097   (e)2631013    Failed to create listener for adaptor _defaultRoot_, IP , port 1935: TCCommBridge::createListener 0.0.0.0:1935/v4: bind failed!!!.    -

    2014-08-06    14:39:12        15097   (e)2631114    Failed to start listeners for adaptor _defaultRoot__edge1.    -

    2014-08-06    14:39:12        15097   (e)2791225    Failed to start edge : _defaultRoot__edge1    -

    #Date: 2014-08-06

    #Fields: date   time    x-pid   x-status        x-ctx   x-comment

    2014-08-06    14:41:22        15903   (i)2581173    Host: videodb.webtv.coop IPv4: 10.2.2.8 -

    2014-08-06    14:41:22        15903   (i)2631180    Info from AccessAdaptor: Access Adaptor started /opt/adobe/ams/modules/access/libconnect.so.    -

    2014-08-06    14:41:22        15903   (e)2631013    Failed to create listener for adaptor _defaultRoot_, IP localhost, port 19350: TCCommBridge::createListener 127.0.0.1:19350/v4: bind failed!!!$

    2014-08-06    14:41:22        15903   (e)2631013    Failed to create listener for adaptor _defaultRoot_, IP , port 1935: TCCommBridge::createListener 0.0.0.0:1935/v4: bind failed!!!.    -

    2014-08-06    14:41:22        15903   (e)2631114    Failed to start listeners for adaptor _defaultRoot__edge1.    -

    2014-08-06    14:41:22        15903   (e)2791225    Failed to start edge : _defaultRoot__edge1

    Content of var/log/messages :

    Aug  6 14:39:11 videodb Service[15070]: Server starting...

    Aug  6 14:39:12 videodb Server[15070]: /opt/adobe/ams/Apache2.2/bin/httpd -f ./conf/httpd.conf -d "/opt/adobe/ams/Apache2.2" -k start returned 0: [Wed Aug 06 14:39:11 2014] [info] mod_jithttp - AMS $

    Aug  6 14:39:12 videodb Server[15070]: /opt/adobe/ams/Apache2.2/bin/htcacheclean -n -t -i -p/opt/adobe/ams/Apache2.2/cacheroot -d5 -l1024K returned 0:

    Aug  6 14:39:12 videodb Adaptor[15097]: Failed to create listener for adaptor _defaultRoot_, IP localhost, port 19350: TCCommBridge::createListener 127.0.0.1:19350/v4: bind failed!!!.

    Aug  6 14:39:12 videodb Adaptor[15099]: Listener started ( backup_defaultRoot__edge1 ) : localhost:19350/v4

    Aug  6 14:39:12 videodb Adaptor[15097]: Failed to create listener for adaptor _defaultRoot_, IP , port 1935: TCCommBridge::createListener 0.0.0.0:1935/v4: bind failed!!!.

    Aug  6 14:39:12 videodb Adaptor[15097]: Failed to start listeners for adaptor _defaultRoot__edge1.

    Aug  6 14:39:12 videodb Edge[15097]: Failed to start edge : _defaultRoot__edge1

    Aug  6 14:39:12 videodb Service[15070]: Server started (/opt/adobe/ams/conf/Server.xml).

    Aug  6 14:39:13 videodb Adaptor[15099]: Listener started ( backup_defaultRoot__edge1 ) : 1935/v4

    Aug  6 14:39:14 videodb Adaptor[15099]: Listener started ( backup_defaultRoot__edge1 ) : 127.0.0.1:19350 (rtmfp-core)/v4

    Aug  6 14:39:14 videodb Adaptor[15099]: Listener started ( backup_defaultRoot__edge1 ) : 10.2.2.8:19350 (rtmfp-core)/v4

    Aug  6 14:39:14 videodb Adaptor[15099]: Public rtmfp-core addresses for listener backup_defaultRoot__edge1 are: 127.0.0.1:19350;10.2.2.8:19350

    Aug  6 14:39:14 videodb Adaptor[15099]: Listener started ( backup_defaultRoot__edge1 ) : 127.0.0.1:1935 (rtmfp)/v4

    Aug  6 14:39:14 videodb Adaptor[15099]: Listener started ( backup_defaultRoot__edge1 ) : 10.2.2.8:1935 (rtmfp)/v4

    Participating Frequently
    August 7, 2014

    Can you try restarting your machine?

    Please ensure that only one instance of ams is running at anytime and kill all previously running ams processes before starting a new ams instance. Only one amsmaster process should be running at a given time.

    You can use the following command to find ams processes running:

    ps -aux | grep ams

    August 1, 2014

    Thanks again Charles. I will try this once I got a suitable timeframe for this operation from the broadcasting team.

    Will report!

    Cheers.

    July 31, 2014

    Thanks Charles.

    Strange thing. Here is the netstat output. Ports 1935 and 19350 are already taken by AMS :

    [root@videodb ~]# netstat -tulpn

    Active Internet connections (only servers)

    Proto Recv-Q Send-Q Local Address              Foreign Address            State      PID/Program name

    tcp        0      0 0.0.0.0:2049                0.0.0.0:*                  LISTEN      -                

    tcp        0      0 0.0.0.0:5666                0.0.0.0:*                  LISTEN      22502/nrpe        

    tcp        0      0 127.0.0.1:8005              0.0.0.0:*                  LISTEN      27901/java        

    tcp        0      0 0.0.0.0:8134                0.0.0.0:*                  LISTEN      15093/httpd      

    tcp        0      0 127.0.0.1:11110            0.0.0.0:*                  LISTEN      29001/./amsadmin  

    tcp        0      0 0.0.0.0:806                0.0.0.0:*                  LISTEN      8256/rpc.statd    

    tcp        0      0 0.0.0.0:807                0.0.0.0:*                  LISTEN      27760/rpc.rquotad

    tcp        0      0 127.0.0.1:199              0.0.0.0:*                  LISTEN      8765/snmpd        

    tcp        0      0 0.0.0.0:8009                0.0.0.0:*                  LISTEN      27901/java        

    tcp        0      0 0.0.0.0:3306                0.0.0.0:*                  LISTEN      12980/mysqld      

    tcp        0      0 0.0.0.0:1935                0.0.0.0:*                  LISTEN      15098/amsedge    

    tcp        0      0 0.0.0.0:111                0.0.0.0:*                  LISTEN      8123/portmap      

    tcp        0      0 0.0.0.0:80                  0.0.0.0:*                  LISTEN      15093/httpd      

    tcp        0      0 0.0.0.0:8080                0.0.0.0:*                  LISTEN      27901/java        

    tcp        0      0 0.0.0.0:819                0.0.0.0:*                  LISTEN      27776/rpc.mountd  

    tcp        0      0 127.0.0.1:19350            0.0.0.0:*                  LISTEN      15098/amsedge    

    tcp        0      0 0.0.0.0:22                  0.0.0.0:*                  LISTEN      8790/sshd        

    tcp        0      0 0.0.0.0:1111                0.0.0.0:*                  LISTEN      29001/./amsadmin  

    tcp        0      0 0.0.0.0:49209              0.0.0.0:*                  LISTEN      -                

    tcp        0      0 127.0.0.1:25                0.0.0.0:*                  LISTEN      9323/master      

    udp        0      0 0.0.0.0:2049                0.0.0.0:*                              -                

    udp        0      0 10.2.2.8:1935              0.0.0.0:*                              15098/amsedge    

    udp        0      0 127.0.0.1:1935              0.0.0.0:*                              15098/amsedge    

    udp        0      0 0.0.0.0:57615              0.0.0.0:*                              -                

    udp        0      0 10.2.2.8:19350              0.0.0.0:*                              15098/amsedge    

    udp        0      0 127.0.0.1:19350            0.0.0.0:*                              15098/amsedge    

    udp        0      0 0.0.0.0:800                0.0.0.0:*                              8256/rpc.statd    

    udp        0      0 0.0.0.0:161                0.0.0.0:*                              8765/snmpd        

    udp        0      0 0.0.0.0:802                0.0.0.0:*                              27760/rpc.rquotad

    udp        0      0 0.0.0.0:803                0.0.0.0:*                              8256/rpc.statd    

    udp        0      0 0.0.0.0:816                0.0.0.0:*                              27776/rpc.mountd  

    udp        0      0 0.0.0.0:49875              0.0.0.0:*                              10305/avahi-daemon

    udp        0      0 0.0.0.0:5353                0.0.0.0:*                              10305/avahi-daemon

    udp        0      0 0.0.0.0:111                0.0.0.0:*                              8123/portmap      

    udp        0      0 10.2.2.8:123                0.0.0.0:*                              8824/ntpd        

    udp        0      0 127.0.0.1:123              0.0.0.0:*                              8824/ntpd        

    udp        0      0 0.0.0.0:123                0.0.0.0:*                              8824/ntpd

    But still the same errors in edge.00.log where it looks like edge tries to start a new connection to those same ports every 2 minutes and 10 seconds.

    #Date: 2014-07-31

    #Fields: date   time    x-pid   x-status        x-ctx   x-comment

    2014-07-31      09:20:24        10369   (i)2581173    Host: videodb.webtv.coop IPv4: 10.2.2.8 -

    2014-07-31      09:20:24        10369   (i)2631180      Info from AccessAdaptor: Access Adaptor started /opt/adobe/ams/modules/access/libconnect.so.    -

    2014-07-31      09:20:24        10369   (e)2631013    Failed to create listener for adaptor backup_defaultRoot_, IP localhost, port 19350: TCCommBridge::createListe$

    2014-07-31      09:20:24        10369   (e)2631013      Failed to create listener for adaptor backup_defaultRoot_, IP , port 1935: TCCommBridge::createListener 0.0.0.$

    2014-07-31      09:20:24        10369   (e)2631114    Failed to start listeners for adaptor backup_defaultRoot__edge1.        -

    2014-07-31      09:20:24        10369   (e)2791225      Failed to start edge : backup_defaultRoot__edge1        -

    #Date: 2014-07-31

    #Fields: date   time    x-pid   x-status        x-ctx   x-comment

    2014-07-31      09:22:34        10662   (i)2581173    Host: videodb.webtv.coop IPv4: 10.2.2.8 -

    2014-07-31      09:22:34        10662   (i)2631180      Info from AccessAdaptor: Access Adaptor started /opt/adobe/ams/modules/access/libconnect.so.    -

    2014-07-31      09:22:34        10662   (e)2631013    Failed to create listener for adaptor backup_defaultRoot_, IP localhost, port 19350: TCCommBridge::createListe$

    2014-07-31      09:22:34        10662   (e)2631013      Failed to create listener for adaptor backup_defaultRoot_, IP , port 1935: TCCommBridge::createListener 0.0.0.$

    2014-07-31      09:22:34        10662   (e)2631114    Failed to start listeners for adaptor backup_defaultRoot__edge1.        -

    2014-07-31      09:22:34        10662   (e)2791225      Failed to start edge : backup_defaultRoot__edge1        -

    #Date: 2014-07-31

    #Fields: date   time    x-pid   x-status        x-ctx   x-comment

    2014-07-31      09:24:44        10900   (i)2581173    Host: videodb.webtv.coop IPv4: 10.2.2.8 -

    2014-07-31      09:24:44        10900   (i)2631180      Info from AccessAdaptor: Access Adaptor started /opt/adobe/ams/modules/access/libconnect.so.    -

    2014-07-31      09:24:44        10900   (e)2631013    Failed to create listener for adaptor backup_defaultRoot_, IP localhost, port 19350: TCCommBridge::createListe$

    2014-07-31      09:24:44        10900   (e)2631013      Failed to create listener for adaptor backup_defaultRoot_, IP , port 1935: TCCommBridge::createListener 0.0.0.$

    2014-07-31      09:24:44        10900   (e)2631114    Failed to start listeners for adaptor backup_defaultRoot__edge1.        -

    2014-07-31      09:24:44        10900   (e)2791225      Failed to start edge : backup_defaultRoot__edge1

    Participating Frequently
    August 1, 2014

    An earlier running instance of AMS seems to be occupying ports 1935 and 19350. Can you please kill these manually with the following command:

    kill 15098

    Once again verify that these ports are no longer occupied by any process using

    netstat -tulpn

    Kill all AMS related process, if still running. Now start AMS. It should work fine.

    July 25, 2014

    FMLE screencaps :

    July 29, 2014

    Update : point 1. above has been resolved. After investigation we found out that was a player issue.

    Point 2 still needs to be addressed please (random service shutdown).

    Help would be greatly appreciated! Staff?

    Participating Frequently
    July 30, 2014

    Can you stop AMS and run the following command to see if any other process is using ports 1935 and 19350?

    netstat -tulpn

    Most probably, you would see some process linked to these ports due to which AMS is not able to bind to these ports. Please kill these processes and start AMS.