Unable to run multiple instances

Report · Nov 05, 2024

I am new to this, I have setup clusters and two instances in each cluster. one instance is up and running and the sites are also working fine. i am on window server and using IIS. sending traffic from cloudfront to the server ( http bindings)

when i start the second instance in the cluster i am getting errors and the site is not available, when i check the log file i see these errors:

exception.log file :

"Error","FelixStartLevel","10/25/24","16:38:00","","The Runtime service is not available. This exception is usually caused by service startup failure. Check your server configuration."
coldfusion.server.ServiceFactory$ServiceNotAvailableException: The Runtime service is not available.
at coldfusion.server.ServiceFactory.getRuntimeService(ServiceFactory.java:633)
at coldfusion.monitor.inmemory.module.InMemoryMonitoringServiceImpl.onMonitoringDisabled(InMemoryMonitoringServiceImpl.java:486)
at coldfusion.monitor.inmemory.module.InMemoryMonitoringServiceImpl.disableMemoryMonitoring(InMemoryMonitoringServiceImpl.java:207)
at coldfusion.monitor.inmemory.module.InMemoryMonitoringServiceImpl.stopMonitoring(InMemoryMonitoringServiceImpl.java:171)
at coldfusion.monitor.inmemory.module.InMemoryMonitoringServiceImpl.stop(InMemoryMonitoringServiceImpl.java:113)
at coldfusion.monitor.activator.Activator.stop(Activator.java:71)
at org.apache.felix.framework.util.SecureAction.stopActivator(SecureAction.java:720)
at org.apache.felix.framework.Felix.stopBundle(Felix.java:2795)
at org.apache.felix.framework.Felix.setActiveStartLevel(Felix.java:1557)
at org.apache.felix.framework.FrameworkStartLevelImpl.run(FrameworkStartLevelImpl.java:308)
at java.base/java.lang.Thread.run(Thread.java:834)

In coldfusion-error.lof file :

Oct 25, 2024 4:33:19 PM org.apache.catalina.core.AprLifecycleListener lifecycleEvent

INFO: The Apache Tomcat Native library which allows using OpenSSL was not found on the java.library.path: [C:\BWCF2021\APIInstance2\lib;C:\CF2021\APIInstance2\jintegra\bin;C:\CF2021\APIInstance2\jintegra\bin\international;C:\CF2021\jdk-11.0.17\bin]

Oct 25, 2024 4:33:19 PM org.apache.coyote.AbstractProtocol init

INFO: Initializing ProtocolHandler ["http-nio-8507"]

Oct 25, 2024 4:33:20 PM org.apache.coyote.AbstractProtocol init

INFO: Initializing ProtocolHandler ["ajp-nio-127.0.0.1-8022"]

Oct 25, 2024 4:33:20 PM org.apache.catalina.core.StandardService startInternal

INFO: Starting service [Catalina]

Oct 25, 2024 4:33:20 PM org.apache.catalina.core.StandardEngine startInternal

INFO: Starting Servlet engine: [Apache Tomcat/9.0.85]

Oct 25, 2024 4:33:20 PM org.apache.catalina.ha.tcp.SimpleTcpCluster startInternal

INFO: Cluster is about to start

Oct 25, 2024 4:33:20 PM org.apache.catalina.tribes.transport.ReceiverBase bind

INFO: Receiver Server Socket bound to:[/172.16.0.73:4007]

Oct 25, 2024 4:33:20 PM org.apache.catalina.tribes.membership.McastServiceImpl setupSocket

INFO: Setting cluster mcast soTimeout to [500]

Oct 25, 2024 4:33:20 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers

INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[4]

Oct 25, 2024 4:33:20 PM org.apache.catalina.ha.tcp.SimpleTcpCluster memberAdded

INFO: Replication member added:[org.apache.catalina.tribes.membership.MemberImpl[tcp://{172, 16, 0, 73}:4001,{172, 16, 0, 73},4001, alive=2783162925, securePort=-1, UDP Port=-1, id={2 -72 101 -51 35 -26 65 56 -68 35 -57 36 -29 47 -110 35 }, payload={}, command={}, domain={}]]

Oct 25, 2024 4:33:21 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers

INFO: Done sleeping, membership established, start level:[4]

Oct 25, 2024 4:33:21 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers

INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[8]

Oct 25, 2024 4:33:21 PM org.apache.catalina.tribes.io.BufferPool getBufferPool

INFO: Created a buffer pool with max size:[104857600] bytes of type: [org.apache.catalina.tribes.io.BufferPool15Impl]

Oct 25, 2024 4:33:22 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers

INFO: Done sleeping, membership established, start level:[8]

Oct 25, 2024 4:33:23 PM org.apache.catalina.ha.session.DeltaManager startInternal

INFO: Register manager [localhost#] to cluster element [Engine] with name [Catalina]

Oct 25, 2024 4:33:23 PM org.apache.catalina.ha.session.DeltaManager startInternal

INFO: Starting clustering manager at [localhost#]

Oct 25, 2024 4:33:23 PM org.apache.catalina.ha.session.DeltaManager getAllClusterSessions

INFO: Manager [localhost#], requesting session state from [org.apache.catalina.tribes.membership.MemberImpl[tcp://{172, 16, 0, 73}:4001,{172, 16, 0, 73},4001, alive=2783166370, securePort=-1, UDP Port=-1, id={2 -72 101 -51 35 -26 65 56 -68 35 -57 36 -29 47 -110 35 }, payload={}, command={}, domain={}]]. This operation will timeout if no session state has been received within [60] seconds.

Oct 25, 2024 4:33:25 PM org.eclipse.jetty.util.log.JavaUtilLog info

INFO: jetty-7.x.y-SNAPSHOT

Oct 25, 2024 4:33:25 PM org.eclipse.jetty.util.log.JavaUtilLog info

INFO: started o.e.j.s.ServletContextHandler{/,null}

Oct 25, 2024 4:33:26 PM org.eclipse.jetty.util.log.JavaUtilLog info

INFO: Started SelectChannelConnector@0.0.0.0:8089

Oct 25, 2024 4:33:28 PM org.apache.catalina.ha.session.DeltaManager waitForSendAllSessions

INFO: Manager [localhost#]; session state sent at [10/25/24 4:33 PM] received in [5,066] ms.

Oct 25, 2024 4:33:29 PM org.apache.catalina.core.ApplicationContext log

INFO: ColdFusionStartUpServlet: ColdFusion: Starting application services

Oct 25, 2024 4:33:29 PM org.apache.catalina.core.ApplicationContext log

INFO: ColdFusionStartUpServlet: ColdFusion: VM version = 11.0.17+10-LTS-269

Oct 25, 2024 4:33:29 PM org.apache.catalina.tribes.transport.nio.NioReplicationTask sendAck

WARNING: Unable to send ACK back through channel, channel disconnected?: [null]

Oct 25, 2024 4:33:44 PM org.apache.catalina.ha.session.JvmRouteBinderValve startInternal

INFO: JvmRouteBinderValve started

Oct 25, 2024 4:33:44 PM org.apache.coyote.AbstractProtocol start

INFO: Starting ProtocolHandler ["http-nio-8507"]

Oct 25, 2024 4:33:44 PM org.apache.coyote.AbstractProtocol start

INFO: Starting ProtocolHandler ["ajp-nio-127.0.0.1-8022"]

Oct 25, 2024 4:33:44 PM com.adobe.coldfusion.launcher.Launcher run

INFO: Server startup in 25424 ms

Oct 25, 2024 4:33:48 PM org.apache.coyote.http11.Http11Processor service

INFO: Error parsing HTTP request header

Note: further occurrences of HTTP request parsing errors will be logged at DEBUG level.

java.lang.IllegalArgumentException: Invalid character found in method name [0x160x030x030x01n0x010x000x01j0x030x030xeb0xb3i0x0a"0xf20xe20xaaRO&C0x940xab0xe00xf1QM00x980xc0H0xdc0xa10x12b0x1a0xfd0xb40xa30x19@ ]. HTTP method names must be tokens

at org.apache.coyote.http11.Http11InputBuffer.parseRequestLine(Http11InputBuffer.java:407)

at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:263)

at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:63)

at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:928)

at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1794)

at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:52)

at org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191)

at org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659)

at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)

at java.base/java.lang.Thread.run(Thread.java:834)

Oct 25, 2024 4:38:00 PM org.apache.catalina.core.StandardServer await

INFO: A valid shutdown command was received via the shutdown port. Stopping the Server instance.

Oct 25, 2024 4:38:00 PM org.apache.coyote.AbstractProtocol pause

INFO: Pausing ProtocolHandler ["http-nio-8507"]

Oct 25, 2024 4:38:00 PM org.apache.coyote.AbstractProtocol pause

INFO: Pausing ProtocolHandler ["ajp-nio-127.0.0.1-8022"]

Oct 25, 2024 4:38:00 PM org.apache.catalina.core.StandardService stopInternal

INFO: Stopping service [Catalina]

Oct 25, 2024 4:38:00 PM org.apache.catalina.ha.session.JvmRouteBinderValve stopInternal

INFO: JvmRouteBinderValve stopped

Oct 25, 2024 4:38:00 PM org.apache.catalina.ha.session.DeltaManager stopInternal

INFO: Manager [localhost#] expiring sessions upon shutdown

Oct 25, 2024 4:38:00 PM org.apache.coyote.AbstractProtocol stop

INFO: Stopping ProtocolHandler ["http-nio-8507"]

Oct 25, 2024 4:38:00 PM org.apache.coyote.AbstractProtocol stop

INFO: Stopping ProtocolHandler ["ajp-nio-127.0.0.1-8022"]

Oct 25, 2024 4:49:21 PM org.apache.catalina.core.AprLifecycleListener lifecycleEvent

INFO: The Apache Tomcat Native library which allows using OpenSSL was not found on the java.library.path: [C:\CF2021\APIInstance2\lib;C:\CF2021\APIInstance2\jintegra\bin;C:\CF2021\APIInstance2\jintegra\bin\international;C:\BWCF2021\jdk-11.0.17\bin]

Oct 25, 2024 4:49:21 PM org.apache.coyote.AbstractProtocol init

INFO: Initializing ProtocolHandler ["http-nio-8507"]

Oct 25, 2024 4:49:21 PM org.apache.coyote.AbstractProtocol init

INFO: Initializing ProtocolHandler ["ajp-nio-127.0.0.1-8022"]

Oct 25, 2024 4:49:21 PM org.apache.catalina.core.StandardService startInternal

INFO: Starting service [Catalina]

Oct 25, 2024 4:49:21 PM org.apache.catalina.core.StandardEngine startInternal

INFO: Starting Servlet engine: [Apache Tomcat/9.0.85]

Oct 25, 2024 4:49:21 PM org.apache.catalina.ha.tcp.SimpleTcpCluster startInternal

INFO: Cluster is about to start

Oct 25, 2024 4:49:21 PM org.apache.catalina.tribes.transport.ReceiverBase bind

INFO: Receiver Server Socket bound to:[/172.16.0.73:4007]

Oct 25, 2024 4:49:21 PM org.apache.catalina.tribes.membership.McastServiceImpl setupSocket

INFO: Setting cluster mcast soTimeout to [500]

Oct 25, 2024 4:49:21 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers

INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[4]

Oct 25, 2024 4:49:22 PM org.apache.catalina.ha.tcp.SimpleTcpCluster memberAdded

INFO: Replication member added:[org.apache.catalina.tribes.membership.MemberImpl[tcp://{172, 16, 0, 73}:4001,{172, 16, 0, 73},4001, alive=2784124790, securePort=-1, UDP Port=-1, id={2 -72 101 -51 35 -26 65 56 -68 35 -57 36 -29 47 -110 35 }, payload={}, command={}, domain={}]]

Oct 25, 2024 4:49:22 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers

INFO: Done sleeping, membership established, start level:[4]

Oct 25, 2024 4:49:22 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers

INFO: Sleeping for [1000] milliseconds to establish cluster membership, start level:[8]

Oct 25, 2024 4:49:22 PM org.apache.catalina.tribes.io.BufferPool getBufferPool

INFO: Created a buffer pool with max size:[104857600] bytes of type: [org.apache.catalina.tribes.io.BufferPool15Impl]

Oct 25, 2024 4:49:24 PM org.apache.catalina.tribes.membership.McastServiceImpl waitForMembers

INFO: Done sleeping, membership established, start level:[8]

Oct 25, 2024 4:49:25 PM org.apache.catalina.ha.session.DeltaManager startInternal

INFO: Register manager [localhost#] to cluster element [Engine] with name [Catalina]

Oct 25, 2024 4:49:25 PM org.apache.catalina.ha.session.DeltaManager startInternal

INFO: Starting clustering manager at [localhost#]

Oct 25, 2024 4:49:25 PM org.apache.catalina.ha.session.DeltaManager getAllClusterSessions

INFO: Manager [localhost#], requesting session state from [org.apache.catalina.tribes.membership.MemberImpl[tcp://{172, 16, 0, 73}:4001,{172, 16, 0, 73},4001, alive=2784127964, securePort=-1, UDP Port=-1, id={2 -72 101 -51 35 -26 65 56 -68 35 -57 36 -29 47 -110 35 }, payload={}, command={}, domain={}]]. This operation will timeout if no session state has been received within [60] seconds.

Oct 25, 2024 4:49:27 PM org.eclipse.jetty.util.log.JavaUtilLog info

INFO: jetty-7.x.y-SNAPSHOT

Oct 25, 2024 4:49:27 PM org.eclipse.jetty.util.log.JavaUtilLog info

INFO: started o.e.j.s.ServletContextHandler{/,null}

Oct 25, 2024 4:49:27 PM org.eclipse.jetty.util.log.JavaUtilLog info

INFO: Started SelectChannelConnector@0.0.0.0:8089

Oct 25, 2024 4:49:30 PM org.apache.catalina.ha.session.DeltaManager waitForSendAllSessions

INFO: Manager [localhost#]; session state sent at [10/25/24 4:49 PM] received in [5,076] ms.

Report · Nov 06, 2024

@BKBK , I am really sorry ,but as per my understanding all the requests come in http not https. I dont know how to check this ( i am a newbie)

By @v_9081

No problem at all, @v_9081 .

What I am saying is as follows. Let's suppose that the port number of the instance is 8501. Then, the error

java.lang.IllegalArgumentException: Invalid character found in method name

suggests that the request https://yourDomain:8501 has been sent to the instance, rather than http://yourDomain:8501. Or vice versa. So try both, after replacing the correct values of domain(usually localhost) and port.

Report · Nov 06, 2024

@v_9081 ,

Let's suppose that https traffic goes to the load balancer and the load balancer sends the traffic to instance2. You simply wish to get instance2 to run, for example, in case instance1 fails. Let's further suppose that IIS is being used and the bindings of each site are http + port 80.

Now look at the traffic going to instance1 (the successfully working instance). I would presume it is https. Then that would explain the error. Instance2 is probably not yet configured for IIS, let alone for https.

So, to solve the problem you have to do two things:

1. Configure the ColdFusion instance, Instance2, to connect and use IIS as webserver. To do so, use the Web Server Configuration Tool, {INSTANCE2_HOME}\runtime\bin\wsconfig.exe. Search and you will find Adobe documentation and plenty of information in this forum on how to configure a ColdFusion instance to work with IIS as web server.

2. Configure IIS to use HTTPS. This requires you to import the relevant server certificates. Here, too, you will find Adobe documentation and plenty of information in this forum on how to configure IIS and how to import certificates.

If, as you said, you are a newbie, then I should point out that doing the above tasks might be challenging. If you wanted to solve this quickly or to avoid risks, I would recommend you hire a ColdFusion consultant for an hour or two.

Report · Nov 07, 2024

@v_9081 , I have changed the last paragraph of my last post slightly. If your organization allows you the space and the time to dig in and solve the problem then, by all means, do dig in.

Research the problem. Ask questions in the forum. Apply the suggestions you receive, and return with feedback. As a community, we're here to discuss all things ColdFusion and to help each other.

Report · Nov 06, 2024

V, you've focused incorrectly on the second point in my reply, without regard to my far more important first point (these are STILL your cf startup logs from 6 months ago) and last point (how to get you the right uodate log). Please reconsider those two points.

/Charlie (troubleshooter, carehart.org)