mike42780
Community Beginner
mike42780
Community Beginner
Activity
‎Sep 27, 2017
09:43 AM
I know this is a couple of years later, but thanks for this thread. I was having the same issue with CF2016. I followed the lockdown guide and couldn't get the site wide error handler to work as the CFAdmin site is not under the same site. Eventually I had to go the Coldfusion mapping route to get it working again.
... View more
‎Aug 12, 2017
04:44 PM
Server's been up for a week or so. I guess it really just needed more Ram. Thanks for all the help.
... View more
‎Aug 07, 2017
08:04 PM
Ok. Yeah, I saw the toggles under view, but just wanted to be sure. Thanks.
... View more
‎Aug 07, 2017
07:36 PM
Visually, am I looking at the blue lines that go up and fall back down to see that it's garbage collecting? The blue lines being the used heap on GCviewer? i can't seem to find paroldgen on gcviewer, but see it in the log file no problem. Thanks again.
... View more
‎Aug 07, 2017
07:24 PM
Thanks Carl, good info. I just went through the current logs and noticed the ParOldGen size starts at the min, increases to the max, and then does a full Garbage collection. And then starts over. Does that over and over. Seem to be working more as expected. Response time on the website seems to be much better too.
... View more
‎Aug 07, 2017
10:16 AM
Thanks for the responses. The server seems to be performing much better with the increased ram. I don't know why I didn't think of looking at that first. I guess because it had worked fine in the past with 4GB of ram. Either way, I'll wait maybe a few more days and then mark the response as correct if I don't see any other issues.
... View more
‎Aug 04, 2017
04:41 PM
Upgraded the server to 8GB of ram. Changed Coldfusion to -Xms2048m -Xmx2048m. Unfortunately probably won't have a true test of the server load until Monday.
... View more
‎Aug 04, 2017
11:01 AM
Interesting. We've never had a problem in the past with 4GB so I didn't really even think about it. And everything runs fine for hours, and in the past days, so I can't help but wonder if there's some more configuration I could be doing as well. I can probably upgrade to 8GB of ram to start on the hardware side though. And then I would be upping java.args=-server -Xms1024m -Xmx1024m to 2 or 3GB then I'm assuming as well to take advantage of the increased ram.
... View more
‎Aug 04, 2017
09:42 AM
Upgraded to CF 2016 (on Windows 2016 64 bit VM server with 2 CPUs and 4GB of ram), and have had a lot of issues with the server hanging, going very slow, and the CPU spiking to very close to 100% and never going down. Usually a server/CF service restart fixes the issue for a while. I'm rebooting the server sometimes 3-4 times a day. This is the same code that worked fine w/o any issues like this in the past for years. After a reboot things will look like normal for hours, and then just slowly deteriorate to the point where it's unusable. It's kind of random too. Sometimes 2-3 hours. Sometimes 6, etc. Sometimes it'll happen overnight when just a few scheduled tasks are running. Things that have run for years w/o issue. I'm trying to tweak the java arguments to help resolve this thinking this is maybe the problem. This is my jvm.config arguments: java.args=-server -Xms1024m -Xmx1024m -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintHeapAtGC -verbose:gc -Xloggc:web_GC.log -Xdebug -Xrunjdwp:transport=dt_socket,server=y,suspend=n,address=5005 -XX:MaxMetaspaceSize=192m -XX:+UseParallelGC -Xbatch -Dcoldfusion.home={application.home} -Duser.language=en -Dcoldfusion.rootDir={application.home} -Dcoldfusion.libPath={application.home}/lib -Dorg.apache.coyote.USE_CUSTOM_STATUS_MSG_IN_HEADER=true -Dcoldfusion.jsafe.defaultalgo=FIPS186Random -Dorg.eclipse.jetty.util.log.class=org.eclipse.jetty.util.log.JavaUtilLog -Djava.util.logging.config.file={application.home}/lib/logging.properties -Dcoldfusion.classPath={application.home}/lib/updates,{application.home}/lib,{application.home}/lib/axis2,{application.home}/gateway/lib/,{application.home}/wwwroot/WEB-INF/flex/jars,{application.home}/wwwroot/WEB-INF/cfform/jars I've also updated java to jre1.8.0_131 and use that for Coldfusion. I monitor the garbage collection in GCViewier. Here is a screenshot around when one of the hangups occur. The black lines are "Full GC lines". I've also done a few thread dumps and notice the ParOldGen is always maxed out around 99% when the issue occurs. I didn't see anything too obvious in the thread dump otherwise. Could post more if needed. Heap PSYoungGen total 334336K, used 28807K [0x00000000eab00000, 0x0000000100000000, 0x0000000100000000) eden space 319488K, 9% used [0x00000000eab00000,0x00000000eca02ab0,0x00000000fe300000) from space 14848K, 0% used [0x00000000fe300000,0x00000000fe300000,0x00000000ff180000) to space 14848K, 0% used [0x00000000ff180000,0x00000000ff180000,0x0000000100000000) ParOldGen total 699392K, used 699181K [0x00000000c0000000, 0x00000000eab00000, 0x00000000eab00000) object space 699392K, 99% used [0x00000000c0000000,0x00000000eaacb560,0x00000000eab00000) Metaspace used 142208K, capacity 164916K, committed 165196K, reserved 1191936K class space used 16865K, capacity 22202K, committed 22348K, reserved 1048576K I also installed a trial version of Seefusion just to see if anything obvious is hanging or running slow. Nothing really came up either. Right after a CF restart pages take slightly longer while things get cached, but then it looks good. We have a few different instances of CFWheels running on our site. I'm sure there's a little extra overhead there, but nothing that CF couldn't handle in the past. I've read some information on different flags (Java HotSpot VM Options ) or swapping out "UseParallelGC" for a different type of garbage collection. Most of the Coldfusion information is from years ago. Just not sure what applies anymore, or what else could be causing this. I checked the thread dump for any java outofmemoryerror's in the log, but don't see any. Based on some more reading, I'm thinking maybe I should try to add a -XX:Permsize= or -XX:maxpermsize= to my arguments possibly. Any help or insight would be greatly appreciated!
... View more
‎Jul 25, 2017
08:58 AM
I have this issue as well. I'm using CF 2016 on Windows 2016 (IIS 10). The cs-uri-stem for a fair amount of logs just shows "/jakarta/isapi_redirect.dll". These are valid 200 statuses over ssl and non ssl connections. If I go look at the refererPath I can usually get an idea of where it came from, but it's not ideal. I'm just using the regular logging.
... View more
‎Dec 22, 2014
07:24 AM
Hi Charlie, For that smaller site that seemed to be causing the unusual URL, I deleted the IIS site and re-created it. And then I deleted the production files and copied the files from our development server and made sure everything was working like normal. That stopped the URL from popping up in the log files. No idea how. That site didn't have any cfhttp calls on it anywhere. We also added an additional CPU on the server at the request of a Adobe that was looking at it. We've had a couple of CPU spikes since then that have caused the site to run slow for a couple of minutes, but that is usually not the norm now. The CPU stays lower and if it spikes at 100% it doesn't stay there long. I'm still nervous about it, but for the most part it has been stable. I never saw any unusual processes running that looked like the bitcoin exploit, so maybe that was on the old server and didn't get carried over. We locked down the server using the CF11 whitepaper the best we could. If the bitcoin exploit was hitting our server hard, hopefully it has moved on. I'm keeping an eye on it, but not sure our server will get hard over the holidays, so again not the best test. Thanks again for all of your help.
... View more
‎Dec 13, 2014
08:34 PM
Thanks Charlie for your insight. I searched everywhere to find a cfhttp request that was causing the issue, but couldn't find it. I did find some unusual files that were loaded though that I know we didn't put there. I did a search and found this link that shows the code. Coldfusion CFIDE bitcoin mining exploit – PHP involved… | code-complete.com and that you mention in your article too. I don't see any of the executables running or files that were mentioned though. I found that code in 8 different spots though and removed them. Maybe our old server had the executables and hacked files on them. Hard to know as it won't boot up anymore! I think I did possibly isolate the HTTP request {URL='http://zzen1wbudopwg.nchyt.com/encfm/en0024-ssj5iway6wvg/cbeim94a1s2kebu.php?do=218', method='get'} in the http.log file to a certain site in IIS though. And it wasn't our main site. I turn off this website in IIS and it appears the weird request goes away. I turn the site back on and it starts to re-appear. It doesn't always load constantly so it's a little hard to tell. This site is pretty small. I went through each file on the site and did find one file that did appear to be hacked. It wasn't coldfusion code though. Just some html links. I removed it. That's all I could find. No cfhttp calls or anything else. We re-installed Coldfusion 11 on Friday as well and upgraded to Update 3. It doesn't stay locked at 100% as much right now, but it being over the weekend we don't get much traffic. Monday will be the real test. I think I will leave that smaller site turned off for now and see how things perform. I'm doing a full virus scan for the heck of it overnight too. Don't really expect it to find anything though. I also turned on advanced logging in IIS 7.5 and don't see anything out of the ordinary. I made sure client variables weren't in the registry either. Here's a part of the http.log file when I turn the IIS site on. I turn the site off and it stops popping up in the logs. "Information","ajp-bio-8014-exec-57","12/13/14","22:33:14",,"Starting HTTP request {URL='http://zzen1wbudopwg.nchyt.com/encfm/en0024-ssj5iway6wvg/cbeim94a1s2kebu.php?do=233', method='get'}" "Information","ajp-bio-8014-exec-57","12/13/14","22:36:17",,"Starting HTTP request {URL='http://zzen1wbudopwg.nchyt.com/encfm/en0024-ssj5iway6wvg/cbeim94a1s2kebu.php?do=601', method='get'}" "Information","ajp-bio-8014-exec-57","12/13/14","22:38:31",,"Starting HTTP request {URL='http://zzen1wbudopwg.nchyt.com/encfm/en0024-ssj5iway6wvg/cbeim94a1s2kebu.php?do=459', method='get'}" "Information","ajp-bio-8014-exec-57","12/13/14","22:38:54",,"Starting HTTP request {URL='http://zzen1wbudopwg.nchyt.com/encfm/en0024-ssj5iway6wvg/cbeim94a1s2kebu.php?do=108', method='get'}" "Information","ajp-bio-8014-exec-57","12/13/14","22:39:55",,"Starting HTTP request {URL='http://zzen1wbudopwg.nchyt.com/encfm/en0024-ssj5iway6wvg/cbeim94a1s2kebu.php?do=218', method='get'}" "Information","ajp-bio-8014-exec-63","12/13/14","22:52:03",,"Starting HTTP request {URL='http://zzen1wbudopwg.nchyt.com/encfm/en0024-ssj5iway6wvg/cbeim94a1s2kebu.php?do=54', method='get'}" "Information","ajp-bio-8014-exec-64","12/13/14","22:57:32",,"Starting HTTP request {URL='http://zzen1wbudopwg.nchyt.com/encfm/en0024-ssj5iway6wvg/cbeim94a1s2kebu.php?do=40', method='get'}" "Information","ajp-bio-8014-exec-64","12/13/14","22:58:37",,"Starting HTTP request {URL='http://zzen1wbudopwg.nchyt.com/encfm/en0024-ssj5iway6wvg/cbeim94a1s2kebu.php?do=702', method='get'}"
... View more
‎Dec 12, 2014
12:20 PM
Our web server is stuck at 100% CPU. Three days ago we were on CF9 and started running into this problem until the server crashed and wasn't salvageable. Luckily we had a fresh Windows 2008 Server R2 ready to go with a fresh copy of CF11 on it. I copied all the website files over and we were back up and running. A day later the CPU is back to 100% on the new CF11 Windows 2008R2 server. I also updated CF11 to the latest update 3 that was just released. If I turn off the CF service the CPU usage goes back to normal. If I turn CF back on, the CPU goes back to 100% within like 5 seconds. So it doesn't seem like some slow running page or anything that eventually eats up all the memory or whatever. I'm not an expert at looking at the logs, but I don't see anything too out of the ordinary. The one thing that looks strange to me is I see this line over and over. Dec 12, 2014 11:28:41 AM Information [ajp-bio-8014-exec-59] - Starting HTTP request {URL='http://zzen1wbudopwg.nchyt.com/encfm/en0024-ssj5iway6wvg/cbeim94a1s2kebu.php?do=194', method='get'} That line makes me think we got hacked somehow, but it's hard to know. I did up my JVM heap size and max size to 1024MB. We have 4GB of memory. And i changed teh JVM arguments to what's below based on a forum post. Nothing seems to help. -server -XX:PermSize=192m -XX:MaxPermSize=192m -XX:+UseParallelGC -Xbatch -Dcoldfusion.home={application.home} -Dorg.eclipse.jetty.util.log.class=org.eclipse.jetty.util.log.JavaUtilLog -Duser.language=en -Dcoldfusion.rootDir={application.home} -Dcoldfusion.libPath={application.home}/lib -Dorg.apache.coyote.USE_CUSTOM_STATUS_MSG_IN_HEADER=true -Dcoldfusion.jsafe.defaultalgo=FIPS186Random Any additional ideas on how to debug this or what to look at? Thanks!
... View more
‎Aug 13, 2014
12:59 PM
Right there with you. Going from CF9 to CF11 and all my charts are completely destroyed! Have to completely redo everything before I can move this into production. Why Adobe?
... View more
‎May 25, 2006
01:49 PM
I found a coldfusion-out.log file which seems to have a
little more info. It shows an error of not being able to open the
license.properties file. I checked the folder it's looking in and
there is no license.properties file there. The service proceeds to
reboot. This happens many times a day. Anyone know what this is?
Starting Macromedia JRun 4.0 (Build 92909), coldfusion server
05/25 12:25:16 warning Unable to open
D:\CFusionMX7\runtime/lib/license.properties
05/25 12:25:18 info JRun Naming Service listening on *:2920
05/25 12:25:18 warning No sessionSecret has been specified in
jrun.xml. Installing a self generated sessionSecret.
05/25 12:25:19 info No JDBC data sources have been configured
for this server (see jrun-resources.xml)
05/25 12:25:19 info JRun Proxy Server listening on *:51011
05/25 12:25:19 info Deploying enterprise application
"Macromedia ColdFusion MX" from: file:/D:/CFusionMX7/
05/25 12:25:20 info Deploying web application "Macromedia
Coldfusion MX" from: file:/D:/CFusionMX7/
05/25 12:25:22 INFO License Service: Flex 1.5 CF Edition
enabled
05/25 12:25:22 INFO Starting Flex 1.5 CF Edition
05/25 12:25:23 user JSPServlet: init
05/25 12:25:23 user CFMxmlServlet: init
05/25 12:25:23 user CFMxmlServlet: Macromedia Flex Build:
87315.134646
05/25 12:25:23 INFO Macromedia Flex Build: 87315.134646
05/25 12:25:26 user ColdFusionStartUpServlet: init
05/25 12:25:26 user ColdFusionStartUpServlet: ColdFusion MX:
Starting application services
05/25 12:25:26 user ColdFusionStartUpServlet: ColdFusion MX:
VM version = 1.4.2_05-b04
05/25 12:25:26 Information [main] - Starting logging...
05/25 12:25:26 Information [main] - Starting crypto...
05/25 12:25:28 Information [main] - Starting license...
05/25 12:25:28 Information [main] - Starting License server
...
05/25 12:25:28 Information [main] - Starting scheduler...
05/25 12:25:28 Information [main] - Starting WatchService...
05/25 12:25:28 Information [main] - Starting debugging...
05/25 12:25:28 Information [main] - Starting sql...
05/25 12:25:34 Information [main] - Pool Manager Started
05/25 12:25:34 Information [main] - Starting mail...
05/25 12:25:35 Information [main] - CORBA Configuration not
enabled
05/25 12:25:35 Information [main] - Starting cron...
05/25 12:25:35 Information [main] - Starting registry...
05/25 12:25:35 Information [main] - Starting client...
05/25 12:25:35 Information [main] - Starting xmlrpc...
05/25 12:25:36 Information [main] - Starting graphing...
05/25 12:25:36 Information [main] - Starting verity...
05/25 12:25:36 Information [main] - Starting archive...
05/25 12:25:36 Information [main] - Starting document...
05/25 12:25:38 Information [main] - Starting eventgateway...
05/25 12:25:39 Information [main] - Starting Event Backend
Handlers
05/25 12:25:39 Information [main] - Initialized
EventRequestDispatcher with a Thread Pool size of 10
05/25 12:25:39 Information [main] - Initializing
EventRequestHandler
05/25 12:25:39 Information [main] - Starting Event Gateways
05/25 12:25:39 Information [main] - ColdFusion started
05/25 12:25:39 user ColdFusionStartUpServlet: ColdFusion MX:
application services are now available
05/25 12:25:39 user CFSwfServlet: init
05/25 12:25:39 user CFCServlet: init
05/25 12:25:40 user FlashGateway: init
05/25 12:25:40 user CFFormGateway: init
05/25 12:25:40 user CFInternalServlet: init
Server coldfusion ready (startup time: 27 seconds)
... View more
‎May 25, 2006
12:34 PM
I've been having the same problems with CFMX 7.01 on IIS6,
except it's from "main". At times it reboots like every 10 minutes.
Other times a couple hours. Haven't found any reason for it yet.
"Information","main","05/25/06","14:18:30",,"Starting
verity..."
"Information","main","05/25/06","14:18:30",,"Starting
archive..."
"Information","main","05/25/06","14:18:30",,"Starting
document..."
"Information","main","05/25/06","14:18:31",,"Starting
eventgateway..."
"Information","main","05/25/06","14:18:32",,"ColdFusion
started"
... View more