CF2016 Update 16 w3wp.exe crash

[mguenther1272]

Folks,

I've been dealing with a problem over the past month or so with one of my developers where his application is crashing my IIS server's w3wp.exe.

Essentially, the application pool keeps crashing and restarting until it hits the limit of crashes within the timeframe allowed, and then stays down - resulting in a 503 error - website unavailable.

According to the crash dumps that I've been able to collect - the faulting module in this case is MSVCR110.dll - and it's crashing because it's trying to read from memory that it doesn't have access to.

Fault bucket 1896345861034215315, type 4
Event Name: APPCRASH
Response: Not available
Cab Id: 0

Problem signature:
P1: w3wp.exe
P2: 10.0.14393.0
P3: 57899b8a
P4: MSVCR110.dll
P5: 11.0.51106.1
P6: 5098826e
P7: c0000005
P8: 0000000000051d70
P9: 
P10: 

Faulting application name: w3wp.exe, version: 10.0.14393.0, time stamp: 0x57899b8a
Faulting module name: MSVCR110.dll, version: 11.0.51106.1, time stamp: 0x5098826e
Exception code: 0xc0000005
Fault offset: 0x0000000000051d70
Faulting process id: 0x331c
Faulting application start time: 0x01d6933ff834baae
Faulting application path: c:\windows\system32\inetsrv\w3wp.exe
Faulting module path: C:\Windows\SYSTEM32\MSVCR110.dll
Report Id: e41b3d3a-9f47-4a72-94e0-5696029da3a3
Faulting package full name: 
Faulting package-relative application ID: 

I don't think we're looking at a problem with the isapi_connector.dll being out of date, as it has the date on it that I applied the Update 16 fixes, and I definitely upgraded the connector in the wsconfig tool.

The developer, in this case is using (I believe) Wheels for his application framework (don't know if this really matters or not).

I don't think that this is related to the AJP connector changes in Tomcat, as the website loads normally when starting things up and our other instances running on the same server have not experienced this problem, but looking in the isapi_redirect log I do see a LOT of calls to jk_ajp_common.c around the times when the AppPool crashes - so, admittedly,  I could be wrong there.  I have gone ahead and, just in case, added allowedRequestAttributesPattern to the server.xml for that instances and set it to ".*", again - just in case.

I'm pretty stumped at this point.  ANY ideas?

Thanks!

[BKBK]

This is a complex problem. As you would have noticed, the strategy I use is borrowed from the greatest complex-problem solver: nature. The strategy is: turn every stone; learn; fail fast.

[Dan24843164p26x]

Hello.  I see this thread stopped.  I am experiencing the same problem.  I attempted the ideas in this thread but i haven't fixed it. 

This is CF 2016.  HF 16.  The CF Administration panel works but CF sites that are in IIS (8.5) do not.

[Charlie Arehart]

Dan, when you say "the same problem" as mguenther1272, do you mean:

1. You get an error about a faulting msvcr dll?
2. And that it happens not in every request but only after a time?
3. And that you have multiple instances of cf?

If there are differences please share them. And you may want to share what error you DO get, and what steps you HAVE done, rather than say merely you've done them all. Your problem may differ in some important way.

And as I said to mguenther1272, you need not wait to wade through lots of backhand forth here over days. For a potentially complex challenge like this, it's a lot more effective to go through things in a shared desktop session together, which I offer in a consulting session. More at carehart.org/consulting. It's not free, no. But we may resolve things far more quickly than you could fear--and you won't pay for time you don't find valuable.

Or sure, we can dig in as a community here.

Btw, mguenther1272, did you ever resolve things? 

[Dan24843164p26x]

it happens on every call.  and there is only one instance of cf

I have:

* (re)reinstalled the msvcr 2010 and 2012.

the application event viewer shows the following,  I have to restart the application pool in IIS to try again,

Faulting application name: w3wp.exe, version: 8.5.9600.16384, time stamp: 0x5215df96
Faulting module name: MSVCR110.dll, version: 11.0.51106.1, time stamp: 0x5098826e
Exception code: 0xc0000005
Fault offset: 0x0000000000051d70
Faulting process id: 0x25b8
Faulting application start time: 0x01d87f2f2f1557ab
Faulting application path: c:\windows\system32\inetsrv\w3wp.exe
Faulting module path: C:\Windows\SYSTEM32\MSVCR110.dll
Report Id: 77326054-eb22-11ec-8174-005056b4cee6
Faulting package full name:
Faulting package-relative application ID:

Interesting, is that this machine initially wasn't getting the CF admin panel.  Then I installed HF 17. That got the admin panel worked but our code broke because of an 'elvis' operator.  I cleared the INF folder and restarted and that didn't help.  I took HF 17 off and i have had this problem since.  And that was yesterday.