Known Participant

Answered

CFHTTP I/O Exception: null

Forum|Forum|7 years ago
December 3, 2018
4 replies
2344 views

Greetings,

I am trying to get PDF content using CFHTTP from the following link: https://policy.ucop.edu/doc/3220479/BFB-BUS-38.

It works in browser, but CFHTTP returns following:

ErrorDetail

I/O Exception: null

Filecontent

Connection Failure

Header

[empty string]

Mimetype

Unable to determine MIME type of file.

Responseheader

test - struct [empty]

Statuscode

Connection Failure. Status code unavailable.

Text

YES

My CF code is:

CF Server is CF11 developer edition, version 11,0,15,311399.

Looking at Response headers in browser, I noticed that Transfer-Encoding: chunked and Content-Length is missing(Server Apache). Is there problem with CFHTTP and Transfer-Encoding: chunked?

Any ideas on how to make it work?

Regards,

Simon

This topic has been closed for replies.

Correct answer BKBK

SimonGSW wrote
I am trying to get PDF content using CFHTTP from the following link: https://policy.ucop.edu/doc/3220479/BFB-BUS-38.
It works in browser, but CFHTTP returns following:
ErrorDetail I/O Exception: null
Filecontent Connection Failure
Header [empty string]
Mimetype Unable to determine MIME type of file.
Responseheader
test - struct [empty]
Statuscode Connection Failure. Status code unavailable.
Text YES
My CF code is:
<cfhttp method="get" url="https://policy.ucop.edu/doc/3220479/BFB-BUS-38" timeout="50" result="test"></cfhttp>
<cfdump var="#test#" label="test">
CF Server is CF11 developer edition, version 11,0,15,311399.
Looking at Response headers in browser, I noticed that Transfer-Encoding: chunked and Content-Length is missing(Server Apache). Is there problem with CFHTTP and Transfer-Encoding: chunked?
Any ideas on how to make it work?

Hi SimonGSW, I have an idea on how to make it work. The site may be expecting you to pass it some parameters. To know which parameters to pass, open any URL in the browser and press F12 on your keyboard to open the Developer Tools screen.

Then, with the Developer Tools still visible, open https://policy.ucop.edu/doc/3220479/BFB-BUS-38. You should see the PDF file as expected.

Now, click on the Network tab in Developer Tools. Copy all the request headers and use them as HTTP parameters in your cfhttp call. In your cfhttp tag, change the method from Get to Post. Also add the attributes, Port and Getasbinary. The result should be something like this:

</cfhttp>

BKBK

Community Expert

How to deal with different or changing cookies for 30 URLs is beyond your original question. Ask the ucop.edu webmaster for help.

For now, we have solved the CFHTTP I/O Exception problem.

BKBK

Correct answer

Community Expert

SimonGSW wrote
I am trying to get PDF content using CFHTTP from the following link: https://policy.ucop.edu/doc/3220479/BFB-BUS-38.
It works in browser, but CFHTTP returns following:
ErrorDetail I/O Exception: null
Filecontent Connection Failure
Header [empty string]
Mimetype Unable to determine MIME type of file.
Responseheader
test - struct [empty]
Statuscode Connection Failure. Status code unavailable.
Text YES
My CF code is:
<cfhttp method="get" url="https://policy.ucop.edu/doc/3220479/BFB-BUS-38" timeout="50" result="test"></cfhttp>
<cfdump var="#test#" label="test">
CF Server is CF11 developer edition, version 11,0,15,311399.
Looking at Response headers in browser, I noticed that Transfer-Encoding: chunked and Content-Length is missing(Server Apache). Is there problem with CFHTTP and Transfer-Encoding: chunked?
Any ideas on how to make it work?

Hi SimonGSW, I have an idea on how to make it work. The site may be expecting you to pass it some parameters. To know which parameters to pass, open any URL in the browser and press F12 on your keyboard to open the Developer Tools screen.

Then, with the Developer Tools still visible, open https://policy.ucop.edu/doc/3220479/BFB-BUS-38. You should see the PDF file as expected.

Now, click on the Network tab in Developer Tools. Copy all the request headers and use them as HTTP parameters in your cfhttp call. In your cfhttp tag, change the method from Get to Post. Also add the attributes, Port and Getasbinary. The result should be something like this:

</cfhttp>

S

SimonGSWAuthor

Known Participant

Thanks BKBK,

Your comment helped me to get a resolution. The issue is in passing cookies in CFHTTP request and also setting getasbinary="auto"(that should be default, but without that option, I got empty PDF file)

So,

</cfhttp>

works without problem, but more work needs to be done in order to get those cookies(I can't expect static values to work forever).

I used another CFHTTP with option redirect='no' to get those cookies and include those in the final CFHTTP. That has done the trick.

It is actually even more complex if request has more than one redirect. Just try link httpp://policy.ucop/edu/doc/3220479. That one has additional redirect from http to https and requires additional level of cfhttp to get the final result.

My task was actually collecting documents(multiple formats) from links on University policy site.

Regards,

Simon

BKBK

Community Expert

Glad to see it is working. I experimented by setting the cookie values to 0, and I still got the PDF.

</cfhttp>

Charlie Arehart

Community Expert

Simon, I don't see that anyone has asked what JVM version you have CF using. It may be Java 7 (as CF11 originally came out on that). You can see the JVM version CF is using in the CF Admin "setttings summary" page.

And it may need that you simply need to update to Java 8. (And as long as you have applied CF11 update 3, which added support for Java 8.)

Sometimes (despite the lack of clarity in the errors you see), issues of CFHTTP failures calling out to https URLs are down to differences in the DESTINATION's support for various SSL or TLS versions and encryption algorithms, and some are NOT supported by Java 7 or earlier.

(And this is also why you find it "works" in a real browser but not in CF. Like Dave said about certs, what browsers support is different than what is supported by the java-based httpclient class in CF, which is simulating a browser for us.)

Are you aware of how to update CF to point to a new JVM? There are various resources out there. And then as for things that can go wrong when updating the JVM and how to recover/avoid those problems, I have a blog post on it, listed at the top of my https://www.carehart.org/top.cfm page.

Let us know if this is it or not.

/Charlie (troubleshooter, carehart. org)

S

SimonGSWAuthor

Known Participant

Thanks Charlie,

CF Admin reports Java Version 1.8.0_25 and I have latest CF11 update installed.

It would be interesting if anybody can check that issue with CFFTP in CF 2018 or CF 2016 using URL that I supplied https://policy.ucop.edu/doc/3220479/BFB-BUS-38 https://policy.ucop.edu/doc/3220479/BFB-BUS-38http://

That just a link to a PDF document in UC California.

Regards,

Simon

Charlie Arehart

Community Expert

That's an old Java 8. A later one might work: the latest is 191.

Ans I'm afraid I'm seeing this on my phone so challenging to test it while out. Perhaps someone else will if I don't get to try that for you.

/Charlie

Sent via the Samsung Galaxy S7 active, an AT&T 4G LTE smartphone

/Charlie (troubleshooter, carehart. org)

WolfShade

Legend

I'm not sure, but I think that if you're going to have the web server connect to a secure (SSL/TLS) website, you have to manually insert the certificate for CF to transmit via Apache. Per the CFHTTP docs:

Manually import a certificate

Go to a page on the SSL server in question.
Double-click the lock icon.
Click the Details tab.
Click Copy To File.
Select the base64 option and save the file.
Copy the CER file into C:\ColdFusion9\runtime\jre\lib\security (or whichever JRE ColdFusion is using).
Run the following command in the same directory (keytool.exe is located in C:\ColdFusion9\runtime\jre\bin):
keytool -import -keystore cacerts -alias giveUniqueName -file filename.cer

HTH,

^ _ ^

S

SimonGSWAuthor

Known Participant

Thanks for your reply.

I think that is not the case.

1. Certificate for the site is signed by authority that JSSE should definitely recognize InCommon RSA

2. Error Detail should be different, like authentication issue(not NULL)

Regards,

Simon

D

Dave Watts

Community Expert

Nevertheless, that is by far the most likely cause of your error. Generally, when you get a connection failure attempting to connect via TLS, that is the cause. The Java keystore typically does not contain the certificate chain for your site's certificate. It doesn't contain nearly as many root and intermediate certificates as a browser. And there is no error that CF can really see - it is literally unable to connect to the site. It doesn't receive an authentication error, TLS connection doesn't require authentication. If I was betting on the cause of your error, I'd put every dollar I have on this.

Dave Watts, Fig Leaf Software

Dave Watts, Eidolon LLC

Manually import a certificate

Sign up

To post, reply, or follow discussions, please sign in with your Adobe ID.

Sign in to Adobe Community

To post, reply, or follow discussions, please sign in with your Adobe ID.

Scanning file for viruses.

This file cannot be downloaded