Special Characters Not Translating

Forum|Forum|4 years ago
August 25, 2021
3 replies
705 views

Hi,

Using coldfusion 16 and backend sqlserver. Have a product table whose name field is of data type "nvarchar(250)". Have data to insert which contain special characters like Apostrophe (‘), Ampersand (&), Trademark (™), Circle R (®), Copyright – Circle C (©)

Now, it's storing in DB these characters like '?'.

Is it possible to store the characters as such in DB?

Please advise

This topic has been closed for replies.

BKBK

Community Expert

Ensure that your ColdFusion application uses UTF-8 encoding. One way to do so is as follows:

Open the ColdFusion Administrator for the particular ColdFusion instance;
Navigate to the page Server Settings > Java and JVM;
Inspect the content of the field JVM Arguments. Does it include the setting -Dfile.encoding=UTF-8 ?
If so, then the application uses UTF-8 encoding, and there's no need to proceed any further. We have to look for the cause of the problem elsewhere.
If not, then you have to include UTF-8 encoding in your Java settings.
To include UTF-8 encoding, place your mouse cursor at the end of the text in the JVM Arguments field. Press space-bar of your keyboard to create a space. Type -Dfile.encoding=UTF-8 and press the button to Submit Changes.
Restart the ColdFusion instance.

Does that solve the problem?

D

Dave Watts

Community Expert

If you're seeing those characters, it could be because you're not saving them as Unicode, or because you're not retrieving them as Unicode. Try each of those things separately. Look at SQL Server directly using SQL Server Management Console or whatever it's called nowadays, and run a query to fetch them. If they're still showing up as question marks, that indicates you're not saving them as Unicode. Otherwise, you're retrieving and/or displaying them in a way that doesn't support Unicode.

If you're not saving them as Unicode, check your SQL Server data source to make sure that the Unicode box is checked under "Advanced Settings" if I recall correctly. That's the most likely problem, I think. See how that works and let us know.

Dave Watts, Eidolon LLC

jibinanto40792294Author

Inspiring

Thanks for the guidance.
While trying directly from SQL Server Management Console window, the special characters are saved to table
column correctly.But while trying to insert using cf code, ie reading the special character text from a csv file
and importing to sql table,it is not getting saved properly.

Tried with above mentioned unicode settings from cf admin datasource advance settings area, restarted both cf service and system,still saving incorrectly.

Please advise