IT Answers » UTF-8

Store and retrieve data in UTF-8 on SQL Server 2005

MrGeorge — Fri, 03 Feb 2012 11:11:50 +0000

(Apologies:I put this question under Windows Server 2003 tag by mistake, so I copied and pasted it here where it should be)
I am trying to store and retrieve data in UTF-8 on SQL Server 2005 and having problems. I manually type Greek (just for example) into the database and when I open the table SQL makes it into question marks ???. What should I do to be able to store and read UTF-8 data? My columns are all NVARCHAR(MAX). I anticipate that my database will need to store other languages too through a scripting language (ASP Classic in this case). How do I tell SQL Server 2005 to support more than one language for storing and retrieving data?

Parsing a XML file with Chinese Characters in AS/400

EdmondTang — Wed, 05 Oct 2011 04:33:15 +0000

I am working on a project which require to parse a XML file (in UTF-8 encoding) and put the value into a AS/400 physical file by using JAVA. However, one of the tags in XML may contain both Traditional Chinese and Simplified Chinese characters.
The field in the physical file has already defined as DBCS (Open-type).
Now, my problem is I could only select ONE CCSID every time when I convert the byte stream back into string (for EBCDIC) in JAVA (please correct me if my understanding is wrong), for example, I am now using valueString.getBytes(“CP937″). However, it seems that “CP937″ does not support Simplified Chinese and if I change it to “CP935″, the results is Traditional Chinese cannot be supported this time.

Could anyone advise how can I support both Traditional Chinese and Simplified Chinese? Thanks so much!

Transfer data file ‘PF’ from AS/400 to AIX

mohammadhirbawi — Mon, 18 Oct 2010 09:40:19 +0000

I want to transfer data file ‘PF’ from AS/400 to AIX server,but i want to change the file type to UTF-8. please advice me how to do this. thanks

How to display CCSID(1200) in a DSPF 5250

Protelo — Tue, 12 Oct 2010 17:25:27 +0000

I am working on a project to enable certain fields in the DB for unicode UTF-8. I have coded the affected DSPF with CCSID(1200) and recompiled, however the data is still displayed as gibberish. What am I doing wrong?

Convert/Supress non UTF-8 to UTF-8 on as/400 while CPYTOSTMF

NarasimhaReddy — Fri, 31 Jul 2009 12:01:54 +0000

Hi,

I am generating XML from AS/400. I am doing following steps:
Creating Flat File wiht RCDLEN (260) and CCSID 65535 (Default).
I am reading data from some other Physical File.
Putting data in between XML tags in required XML format and writing this record into Flat File.
Now flat file contains XML formatted data.
I do CPYTOSTMF with STMFCODPAG(*PCASCII).
Then I copy the XML file from IFS to PC.
Now, If I open the XML file on PC, it gives error some times. Error is File contains non UTF-8 characters, those are not valid in XML file.

If I check the data in my original PF, It has some invalid characters. I am getting these data from other open systems into my AS/400.

Can some body help How to suppress or convert these characters, so that I can process XML on PC successfully.

Thanks
Reddy

ArcGIS, .NET, Urgent! Please help

Andisheh — Thu, 18 Jun 2009 14:28:21 +0000

I’m trying to save a unicode utf8 string –> “سلام” in a feature of a featureclass, but it is saved like “????”.as ArcMap support different encodin and also Farsi that I’m working with, It should be possible through my program.but I didn’t find any way yet.anybody knows about this?

feature = fc.CreateFeature();
feature.Shape = point;
feature.set_Value(feature.Fields.FindField(“Name”), o.Name);
feature.Store();

fc is an IFeatureClass, feature is an IFeature and o.Name is a unicode.utf8 string.in watch window:
feature.get_value(feature.Fields.FindField(“Name”))–> is OK
but
fc.GetFeature(1).Get_Value(feature.Fields.FindField(“Name”)) –> is “????”

and this is what is saved. What should I do? Cry

Sending emails in UTF-8 format using a BlackBerry

mshen — Fri, 20 Mar 2009 08:07:05 +0000

A Blackberry Pearl user is sending emails for a gmail account. The emails are being sent in Windows-1252 format. How do I set it to send emails in a UTF-8 format?

How do you create a file containing Simplified Chinese characters (DBCS) and English in the same field on IBM iSeries IFS in UNICODE UTF-8 format?

Tom P — Fri, 20 Jun 2008 19:10:34 +0000

Caveat – I am not an iSeries programmer(since 15 years ago), so please be very specific with your answer so that I can understand it. I am trying to print product labels with Simplified Chinese characters on a Zebra bar code printer from data retrieved from IBM iSeries (AS/400). The data for the label is created by an RPG ILE program in XML format (essentially a text file with 1 field). The file is defined with CCSID 935 (Simplified Chinese), which should handle mixed SBCS and DBCS. The iSeries user profile is defined to use Simplified Chinese. The iSeries session is run on a VMWare VM created to display Chinese characters. The problem I am having is converting the file from the EBCDIC to UNICODE UTF-8, which is required to print the Chinese characters on the bar code printer. The file is in an XML format because the printer has a built-in XML parser in its firmware that overlays the label format with the values in the XML file. For label fields using Chinese characters a special font is used that contains the Simplified Chinese character set (UNICODE font) in onboard flash memory. Label formats (ZPL) reside in onboard flash memory on the printer also. I have tried FTP’ing the file directly from the iSeries to the printer but the EBCDIC to UNICODE conversion did not work. I’ve tried CCSID’s of 1208 and 13488 for the UNICODE output. I’ve tried outputting the XML file to the IFS so that I could FTP the file directly to the printer from there, but I haven’t quite managed to generate the file in UNICODE UTF-8 on the IFS. It continues to be EBCDIC on the IFS. You can view the file from the iSeries using the EDTF command and see the Chinese characters, but viewing the file in the IFS from the desktop using NotePad++ you can only see garbage until you convert the file from EBCDIC to ASCII. I have contacted IBM Tech Support and have opened an issue. So far (several months) they have been unable to come up with a workable solution. I am hoping that someone has already encountered this or a similar issue and solved it. After all, there are a lot of companies doing business in China and some of them use the iSeries. Thanks in advance.