

As you can see from the screen prints below, most of the rows contain one or several special characters. First, we need to create a UTF-8 encoded text file with some special characters. Working with SSIS and UTF-8 Unicode DataĮnough of the theory and background let us put this knowledge into practice. To ease the conversion from prior encoding standards, keep in mind the first 128 UTF-8 characters match the ANSI character encoding standards. Of course, there is much more to it, so feel free to take a look at the link in the next steps section of this tip.

I know I am going to do a disservice to the encoding process by explaining the transformation in these terms, however, UTF is sort of like the decryption key (or secret decoder ring!) used to map your backend bytes to the actual characters displayed on the screen. Drilling down further, UTF-8 is actually an encoding method for handling all the characters in the Unicode set of characters and stands for Unicode Transformation Format. The consortium was setup to standardize the numbering scheme assigned to represent a letter or character across all languages, countries, software products, and hardware platforms. Unicode is an encoding standard maintained by the Unicode Consortium most of the biggest players in the technology field (Google, SAP, Microsoft, Oracle) along with many others belong to the consortium. First, providing some background about UTF-8 and Unicode would likely go a long way into explaining how to handle these different code page types.
