files/config.unicode_support.html

config.unicode_support.html 

  1. <!DOCTYPE html><html>
  2.    <head>
  3.       <meta http-equiv="X-UA-Compatible" content="IE=edge" />
  4.       <meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
  5.       <title>Unicode Support // P4Convert: User Guide</title>
  6.       <meta name="generator" content="DocBook XSL Stylesheets V1.78.1 with Perforce customizations" />
  7.       <link rel="home" href="copyright.html" title="P4Convert: User Guide" />
  8.       <link rel="up" href="chapter.config.html" title="Configuration" />
  9.       <link rel="prev" href="config.changelist_offset_options.html" title="Changelist Offset options" />
  10.       <link rel="next" href="config.advanced.html" title="Advanced Configuration" />
  11.       <meta name="Section-title" content="Unicode Support" />
  12.       <meta name="viewport" content="width=device-width, initial-scale=1.0" />
  13.       <link rel="stylesheet" href="vendor/bootstrap/css/bootstrap.css" />
  14.       <link rel="stylesheet" href="vendor/prettify/prettify.css" />
  15.       <link rel="stylesheet" href="css/perforce.css" />
  16.       <link rel="stylesheet" href="css/print.css" media="print" />
  17.       <link rel="shortcut icon" href="images/favicon.ico" />
  18.       <!--[if lt IE 9]>
  19.   <script type="text/javascript" src="vendor/respond/respond.min.js"></script>
  20.   <link rel="stylesheet" type="text/css" href="css/ie.css"/>
  21. <![endif]-->
  22.    </head>
  23.    <body><a id="page-top"></a><div id="header">
  24.          <div class="container"><button name="toc" type="button" class="toc"><span class="glyphicon glyphicon-list"></span></button><span class="logo"><a href="http://www.perforce.com/documentation"></a></span><h1><a href="index.html" class="title"><span class="brand"></span><span class="guide-title">P4Convert: User Guide</span><span class="guide-subtitle">
  25.                                    (April 2015)
  26.                                  </span></a></h1><a title="Download a PDF version of this guide" class="pdf" href="ethel.pdf"><span class="glyphicon glyphicon-book"></span></a><button name="search" type="button" class="search" title="Search this guide"><span class="glyphicon glyphicon-search"></span></button></div>
  27.          <div id="progress"></div>
  28.       </div>
  29.       <div id="content" class="content" tabindex="-1">
  30.          <div class="container">
  31.             <!---->
  32.             <div class="section" id="config.unicode_support">
  33.                <div class="titlepage">
  34.                   <div>
  35.                      <div>
  36.                         <h2 class="title" style="clear: both">Unicode Support</h2>
  37.                      </div>
  38.                   </div>
  39.                </div>
  40.                <p>
  41.                   The following Unicode enable options apply to Unicode support for Import
  42.                   Mode and Convert Mode. The Charset options are only applicable to Import
  43.                   Mode, when translating a file through the Perforce client. In Convert Mode
  44.                         archive files are always written in UTF-8 for a Unicode enabled Perforce
  45.                         server.
  46.                       
  47.                </p>
  48.                <p>
  49.                         Defaults (for non-Unicode servers):
  50.                       
  51.                </p><pre lang="ini" class="programlisting">
  52. com.p4convert.p4.unicode=false
  53. com.p4convert.p4.translate=true
  54. com.p4convert.p4.charset=&lt;none&gt;
  55. </pre><p>
  56.                         In some situations it is preferable to import text files as-is (untranslated).
  57.                         Typically this is true for a non-unicode environment where all the user are on
  58.                         Windows clients.  To disable translation set the following option to
  59.                         <em class="parameter"><code>false</code></em>.
  60.                       
  61.                </p><pre lang="ini" class="programlisting">
  62. com.p4convert.p4.translate=false
  63. </pre><p>
  64.                         When translation is disabled high-ascii text uses the content type
  65.                         <em class="parameter"><code>TEXT-RAW</code></em> and the following warning is disabled:
  66.                       
  67.                </p><pre lang="ini" class="programlisting">
  68. ... Non-unicode server, downgrading file to text
  69. </pre><p>
  70.                         Recommended configuration for a Unicode conversion:
  71.                       
  72.                </p><pre lang="ini" class="programlisting">
  73. com.p4convert.p4.unicode=true
  74. com.p4convert.p4.translate=true
  75. com.p4convert.p4.charset=utf8
  76. </pre><p>
  77.                         For Unicode conversions set the JVM arg:
  78.                       
  79.                </p><pre lang="ini" class="programlisting">
  80. -Dfile.encoding=UTF-8
  81. </pre><p>
  82.                         Some Solaris and Linux conversions may need the locale set:
  83.                       
  84.                </p><pre lang="bash" class="programlisting">
  85. export LC_ALL=en_GB.UTF-8 
  86. </pre><p>
  87.                         Once a Perforce server is switched to Unicode enabled mode
  88.                         (<em class="parameter"><code>-xi</code></em>), all client workspaces need to define a
  89.                         character set. For details see:
  90.                       
  91.                </p>
  92.                <p>
  93.                         <a class="link" href="http://answers.perforce.com/articles/KB_Article/Internationalization-and-Localization" target="_top">http://answers.perforce.com/articles/KB_Article/Internationalization-and-Localization</a>
  94.                       
  95.                </p>
  96.                <div class="note admonition">
  97.                   <h3 class="title">Note</h3>
  98.                   <p>
  99.                              A non-Unicode enabled Perforce Server will accept UTF16 files.
  100.                            
  101.                   </p>
  102.                </div>
  103.                <div class="section" id="config.unicode_support.normalization">
  104.                   <div class="titlepage">
  105.                      <div>
  106.                         <div>
  107.                            <h3 class="title">Normalisation</h3>
  108.                         </div>
  109.                      </div>
  110.                   </div>
  111.                   <p>
  112.                              Platform Unicode normalisation is detected when the configuration file
  113.                              is generated, however it can be changed by setting the following
  114.                              configuration option to <code class="literal">NFC</code> or
  115.                              <code class="literal">NFD</code>:
  116.                            
  117.                   </p><pre lang="ini" class="programlisting">
  118. com.p4convert.p4.normalisation=NFD
  119. </pre><p>
  120.                              The default detection is based on the following:
  121.                            
  122.                   </p>
  123.                   <div class="informaltable">
  124.                      <table border="0">
  125.                         <colgroup>
  126.                            <col class="platform" />
  127.                            <col class="normalization" />
  128.                         </colgroup>
  129.                         <thead>
  130.                            <tr>
  131.                               <th>
  132.                                  <p>Platform</p>
  133.                               </th>
  134.                               <th>
  135.                                  <p>Normalization</p>
  136.                               </th>
  137.                            </tr>
  138.                         </thead>
  139.                         <tbody>
  140.                            <tr>
  141.                               <td>
  142.                                  <p>Windows</p>
  143.                               </td>
  144.                               <td>
  145.                                  <p><code class="literal">NFC</code></p>
  146.                               </td>
  147.                            </tr>
  148.                            <tr>
  149.                               <td>
  150.                                  <p>Mac</p>
  151.                               </td>
  152.                               <td>
  153.                                  <p><code class="literal">NFD</code></p>
  154.                               </td>
  155.                            </tr>
  156.                            <tr>
  157.                               <td>
  158.                                  <p>*nix/*nux</p>
  159.                               </td>
  160.                               <td>
  161.                                  <p><code class="literal">NFC</code></p>
  162.                               </td>
  163.                            </tr>
  164.                            <tr>
  165.                               <td>
  166.                                  <p>Sun</p>
  167.                               </td>
  168.                               <td>
  169.                                  <p><code class="literal">NFC</code></p>
  170.                               </td>
  171.                            </tr>
  172.                         </tbody>
  173.                      </table>
  174.                   </div>
  175.                </div>
  176.                <div class="section" id="config.unicode_support.subversion_properties">
  177.                   <div class="titlepage">
  178.                      <div>
  179.                         <div>
  180.                            <h3 class="title">Subversion Properties</h3>
  181.                         </div>
  182.                      </div>
  183.                   </div>
  184.                   <p>
  185.                              By default, the converter parses Subversion properties as UTF-8 strings.
  186.                              The conversion uses properties such as <code class="literal">svn:log</code>,
  187.                              <code class="literal">svn:author</code> for attributes in Perforce and must decode
  188.                              the byte sequence to UTF-8. In some data sets Windows users may have
  189.                              added high ASCII characters in one or more code pages. This release now
  190.                              supports a configuration option:
  191.                            
  192.                   </p><pre lang="ini" class="programlisting">
  193. com.p4convert.svn.propTextType=UNKNOWN
  194. </pre><p>
  195.                              The following strings denote the supported char-sets:
  196.                            
  197.                   </p>
  198.                   <table border="0" summary="Simple list" class="simplelist">
  199.                      <tr>
  200.                         <td>Big5</td>
  201.                         <td>IBM424_rtl</td>
  202.                         <td>ISO-8859-7</td>
  203.                         <td>UTF-16LE</td>
  204.                      </tr>
  205.                      <tr>
  206.                         <td>BINARY</td>
  207.                         <td>ISO-2022-CN</td>
  208.                         <td>ISO-8859-8</td>
  209.                         <td>UTF-32BE</td>
  210.                      </tr>
  211.                      <tr>
  212.                         <td>EUC-JP</td>
  213.                         <td>ISO-2022-JP</td>
  214.                         <td>ISO-8859-9</td>
  215.                         <td>UTF-32LE</td>
  216.                      </tr>
  217.                      <tr>
  218.                         <td>EUC-KR</td>
  219.                         <td>ISO-2022-KR</td>
  220.                         <td>KOI8-R</td>
  221.                         <td>UTF-8</td>
  222.                      </tr>
  223.                      <tr>
  224.                         <td>GB18030</td>
  225.                         <td>ISO-8859-1</td>
  226.                         <td>Shift_JIS</td>
  227.                         <td>windows-1251</td>
  228.                      </tr>
  229.                      <tr>
  230.                         <td>IBM420_ltr</td>
  231.                         <td>ISO-8859-2</td>
  232.                         <td>UNKNOWN</td>
  233.                         <td>windows-1252</td>
  234.                      </tr>
  235.                      <tr>
  236.                         <td>IBM420_rtl</td>
  237.                         <td>ISO-8859-5</td>
  238.                         <td>US-ASCII</td>
  239.                         <td>windows-1254</td>
  240.                      </tr>
  241.                      <tr>
  242.                         <td>IBM424_ltr</td>
  243.                         <td>ISO-8859-6</td>
  244.                         <td>UTF-16BE</td>
  245.                         <td>windows-1256</td>
  246.                      </tr>
  247.                   </table>
  248.                   <p>
  249.                              The first scan is always <code class="literal">UTF-8</code> followed by the
  250.                              configuration option. <code class="literal">BINARY</code> implies a skip and the
  251.                              string <code class="literal">&lt;binary property&gt;</code> is inserted.
  252.                            
  253.                   </p>
  254.                </div>
  255.             </div>
  256.          </div>
  257.       </div>
  258.       <div id="nav" class="toc"></div>
  259.       <div id="search">
  260.          <div class="input"><input id="search-text" type="search" placeholder="Search this guide" /><button name="clear" type="button" class="clear"><span class="glyphicon glyphicon-remove-sign"></span></button></div>
  261.          <div class="controls">
  262.             <div class="substring"><input type="checkbox" class="substring" name="substring" value="hide" checked="1" /><span class="description">Hide partial matches</span></div>
  263.             <div class="highlighter"><input type="checkbox" class="highlight" name="highlight" value="show" checked="1" /><span class="description">Highlight matches</span></div>
  264.          </div>
  265.          <div class="count"><span class="number">0</span> matching pages
  266.                   
  267.          </div>
  268.          <ul class="results"></ul>
  269.       </div>
  270.       <div id="footer">
  271.          <div class="container"><a accesskey="p" class="nav-prev" title="Press 'p', or left-arrow, to view the previous page" href="config.changelist_offset_options.html"><span class="glyphicon glyphicon-chevron-left"></span><div class="label">Previous</div>
  272.                <div class="title">Changelist Offset options</div></a><a accesskey="n" class="nav-next" title="Press 'n', or right-arrow, to view the next page" href="config.advanced.html"><span class="glyphicon glyphicon-chevron-right"></span><div class="label">Next</div>
  273.                <div class="title">Advanced Configuration</div></a></div>
  274.       </div><script type="text/javascript" src="vendor/jquery/jquery-1.11.3.min.js"></script><script type="text/javascript" src="vendor/bootstrap/js/bootstrap.js"></script><script type="text/javascript" src="vendor/cookie/jquery.cookie.js"></script><script type="text/javascript" src="vendor/highlight/jquery.highlight.js"></script><script type="text/javascript" src="vendor/jsrender/jsrender.js"></script><script type="text/javascript" src="vendor/touchwipe/jquery.touchwipe.min.js"></script><script type="text/javascript" src="vendor/prettify/prettify.js"></script><script defer="1" type="text/javascript" src="js/index.js"></script><script defer="1" type="text/javascript" src="js/toc.js"></script><script defer="1" type="text/javascript" src="js/perforce.js"></script></body>
  275. </html>
# Change User Description Committed
#1 13899 Paul Allen added docs to gradle 10 years ago