Charset detection

<h2 id="see-also">See also</h2>
<ul><li><a href="/facts/International_Components_for_Unicode/SVyD2Yr5">International Components for Unicode</a> – a library that can perform charset detection</li>
<li><a href="/facts/Language_identification/PwGzN9Nt">Language identification</a></li>
<li><a href="/facts/Content_sniffing/E1lTSs97">Content sniffing</a></li>
<li><a href="/facts/Browser_sniffing/eM7YD1Bz">Browser sniffing</a> – a similar heuristic technique for determining the capabilities of a web browser, before serving content to it</li></ul>

<h2 id="external-links">External links</h2>
<ul><li><a href="http://msdn.microsoft.com/en-us/library/aa920101.aspx">IMultiLanguage2::DetectInputCodepage</a></li>
<li><a href="https://web.archive.org/web/20101217195221/http://icu-project.org/apiref/icu4c/ucsdet_8h.html">API reference for ICU charset detection</a></li>
<li><a href="http://cpdetector.sourceforge.net/usage.shtml">Reference for <i>cpdetector</i> charset detection</a></li>
<li><a href="https://www-archive.mozilla.org/projects/intl/chardet.html">Mozilla Charset Detectors</a></li>
<li><a href="https://web.archive.org/web/20101018031124/http://jchardet.sourceforge.net/">Java port of Mozilla Charset Detectors</a></li>
<li><a href="http://chsdet.sourceforge.net/">Delphi/Pascal port of Mozilla Charset Detectors</a></li>
<li><a href="https://www.freedesktop.org/wiki/Software/uchardet/"><i>uchardet</i>, C++ fork of Mozilla Charset Detectors; includes Bash command-line tool</a></li>
<li><a href="https://github.com/errepi/ude">C# port of Mozilla Charset Detectors</a></li>
<li><a href="http://www.joshisanerd.com/projects/hebci/">HEBCI, a technique for detecting the character set used in form submissions</a></li>
<li><a href="http://www.fas.org/irp/doddir/army/fm34-40-2/appb.pdf">Frequency distributions of English trigraphs</a></li></ul>

<h2 id="references">References</h2>

<ol>
<li id="fn:1"><p>"PHP: mb_detect_encoding - Manual". www.php.net. Retrieved 2024-11-12. <a href="https://www.php.net/manual/en/function.mb-detect-encoding.php#:~:text=Automatic%20detection%20of%20the%20intended,encrypted%20string%20without%20the%20key." target="_blank">https://www.php.net/manual/en/function.mb-detect-encoding.php#:~:text=Automatic%20detection%20of%20the%20intended,encrypted%20string%20without%20the%20key.</a> <a href="#fnref:1" class="footnote-back-ref">↩</a></p></li>
<li id="fn:2"><p>Kim, Seung-Ho; Park, Jongsoo (2007). "Automatic Detection of Character Encoding and Language". {{cite journal}}: Cite journal requires |journal= (help) <a href="https://www.semanticscholar.org/paper/Automatic-Detection-of-Character-Encoding-and-Kim-Park/ec4965fa465b92aed3e8843ab24ce809cb50a9e7" target="_blank">https://www.semanticscholar.org/paper/Automatic-Detection-of-Character-Encoding-and-Kim-Park/ec4965fa465b92aed3e8843ab24ce809cb50a9e7</a> <a href="#fnref:2" class="footnote-back-ref">↩</a></p></li>
<li id="fn:3"><p>Kim, Seung-Ho; Park, Jongsoo (2007). "Automatic Detection of Character Encoding and Language". {{cite journal}}: Cite journal requires |journal= (help) <a href="https://www.semanticscholar.org/paper/Automatic-Detection-of-Character-Encoding-and-Kim-Park/ec4965fa465b92aed3e8843ab24ce809cb50a9e7" target="_blank">https://www.semanticscholar.org/paper/Automatic-Detection-of-Character-Encoding-and-Kim-Park/ec4965fa465b92aed3e8843ab24ce809cb50a9e7</a> <a href="#fnref:3" class="footnote-back-ref">↩</a></p></li>
<li id="fn:4"><p>"PHP: mb_detect_encoding - Manual". www.php.net. Retrieved 2024-11-12. <a href="https://www.php.net/manual/en/function.mb-detect-encoding.php#:~:text=Automatic%20detection%20of%20the%20intended,encrypted%20string%20without%20the%20key." target="_blank">https://www.php.net/manual/en/function.mb-detect-encoding.php#:~:text=Automatic%20detection%20of%20the%20intended,encrypted%20string%20without%20the%20key.</a> <a href="#fnref:4" class="footnote-back-ref">↩</a></p></li>
<li id="fn:5"><p>"A composite approach to language/encoding detection". www-archive.mozilla.org. Retrieved 2024-11-12. <a href="https://www-archive.mozilla.org/projects/intl/universalcharsetdetection.html" target="_blank">https://www-archive.mozilla.org/projects/intl/universalcharsetdetection.html</a> <a href="#fnref:5" class="footnote-back-ref">↩</a></p></li>
<li id="fn:6"><p>In a random byte string, a byte with the high bit set has only a 1/15 chance of starting a valid UTF-8 code point. Odds are even lower in actual text, which is not random but tends to contain isolated bytes with the high bit set which are always invalid in UTF-8. <a href="#fnref:6" class="footnote-back-ref">↩</a></p></li>
<li id="fn:7"><p>"A composite approach to language/encoding detection". www-archive.mozilla.org. Retrieved 2024-11-12. <a href="https://www-archive.mozilla.org/projects/intl/universalcharsetdetection.html" target="_blank">https://www-archive.mozilla.org/projects/intl/universalcharsetdetection.html</a> <a href="#fnref:7" class="footnote-back-ref">↩</a></p></li>
</ol>

Charset detection open-in-new

Charset detection