Req #47875 [Com]: No option to set HTML input encoding

Wed, 04 Jul 2012 01:02:33 -0700 

Edit report at https://bugs.php.net/bug.php?id=47875&edit=1

 ID:                 47875
 Comment by:         julien at go-on-web dot com
 Reported by:        thomas dot koch at ymc dot ch
 Summary:            No option to set HTML input encoding
 Status:             Open
 Type:               Feature/Change Request
 Package:            DOM XML related
 Operating System:   Debian Lenny
 PHP Version:        5.2.9
 Block user comment: N
 Private report:     N

 New Comment:

I have another test case for you, using HTML5 :


<?php


// ----- 
// FAIL CASE

$html = <<<HTML
<!DOCTYPE html>
<html lang="fr">
  <head>
    <meta charset="UTF-8"/>
  </head>
  <body>
    <p id="accent">Test case with simple accent (&eacute;) : é</p>
  </body>
</html>
HTML;
                
$doc = new DomDocument( 1.0, 'UTF-8' );
$doc->loadHTML( $html );

var_dump( $doc->getElementById('accent')->textContent );

//=> string(40) "Test case with simple accent (é) : é" 
// ----



// -----
// SUCCESS CASE (but invalid html5)

$html = <<<HTML
<!DOCTYPE html>
<html lang="fr">
  <head>
    <meta http-equiv="content-type" content="text/html; charset=utf-8"/>
  </head>
  <body>
    <p id="accent">Test case with simple accent (&eacute;) : é</p>
  </body>
</html>
HTML;

$doc = new DomDocument( 1.0, 'UTF-8' );
$doc->loadHTML( $html );

var_dump( $doc->getElementById('accent')->textContent );

//=> string(38) "Test case with simple accent (é) : é"
// -----

?>


Regards, 
Julien


Previous Comments:
------------------------------------------------------------------------
[2009-04-02 09:07:32] thomas dot koch at ymc dot ch

Description:
------------
Enhancement request.

I need a possibility to indicate the html input encoding (as parsed from the 
HTTP headers) when parsing a html string with DOMDocument::loadHTML. Using 
loadHTMLFile is not always an option.

libxml2 honors the content-type meta tag, but this may not always be present.

How should the input encoding be indicated? In DOMDocument::__construct() or in 
DOMDocument::encoding or is that both the same?

One could look in libxml2/HTMLparser.c#5580, function
htmlCreateFileParserCtxt(const char *filename, const char *encoding)

There the encoding is set by first building a "charset=$encoding" string and 
passing it to htmlCheckEncoding, which in turn parses the encoding out of the 
string again. This may be worth cleaning up together with upstream.

Reproduce code:
---------------
<?php

$html = <<<EOT
<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN" 
"http://www.w3.org/TR/REC-html40/loose.dtd";>
<html> 
<head> 
<!--meta http-equiv="content-type" content="text/html; charset=utf-8" -->
</head>
<body id="umlaut">süß</body>
</html>
EOT;

$dom = new DOMDocument;
var_dump( $dom->loadHTML( $html ) );
$elem = $dom->getElementById( 'umlaut' );
echo $elem->textContent;




------------------------------------------------------------------------



-- 
Edit this bug report at https://bugs.php.net/bug.php?id=47875&edit=1

Reply via email to