[jira] [Commented] (TIKA-2727) Parsing and detect mime type of XML file stuck in infinite loop
[ https://issues.apache.org/jira/browse/TIKA-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16705058#comment-16705058 ] Tim Allison commented on TIKA-2727: --- CVE-2018-11796 http://tika.apache.org/security.html > Parsing and detect mime type of XML file stuck in infinite loop > --- > > Key: TIKA-2727 > URL: https://issues.apache.org/jira/browse/TIKA-2727 > Project: Tika > Issue Type: Bug > Components: detector, parser >Affects Versions: 1.17 >Reporter: Slava G >Assignee: Tim Allison >Priority: Blocker > Fix For: 2.0.0, 1.19.1 > > Attachments: 1_6e4b115e-7d2d-45f1-a842-35b5ad7ba559, > 1_e3e13f0e-7085-4000-a558-5d255ed7a944.xml > > > Hi, > I'm trying to parse (even mime type detect) some XML file that it's not > large, but kinda tricky and my process hangs on : > XMLStringBuffer.append(char[], int, int) line: not available > XMLStringBuffer.append(XMLString) line: not available > XMLNSDocumentScannerImpl(XMLScanner).scanAttributeValue(XMLString, XMLString, > String, boolean, String) line: not available > XMLNSDocumentScannerImpl.scanAttribute(XMLAttributesImpl) line: not available > XMLNSDocumentScannerImpl.scanStartElement() line: not available > XMLNSDocumentScannerImpl$NSContentDispatcher.scanRootElementHook() line: not > available > XMLNSDocumentScannerImpl$NSContentDispatcher(XMLDocumentFragmentScannerImpl$FragmentContentDispatcher).dispatch(boolean) > line: not available > XMLNSDocumentScannerImpl(XMLDocumentFragmentScannerImpl).scanDocument(boolean) > line: not available > XIncludeAwareParserConfiguration(XML11Configuration).parse(boolean) line: not > available > XIncludeAwareParserConfiguration(XML11Configuration).parse(XMLInputSource) > line: not available > SAXParserImpl$JAXPSAXParser(XMLParser).parse(XMLInputSource) line: not > available > SAXParserImpl$JAXPSAXParser(AbstractSAXParser).parse(InputSource) line: not > available > SAXParserImpl$JAXPSAXParser.parse(InputSource) line: not available > SAXParserImpl.parse(InputSource, DefaultHandler) line: not available > SAXParserImpl(SAXParser).parse(InputStream, DefaultHandler) line: 195 > XmlRootExtractor.extractRootElement(InputStream) line: 62 > XmlRootExtractor.extractRootElement(byte[]) line: 42 > MimeTypes.getMimeType(byte[]) line: 212 > MimeTypes.detect(InputStream, Metadata) line: 494 > DefaultDetector(CompositeDetector).detect(InputStream, Metadata) line: 84 > > Please see attached XML file. > Please advise. > Thanks -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (TIKA-2727) Parsing and detect mime type of XML file stuck in infinite loop
[ https://issues.apache.org/jira/browse/TIKA-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16705055#comment-16705055 ] David Dillard commented on TIKA-2727: - Any plans to get a CVE for this issue? A hang sounds like a Denial of Service to me. > Parsing and detect mime type of XML file stuck in infinite loop > --- > > Key: TIKA-2727 > URL: https://issues.apache.org/jira/browse/TIKA-2727 > Project: Tika > Issue Type: Bug > Components: detector, parser >Affects Versions: 1.17 >Reporter: Slava G >Assignee: Tim Allison >Priority: Blocker > Fix For: 2.0.0, 1.19.1 > > Attachments: 1_6e4b115e-7d2d-45f1-a842-35b5ad7ba559, > 1_e3e13f0e-7085-4000-a558-5d255ed7a944.xml > > > Hi, > I'm trying to parse (even mime type detect) some XML file that it's not > large, but kinda tricky and my process hangs on : > XMLStringBuffer.append(char[], int, int) line: not available > XMLStringBuffer.append(XMLString) line: not available > XMLNSDocumentScannerImpl(XMLScanner).scanAttributeValue(XMLString, XMLString, > String, boolean, String) line: not available > XMLNSDocumentScannerImpl.scanAttribute(XMLAttributesImpl) line: not available > XMLNSDocumentScannerImpl.scanStartElement() line: not available > XMLNSDocumentScannerImpl$NSContentDispatcher.scanRootElementHook() line: not > available > XMLNSDocumentScannerImpl$NSContentDispatcher(XMLDocumentFragmentScannerImpl$FragmentContentDispatcher).dispatch(boolean) > line: not available > XMLNSDocumentScannerImpl(XMLDocumentFragmentScannerImpl).scanDocument(boolean) > line: not available > XIncludeAwareParserConfiguration(XML11Configuration).parse(boolean) line: not > available > XIncludeAwareParserConfiguration(XML11Configuration).parse(XMLInputSource) > line: not available > SAXParserImpl$JAXPSAXParser(XMLParser).parse(XMLInputSource) line: not > available > SAXParserImpl$JAXPSAXParser(AbstractSAXParser).parse(InputSource) line: not > available > SAXParserImpl$JAXPSAXParser.parse(InputSource) line: not available > SAXParserImpl.parse(InputSource, DefaultHandler) line: not available > SAXParserImpl(SAXParser).parse(InputStream, DefaultHandler) line: 195 > XmlRootExtractor.extractRootElement(InputStream) line: 62 > XmlRootExtractor.extractRootElement(byte[]) line: 42 > MimeTypes.getMimeType(byte[]) line: 212 > MimeTypes.detect(InputStream, Metadata) line: 494 > DefaultDetector(CompositeDetector).detect(InputStream, Metadata) line: 84 > > Please see attached XML file. > Please advise. > Thanks -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (TIKA-2727) Parsing and detect mime type of XML file stuck in infinite loop
[ https://issues.apache.org/jira/browse/TIKA-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16632536#comment-16632536 ] Slava G commented on TIKA-2727: --- Hi Tim, Sorry I didn't get you, about what email ? Thanks > Parsing and detect mime type of XML file stuck in infinite loop > --- > > Key: TIKA-2727 > URL: https://issues.apache.org/jira/browse/TIKA-2727 > Project: Tika > Issue Type: Bug > Components: detector, parser >Affects Versions: 1.17 >Reporter: Slava G >Assignee: Tim Allison >Priority: Blocker > Attachments: 1_6e4b115e-7d2d-45f1-a842-35b5ad7ba559, > 1_e3e13f0e-7085-4000-a558-5d255ed7a944.xml > > > Hi, > I'm trying to parse (even mime type detect) some XML file that it's not > large, but kinda tricky and my process hangs on : > XMLStringBuffer.append(char[], int, int) line: not available > XMLStringBuffer.append(XMLString) line: not available > XMLNSDocumentScannerImpl(XMLScanner).scanAttributeValue(XMLString, XMLString, > String, boolean, String) line: not available > XMLNSDocumentScannerImpl.scanAttribute(XMLAttributesImpl) line: not available > XMLNSDocumentScannerImpl.scanStartElement() line: not available > XMLNSDocumentScannerImpl$NSContentDispatcher.scanRootElementHook() line: not > available > XMLNSDocumentScannerImpl$NSContentDispatcher(XMLDocumentFragmentScannerImpl$FragmentContentDispatcher).dispatch(boolean) > line: not available > XMLNSDocumentScannerImpl(XMLDocumentFragmentScannerImpl).scanDocument(boolean) > line: not available > XIncludeAwareParserConfiguration(XML11Configuration).parse(boolean) line: not > available > XIncludeAwareParserConfiguration(XML11Configuration).parse(XMLInputSource) > line: not available > SAXParserImpl$JAXPSAXParser(XMLParser).parse(XMLInputSource) line: not > available > SAXParserImpl$JAXPSAXParser(AbstractSAXParser).parse(InputSource) line: not > available > SAXParserImpl$JAXPSAXParser.parse(InputSource) line: not available > SAXParserImpl.parse(InputSource, DefaultHandler) line: not available > SAXParserImpl(SAXParser).parse(InputStream, DefaultHandler) line: 195 > XmlRootExtractor.extractRootElement(InputStream) line: 62 > XmlRootExtractor.extractRootElement(byte[]) line: 42 > MimeTypes.getMimeType(byte[]) line: 212 > MimeTypes.detect(InputStream, Metadata) line: 494 > DefaultDetector(CompositeDetector).detect(InputStream, Metadata) line: 84 > > Please see attached XML file. > Please advise. > Thanks -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (TIKA-2727) Parsing and detect mime type of XML file stuck in infinite loop
[ https://issues.apache.org/jira/browse/TIKA-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16632533#comment-16632533 ] Tim Allison commented on TIKA-2727: --- [~slavago] thank you for notifying us of this. Can you send me an email talli...@apache.org ? > Parsing and detect mime type of XML file stuck in infinite loop > --- > > Key: TIKA-2727 > URL: https://issues.apache.org/jira/browse/TIKA-2727 > Project: Tika > Issue Type: Bug > Components: detector, parser >Affects Versions: 1.17 >Reporter: Slava G >Assignee: Tim Allison >Priority: Blocker > Attachments: 1_6e4b115e-7d2d-45f1-a842-35b5ad7ba559, > 1_e3e13f0e-7085-4000-a558-5d255ed7a944.xml > > > Hi, > I'm trying to parse (even mime type detect) some XML file that it's not > large, but kinda tricky and my process hangs on : > XMLStringBuffer.append(char[], int, int) line: not available > XMLStringBuffer.append(XMLString) line: not available > XMLNSDocumentScannerImpl(XMLScanner).scanAttributeValue(XMLString, XMLString, > String, boolean, String) line: not available > XMLNSDocumentScannerImpl.scanAttribute(XMLAttributesImpl) line: not available > XMLNSDocumentScannerImpl.scanStartElement() line: not available > XMLNSDocumentScannerImpl$NSContentDispatcher.scanRootElementHook() line: not > available > XMLNSDocumentScannerImpl$NSContentDispatcher(XMLDocumentFragmentScannerImpl$FragmentContentDispatcher).dispatch(boolean) > line: not available > XMLNSDocumentScannerImpl(XMLDocumentFragmentScannerImpl).scanDocument(boolean) > line: not available > XIncludeAwareParserConfiguration(XML11Configuration).parse(boolean) line: not > available > XIncludeAwareParserConfiguration(XML11Configuration).parse(XMLInputSource) > line: not available > SAXParserImpl$JAXPSAXParser(XMLParser).parse(XMLInputSource) line: not > available > SAXParserImpl$JAXPSAXParser(AbstractSAXParser).parse(InputSource) line: not > available > SAXParserImpl$JAXPSAXParser.parse(InputSource) line: not available > SAXParserImpl.parse(InputSource, DefaultHandler) line: not available > SAXParserImpl(SAXParser).parse(InputStream, DefaultHandler) line: 195 > XmlRootExtractor.extractRootElement(InputStream) line: 62 > XmlRootExtractor.extractRootElement(byte[]) line: 42 > MimeTypes.getMimeType(byte[]) line: 212 > MimeTypes.detect(InputStream, Metadata) line: 494 > DefaultDetector(CompositeDetector).detect(InputStream, Metadata) line: 84 > > Please see attached XML file. > Please advise. > Thanks -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (TIKA-2727) Parsing and detect mime type of XML file stuck in infinite loop
[ https://issues.apache.org/jira/browse/TIKA-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16627752#comment-16627752 ] Hudson commented on TIKA-2727: -- SUCCESS: Integrated in Jenkins build tika-branch-1x #98 (See [https://builds.apache.org/job/tika-branch-1x/98/]) TIKA-2727 (tallison: [https://github.com/apache/tika/commit/a1f48b0a6f9cdf65ea01f7f3108e1590e96a086c]) * (edit) tika-parsers/src/test/java/org/apache/tika/TestParsers.java * (edit) tika-parsers/src/test/java/org/apache/tika/XMLTestBase.java * (edit) tika-core/src/main/java/org/apache/tika/utils/XMLReaderUtils.java * (edit) tika-parsers/src/test/java/org/apache/tika/TestXXEInXML.java * (edit) tika-parsers/src/test/java/org/apache/tika/TestXMLEntityExpansion.java > Parsing and detect mime type of XML file stuck in infinite loop > --- > > Key: TIKA-2727 > URL: https://issues.apache.org/jira/browse/TIKA-2727 > Project: Tika > Issue Type: Bug > Components: detector, parser >Affects Versions: 1.17 >Reporter: Slava G >Assignee: Tim Allison >Priority: Blocker > Fix For: 1.19, 2.0.0 > > Attachments: 1_6e4b115e-7d2d-45f1-a842-35b5ad7ba559, > 1_e3e13f0e-7085-4000-a558-5d255ed7a944.xml > > > Hi, > I'm trying to parse (even mime type detect) some XML file that it's not > large, but kinda tricky and my process hangs on : > XMLStringBuffer.append(char[], int, int) line: not available > XMLStringBuffer.append(XMLString) line: not available > XMLNSDocumentScannerImpl(XMLScanner).scanAttributeValue(XMLString, XMLString, > String, boolean, String) line: not available > XMLNSDocumentScannerImpl.scanAttribute(XMLAttributesImpl) line: not available > XMLNSDocumentScannerImpl.scanStartElement() line: not available > XMLNSDocumentScannerImpl$NSContentDispatcher.scanRootElementHook() line: not > available > XMLNSDocumentScannerImpl$NSContentDispatcher(XMLDocumentFragmentScannerImpl$FragmentContentDispatcher).dispatch(boolean) > line: not available > XMLNSDocumentScannerImpl(XMLDocumentFragmentScannerImpl).scanDocument(boolean) > line: not available > XIncludeAwareParserConfiguration(XML11Configuration).parse(boolean) line: not > available > XIncludeAwareParserConfiguration(XML11Configuration).parse(XMLInputSource) > line: not available > SAXParserImpl$JAXPSAXParser(XMLParser).parse(XMLInputSource) line: not > available > SAXParserImpl$JAXPSAXParser(AbstractSAXParser).parse(InputSource) line: not > available > SAXParserImpl$JAXPSAXParser.parse(InputSource) line: not available > SAXParserImpl.parse(InputSource, DefaultHandler) line: not available > SAXParserImpl(SAXParser).parse(InputStream, DefaultHandler) line: 195 > XmlRootExtractor.extractRootElement(InputStream) line: 62 > XmlRootExtractor.extractRootElement(byte[]) line: 42 > MimeTypes.getMimeType(byte[]) line: 212 > MimeTypes.detect(InputStream, Metadata) line: 494 > DefaultDetector(CompositeDetector).detect(InputStream, Metadata) line: 84 > > Please see attached XML file. > Please advise. > Thanks -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (TIKA-2727) Parsing and detect mime type of XML file stuck in infinite loop
[ https://issues.apache.org/jira/browse/TIKA-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16627746#comment-16627746 ] Hudson commented on TIKA-2727: -- SUCCESS: Integrated in Jenkins build Tika-trunk #1567 (See [https://builds.apache.org/job/Tika-trunk/1567/]) TIKA-2727 (tallison: [https://github.com/apache/tika/commit/86d4ba1e1806c8c386e913f6848b938f657df2c6]) * (edit) tika-parsers/src/test/java/org/apache/tika/TestParsers.java * (edit) tika-parsers/src/test/java/org/apache/tika/TestXXEInXML.java * (edit) tika-core/src/main/java/org/apache/tika/utils/XMLReaderUtils.java * (edit) tika-parsers/src/test/java/org/apache/tika/TestXMLEntityExpansion.java * (edit) tika-parsers/src/test/java/org/apache/tika/XMLTestBase.java > Parsing and detect mime type of XML file stuck in infinite loop > --- > > Key: TIKA-2727 > URL: https://issues.apache.org/jira/browse/TIKA-2727 > Project: Tika > Issue Type: Bug > Components: detector, parser >Affects Versions: 1.17 >Reporter: Slava G >Assignee: Tim Allison >Priority: Blocker > Fix For: 1.19, 2.0.0 > > Attachments: 1_6e4b115e-7d2d-45f1-a842-35b5ad7ba559, > 1_e3e13f0e-7085-4000-a558-5d255ed7a944.xml > > > Hi, > I'm trying to parse (even mime type detect) some XML file that it's not > large, but kinda tricky and my process hangs on : > XMLStringBuffer.append(char[], int, int) line: not available > XMLStringBuffer.append(XMLString) line: not available > XMLNSDocumentScannerImpl(XMLScanner).scanAttributeValue(XMLString, XMLString, > String, boolean, String) line: not available > XMLNSDocumentScannerImpl.scanAttribute(XMLAttributesImpl) line: not available > XMLNSDocumentScannerImpl.scanStartElement() line: not available > XMLNSDocumentScannerImpl$NSContentDispatcher.scanRootElementHook() line: not > available > XMLNSDocumentScannerImpl$NSContentDispatcher(XMLDocumentFragmentScannerImpl$FragmentContentDispatcher).dispatch(boolean) > line: not available > XMLNSDocumentScannerImpl(XMLDocumentFragmentScannerImpl).scanDocument(boolean) > line: not available > XIncludeAwareParserConfiguration(XML11Configuration).parse(boolean) line: not > available > XIncludeAwareParserConfiguration(XML11Configuration).parse(XMLInputSource) > line: not available > SAXParserImpl$JAXPSAXParser(XMLParser).parse(XMLInputSource) line: not > available > SAXParserImpl$JAXPSAXParser(AbstractSAXParser).parse(InputSource) line: not > available > SAXParserImpl$JAXPSAXParser.parse(InputSource) line: not available > SAXParserImpl.parse(InputSource, DefaultHandler) line: not available > SAXParserImpl(SAXParser).parse(InputStream, DefaultHandler) line: 195 > XmlRootExtractor.extractRootElement(InputStream) line: 62 > XmlRootExtractor.extractRootElement(byte[]) line: 42 > MimeTypes.getMimeType(byte[]) line: 212 > MimeTypes.detect(InputStream, Metadata) line: 494 > DefaultDetector(CompositeDetector).detect(InputStream, Metadata) line: 84 > > Please see attached XML file. > Please advise. > Thanks -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (TIKA-2727) Parsing and detect mime type of XML file stuck in infinite loop
[ https://issues.apache.org/jira/browse/TIKA-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16627704#comment-16627704 ] Hudson commented on TIKA-2727: -- UNSTABLE: Integrated in Jenkins build tika-2.x-windows #321 (See [https://builds.apache.org/job/tika-2.x-windows/321/]) TIKA-2727 (tallison: rev 86d4ba1e1806c8c386e913f6848b938f657df2c6) * (edit) tika-core/src/main/java/org/apache/tika/utils/XMLReaderUtils.java * (edit) tika-parsers/src/test/java/org/apache/tika/XMLTestBase.java * (edit) tika-parsers/src/test/java/org/apache/tika/TestXMLEntityExpansion.java * (edit) tika-parsers/src/test/java/org/apache/tika/TestParsers.java * (edit) tika-parsers/src/test/java/org/apache/tika/TestXXEInXML.java > Parsing and detect mime type of XML file stuck in infinite loop > --- > > Key: TIKA-2727 > URL: https://issues.apache.org/jira/browse/TIKA-2727 > Project: Tika > Issue Type: Bug > Components: detector, parser >Affects Versions: 1.17 >Reporter: Slava G >Assignee: Tim Allison >Priority: Blocker > Fix For: 1.19, 2.0.0 > > Attachments: 1_6e4b115e-7d2d-45f1-a842-35b5ad7ba559, > 1_e3e13f0e-7085-4000-a558-5d255ed7a944.xml > > > Hi, > I'm trying to parse (even mime type detect) some XML file that it's not > large, but kinda tricky and my process hangs on : > XMLStringBuffer.append(char[], int, int) line: not available > XMLStringBuffer.append(XMLString) line: not available > XMLNSDocumentScannerImpl(XMLScanner).scanAttributeValue(XMLString, XMLString, > String, boolean, String) line: not available > XMLNSDocumentScannerImpl.scanAttribute(XMLAttributesImpl) line: not available > XMLNSDocumentScannerImpl.scanStartElement() line: not available > XMLNSDocumentScannerImpl$NSContentDispatcher.scanRootElementHook() line: not > available > XMLNSDocumentScannerImpl$NSContentDispatcher(XMLDocumentFragmentScannerImpl$FragmentContentDispatcher).dispatch(boolean) > line: not available > XMLNSDocumentScannerImpl(XMLDocumentFragmentScannerImpl).scanDocument(boolean) > line: not available > XIncludeAwareParserConfiguration(XML11Configuration).parse(boolean) line: not > available > XIncludeAwareParserConfiguration(XML11Configuration).parse(XMLInputSource) > line: not available > SAXParserImpl$JAXPSAXParser(XMLParser).parse(XMLInputSource) line: not > available > SAXParserImpl$JAXPSAXParser(AbstractSAXParser).parse(InputSource) line: not > available > SAXParserImpl$JAXPSAXParser.parse(InputSource) line: not available > SAXParserImpl.parse(InputSource, DefaultHandler) line: not available > SAXParserImpl(SAXParser).parse(InputStream, DefaultHandler) line: 195 > XmlRootExtractor.extractRootElement(InputStream) line: 62 > XmlRootExtractor.extractRootElement(byte[]) line: 42 > MimeTypes.getMimeType(byte[]) line: 212 > MimeTypes.detect(InputStream, Metadata) line: 494 > DefaultDetector(CompositeDetector).detect(InputStream, Metadata) line: 84 > > Please see attached XML file. > Please advise. > Thanks -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (TIKA-2727) Parsing and detect mime type of XML file stuck in infinite loop
[ https://issues.apache.org/jira/browse/TIKA-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626445#comment-16626445 ] Slava G commented on TIKA-2727: --- Ok, thanks hope you'll be able to fix this quick. Thanks a lot > Parsing and detect mime type of XML file stuck in infinite loop > --- > > Key: TIKA-2727 > URL: https://issues.apache.org/jira/browse/TIKA-2727 > Project: Tika > Issue Type: Bug > Components: detector, parser >Affects Versions: 1.17 >Reporter: Slava G >Assignee: Tim Allison >Priority: Blocker > Fix For: 1.19, 2.0.0 > > Attachments: 1_6e4b115e-7d2d-45f1-a842-35b5ad7ba559, > 1_e3e13f0e-7085-4000-a558-5d255ed7a944.xml > > > Hi, > I'm trying to parse (even mime type detect) some XML file that it's not > large, but kinda tricky and my process hangs on : > XMLStringBuffer.append(char[], int, int) line: not available > XMLStringBuffer.append(XMLString) line: not available > XMLNSDocumentScannerImpl(XMLScanner).scanAttributeValue(XMLString, XMLString, > String, boolean, String) line: not available > XMLNSDocumentScannerImpl.scanAttribute(XMLAttributesImpl) line: not available > XMLNSDocumentScannerImpl.scanStartElement() line: not available > XMLNSDocumentScannerImpl$NSContentDispatcher.scanRootElementHook() line: not > available > XMLNSDocumentScannerImpl$NSContentDispatcher(XMLDocumentFragmentScannerImpl$FragmentContentDispatcher).dispatch(boolean) > line: not available > XMLNSDocumentScannerImpl(XMLDocumentFragmentScannerImpl).scanDocument(boolean) > line: not available > XIncludeAwareParserConfiguration(XML11Configuration).parse(boolean) line: not > available > XIncludeAwareParserConfiguration(XML11Configuration).parse(XMLInputSource) > line: not available > SAXParserImpl$JAXPSAXParser(XMLParser).parse(XMLInputSource) line: not > available > SAXParserImpl$JAXPSAXParser(AbstractSAXParser).parse(InputSource) line: not > available > SAXParserImpl$JAXPSAXParser.parse(InputSource) line: not available > SAXParserImpl.parse(InputSource, DefaultHandler) line: not available > SAXParserImpl(SAXParser).parse(InputStream, DefaultHandler) line: 195 > XmlRootExtractor.extractRootElement(InputStream) line: 62 > XmlRootExtractor.extractRootElement(byte[]) line: 42 > MimeTypes.getMimeType(byte[]) line: 212 > MimeTypes.detect(InputStream, Metadata) line: 494 > DefaultDetector(CompositeDetector).detect(InputStream, Metadata) line: 84 > > Please see attached XML file. > Please advise. > Thanks -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (TIKA-2727) Parsing and detect mime type of XML file stuck in infinite loop
[ https://issues.apache.org/jira/browse/TIKA-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626439#comment-16626439 ] Tim Allison commented on TIKA-2727: --- Y. I can reproduce this on the 10th iteration single threaded. > Parsing and detect mime type of XML file stuck in infinite loop > --- > > Key: TIKA-2727 > URL: https://issues.apache.org/jira/browse/TIKA-2727 > Project: Tika > Issue Type: Bug > Components: detector, parser >Affects Versions: 1.17 >Reporter: Slava G >Assignee: Tim Allison >Priority: Major > Fix For: 1.19, 2.0.0 > > Attachments: 1_6e4b115e-7d2d-45f1-a842-35b5ad7ba559, > 1_e3e13f0e-7085-4000-a558-5d255ed7a944.xml > > > Hi, > I'm trying to parse (even mime type detect) some XML file that it's not > large, but kinda tricky and my process hangs on : > XMLStringBuffer.append(char[], int, int) line: not available > XMLStringBuffer.append(XMLString) line: not available > XMLNSDocumentScannerImpl(XMLScanner).scanAttributeValue(XMLString, XMLString, > String, boolean, String) line: not available > XMLNSDocumentScannerImpl.scanAttribute(XMLAttributesImpl) line: not available > XMLNSDocumentScannerImpl.scanStartElement() line: not available > XMLNSDocumentScannerImpl$NSContentDispatcher.scanRootElementHook() line: not > available > XMLNSDocumentScannerImpl$NSContentDispatcher(XMLDocumentFragmentScannerImpl$FragmentContentDispatcher).dispatch(boolean) > line: not available > XMLNSDocumentScannerImpl(XMLDocumentFragmentScannerImpl).scanDocument(boolean) > line: not available > XIncludeAwareParserConfiguration(XML11Configuration).parse(boolean) line: not > available > XIncludeAwareParserConfiguration(XML11Configuration).parse(XMLInputSource) > line: not available > SAXParserImpl$JAXPSAXParser(XMLParser).parse(XMLInputSource) line: not > available > SAXParserImpl$JAXPSAXParser(AbstractSAXParser).parse(InputSource) line: not > available > SAXParserImpl$JAXPSAXParser.parse(InputSource) line: not available > SAXParserImpl.parse(InputSource, DefaultHandler) line: not available > SAXParserImpl(SAXParser).parse(InputStream, DefaultHandler) line: 195 > XmlRootExtractor.extractRootElement(InputStream) line: 62 > XmlRootExtractor.extractRootElement(byte[]) line: 42 > MimeTypes.getMimeType(byte[]) line: 212 > MimeTypes.detect(InputStream, Metadata) line: 494 > DefaultDetector(CompositeDetector).detect(InputStream, Metadata) line: 84 > > Please see attached XML file. > Please advise. > Thanks -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (TIKA-2727) Parsing and detect mime type of XML file stuck in infinite loop
[ https://issues.apache.org/jira/browse/TIKA-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626437#comment-16626437 ] Slava G commented on TIKA-2727: --- 10 iterations inside for loop (same thread) , file 1_6e4b115e-7d2d-45f1-a842-35b5ad7ba559, I attached it right now. > Parsing and detect mime type of XML file stuck in infinite loop > --- > > Key: TIKA-2727 > URL: https://issues.apache.org/jira/browse/TIKA-2727 > Project: Tika > Issue Type: Bug > Components: detector, parser >Affects Versions: 1.17 >Reporter: Slava G >Assignee: Tim Allison >Priority: Major > Fix For: 1.19, 2.0.0 > > Attachments: 1_6e4b115e-7d2d-45f1-a842-35b5ad7ba559, > 1_e3e13f0e-7085-4000-a558-5d255ed7a944.xml > > > Hi, > I'm trying to parse (even mime type detect) some XML file that it's not > large, but kinda tricky and my process hangs on : > XMLStringBuffer.append(char[], int, int) line: not available > XMLStringBuffer.append(XMLString) line: not available > XMLNSDocumentScannerImpl(XMLScanner).scanAttributeValue(XMLString, XMLString, > String, boolean, String) line: not available > XMLNSDocumentScannerImpl.scanAttribute(XMLAttributesImpl) line: not available > XMLNSDocumentScannerImpl.scanStartElement() line: not available > XMLNSDocumentScannerImpl$NSContentDispatcher.scanRootElementHook() line: not > available > XMLNSDocumentScannerImpl$NSContentDispatcher(XMLDocumentFragmentScannerImpl$FragmentContentDispatcher).dispatch(boolean) > line: not available > XMLNSDocumentScannerImpl(XMLDocumentFragmentScannerImpl).scanDocument(boolean) > line: not available > XIncludeAwareParserConfiguration(XML11Configuration).parse(boolean) line: not > available > XIncludeAwareParserConfiguration(XML11Configuration).parse(XMLInputSource) > line: not available > SAXParserImpl$JAXPSAXParser(XMLParser).parse(XMLInputSource) line: not > available > SAXParserImpl$JAXPSAXParser(AbstractSAXParser).parse(InputSource) line: not > available > SAXParserImpl$JAXPSAXParser.parse(InputSource) line: not available > SAXParserImpl.parse(InputSource, DefaultHandler) line: not available > SAXParserImpl(SAXParser).parse(InputStream, DefaultHandler) line: 195 > XmlRootExtractor.extractRootElement(InputStream) line: 62 > XmlRootExtractor.extractRootElement(byte[]) line: 42 > MimeTypes.getMimeType(byte[]) line: 212 > MimeTypes.detect(InputStream, Metadata) line: 494 > DefaultDetector(CompositeDetector).detect(InputStream, Metadata) line: 84 > > Please see attached XML file. > Please advise. > Thanks -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (TIKA-2727) Parsing and detect mime type of XML file stuck in infinite loop
[ https://issues.apache.org/jira/browse/TIKA-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626434#comment-16626434 ] Tim Allison commented on TIKA-2727: --- This is with the attached .xml file above? Are you running multiple threads concurrently or can you reproduce this after 10 iterations single-threaded? > Parsing and detect mime type of XML file stuck in infinite loop > --- > > Key: TIKA-2727 > URL: https://issues.apache.org/jira/browse/TIKA-2727 > Project: Tika > Issue Type: Bug > Components: detector, parser >Affects Versions: 1.17 >Reporter: Slava G >Assignee: Tim Allison >Priority: Major > Fix For: 1.19, 2.0.0 > > Attachments: 1_e3e13f0e-7085-4000-a558-5d255ed7a944.xml > > > Hi, > I'm trying to parse (even mime type detect) some XML file that it's not > large, but kinda tricky and my process hangs on : > XMLStringBuffer.append(char[], int, int) line: not available > XMLStringBuffer.append(XMLString) line: not available > XMLNSDocumentScannerImpl(XMLScanner).scanAttributeValue(XMLString, XMLString, > String, boolean, String) line: not available > XMLNSDocumentScannerImpl.scanAttribute(XMLAttributesImpl) line: not available > XMLNSDocumentScannerImpl.scanStartElement() line: not available > XMLNSDocumentScannerImpl$NSContentDispatcher.scanRootElementHook() line: not > available > XMLNSDocumentScannerImpl$NSContentDispatcher(XMLDocumentFragmentScannerImpl$FragmentContentDispatcher).dispatch(boolean) > line: not available > XMLNSDocumentScannerImpl(XMLDocumentFragmentScannerImpl).scanDocument(boolean) > line: not available > XIncludeAwareParserConfiguration(XML11Configuration).parse(boolean) line: not > available > XIncludeAwareParserConfiguration(XML11Configuration).parse(XMLInputSource) > line: not available > SAXParserImpl$JAXPSAXParser(XMLParser).parse(XMLInputSource) line: not > available > SAXParserImpl$JAXPSAXParser(AbstractSAXParser).parse(InputSource) line: not > available > SAXParserImpl$JAXPSAXParser.parse(InputSource) line: not available > SAXParserImpl.parse(InputSource, DefaultHandler) line: not available > SAXParserImpl(SAXParser).parse(InputStream, DefaultHandler) line: 195 > XmlRootExtractor.extractRootElement(InputStream) line: 62 > XmlRootExtractor.extractRootElement(byte[]) line: 42 > MimeTypes.getMimeType(byte[]) line: 212 > MimeTypes.detect(InputStream, Metadata) line: 494 > DefaultDetector(CompositeDetector).detect(InputStream, Metadata) line: 84 > > Please see attached XML file. > Please advise. > Thanks -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (TIKA-2727) Parsing and detect mime type of XML file stuck in infinite loop
[ https://issues.apache.org/jira/browse/TIKA-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626408#comment-16626408 ] Slava G commented on TIKA-2727: --- Tried to reproduce, after few hundreds xml that was transfer to TIKA for parsing, it's hanged out: at org.apache.xerces.impl.XMLEntityScanner.load(Unknown Source) at org.apache.xerces.impl.XMLEntityScanner.scanLiteral(Unknown Source) at org.apache.xerces.impl.XMLScanner.scanAttributeValue(Unknown Source) at org.apache.xerces.impl.XMLNSDocumentScannerImpl.scanAttribute(Unknown Source) at org.apache.xerces.impl.XMLNSDocumentScannerImpl.scanStartElement(Unknown Source) at org.apache.xerces.impl.XMLNSDocumentScannerImpl$NSContentDispatcher.scanRootElementHook(Unknown Source) at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl$FragmentContentDispatcher.dispatch(Unknown Source) at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown Source) at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source) at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source) at org.apache.xerces.parsers.XMLParser.parse(Unknown Source) at org.apache.xerces.parsers.AbstractSAXParser.parse(Unknown Source) at org.apache.xerces.jaxp.SAXParserImpl$JAXPSAXParser.parse(Unknown Source) at org.apache.xerces.jaxp.SAXParserImpl.parse(Unknown Source) at javax.xml.parsers.SAXParser.parse(SAXParser.java:195) at org.apache.tika.utils.XMLReaderUtils.parseSAX(XMLReaderUtils.java:371) at org.apache.tika.detect.XmlRootExtractor.extractRootElement(XmlRootExtractor.java:53) at org.apache.tika.detect.XmlRootExtractor.extractRootElement(XmlRootExtractor.java:44) at org.apache.tika.mime.MimeTypes.getMimeType(MimeTypes.java:212) at org.apache.tika.mime.MimeTypes.detect(MimeTypes.java:493) at org.apache.tika.detect.CompositeDetector.detect(CompositeDetector.java:84) > Parsing and detect mime type of XML file stuck in infinite loop > --- > > Key: TIKA-2727 > URL: https://issues.apache.org/jira/browse/TIKA-2727 > Project: Tika > Issue Type: Bug > Components: detector, parser >Affects Versions: 1.17 >Reporter: Slava G >Assignee: Tim Allison >Priority: Major > Fix For: 1.19, 2.0.0 > > Attachments: 1_e3e13f0e-7085-4000-a558-5d255ed7a944.xml > > > Hi, > I'm trying to parse (even mime type detect) some XML file that it's not > large, but kinda tricky and my process hangs on : > XMLStringBuffer.append(char[], int, int) line: not available > XMLStringBuffer.append(XMLString) line: not available > XMLNSDocumentScannerImpl(XMLScanner).scanAttributeValue(XMLString, XMLString, > String, boolean, String) line: not available > XMLNSDocumentScannerImpl.scanAttribute(XMLAttributesImpl) line: not available > XMLNSDocumentScannerImpl.scanStartElement() line: not available > XMLNSDocumentScannerImpl$NSContentDispatcher.scanRootElementHook() line: not > available > XMLNSDocumentScannerImpl$NSContentDispatcher(XMLDocumentFragmentScannerImpl$FragmentContentDispatcher).dispatch(boolean) > line: not available > XMLNSDocumentScannerImpl(XMLDocumentFragmentScannerImpl).scanDocument(boolean) > line: not available > XIncludeAwareParserConfiguration(XML11Configuration).parse(boolean) line: not > available > XIncludeAwareParserConfiguration(XML11Configuration).parse(XMLInputSource) > line: not available > SAXParserImpl$JAXPSAXParser(XMLParser).parse(XMLInputSource) line: not > available > SAXParserImpl$JAXPSAXParser(AbstractSAXParser).parse(InputSource) line: not > available > SAXParserImpl$JAXPSAXParser.parse(InputSource) line: not available > SAXParserImpl.parse(InputSource, DefaultHandler) line: not available > SAXParserImpl(SAXParser).parse(InputStream, DefaultHandler) line: 195 > XmlRootExtractor.extractRootElement(InputStream) line: 62 > XmlRootExtractor.extractRootElement(byte[]) line: 42 > MimeTypes.getMimeType(byte[]) line: 212 > MimeTypes.detect(InputStream, Metadata) line: 494 > DefaultDetector(CompositeDetector).detect(InputStream, Metadata) line: 84 > > Please see attached XML file. > Please advise. > Thanks -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (TIKA-2727) Parsing and detect mime type of XML file stuck in infinite loop
[ https://issues.apache.org/jira/browse/TIKA-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625985#comment-16625985 ] Slava G commented on TIKA-2727: --- Thanks, will look. Could be that in 1.19 solution is not always working ? I still see that it stuck on XML files, like one that I attached. > Parsing and detect mime type of XML file stuck in infinite loop > --- > > Key: TIKA-2727 > URL: https://issues.apache.org/jira/browse/TIKA-2727 > Project: Tika > Issue Type: Bug > Components: detector, parser >Affects Versions: 1.17 >Reporter: Slava G >Assignee: Tim Allison >Priority: Major > Fix For: 1.19, 2.0.0 > > Attachments: 1_e3e13f0e-7085-4000-a558-5d255ed7a944.xml > > > Hi, > I'm trying to parse (even mime type detect) some XML file that it's not > large, but kinda tricky and my process hangs on : > XMLStringBuffer.append(char[], int, int) line: not available > XMLStringBuffer.append(XMLString) line: not available > XMLNSDocumentScannerImpl(XMLScanner).scanAttributeValue(XMLString, XMLString, > String, boolean, String) line: not available > XMLNSDocumentScannerImpl.scanAttribute(XMLAttributesImpl) line: not available > XMLNSDocumentScannerImpl.scanStartElement() line: not available > XMLNSDocumentScannerImpl$NSContentDispatcher.scanRootElementHook() line: not > available > XMLNSDocumentScannerImpl$NSContentDispatcher(XMLDocumentFragmentScannerImpl$FragmentContentDispatcher).dispatch(boolean) > line: not available > XMLNSDocumentScannerImpl(XMLDocumentFragmentScannerImpl).scanDocument(boolean) > line: not available > XIncludeAwareParserConfiguration(XML11Configuration).parse(boolean) line: not > available > XIncludeAwareParserConfiguration(XML11Configuration).parse(XMLInputSource) > line: not available > SAXParserImpl$JAXPSAXParser(XMLParser).parse(XMLInputSource) line: not > available > SAXParserImpl$JAXPSAXParser(AbstractSAXParser).parse(InputSource) line: not > available > SAXParserImpl$JAXPSAXParser.parse(InputSource) line: not available > SAXParserImpl.parse(InputSource, DefaultHandler) line: not available > SAXParserImpl(SAXParser).parse(InputStream, DefaultHandler) line: 195 > XmlRootExtractor.extractRootElement(InputStream) line: 62 > XmlRootExtractor.extractRootElement(byte[]) line: 42 > MimeTypes.getMimeType(byte[]) line: 212 > MimeTypes.detect(InputStream, Metadata) line: 494 > DefaultDetector(CompositeDetector).detect(InputStream, Metadata) line: 84 > > Please see attached XML file. > Please advise. > Thanks -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (TIKA-2727) Parsing and detect mime type of XML file stuck in infinite loop
[ https://issues.apache.org/jira/browse/TIKA-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625979#comment-16625979 ] Tim Allison commented on TIKA-2727: --- See TIKA-2732. > Parsing and detect mime type of XML file stuck in infinite loop > --- > > Key: TIKA-2727 > URL: https://issues.apache.org/jira/browse/TIKA-2727 > Project: Tika > Issue Type: Bug > Components: detector, parser >Affects Versions: 1.17 >Reporter: Slava G >Assignee: Tim Allison >Priority: Major > Fix For: 1.19, 2.0.0 > > Attachments: 1_e3e13f0e-7085-4000-a558-5d255ed7a944.xml > > > Hi, > I'm trying to parse (even mime type detect) some XML file that it's not > large, but kinda tricky and my process hangs on : > XMLStringBuffer.append(char[], int, int) line: not available > XMLStringBuffer.append(XMLString) line: not available > XMLNSDocumentScannerImpl(XMLScanner).scanAttributeValue(XMLString, XMLString, > String, boolean, String) line: not available > XMLNSDocumentScannerImpl.scanAttribute(XMLAttributesImpl) line: not available > XMLNSDocumentScannerImpl.scanStartElement() line: not available > XMLNSDocumentScannerImpl$NSContentDispatcher.scanRootElementHook() line: not > available > XMLNSDocumentScannerImpl$NSContentDispatcher(XMLDocumentFragmentScannerImpl$FragmentContentDispatcher).dispatch(boolean) > line: not available > XMLNSDocumentScannerImpl(XMLDocumentFragmentScannerImpl).scanDocument(boolean) > line: not available > XIncludeAwareParserConfiguration(XML11Configuration).parse(boolean) line: not > available > XIncludeAwareParserConfiguration(XML11Configuration).parse(XMLInputSource) > line: not available > SAXParserImpl$JAXPSAXParser(XMLParser).parse(XMLInputSource) line: not > available > SAXParserImpl$JAXPSAXParser(AbstractSAXParser).parse(InputSource) line: not > available > SAXParserImpl$JAXPSAXParser.parse(InputSource) line: not available > SAXParserImpl.parse(InputSource, DefaultHandler) line: not available > SAXParserImpl(SAXParser).parse(InputStream, DefaultHandler) line: 195 > XmlRootExtractor.extractRootElement(InputStream) line: 62 > XmlRootExtractor.extractRootElement(byte[]) line: 42 > MimeTypes.getMimeType(byte[]) line: 212 > MimeTypes.detect(InputStream, Metadata) line: 494 > DefaultDetector(CompositeDetector).detect(InputStream, Metadata) line: 84 > > Please see attached XML file. > Please advise. > Thanks -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (TIKA-2727) Parsing and detect mime type of XML file stuck in infinite loop
[ https://issues.apache.org/jira/browse/TIKA-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625041#comment-16625041 ] Slava G commented on TIKA-2727: --- Hi, Testing the 1.19 and seems that on some files that it was stuck (1.17) it working fine, but still have one file that it's hang on it. Is it possible to configure limit of expansion in TIKA only (as you said it's limited by 20) ? without specifying -JDjdk.xml.entityExpansionLimit=10 ? Thanks. > Parsing and detect mime type of XML file stuck in infinite loop > --- > > Key: TIKA-2727 > URL: https://issues.apache.org/jira/browse/TIKA-2727 > Project: Tika > Issue Type: Bug > Components: detector, parser >Affects Versions: 1.17 >Reporter: Slava G >Assignee: Tim Allison >Priority: Major > Fix For: 1.19, 2.0.0 > > Attachments: 1_e3e13f0e-7085-4000-a558-5d255ed7a944.xml > > > Hi, > I'm trying to parse (even mime type detect) some XML file that it's not > large, but kinda tricky and my process hangs on : > XMLStringBuffer.append(char[], int, int) line: not available > XMLStringBuffer.append(XMLString) line: not available > XMLNSDocumentScannerImpl(XMLScanner).scanAttributeValue(XMLString, XMLString, > String, boolean, String) line: not available > XMLNSDocumentScannerImpl.scanAttribute(XMLAttributesImpl) line: not available > XMLNSDocumentScannerImpl.scanStartElement() line: not available > XMLNSDocumentScannerImpl$NSContentDispatcher.scanRootElementHook() line: not > available > XMLNSDocumentScannerImpl$NSContentDispatcher(XMLDocumentFragmentScannerImpl$FragmentContentDispatcher).dispatch(boolean) > line: not available > XMLNSDocumentScannerImpl(XMLDocumentFragmentScannerImpl).scanDocument(boolean) > line: not available > XIncludeAwareParserConfiguration(XML11Configuration).parse(boolean) line: not > available > XIncludeAwareParserConfiguration(XML11Configuration).parse(XMLInputSource) > line: not available > SAXParserImpl$JAXPSAXParser(XMLParser).parse(XMLInputSource) line: not > available > SAXParserImpl$JAXPSAXParser(AbstractSAXParser).parse(InputSource) line: not > available > SAXParserImpl$JAXPSAXParser.parse(InputSource) line: not available > SAXParserImpl.parse(InputSource, DefaultHandler) line: not available > SAXParserImpl(SAXParser).parse(InputStream, DefaultHandler) line: 195 > XmlRootExtractor.extractRootElement(InputStream) line: 62 > XmlRootExtractor.extractRootElement(byte[]) line: 42 > MimeTypes.getMimeType(byte[]) line: 212 > MimeTypes.detect(InputStream, Metadata) line: 494 > DefaultDetector(CompositeDetector).detect(InputStream, Metadata) line: 84 > > Please see attached XML file. > Please advise. > Thanks -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (TIKA-2727) Parsing and detect mime type of XML file stuck in infinite loop
[ https://issues.apache.org/jira/browse/TIKA-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16618986#comment-16618986 ] Slava G commented on TIKA-2727: --- The problems is that issue not always reproducible, I can't point on some content or anything else. Seems that it's somehow related to jars conflicts and order of class loading, but don't know what exactly, in version 1.17 everything works fine, in the 1.18 we started to fail on many emails parsings. > Parsing and detect mime type of XML file stuck in infinite loop > --- > > Key: TIKA-2727 > URL: https://issues.apache.org/jira/browse/TIKA-2727 > Project: Tika > Issue Type: Bug > Components: detector, parser >Affects Versions: 1.17 >Reporter: Slava G >Assignee: Tim Allison >Priority: Major > Fix For: 1.19, 2.0.0 > > Attachments: 1_e3e13f0e-7085-4000-a558-5d255ed7a944.xml > > > Hi, > I'm trying to parse (even mime type detect) some XML file that it's not > large, but kinda tricky and my process hangs on : > XMLStringBuffer.append(char[], int, int) line: not available > XMLStringBuffer.append(XMLString) line: not available > XMLNSDocumentScannerImpl(XMLScanner).scanAttributeValue(XMLString, XMLString, > String, boolean, String) line: not available > XMLNSDocumentScannerImpl.scanAttribute(XMLAttributesImpl) line: not available > XMLNSDocumentScannerImpl.scanStartElement() line: not available > XMLNSDocumentScannerImpl$NSContentDispatcher.scanRootElementHook() line: not > available > XMLNSDocumentScannerImpl$NSContentDispatcher(XMLDocumentFragmentScannerImpl$FragmentContentDispatcher).dispatch(boolean) > line: not available > XMLNSDocumentScannerImpl(XMLDocumentFragmentScannerImpl).scanDocument(boolean) > line: not available > XIncludeAwareParserConfiguration(XML11Configuration).parse(boolean) line: not > available > XIncludeAwareParserConfiguration(XML11Configuration).parse(XMLInputSource) > line: not available > SAXParserImpl$JAXPSAXParser(XMLParser).parse(XMLInputSource) line: not > available > SAXParserImpl$JAXPSAXParser(AbstractSAXParser).parse(InputSource) line: not > available > SAXParserImpl$JAXPSAXParser.parse(InputSource) line: not available > SAXParserImpl.parse(InputSource, DefaultHandler) line: not available > SAXParserImpl(SAXParser).parse(InputStream, DefaultHandler) line: 195 > XmlRootExtractor.extractRootElement(InputStream) line: 62 > XmlRootExtractor.extractRootElement(byte[]) line: 42 > MimeTypes.getMimeType(byte[]) line: 212 > MimeTypes.detect(InputStream, Metadata) line: 494 > DefaultDetector(CompositeDetector).detect(InputStream, Metadata) line: 84 > > Please see attached XML file. > Please advise. > Thanks -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (TIKA-2727) Parsing and detect mime type of XML file stuck in infinite loop
[ https://issues.apache.org/jira/browse/TIKA-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16617928#comment-16617928 ] Slava G commented on TIKA-2727: --- Will definitely work to provide as much as possible information to solve this. Thanks > Parsing and detect mime type of XML file stuck in infinite loop > --- > > Key: TIKA-2727 > URL: https://issues.apache.org/jira/browse/TIKA-2727 > Project: Tika > Issue Type: Bug > Components: detector, parser >Affects Versions: 1.17 >Reporter: Slava G >Assignee: Tim Allison >Priority: Major > Fix For: 1.19, 2.0.0 > > Attachments: 1_e3e13f0e-7085-4000-a558-5d255ed7a944.xml > > > Hi, > I'm trying to parse (even mime type detect) some XML file that it's not > large, but kinda tricky and my process hangs on : > XMLStringBuffer.append(char[], int, int) line: not available > XMLStringBuffer.append(XMLString) line: not available > XMLNSDocumentScannerImpl(XMLScanner).scanAttributeValue(XMLString, XMLString, > String, boolean, String) line: not available > XMLNSDocumentScannerImpl.scanAttribute(XMLAttributesImpl) line: not available > XMLNSDocumentScannerImpl.scanStartElement() line: not available > XMLNSDocumentScannerImpl$NSContentDispatcher.scanRootElementHook() line: not > available > XMLNSDocumentScannerImpl$NSContentDispatcher(XMLDocumentFragmentScannerImpl$FragmentContentDispatcher).dispatch(boolean) > line: not available > XMLNSDocumentScannerImpl(XMLDocumentFragmentScannerImpl).scanDocument(boolean) > line: not available > XIncludeAwareParserConfiguration(XML11Configuration).parse(boolean) line: not > available > XIncludeAwareParserConfiguration(XML11Configuration).parse(XMLInputSource) > line: not available > SAXParserImpl$JAXPSAXParser(XMLParser).parse(XMLInputSource) line: not > available > SAXParserImpl$JAXPSAXParser(AbstractSAXParser).parse(InputSource) line: not > available > SAXParserImpl$JAXPSAXParser.parse(InputSource) line: not available > SAXParserImpl.parse(InputSource, DefaultHandler) line: not available > SAXParserImpl(SAXParser).parse(InputStream, DefaultHandler) line: 195 > XmlRootExtractor.extractRootElement(InputStream) line: 62 > XmlRootExtractor.extractRootElement(byte[]) line: 42 > MimeTypes.getMimeType(byte[]) line: 212 > MimeTypes.detect(InputStream, Metadata) line: 494 > DefaultDetector(CompositeDetector).detect(InputStream, Metadata) line: 84 > > Please see attached XML file. > Please advise. > Thanks -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (TIKA-2727) Parsing and detect mime type of XML file stuck in infinite loop
[
https://issues.apache.org/jira/browse/TIKA-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16617924#comment-16617924
]
Tim Allison commented on TIKA-2727:
---
{quote}Does sersion 1.19 solves this issue more delicate?
{quote}
Somewhat, if the user sets the above option, we respect that. Otherwise, we
set the limit to 20 expansions for our XML parsers.
{quote}I'm afraid that 1.19 will brings same issue back to us.
{quote}
Y. That wouldn't surprise me. If you're able to help us figure out what's
going on, we can fix it. :D
> Parsing and detect mime type of XML file stuck in infinite loop
> ---
>
> Key: TIKA-2727
> URL: https://issues.apache.org/jira/browse/TIKA-2727
> Project: Tika
> Issue Type: Bug
> Components: detector, parser
>Affects Versions: 1.17
>Reporter: Slava G
>Assignee: Tim Allison
>Priority: Major
> Fix For: 1.19, 2.0.0
>
> Attachments: 1_e3e13f0e-7085-4000-a558-5d255ed7a944.xml
>
>
> Hi,
> I'm trying to parse (even mime type detect) some XML file that it's not
> large, but kinda tricky and my process hangs on :
> XMLStringBuffer.append(char[], int, int) line: not available
> XMLStringBuffer.append(XMLString) line: not available
> XMLNSDocumentScannerImpl(XMLScanner).scanAttributeValue(XMLString, XMLString,
> String, boolean, String) line: not available
> XMLNSDocumentScannerImpl.scanAttribute(XMLAttributesImpl) line: not available
> XMLNSDocumentScannerImpl.scanStartElement() line: not available
> XMLNSDocumentScannerImpl$NSContentDispatcher.scanRootElementHook() line: not
> available
> XMLNSDocumentScannerImpl$NSContentDispatcher(XMLDocumentFragmentScannerImpl$FragmentContentDispatcher).dispatch(boolean)
> line: not available
> XMLNSDocumentScannerImpl(XMLDocumentFragmentScannerImpl).scanDocument(boolean)
> line: not available
> XIncludeAwareParserConfiguration(XML11Configuration).parse(boolean) line: not
> available
> XIncludeAwareParserConfiguration(XML11Configuration).parse(XMLInputSource)
> line: not available
> SAXParserImpl$JAXPSAXParser(XMLParser).parse(XMLInputSource) line: not
> available
> SAXParserImpl$JAXPSAXParser(AbstractSAXParser).parse(InputSource) line: not
> available
> SAXParserImpl$JAXPSAXParser.parse(InputSource) line: not available
> SAXParserImpl.parse(InputSource, DefaultHandler) line: not available
> SAXParserImpl(SAXParser).parse(InputStream, DefaultHandler) line: 195
> XmlRootExtractor.extractRootElement(InputStream) line: 62
> XmlRootExtractor.extractRootElement(byte[]) line: 42
> MimeTypes.getMimeType(byte[]) line: 212
> MimeTypes.detect(InputStream, Metadata) line: 494
> DefaultDetector(CompositeDetector).detect(InputStream, Metadata) line: 84
>
> Please see attached XML file.
> Please advise.
> Thanks
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (TIKA-2727) Parsing and detect mime type of XML file stuck in infinite loop
[ https://issues.apache.org/jira/browse/TIKA-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16617833#comment-16617833 ] Slava G commented on TIKA-2727: --- I'm using TIKA directly in my code, Does sersion 1.19 solves this issue more delicate? Also, we're using 1.17, because when we switched to 1.18 many customers data for parsing is failed due to very strange error, that was not discivered by our QA. So,. I'm afraid that 1.19 will brings same issue back to us. > Parsing and detect mime type of XML file stuck in infinite loop > --- > > Key: TIKA-2727 > URL: https://issues.apache.org/jira/browse/TIKA-2727 > Project: Tika > Issue Type: Bug > Components: detector, parser >Affects Versions: 1.17 >Reporter: Slava G >Assignee: Tim Allison >Priority: Major > Fix For: 1.19, 2.0.0 > > Attachments: 1_e3e13f0e-7085-4000-a558-5d255ed7a944.xml > > > Hi, > I'm trying to parse (even mime type detect) some XML file that it's not > large, but kinda tricky and my process hangs on : > XMLStringBuffer.append(char[], int, int) line: not available > XMLStringBuffer.append(XMLString) line: not available > XMLNSDocumentScannerImpl(XMLScanner).scanAttributeValue(XMLString, XMLString, > String, boolean, String) line: not available > XMLNSDocumentScannerImpl.scanAttribute(XMLAttributesImpl) line: not available > XMLNSDocumentScannerImpl.scanStartElement() line: not available > XMLNSDocumentScannerImpl$NSContentDispatcher.scanRootElementHook() line: not > available > XMLNSDocumentScannerImpl$NSContentDispatcher(XMLDocumentFragmentScannerImpl$FragmentContentDispatcher).dispatch(boolean) > line: not available > XMLNSDocumentScannerImpl(XMLDocumentFragmentScannerImpl).scanDocument(boolean) > line: not available > XIncludeAwareParserConfiguration(XML11Configuration).parse(boolean) line: not > available > XIncludeAwareParserConfiguration(XML11Configuration).parse(XMLInputSource) > line: not available > SAXParserImpl$JAXPSAXParser(XMLParser).parse(XMLInputSource) line: not > available > SAXParserImpl$JAXPSAXParser(AbstractSAXParser).parse(InputSource) line: not > available > SAXParserImpl$JAXPSAXParser.parse(InputSource) line: not available > SAXParserImpl.parse(InputSource, DefaultHandler) line: not available > SAXParserImpl(SAXParser).parse(InputStream, DefaultHandler) line: 195 > XmlRootExtractor.extractRootElement(InputStream) line: 62 > XmlRootExtractor.extractRootElement(byte[]) line: 42 > MimeTypes.getMimeType(byte[]) line: 212 > MimeTypes.detect(InputStream, Metadata) line: 494 > DefaultDetector(CompositeDetector).detect(InputStream, Metadata) line: 84 > > Please see attached XML file. > Please advise. > Thanks -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (TIKA-2727) Parsing and detect mime type of XML file stuck in infinite loop
[
https://issues.apache.org/jira/browse/TIKA-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16617783#comment-16617783
]
Tim Allison commented on TIKA-2727:
---
If you're using Tika directly within your code (DON'T DO THIS!), that'll affect
everything in your jvm that is paying attention to it. :D
If you're running tika in batch mode, you can limit it to the child process
with, e.g. {{-JDjdk.xml.entityExpansionLimit=10}} Or, if you are using the new
robust tika-server feature available in Tika 1.19, you can specify that for the
child jvm, too. Or, if you're using the ForkParser, you can specify it there.
> Parsing and detect mime type of XML file stuck in infinite loop
> ---
>
> Key: TIKA-2727
> URL: https://issues.apache.org/jira/browse/TIKA-2727
> Project: Tika
> Issue Type: Bug
> Components: detector, parser
>Affects Versions: 1.17
>Reporter: Slava G
>Assignee: Tim Allison
>Priority: Major
> Fix For: 1.19, 2.0.0
>
> Attachments: 1_e3e13f0e-7085-4000-a558-5d255ed7a944.xml
>
>
> Hi,
> I'm trying to parse (even mime type detect) some XML file that it's not
> large, but kinda tricky and my process hangs on :
> XMLStringBuffer.append(char[], int, int) line: not available
> XMLStringBuffer.append(XMLString) line: not available
> XMLNSDocumentScannerImpl(XMLScanner).scanAttributeValue(XMLString, XMLString,
> String, boolean, String) line: not available
> XMLNSDocumentScannerImpl.scanAttribute(XMLAttributesImpl) line: not available
> XMLNSDocumentScannerImpl.scanStartElement() line: not available
> XMLNSDocumentScannerImpl$NSContentDispatcher.scanRootElementHook() line: not
> available
> XMLNSDocumentScannerImpl$NSContentDispatcher(XMLDocumentFragmentScannerImpl$FragmentContentDispatcher).dispatch(boolean)
> line: not available
> XMLNSDocumentScannerImpl(XMLDocumentFragmentScannerImpl).scanDocument(boolean)
> line: not available
> XIncludeAwareParserConfiguration(XML11Configuration).parse(boolean) line: not
> available
> XIncludeAwareParserConfiguration(XML11Configuration).parse(XMLInputSource)
> line: not available
> SAXParserImpl$JAXPSAXParser(XMLParser).parse(XMLInputSource) line: not
> available
> SAXParserImpl$JAXPSAXParser(AbstractSAXParser).parse(InputSource) line: not
> available
> SAXParserImpl$JAXPSAXParser.parse(InputSource) line: not available
> SAXParserImpl.parse(InputSource, DefaultHandler) line: not available
> SAXParserImpl(SAXParser).parse(InputStream, DefaultHandler) line: 195
> XmlRootExtractor.extractRootElement(InputStream) line: 62
> XmlRootExtractor.extractRootElement(byte[]) line: 42
> MimeTypes.getMimeType(byte[]) line: 212
> MimeTypes.detect(InputStream, Metadata) line: 494
> DefaultDetector(CompositeDetector).detect(InputStream, Metadata) line: 84
>
> Please see attached XML file.
> Please advise.
> Thanks
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (TIKA-2727) Parsing and detect mime type of XML file stuck in infinite loop
[ https://issues.apache.org/jira/browse/TIKA-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16617516#comment-16617516 ] Slava G commented on TIKA-2727: --- Great !!! Thanks. Is the jdk.xml.entityExpansionLimit relevant only for TIKA or can affect anything else XML related ? > Parsing and detect mime type of XML file stuck in infinite loop > --- > > Key: TIKA-2727 > URL: https://issues.apache.org/jira/browse/TIKA-2727 > Project: Tika > Issue Type: Bug > Components: detector, parser >Affects Versions: 1.17 >Reporter: Slava G >Assignee: Tim Allison >Priority: Major > Fix For: 1.19, 2.0.0 > > Attachments: 1_e3e13f0e-7085-4000-a558-5d255ed7a944.xml > > > Hi, > I'm trying to parse (even mime type detect) some XML file that it's not > large, but kinda tricky and my process hangs on : > XMLStringBuffer.append(char[], int, int) line: not available > XMLStringBuffer.append(XMLString) line: not available > XMLNSDocumentScannerImpl(XMLScanner).scanAttributeValue(XMLString, XMLString, > String, boolean, String) line: not available > XMLNSDocumentScannerImpl.scanAttribute(XMLAttributesImpl) line: not available > XMLNSDocumentScannerImpl.scanStartElement() line: not available > XMLNSDocumentScannerImpl$NSContentDispatcher.scanRootElementHook() line: not > available > XMLNSDocumentScannerImpl$NSContentDispatcher(XMLDocumentFragmentScannerImpl$FragmentContentDispatcher).dispatch(boolean) > line: not available > XMLNSDocumentScannerImpl(XMLDocumentFragmentScannerImpl).scanDocument(boolean) > line: not available > XIncludeAwareParserConfiguration(XML11Configuration).parse(boolean) line: not > available > XIncludeAwareParserConfiguration(XML11Configuration).parse(XMLInputSource) > line: not available > SAXParserImpl$JAXPSAXParser(XMLParser).parse(XMLInputSource) line: not > available > SAXParserImpl$JAXPSAXParser(AbstractSAXParser).parse(InputSource) line: not > available > SAXParserImpl$JAXPSAXParser.parse(InputSource) line: not available > SAXParserImpl.parse(InputSource, DefaultHandler) line: not available > SAXParserImpl(SAXParser).parse(InputStream, DefaultHandler) line: 195 > XmlRootExtractor.extractRootElement(InputStream) line: 62 > XmlRootExtractor.extractRootElement(byte[]) line: 42 > MimeTypes.getMimeType(byte[]) line: 212 > MimeTypes.detect(InputStream, Metadata) line: 494 > DefaultDetector(CompositeDetector).detect(InputStream, Metadata) line: 84 > > Please see attached XML file. > Please advise. > Thanks -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (TIKA-2727) Parsing and detect mime type of XML file stuck in infinite loop
[
https://issues.apache.org/jira/browse/TIKA-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16617480#comment-16617480
]
Tim Allison commented on TIKA-2727:
---
Until you can upgrade to 1.19, you should be able to limit entity expansion via
the commandline, e.g.:
{{-Djdk.xml.entityExpansionLimit=10}}
> Parsing and detect mime type of XML file stuck in infinite loop
> ---
>
> Key: TIKA-2727
> URL: https://issues.apache.org/jira/browse/TIKA-2727
> Project: Tika
> Issue Type: Bug
> Components: detector, parser
>Affects Versions: 1.17
>Reporter: Slava G
>Assignee: Tim Allison
>Priority: Major
> Fix For: 1.19, 2.0.0
>
> Attachments: 1_e3e13f0e-7085-4000-a558-5d255ed7a944.xml
>
>
> Hi,
> I'm trying to parse (even mime type detect) some XML file that it's not
> large, but kinda tricky and my process hangs on :
> XMLStringBuffer.append(char[], int, int) line: not available
> XMLStringBuffer.append(XMLString) line: not available
> XMLNSDocumentScannerImpl(XMLScanner).scanAttributeValue(XMLString, XMLString,
> String, boolean, String) line: not available
> XMLNSDocumentScannerImpl.scanAttribute(XMLAttributesImpl) line: not available
> XMLNSDocumentScannerImpl.scanStartElement() line: not available
> XMLNSDocumentScannerImpl$NSContentDispatcher.scanRootElementHook() line: not
> available
> XMLNSDocumentScannerImpl$NSContentDispatcher(XMLDocumentFragmentScannerImpl$FragmentContentDispatcher).dispatch(boolean)
> line: not available
> XMLNSDocumentScannerImpl(XMLDocumentFragmentScannerImpl).scanDocument(boolean)
> line: not available
> XIncludeAwareParserConfiguration(XML11Configuration).parse(boolean) line: not
> available
> XIncludeAwareParserConfiguration(XML11Configuration).parse(XMLInputSource)
> line: not available
> SAXParserImpl$JAXPSAXParser(XMLParser).parse(XMLInputSource) line: not
> available
> SAXParserImpl$JAXPSAXParser(AbstractSAXParser).parse(InputSource) line: not
> available
> SAXParserImpl$JAXPSAXParser.parse(InputSource) line: not available
> SAXParserImpl.parse(InputSource, DefaultHandler) line: not available
> SAXParserImpl(SAXParser).parse(InputStream, DefaultHandler) line: 195
> XmlRootExtractor.extractRootElement(InputStream) line: 62
> XmlRootExtractor.extractRootElement(byte[]) line: 42
> MimeTypes.getMimeType(byte[]) line: 212
> MimeTypes.detect(InputStream, Metadata) line: 494
> DefaultDetector(CompositeDetector).detect(InputStream, Metadata) line: 84
>
> Please see attached XML file.
> Please advise.
> Thanks
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
