Hans Brende created ANY23-443: --------------------------------- Summary: Improve efficiency of RDFa Extractor Key: ANY23-443 URL: https://issues.apache.org/jira/browse/ANY23-443 Project: Apache Any23 Issue Type: Improvement Reporter: Hans Brende
Our RDFa Extractor is terribly inefficient. 1st, we parse the html "tag soup" input stream into a DOM using Jsoup 2nd, we transform the DOM back into an input stream, containing strictly valid XML to avoid errors in the underlying semargl parser 3rd, the underlying semargl parser resurrects this input stream as XML and hands off XML streaming events to its underlying XmlSink. 4th, semargl's XmlSink hands its own RDF events back to RDF4J, which in turn hands them back to Any23. I propose cutting out all these intermediate steps by simply walking the original jsoup DOM and handing our own XML events directly to semargl's XmlSink, which we will configure to give RDF events directly back to Any23. This will also allow us to get rid of most (or possibly all) of the various HTML-to-XML "fixups" we had to implement to prevent extraction failures. -- This message was sent by Atlassian Jira (v8.3.2#803003)