[ 
https://issues.apache.org/jira/browse/CRUNCH-491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Christian Tzolov reopened CRUNCH-491:
-------------------------------------

Bogus logic for computing the number of bytes read. Some of the issues found: 
- Counter is not aligned with Split's start mark.
- Counter increment syntax is bogus (doesn't increment)
- Incorrect assumption that we compute the number of raw bytes read from the 
underlying xml file by counting the bytes in the characters read from the 
encoded input stream. 

> Add an Xml File Source
> ----------------------
>
>                 Key: CRUNCH-491
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-491
>             Project: Crunch
>          Issue Type: New Feature
>          Components: Core
>    Affects Versions: 0.11.0
>            Reporter: Christian Tzolov
>            Assignee: Christian Tzolov
>            Priority: Minor
>              Labels: inputformat, source, xml
>         Attachments: CRUNCH-491.patch, CRUNCH-491b.patch, CRUNCH-491c.patch, 
> CRUNCH-491d.patch
>
>
> Large XML documents that are composed of a repetitive XML elements can be 
> broken into chunks delimited by the start and end tags of those elements.
> The XmlSource should process XML files and extract out the XML between the 
> pre-configured start / end tags.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to