Josef Ludvíček created CAMEL-8150:
-------------------------------------
Summary: camel-hdfs sending message per chunk, not per file
Key: CAMEL-8150
URL: https://issues.apache.org/jira/browse/CAMEL-8150
Project: Camel
Issue Type: Improvement
Components: camel-hdfs, documentation
Affects Versions: 2.14.0
Reporter: Josef Ludvíček
When hdfs consumer picks orinary file, it sends message per data chunk.
Not message per file as one could expect.
In the docs it is mentioned only in option description, which can be overlooked
very easily.
It should be explicitly written in the beginning of the [component doc page |
https://camel.apache.org/hdfs2].
Option description from docs
|chunkSize | 4096 | When reading a normal file, this is split into chunks
producing a message per chunk. |
Sample camel route (workaround could be to add {{?fileExist=Append}} to file
component)
{code:xml}
<camel:route id="toFile">
<from uri="hdfs2:localhost:8020/tmp/camel-test/"/>
<log message="picked up file from hdfs with name
$simple{header.CamelFileName}"/>
<to uri="file:test-dest"/>
<log message="file downloaded from hadoop"/>
</camel:route>
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
