Author: buildbot
Date: Fri Feb 1 12:25:25 2013
New Revision: 848891
Log:
Production update by buildbot for camel
Modified:
websites/production/camel/content/book-component-appendix.html
websites/production/camel/content/book-in-one-page.html
websites/production/camel/content/cache/main.pageCache
websites/production/camel/content/camel-2110-release.html
websites/production/camel/content/hdfs.html
Modified: websites/production/camel/content/book-component-appendix.html
==============================================================================
--- websites/production/camel/content/book-component-appendix.html (original)
+++ websites/production/camel/content/book-component-appendix.html Fri Feb 1
12:25:25 2013
@@ -6466,6 +6466,15 @@ hdfs:<span class="code-comment">//localh
</div></div>
<p>it means: a new file is created either when it has been idle for more than
1 second or if more than 5 bytes have been written. So, running <tt>hadoop fs
-ls /tmp/simple-file</tt> you'll find the following files seg0, seg1, seg2,
etc</p>
+
+<h3><a shape="rect"
name="BookComponentAppendix-Controllingtoclosefilestream"></a>Controlling to
close file stream</h3>
+<p><b>Available as of Camel 2.10.4</b></p>
+
+<p>When using the <a shape="rect" href="hdfs.html" title="HDFS">HDFS</a>
producer <b>without</b> a split strategy, then the file output stream is by
default closed after the write. However you may want to keep the stream open,
and only explicit close the stream later. For that you can use the header
<tt>HdfsConstants.HDFS_CLOSE</tt> (value = <tt>"CamelHdfsClose"</tt>) to
control this. Setting this value to a boolean allows you to explicit control
whether the stream should be closed or not.</p>
+
+<p>Notice this does not apply if you use a split strategy, as there is varios
strategy that control when the stream is closed.</p>
+
+
<h3><a shape="rect"
name="BookComponentAppendix-UsingthiscomponentinOSGi"></a>Using this component
in OSGi</h3>
<p>This component is fully functional in an OSGi environment however, it
requires some actions from the user. Hadoop uses the thread context class
loader in order to load resources. Usually, the thread context classloader will
be the bundle class loader of the bundle that contains the routes. So, the
default configuration files need to be visible from the bundle class loader. A
typical way to deal with it is to keep a copy of core-default.xml in your
bundle root. That file can be found in the hadoop-common.jar.</p>
<h2><a shape="rect"
name="BookComponentAppendix-HibernateComponent"></a>Hibernate Component</h2>
Modified: websites/production/camel/content/book-in-one-page.html
==============================================================================
--- websites/production/camel/content/book-in-one-page.html (original)
+++ websites/production/camel/content/book-in-one-page.html Fri Feb 1 12:25:25
2013
@@ -26926,6 +26926,15 @@ hdfs:<span class="code-comment">//localh
</div></div>
<p>it means: a new file is created either when it has been idle for more than
1 second or if more than 5 bytes have been written. So, running <tt>hadoop fs
-ls /tmp/simple-file</tt> you'll find the following files seg0, seg1, seg2,
etc</p>
+
+<h3><a shape="rect"
name="BookInOnePage-Controllingtoclosefilestream"></a>Controlling to close file
stream</h3>
+<p><b>Available as of Camel 2.10.4</b></p>
+
+<p>When using the <a shape="rect" href="hdfs.html" title="HDFS">HDFS</a>
producer <b>without</b> a split strategy, then the file output stream is by
default closed after the write. However you may want to keep the stream open,
and only explicit close the stream later. For that you can use the header
<tt>HdfsConstants.HDFS_CLOSE</tt> (value = <tt>"CamelHdfsClose"</tt>) to
control this. Setting this value to a boolean allows you to explicit control
whether the stream should be closed or not.</p>
+
+<p>Notice this does not apply if you use a split strategy, as there is varios
strategy that control when the stream is closed.</p>
+
+
<h3><a shape="rect" name="BookInOnePage-UsingthiscomponentinOSGi"></a>Using
this component in OSGi</h3>
<p>This component is fully functional in an OSGi environment however, it
requires some actions from the user. Hadoop uses the thread context class
loader in order to load resources. Usually, the thread context classloader will
be the bundle class loader of the bundle that contains the routes. So, the
default configuration files need to be visible from the bundle class loader. A
typical way to deal with it is to keep a copy of core-default.xml in your
bundle root. That file can be found in the hadoop-common.jar.</p>
<h2><a shape="rect" name="BookInOnePage-HibernateComponent"></a>Hibernate
Component</h2>
Modified: websites/production/camel/content/cache/main.pageCache
==============================================================================
Binary files - no diff available.
Modified: websites/production/camel/content/camel-2110-release.html
==============================================================================
--- websites/production/camel/content/camel-2110-release.html (original)
+++ websites/production/camel/content/camel-2110-release.html Fri Feb 1
12:25:25 2013
@@ -84,7 +84,7 @@
<p>Welcome to the 2.11.0 release with approximately XXX issues resolved -
including new features, improvements, and bug fixes, such as: </p>
-<ul><li>Added <a shape="rect" href="binding.html" title="Binding">Binding</a>
support, so it is easy to combine things like a <a shape="rect"
href="data-format.html" title="Data Format">Data Format</a> to an <a
shape="rect" href="endpoint.html" title="Endpoint">Endpoint</a> for easier
composition of routes.</li><li>Added support for SOAP 1.2 in <a shape="rect"
href="soap.html" title="SOAP">SOAP</a> data format.</li><li><a shape="rect"
href="cache.html" title="Cache">Cache</a> operation for add/update now supports
expiry headers to control time to live/idle/eternal.</li><li>Added
<tt>allowNullBody</tt> option to <a shape="rect" href="jms.html"
title="JMS">JMS</a> to configure whether sending messages with no body is
allowed.</li><li>Added <tt>connectOnStartup</tt> option to <a shape="rect"
href="hdfs.html" title="HDFS">HDFS</a> to allow to connect on demand, to avoid
having Hadoop block for long time connecting to the HDFS cluster, as it has a
hardcoded 15 minute retry mechan
ism.</li><li>Added support for daily and weekly trends to <a shape="rect"
href="twitter.html" title="Twitter">Twitter</a> component.</li><li>The <a
shape="rect" href="camel-maven-archetypes.html" title="Camel Maven
Archetypes">Camel Maven Archetypes</a> now generates projects without any
license headers.</li><li>Added <tt>rejectOld</tt> option to the <a shape="rect"
href="resequencer.html" title="Resequencer">Resequencer</a> to prevent out of
order messages from being delivered after capacity/timeout events
occur</li><li>Further optimized <a shape="rect" href="xpath.html"
title="XPath">XPath</a> under concurrent load, and as well ensured resources
are cleaned up eagerly</li><li>Added options <tt>allowNullBody</tt> and
<tt>readLockMinLength</tt> to the <a shape="rect" href="file2.html"
title="File2">File</a> and <a shape="rect" href="ftp2.html"
title="FTP2">FTP</a> components.</li><li>Made <tt>changed</tt> read lock
strategy on <a shape="rect" href="ftp2.html" title="FTP2">FT
P</a> go faster (eg when the FTP server has a lot of files in the directory)
if you enable the <tt>fastExistsCheck=true</tt> option as well. Notice that
some FTP server may not support this.</li><li><a shape="rect" href="hl7.html"
title="HL7">HL7</a> moves to HAPI 2.0 and supports using a dedicated Parser
instance in the <a shape="rect" href="hl7.html" title="HL7">HL7</a> MLLP codec
and DataFormat. Added "Terser" language and expression to be able to extract
fields from a parsed message. <a shape="rect" href="hl7.html"
title="HL7">HL7</a> now uses Apache Mina 2.x.</li><li>Add an option
<tt>HttpMethodRestrict</tt> to restrict HTTP method in <a shape="rect"
href="jetty.html" title="Jetty">Jetty</a> and <a shape="rect"
href="servlet.html" title="SERVLET">SERVLET</a></li><li>Add support for
selection of <a shape="rect" href="direct-vm.html"
title="Direct-VM">Direct-VM</a> consumers by using ant-like path
expression.</li><li>The <a shape="rect" href="pojo-producing.html" title="P
OJO Producing">POJO Producing</a>, and <a shape="rect"
href="pojo-consuming.html" title="POJO Consuming">POJO Consuming</a> with
@Consume, @Produce, @EndpointInject now supports a new {{property} attribute to
get the endpoint configuration from a bean property (eg using a getter method);
this allows you to configure this on the bean using conventional bean
configuration.</li><li>Testing with <tt>camel-test-blueprint</tt> on Windows no
longer tries to cleanup after testing taking up 5 seconds and logging
WARNs.</li><li>The <a shape="rect" href="file2.html" title="File2">File</a>,
and <a shape="rect" href="ftp2.html" title="FTP2">FTP</a> components now
support <tt>fileExist=Move</tt> option to move any existing files before
writing a file.</li><li>Added option <tt>loadStatisticsEnabled</tt> on <a
shape="rect" href="camel-jmx.html" title="Camel JMX">Camel JMX</a> to allow to
disable load statistics if not needed (avoids a background thread being in use,
to calculate the load st
ats).</li><li>Enabled "lazy connections" for <a shape="rect" href="xmpp.html"
title="XMPP">XMPP</a> providers via the <tt>testConnectionOnStartup</tt>
option</li><li>Added a connection monitor to detect and fix dropped <a
shape="rect" href="xmpp.html" title="XMPP">XMPP</a> consumer connections at
configurable <tt>connectionPollDelay</tt> intervals</li><li>Added an
<tt>org.apache.camel.builder.ExchangeBuilder</tt> to build the <a shape="rect"
href="exchange.html" title="Exchange">Exchange</a> using a builder
pattern.</li><li>The <a shape="rect" href="camel-run-maven-goal.html"
title="Camel Run Maven Goal">Camel Run Maven Goal</a> can now run <a
shape="rect" href="cdi.html" title="CDI">CDI</a> applications.</li><li>The
Camel <a shape="rect" href="cdi.html" title="CDI">CDI</a> component has
improved a lot.</li><li>Added option <tt>allowRedeliveryWhileStopping</tt> to
<a shape="rect" href="dead-letter-channel.html" title="Dead Letter
Channel">error handlers</a> to control if red
elivery is allowed during stopping/shutting down Camel or the route(s).
Turning this option <tt>false</tt> allows to stop quicker by rejecting
redelivery attempts.</li><li>Added support for specifying user info in Camel <a
shape="rect" href="endpoint.html" title="Endpoint">Endpoint</a> urls, which
contains the @ sign; now the @ sign can be given as is; without being encoded
to %40.</li><li>Added robust connection support for <a shape="rect"
href="jmx.html" title="JMX">JMX</a>. Optional <tt>testConnectionOnStartup</tt>
allows a JMX consumer to attach to a JMX server that becomes available
<em>after</em> the JMX endpoint starts; <tt>reconnectOnConnectionFailure</tt>
enables re-connection of failed JMX connections.</li><li><a shape="rect"
href="jaxb.html" title="JAXB">JAXB</a> and <a shape="rect" href="soap.html"
title="SOAP">SOAP</a> data format now supports controlling namespace prefix
mappings when marshalling (eg to avoid prefixes such as ns2, ns3, ns4
etc.)</li><li>Added s
upport for using raw uris when <a shape="rect" href="component.html"
title="Component">Component</a>s create <a shape="rect" href="endpoint.html"
title="Endpoint">Endpoint</a>s. This gives component writers full power in case
their component has special syntax/notation for endpoint uri
configurations.</li><li><a shape="rect" href="eip.html" title="EIP">EIP</a>s
configured with custom <tt>AggregationStrategy</tt> will now strict check the
custom strategy exists in the <a shape="rect" href="registry.html"
title="Registry">Registry</a> and no longer fallback and use a default strategy
if not.</li><li>Camel now logs on shutdown if any thread pools hasn't been
properly shutdown, and will shutdown them as fail safe (can only be done for
the thread pools Camel manages).</li><li>The buffer size of <a shape="rect"
href="stream-caching.html" title="Stream caching">Stream caching</a> is now
configurable.</li><li>Improved startup performance.</li><li>Added <a
shape="rect" href="jms.html
" title="JMS">JMS</a> URI option <tt>messageListenerContainerFactoryRef</tt>
which allows you to specify a <tt>MessageListenerContainerFactory</tt> to
determine what
<tt>org.springframework.jms.listener.AbstractMessageListenerContainer</tt> to
use to consume messages.</li><li><a shape="rect" href="mqtt.html"
title="MQTT">MQTT</a> producer now leverages the <a shape="rect"
href="asynchronous-routing-engine.html" title="Asynchronous Routing
Engine">Asynchronous Routing Engine</a></li><li>The <a shape="rect"
href="netty.html" title="Netty">Netty</a> producer scales up and down much
better by leveraging a channel pool.</li><li>Added new <a shape="rect"
href="camel-maven-archetypes.html" title="Camel Maven Archetypes">Camel Maven
Archetypes</a> for creating Camel and Groovy applications.</li><li>Camel now
injects <tt>CamelContext</tt> on <tt>Language</tt> and <tt>DataFormat</tt> that
implements <tt>CamelContextAware</tt></li><li>Thread pools in Camel with
<tt>maximumQueueSize</tt
> of 0 or negative will now not use a worker queue but do direct hand-over to
> thread instead.</li><li><a shape="rect" href="simple.html"
> title="Simple">Simple</a> unary operators for inc and dec must now have
> function on left hand side, to be parsed as unary function. Otherwise its
> now regarded as literal.</li><li>Custom assigned id's on Camel <a
> shape="rect" href="routes.html" title="Routes">Routes</a> is now validated
> on starting the routes, that they must be unique within the same
> CamelContext.</li><li>Added <tt>AbstractListAggregationStrategy</tt>
> abstract class to make it easier to <a shape="rect" href="aggregator2.html"
> title="Aggregator2">aggregate</a> into a List<V> using a custom
> <tt>AggregationStrategy</tt>.</li><li><a shape="rect" href="eip.html"
> title="EIP">EIP</a>s which support using <tt>AggregationStrategy</tt> now
> control the lifecycle of the strategy; allowing end users to do custom logic
> in the start/stop methods of their strategy implementation.</li>
<li>Added option <tt>includeSentJMSMessageID</tt> to <a shape="rect"
href="jms.html" title="JMS">JMS</a> to allow to enrich Camel Message with the
actual JMSMessageID for the sent message. Can be used by end users for logging
purpose etc.</li><li>Added option <tt>allowShortLines</tt> and
<tt>ignoreExtraColumns</tt> to <a shape="rect" href="flatpack-dataformat.html"
title="Flatpack DataFormat">Flatpack data format</a>.</li><li><a shape="rect"
href="mail.html" title="Mail">Mail</a> consumer now supports using search terms
to filter mails by terms such as subject, from, body, sent date
etc.</li><li>The cached script file in the <a shape="rect" href="language.html"
title="Language">Language</a> component can now be cleared via
JMX.</li><li>improved the karaf context-info command by adding a verbose mode
to view endpoints list (now hidden by default) and adding stats on the number
of active/inactive routes</li><li>Added support for <tt>UpdateList</tt>,
<tt>DeleteList</tt> and <tt
>ExecutorType</tt> to <a shape="rect" href="mybatis.html"
>title="MyBatis">MyBatis</a> component.</li><li>Added support for easier
>configuration of using concurrent message listener consumer when doing
>request/reply over <a shape="rect" href="jms.html" title="JMS">JMS</a>, by
>leveraging the existing <tt>concurrentConsumers</tt> and
><tt>maxConcurrentConsumers</tt> options.</li><li>Improved the <a shape="rect"
>href="smpp.html" title="SMPP">SMPP</a> consumer to expose more data by
>receiving a <tt>DeliverSM</tt> message.</li><li>Camels <a shape="rect"
>href="using-propertyplaceholder.html" title="Using
>PropertyPlaceholder">property placeholders</a> can now be used in route id /
>node id's in the routes in XML and Java DSLs, eg <route
>id="<tt>coolName</tt>"></li><li>The thread name pattern can easily be
>configured on <camelContext> with the new threadNamePattern
>attribute</li><li>Camel now validates <a shape="rect" href="seda.html"
>title="SEDA">SEDA</a> and <a shape="rec
t" href="vm.html" title="VM">VM</a> endpoints using same queue name, that if
any queue size is in use, that size must match. As well Camel logs at INFO
level when starting up the queues and the sizes. This allows end users to
easily spot any issues if mistakenly using different queue sizes for the same
queue names.</li><li>Added <a shape="rect" href="camel-jmx.html" title="Camel
JMX">JMX</a> operations to <a shape="rect" href="log.html"
title="Log">throughput logger</a> so you can get stats and also reset the stats
at runtime.</li><li>Added ACL support on the <a shape="rect" href="aws-s3.html"
title="AWS-S3">AWS-S3</a> component.</li><li>Allow to configure <a shape="rect"
href="jetty.html" title="Jetty">Jetty</a> http client thread pool settings in
uri to make it easier to have different settings per endpoint.</li><li>Added
support for implied decimal formats to <a shape="rect" href="bindy.html"
title="Bindy">Bindy</a></li><li>Added option <tt>backlog</tt> to <a shape="rect"
href="netty.html" title="Netty">Netty</a> which can be used to allow more
concurrent clients to connect to a <a shape="rect" href="netty.html"
title="Netty">Netty</a> consumer.</li><li>Added support for parsing CSV if a
field has a ' (single quote) at it's beging</li><li>Added support for using
custom url rewrite plugins in <a shape="rect" href="http.html"
title="HTTP">HTTP</a>, <a shape="rect" href="http4.html"
title="HTTP4">HTTP4</a>, and <a shape="rect" href="jetty.html"
title="Jetty">Jetty</a> producers, which gives more control of url mappings,
such as when bridging/proxying http based routes. Provided <tt><a shape="rect"
href="urlrewrite.html" title="UrlRewrite">camel-urlrewrite</a></tt> as out of
the box implementation.</li><li>Improved the <a shape="rect"
href="springintegration.html" title="SpringIntegration">Spring-Integration</a>
consumer to also send back the message headers.</li><li>The Camel <a
shape="rect" href="guice.html" title="Guice">Guice</a> component h
as been upgraded to latest Guice 3.0, and no longer dependent on Guice
extension project <tt>guiceyfruit</tt>.</li><li>ReplyTo Temporary Queue now
refreshed when the underlying <a shape="rect" href="jms.html"
title="JMS">JMS</a> Connection fails.</li><li>When processing an <a
shape="rect" href="exchange.html" title="Exchange">Exchange</a> fails, the
failed route id is available for end users. See details at <a shape="rect"
href="dead-letter-channel.html" title="Dead Letter Channel">Dead Letter
Channel</a>.</li><li>When using <a shape="rect" href="xslt.html"
title="XSLT">XSLT</a> includes will use same file or classpath loading as
endpoint configuration, if not explicit configured.</li><li>Now <a shape="rect"
href="camel-transport-for-cxf.html" title="Camel Transport for CXF">Camel
Transport for CXF</a> supports to configure with blueprint.</li><li><a
shape="rect" href="sql-component.html" title="SQL Component">SQL Component</a>
now supports named parameters in the queries.</
li><li><a shape="rect" href="sql-component.html" title="SQL Component">SQL
Component</a> now supports <a shape="rect" href="batch-consumer.html"
title="Batch Consumer">Batch Consumer</a> to consume data; for example to
pickup new rows being inserted into a table. As well having queries being
execute after each row has been processed, such as deleting/marking the row as
processed.</li><li>JDBC based <a shape="rect" href="sql-component.html"
title="SQL Component">aggregation repository </a> now allows to store message
body and headers as text in individual columns. This makes the data human
readable, as by default the data is stored as binary.</li><li><a shape="rect"
href="file2.html" title="File2">File</a> consumer will on first poll run the
check to delete old orphaned lock files. As opposed to before where this
happened during startup of Camel itself; which could delay starting Camel if
the delete process takes a long time.</li><li><a shape="rect" href="file2.html"
title="F
ile2">File</a> and <a shape="rect" href="ftp2.html" title="FTP2">FTP</a> can
now use a custom idempotent key with the built-in idempotent consumer. For
example you can now use both the file name and size as key.</li><li><a
shape="rect" href="file2.html" title="File2">File</a> and <a shape="rect"
href="ftp2.html" title="FTP2">FTP</a> producers support the
<tt>CamelOverruleFileName</tt> header as a use once and discard header to
overrule and use as filename for writing; while preserving the original
filename in the <tt>CamelFileName</tt> header.</li><li>The <a shape="rect"
href="languages.html" title="Languages">Languages</a> and <a shape="rect"
href="language.html" title="Language">Language</a> component can now load the
script from external resource using <tt>"resource:scheme:location"</tt>
syntax.</li></ul>
+<ul><li>Added <a shape="rect" href="binding.html" title="Binding">Binding</a>
support, so it is easy to combine things like a <a shape="rect"
href="data-format.html" title="Data Format">Data Format</a> to an <a
shape="rect" href="endpoint.html" title="Endpoint">Endpoint</a> for easier
composition of routes.</li><li>Added support for SOAP 1.2 in <a shape="rect"
href="soap.html" title="SOAP">SOAP</a> data format.</li><li><a shape="rect"
href="cache.html" title="Cache">Cache</a> operation for add/update now supports
expiry headers to control time to live/idle/eternal.</li><li>Added
<tt>allowNullBody</tt> option to <a shape="rect" href="jms.html"
title="JMS">JMS</a> to configure whether sending messages with no body is
allowed.</li><li>Added <tt>connectOnStartup</tt> option to <a shape="rect"
href="hdfs.html" title="HDFS">HDFS</a> to allow to connect on demand, to avoid
having Hadoop block for long time connecting to the HDFS cluster, as it has a
hardcoded 15 minute retry mechan
ism.</li><li>Added support for daily and weekly trends to <a shape="rect"
href="twitter.html" title="Twitter">Twitter</a> component.</li><li>The <a
shape="rect" href="camel-maven-archetypes.html" title="Camel Maven
Archetypes">Camel Maven Archetypes</a> now generates projects without any
license headers.</li><li>Added <tt>rejectOld</tt> option to the <a shape="rect"
href="resequencer.html" title="Resequencer">Resequencer</a> to prevent out of
order messages from being delivered after capacity/timeout events
occur</li><li>Further optimized <a shape="rect" href="xpath.html"
title="XPath">XPath</a> under concurrent load, and as well ensured resources
are cleaned up eagerly</li><li>Added options <tt>allowNullBody</tt> and
<tt>readLockMinLength</tt> to the <a shape="rect" href="file2.html"
title="File2">File</a> and <a shape="rect" href="ftp2.html"
title="FTP2">FTP</a> components.</li><li>Made <tt>changed</tt> read lock
strategy on <a shape="rect" href="ftp2.html" title="FTP2">FT
P</a> go faster (eg when the FTP server has a lot of files in the directory)
if you enable the <tt>fastExistsCheck=true</tt> option as well. Notice that
some FTP server may not support this.</li><li><a shape="rect" href="hl7.html"
title="HL7">HL7</a> moves to HAPI 2.0 and supports using a dedicated Parser
instance in the <a shape="rect" href="hl7.html" title="HL7">HL7</a> MLLP codec
and DataFormat. Added "Terser" language and expression to be able to extract
fields from a parsed message. <a shape="rect" href="hl7.html"
title="HL7">HL7</a> now uses Apache Mina 2.x.</li><li>Add an option
<tt>HttpMethodRestrict</tt> to restrict HTTP method in <a shape="rect"
href="jetty.html" title="Jetty">Jetty</a> and <a shape="rect"
href="servlet.html" title="SERVLET">SERVLET</a></li><li>Add support for
selection of <a shape="rect" href="direct-vm.html"
title="Direct-VM">Direct-VM</a> consumers by using ant-like path
expression.</li><li>The <a shape="rect" href="pojo-producing.html" title="P
OJO Producing">POJO Producing</a>, and <a shape="rect"
href="pojo-consuming.html" title="POJO Consuming">POJO Consuming</a> with
@Consume, @Produce, @EndpointInject now supports a new {{property} attribute to
get the endpoint configuration from a bean property (eg using a getter method);
this allows you to configure this on the bean using conventional bean
configuration.</li><li>Testing with <tt>camel-test-blueprint</tt> on Windows no
longer tries to cleanup after testing taking up 5 seconds and logging
WARNs.</li><li>The <a shape="rect" href="file2.html" title="File2">File</a>,
and <a shape="rect" href="ftp2.html" title="FTP2">FTP</a> components now
support <tt>fileExist=Move</tt> option to move any existing files before
writing a file.</li><li>Added option <tt>loadStatisticsEnabled</tt> on <a
shape="rect" href="camel-jmx.html" title="Camel JMX">Camel JMX</a> to allow to
disable load statistics if not needed (avoids a background thread being in use,
to calculate the load st
ats).</li><li>Enabled "lazy connections" for <a shape="rect" href="xmpp.html"
title="XMPP">XMPP</a> providers via the <tt>testConnectionOnStartup</tt>
option</li><li>Added a connection monitor to detect and fix dropped <a
shape="rect" href="xmpp.html" title="XMPP">XMPP</a> consumer connections at
configurable <tt>connectionPollDelay</tt> intervals</li><li>Added an
<tt>org.apache.camel.builder.ExchangeBuilder</tt> to build the <a shape="rect"
href="exchange.html" title="Exchange">Exchange</a> using a builder
pattern.</li><li>The <a shape="rect" href="camel-run-maven-goal.html"
title="Camel Run Maven Goal">Camel Run Maven Goal</a> can now run <a
shape="rect" href="cdi.html" title="CDI">CDI</a> applications.</li><li>The
Camel <a shape="rect" href="cdi.html" title="CDI">CDI</a> component has
improved a lot.</li><li>Added option <tt>allowRedeliveryWhileStopping</tt> to
<a shape="rect" href="dead-letter-channel.html" title="Dead Letter
Channel">error handlers</a> to control if red
elivery is allowed during stopping/shutting down Camel or the route(s).
Turning this option <tt>false</tt> allows to stop quicker by rejecting
redelivery attempts.</li><li>Added support for specifying user info in Camel <a
shape="rect" href="endpoint.html" title="Endpoint">Endpoint</a> urls, which
contains the @ sign; now the @ sign can be given as is; without being encoded
to %40.</li><li>Added robust connection support for <a shape="rect"
href="jmx.html" title="JMX">JMX</a>. Optional <tt>testConnectionOnStartup</tt>
allows a JMX consumer to attach to a JMX server that becomes available
<em>after</em> the JMX endpoint starts; <tt>reconnectOnConnectionFailure</tt>
enables re-connection of failed JMX connections.</li><li><a shape="rect"
href="jaxb.html" title="JAXB">JAXB</a> and <a shape="rect" href="soap.html"
title="SOAP">SOAP</a> data format now supports controlling namespace prefix
mappings when marshalling (eg to avoid prefixes such as ns2, ns3, ns4
etc.)</li><li>Added s
upport for using raw uris when <a shape="rect" href="component.html"
title="Component">Component</a>s create <a shape="rect" href="endpoint.html"
title="Endpoint">Endpoint</a>s. This gives component writers full power in case
their component has special syntax/notation for endpoint uri
configurations.</li><li><a shape="rect" href="eip.html" title="EIP">EIP</a>s
configured with custom <tt>AggregationStrategy</tt> will now strict check the
custom strategy exists in the <a shape="rect" href="registry.html"
title="Registry">Registry</a> and no longer fallback and use a default strategy
if not.</li><li>Camel now logs on shutdown if any thread pools hasn't been
properly shutdown, and will shutdown them as fail safe (can only be done for
the thread pools Camel manages).</li><li>The buffer size of <a shape="rect"
href="stream-caching.html" title="Stream caching">Stream caching</a> is now
configurable.</li><li>Improved startup performance.</li><li>Added <a
shape="rect" href="jms.html
" title="JMS">JMS</a> URI option <tt>messageListenerContainerFactoryRef</tt>
which allows you to specify a <tt>MessageListenerContainerFactory</tt> to
determine what
<tt>org.springframework.jms.listener.AbstractMessageListenerContainer</tt> to
use to consume messages.</li><li><a shape="rect" href="mqtt.html"
title="MQTT">MQTT</a> producer now leverages the <a shape="rect"
href="asynchronous-routing-engine.html" title="Asynchronous Routing
Engine">Asynchronous Routing Engine</a></li><li>The <a shape="rect"
href="netty.html" title="Netty">Netty</a> producer scales up and down much
better by leveraging a channel pool.</li><li>Added new <a shape="rect"
href="camel-maven-archetypes.html" title="Camel Maven Archetypes">Camel Maven
Archetypes</a> for creating Camel and Groovy applications.</li><li>Camel now
injects <tt>CamelContext</tt> on <tt>Language</tt> and <tt>DataFormat</tt> that
implements <tt>CamelContextAware</tt></li><li>Thread pools in Camel with
<tt>maximumQueueSize</tt
> of 0 or negative will now not use a worker queue but do direct hand-over to
> thread instead.</li><li><a shape="rect" href="simple.html"
> title="Simple">Simple</a> unary operators for inc and dec must now have
> function on left hand side, to be parsed as unary function. Otherwise its
> now regarded as literal.</li><li>Custom assigned id's on Camel <a
> shape="rect" href="routes.html" title="Routes">Routes</a> is now validated
> on starting the routes, that they must be unique within the same
> CamelContext.</li><li>Added <tt>AbstractListAggregationStrategy</tt>
> abstract class to make it easier to <a shape="rect" href="aggregator2.html"
> title="Aggregator2">aggregate</a> into a List<V> using a custom
> <tt>AggregationStrategy</tt>.</li><li><a shape="rect" href="eip.html"
> title="EIP">EIP</a>s which support using <tt>AggregationStrategy</tt> now
> control the lifecycle of the strategy; allowing end users to do custom logic
> in the start/stop methods of their strategy implementation.</li>
<li>Added option <tt>includeSentJMSMessageID</tt> to <a shape="rect"
href="jms.html" title="JMS">JMS</a> to allow to enrich Camel Message with the
actual JMSMessageID for the sent message. Can be used by end users for logging
purpose etc.</li><li>Added option <tt>allowShortLines</tt> and
<tt>ignoreExtraColumns</tt> to <a shape="rect" href="flatpack-dataformat.html"
title="Flatpack DataFormat">Flatpack data format</a>.</li><li><a shape="rect"
href="mail.html" title="Mail">Mail</a> consumer now supports using search terms
to filter mails by terms such as subject, from, body, sent date
etc.</li><li>The cached script file in the <a shape="rect" href="language.html"
title="Language">Language</a> component can now be cleared via
JMX.</li><li>improved the karaf context-info command by adding a verbose mode
to view endpoints list (now hidden by default) and adding stats on the number
of active/inactive routes</li><li>Added support for <tt>UpdateList</tt>,
<tt>DeleteList</tt> and <tt
>ExecutorType</tt> to <a shape="rect" href="mybatis.html"
>title="MyBatis">MyBatis</a> component.</li><li>Added support for easier
>configuration of using concurrent message listener consumer when doing
>request/reply over <a shape="rect" href="jms.html" title="JMS">JMS</a>, by
>leveraging the existing <tt>concurrentConsumers</tt> and
><tt>maxConcurrentConsumers</tt> options.</li><li>Improved the <a shape="rect"
>href="smpp.html" title="SMPP">SMPP</a> consumer to expose more data by
>receiving a <tt>DeliverSM</tt> message.</li><li>Camels <a shape="rect"
>href="using-propertyplaceholder.html" title="Using
>PropertyPlaceholder">property placeholders</a> can now be used in route id /
>node id's in the routes in XML and Java DSLs, eg <route
>id="<tt>coolName</tt>"></li><li>The thread name pattern can easily be
>configured on <camelContext> with the new threadNamePattern
>attribute</li><li>Camel now validates <a shape="rect" href="seda.html"
>title="SEDA">SEDA</a> and <a shape="rec
t" href="vm.html" title="VM">VM</a> endpoints using same queue name, that if
any queue size is in use, that size must match. As well Camel logs at INFO
level when starting up the queues and the sizes. This allows end users to
easily spot any issues if mistakenly using different queue sizes for the same
queue names.</li><li>Added <a shape="rect" href="camel-jmx.html" title="Camel
JMX">JMX</a> operations to <a shape="rect" href="log.html"
title="Log">throughput logger</a> so you can get stats and also reset the stats
at runtime.</li><li>Added ACL support on the <a shape="rect" href="aws-s3.html"
title="AWS-S3">AWS-S3</a> component.</li><li>Allow to configure <a shape="rect"
href="jetty.html" title="Jetty">Jetty</a> http client thread pool settings in
uri to make it easier to have different settings per endpoint.</li><li>Added
support for implied decimal formats to <a shape="rect" href="bindy.html"
title="Bindy">Bindy</a></li><li>Added option <tt>backlog</tt> to <a shape="rect"
href="netty.html" title="Netty">Netty</a> which can be used to allow more
concurrent clients to connect to a <a shape="rect" href="netty.html"
title="Netty">Netty</a> consumer.</li><li>Added support for parsing CSV if a
field has a ' (single quote) at it's beging</li><li>Added support for using
custom url rewrite plugins in <a shape="rect" href="http.html"
title="HTTP">HTTP</a>, <a shape="rect" href="http4.html"
title="HTTP4">HTTP4</a>, and <a shape="rect" href="jetty.html"
title="Jetty">Jetty</a> producers, which gives more control of url mappings,
such as when bridging/proxying http based routes. Provided <tt><a shape="rect"
href="urlrewrite.html" title="UrlRewrite">camel-urlrewrite</a></tt> as out of
the box implementation.</li><li>Improved the <a shape="rect"
href="springintegration.html" title="SpringIntegration">Spring-Integration</a>
consumer to also send back the message headers.</li><li>The Camel <a
shape="rect" href="guice.html" title="Guice">Guice</a> component h
as been upgraded to latest Guice 3.0, and no longer dependent on Guice
extension project <tt>guiceyfruit</tt>.</li><li>ReplyTo Temporary Queue now
refreshed when the underlying <a shape="rect" href="jms.html"
title="JMS">JMS</a> Connection fails.</li><li>When processing an <a
shape="rect" href="exchange.html" title="Exchange">Exchange</a> fails, the
failed route id is available for end users. See details at <a shape="rect"
href="dead-letter-channel.html" title="Dead Letter Channel">Dead Letter
Channel</a>.</li><li>When using <a shape="rect" href="xslt.html"
title="XSLT">XSLT</a> includes will use same file or classpath loading as
endpoint configuration, if not explicit configured.</li><li>Now <a shape="rect"
href="camel-transport-for-cxf.html" title="Camel Transport for CXF">Camel
Transport for CXF</a> supports to configure with blueprint.</li><li><a
shape="rect" href="sql-component.html" title="SQL Component">SQL Component</a>
now supports named parameters in the queries.</
li><li><a shape="rect" href="sql-component.html" title="SQL Component">SQL
Component</a> now supports <a shape="rect" href="batch-consumer.html"
title="Batch Consumer">Batch Consumer</a> to consume data; for example to
pickup new rows being inserted into a table. As well having queries being
execute after each row has been processed, such as deleting/marking the row as
processed.</li><li>JDBC based <a shape="rect" href="sql-component.html"
title="SQL Component">aggregation repository </a> now allows to store message
body and headers as text in individual columns. This makes the data human
readable, as by default the data is stored as binary.</li><li><a shape="rect"
href="file2.html" title="File2">File</a> consumer will on first poll run the
check to delete old orphaned lock files. As opposed to before where this
happened during startup of Camel itself; which could delay starting Camel if
the delete process takes a long time.</li><li><a shape="rect" href="file2.html"
title="F
ile2">File</a> and <a shape="rect" href="ftp2.html" title="FTP2">FTP</a> can
now use a custom idempotent key with the built-in idempotent consumer. For
example you can now use both the file name and size as key.</li><li><a
shape="rect" href="file2.html" title="File2">File</a> and <a shape="rect"
href="ftp2.html" title="FTP2">FTP</a> producers support the
<tt>CamelOverruleFileName</tt> header as a use once and discard header to
overrule and use as filename for writing; while preserving the original
filename in the <tt>CamelFileName</tt> header.</li><li>The <a shape="rect"
href="languages.html" title="Languages">Languages</a> and <a shape="rect"
href="language.html" title="Language">Language</a> component can now load the
script from external resource using <tt>"resource:scheme:location"</tt>
syntax.</li><li><a shape="rect" href="hdfs.html" title="HDFS">HDFS</a> producer
without a split strategy will now close file stream after writing. You can use
the <tt>CamelHdfsClose</tt>
header to explicit to control if to close file stream or not.</li></ul>
<h3><a shape="rect" name="Camel2.11.0Release-Fixedissues"></a>Fixed issues</h3>
@@ -134,7 +134,8 @@
<h2><a shape="rect"
name="Camel2.11.0Release-Internal%2FNonAPIrefactoringsthatmayaffectusers"></a>Internal/Non
API refactorings that may affect users</h2>
-<ul><li>The <a shape="rect" href="testing.html" title="Testing">Camel Test
Kit</a> provides a default <a shape="rect" href="properties.html"
title="Properties">Properties</a> component out of the box; which mean using
<tt>addComponent("properties", ...)</tt> is no longer needed; instead get the
component using <tt>getComponent("properties")</tt> and configure the component
instead.</li><li>Minor adjustments to
<tt>org.apache.camel.builder.ErrorHandlerBuilder</tt>.</li><li><tt>LRUCache</tt>
will attempt to stop service on eviction of entry.</li><li>Removed
<tt>org.apache.camel.model.NodeFactory</tt> as its no longer
applicable.</li><li>Added <tt>getCamelContext()</tt> methods to
<tt>ProducerTemplate</tt>, and <tt>ConsumerTemplate</tt></li><li>The method
<tt>isMatched</tt> on <tt>GenericFileConsumer</tt> is now abstract and has an
extra parameter.</li><li>The <a shape="rect" href="testing.html"
title="Testing">Camel Test Kit</a> removed the support of JUnit3, please use
JUnit4
version instead.</li><li>The method <tt>prepareOnStartup</tt> on
<tt>org.apache.camel.component.file.GenericFileProcessStrategy</tt> is now
executed on first poll instead of starting the route; as if the job takes a
long time, it will block Camel from starting other routes. If the job takes
more than 1 second to run then its logged at INFO level so people can easier
spot if the task takes a longer time, than usual.</li></ul>
+<ul><li>The <a shape="rect" href="testing.html" title="Testing">Camel Test
Kit</a> provides a default <a shape="rect" href="properties.html"
title="Properties">Properties</a> component out of the box; which mean using
<tt>addComponent("properties", ...)</tt> is no longer needed; instead get the
component using <tt>getComponent("properties")</tt> and configure the component
instead.</li><li>Minor adjustments to
<tt>org.apache.camel.builder.ErrorHandlerBuilder</tt>.</li><li><tt>LRUCache</tt>
will attempt to stop service on eviction of entry.</li><li>Removed
<tt>org.apache.camel.model.NodeFactory</tt> as its no longer
applicable.</li><li>Added <tt>getCamelContext()</tt> methods to
<tt>ProducerTemplate</tt>, and <tt>ConsumerTemplate</tt></li><li>The method
<tt>isMatched</tt> on <tt>GenericFileConsumer</tt> is now abstract and has an
extra parameter.</li><li>The <a shape="rect" href="testing.html"
title="Testing">Camel Test Kit</a> removed the support of JUnit3, please use
JUnit4
version instead.</li><li>The method <tt>prepareOnStartup</tt> on
<tt>org.apache.camel.component.file.GenericFileProcessStrategy</tt> is now
executed on first poll instead of starting the route; as if the job takes a
long time, it will block Camel from starting other routes. If the job takes
more than 1 second to run then its logged at INFO level so people can easier
spot if the task takes a longer time, than usual.</li><li><a shape="rect"
href="hdfs.html" title="HDFS">HDFS</a> producer without a split strategy will
now close file stream after writing. You can use the <tt>CamelHdfsClose</tt>
header to explicit to control if to close file stream or not.</li></ul>
+
<h2><a shape="rect" name="Camel2.11.0Release-KnownIssues"></a>Known Issues</h2>
Modified: websites/production/camel/content/hdfs.html
==============================================================================
--- websites/production/camel/content/hdfs.html (original)
+++ websites/production/camel/content/hdfs.html Fri Feb 1 12:25:25 2013
@@ -136,6 +136,15 @@ hdfs:<span class="code-comment">//localh
</div></div>
<p>it means: a new file is created either when it has been idle for more than
1 second or if more than 5 bytes have been written. So, running <tt>hadoop fs
-ls /tmp/simple-file</tt> you'll find the following files seg0, seg1, seg2,
etc</p>
+
+<h3><a shape="rect" name="HDFS-Controllingtoclosefilestream"></a>Controlling
to close file stream</h3>
+<p><b>Available as of Camel 2.10.4</b></p>
+
+<p>When using the <a shape="rect" href="hdfs.html" title="HDFS">HDFS</a>
producer <b>without</b> a split strategy, then the file output stream is by
default closed after the write. However you may want to keep the stream open,
and only explicit close the stream later. For that you can use the header
<tt>HdfsConstants.HDFS_CLOSE</tt> (value = <tt>"CamelHdfsClose"</tt>) to
control this. Setting this value to a boolean allows you to explicit control
whether the stream should be closed or not.</p>
+
+<p>Notice this does not apply if you use a split strategy, as there is varios
strategy that control when the stream is closed.</p>
+
+
<h3><a shape="rect" name="HDFS-UsingthiscomponentinOSGi"></a>Using this
component in OSGi</h3>
<p>This component is fully functional in an OSGi environment however, it
requires some actions from the user. Hadoop uses the thread context class
loader in order to load resources. Usually, the thread context classloader will
be the bundle class loader of the bundle that contains the routes. So, the
default configuration files need to be visible from the bundle class loader. A
typical way to deal with it is to keep a copy of core-default.xml in your
bundle root. That file can be found in the hadoop-common.jar.</p></div>
</td>
