I didn't follow your second paragraph. The goal with the Chronicle code
should be to put the message back in memory after the Chronicle read as it
was before the Chronicle write, right? So if the message body (only) was
compressed (using the compression algorithm used for ActiveMQ mes
oke that decompression code and end up undoing the
> compression of the message. So you could use a flag that'll tell you to
> recompress it when you read it back out of Chronicle, but then you're doing
> wasteful decompress/compress operations. It would be better to access the
>
just normal
garbage...
> plus any additional reads needed to operate on the message such as
> > if a new subscriber with a non-matching selector connected to the broker)
> > instead of just once under the current algorithm.
>
>
> This is a traditional space / time tradeoff.
So if it’s 5% more
CPU time for 15x more memory, that’s a big $ savings.
It can still do something like 180M messages per second encode/decode.
Which is more than fine. If you’re doing THAT many messages on your broker
you probably have other performance issues.
We’re doing about 1000 transa
t;and
> >put into Chronicle, and once when it's pulled from Chronicle and sent
> >onward, plus any additional reads needed to operate on the message such as
> >if a new subscriber with a non-matching selector connected to the broker)
> >instead of just once under the cur
st once under the current algorithm. On the other hand, your
>GCs should all be from Young Gen (and cheap) whereas the current algorithm
>would likely push many of its messages to Old Gen. Old Gen GCs are more
>expensive under ParallelGC, though they're no worse under G1GC and CM
nd CMS. So
it's a trade-off under ParallelGC (maybe better, maybe worse) and a loss
under the other two.
One other thing: this would give compression at rest, but not in motion,
and it comes at the expense of two serialization/deserialization and
compression/decompression operations per broker
you can do something like 1M message deserializations
per second. Which is normally more than the throughput of the broker.
Additionally, chronicle supports zlib or snappy compression on the message
bodies. So, while the broker supports message compression now, it doesn’t
support this feature on
s
> down
> > very well because 1) we think the JMS properties aren't compressed, and
> 2)
> > they are relatively small messages without a lot of repetition in the
> text.
> >
> > We've tried using the Camel "aggregator" pattern to batch message bo
ey don't seem to compress down
> very well because 1) we think the JMS properties aren't compressed, and 2)
> they are relatively small messages without a lot of repetition in the text.
>
> We've tried using the Camel "aggregator" pattern to batch message bodies
use 1) we think the JMS properties aren't compressed, and 2)
they are relatively small messages without a lot of repetition in the text.
We've tried using the Camel "aggregator" pattern to batch message bodies
together before sending, which gives much better compression, but a
ers are in different data centers.
> >
> > Thanks in advance.
> >
> > -Jonathan
> >
> >
> > --
> > View this message in context:
> http://activemq.2283324.n4.nabble.com/AMQ-5-5-compression-on-network-of-brokers-tp4498914p4507874.html
> > Sent from the ActiveMQ - User mailing list archive at Nabble.com.
>
>
>
> --
> http://fusesource.com
> http://blog.garytully.com
>
open tcp connection to each other?
>
> I am just trying to understand what kind of performance to expect if the
> brokers are in different data centers.
>
> Thanks in advance.
>
> -Jonathan
>
>
> --
> View this message in context:
> http://activemq.2283324.
are in different data centers.
Thanks in advance.
-Jonathan
--
View this message in context:
http://activemq.2283324.n4.nabble.com/AMQ-5-5-compression-on-network-of-brokers-tp4498914p4507874.html
Sent from the ActiveMQ - User mailing list archive at Nabble.com.
| fusesource.com
skype: dejan.bosanac | twitter: @dejanb
blog: http://www.nighttale.net
ActiveMQ in Action: http://www.manning.com/snyder/
On Fri, Mar 23, 2012 at 2:59 PM, Marcin Giedz wrote:
>
> Hi all,
>
>
> Is it possible to have compression enabled on "network of b
Hi all,
Is it possible to have compression enabled on "network of brokers" definition?
but jms.useCompression is invalid option in this case
Thx
M.
me to try it out and report back on whether I
broke anything :)
Regards
>
> On 20 July 2010 10:58, Timothy Bish wrote:
>
> > On Tue, 2010-07-20 at 09:58 +0800, Romain CHANU wrote:
> > > Hi,
> > >
> > > I would like to know if it is possible to
Hey Tim,
I just saw that you created (and resolved!) the ticket.
Thank you :-)
Regards,
Romain
On 20 July 2010 10:58, Timothy Bish wrote:
> On Tue, 2010-07-20 at 09:58 +0800, Romain CHANU wrote:
> > Hi,
> >
> > I would like to know if it is possible to configure the c
On Tue, 2010-07-20 at 09:58 +0800, Romain CHANU wrote:
> Hi,
>
> I would like to know if it is possible to configure the compression ratio in
> ActiveMQ-CPP when using "useCompression" option?
>
> If not, would it be possible to consider this as an improvement for
Hi,
I would like to know if it is possible to configure the compression ratio in
ActiveMQ-CPP when using "useCompression" option?
If not, would it be possible to consider this as an improvement for the
client?
Thank you.
Regards,
Romain
On Mon, 2010-05-17 at 15:05 +0800, Romain CHANU wrote:
> Hi,
>
> I have seen on this page
> http://timbish.blogspot.com/2010/03/activemq-cpp-now-supports-message-body.html
> that
> AMQ-CPP supports message body compression.
>
> I would like to know:
>
> 1) When wo
Hi,
I have seen on this page
http://timbish.blogspot.com/2010/03/activemq-cpp-now-supports-message-body.html
that
AMQ-CPP supports message body compression.
I would like to know:
1) When would be the next release of AMQ-CPP (including this functionality)?
2) What is the compression rate? (some
AMQ 5.3.0, Tomcat 6.0.20
I have and embedded client and server broker running within a single Tomcat
instance for testing. With
message compression enabled we get the following error. Any ideas what we
can do to mitigate this, or at least debug it further?
2010-04-15 11:46:16,378 INFO
> > wrote:
>
> > > It also appears that there is an option to use message level
> compression.
> > > If
> > > > compression is available on the SSL transport stream, I expect we
> would
> > > want
> > > > to ensure that message co
nks are geographically distributed. These links will use the SSL
> > transport
> > > for reasons of security, but we also want to use compression to minimize
> > > bandwidth usage over the WAN links. I've searched the available
> > > documentation and so far ha
gt; > for reasons of security, but we also want to use compression to minimize
> > bandwidth usage over the WAN links. I've searched the available
> > documentation and so far haven't found a definitive source that tells
> > whether the SSL Transport uses rfc3749 co
On Mon, Apr 5, 2010 at 2:48 PM, Jim Lloyd wrote:
> I'm in the process of building a network of brokers in which some of the
> links are geographically distributed. These links will use the SSL transport
> for reasons of security, but we also want to use compression to minimize
>
I'm in the process of building a network of brokers in which some of the
links are geographically distributed. These links will use the SSL transport
for reasons of security, but we also want to use compression to minimize
bandwidth usage over the WAN links. I've searched the
Hello,
I am new activemq user and also interested with compression. Can you please
tell me how big message has to be to get compressed. Are you using gzip?
What activemq class does compression?
Thank you very much
Diego
rajdavies wrote:
>
> The producer does the compression - so i
ok, many thanks for that info.
i was thinking that the consumer would get messages compressed if he
connected with useCompression flag.
rajdavies wrote:
>
> The producer does the compression - so it does need to know that the
> useCompression flag is set
> On Sep 28, 2007
The producer does the compression - so it does need to know that the
useCompression flag is set
On Sep 28, 2007, at 4:20 PM, srasul wrote:
Hi there,
i was doing some testing with compression, and i have found that both
producer and consumer need to have compression enabled in the
Hi there,
i was doing some testing with compression, and i have found that both
producer and consumer need to have compression enabled in the connection url
for compression to work. is this normal behavior?
I did some testing by doing a network trace and found:
- for compression to work, i have
I am using AMQ 5.0 SNAPSHOT
I am testing compression with Text messages and have set
jms.useCompression=true in my producer's brokerURL.
tcp://localhost:61616?jms.useCompression=true
...and ((ActiveMQConnection)conn).isUseCompression() always returns 'true'
However, when
Just read https://issues.apache.org/activemq/browse/AMQ-1140 JIRA issue
about compression . Does this really mean that up to version 4.1.1
compression didn't work?
Kind regards
Juergen
Juergen Mayrbaeurl wrote:
>
> We're using compression (useCompression=true in serverURL)
ideas? Should we simply disable the use of compression?
Kind regards
Juergen
Juergen Mayrbaeurl wrote:
>
> We're using compression (useCompression=true in serverURL) on the producer
> side with durable topic subscribers. Unfortunately our consumer gets an
> 'java.uti
We're using compression (useCompression=true in serverURL) on the producer
side with durable topic subscribers. Unfortunately our consumer gets an
'java.util.zip.ZipException: unknown compression method' (happened the first
time after thousands of successful transported messages).
On 6/16/07, iqbalzaveri <[EMAIL PROTECTED]> wrote:
Hello,
I am trying to set compression for messages using XML config. Here's a
snapshot of the activemq.xml
http://activemq.org/config/1.0";>
.
..
...
factory = new ActiveMQConnectionFactory(ur
You are setting the compression in the client configuration not tha AMQ
server
iqbalzaveri wrote:
>
> Hello,
> I am trying to set compression for messages using XML config. Here's a
> snapshot of the activemq.xml
>
&
On 6/20/07, keneida <[EMAIL PROTECTED]> wrote:
what kind of compression is used when jms.useCommpresion is deifned to true.
gzip
--
James
---
http://macstrac.blogspot.com/
what kind of compression is used when jms.useCommpresion is deifned to true.
--
View this message in context:
http://www.nabble.com/message-compression-tf3952518s2354.html#a11213828
Sent from the ActiveMQ - User mailing list archive at Nabble.com.
Hello,
I am trying to set compression for messages using XML config. Here's a
snapshot of the activemq.xml
http://activemq.org/config/1.0";>
.
..
...
factory = new ActiveMQConnectionFactory(url);
boolean isUseCompression =
((ActiveMQConn
41 matches
Mail list logo
