Re: Artemis - Large Message - Core => AMQP

Another possibility would be Stomp... although I have not seen anyone using large messages with stomp... they will for sure read into memory before sent to the clients. On Tue, Jul 26, 2022 at 1:38 PM Clebert Suconic wrote: > > Either that of have your Java producer to switch to AMQP. > > And

Re: Artemis - Large Message - Core => AMQP

Either that of have your Java producer to switch to AMQP. And that is true that the whole message will be read into memory before it's converted. On Tue, Jul 26, 2022 at 12:46 AM Jan Šmucr wrote: > > Hello. I'm sorry for the late reply but somehow the message got caught by my > spam filter. >

Re: Artemis - Large Message - Core => AMQP

Hello. I'm sorry for the late reply but somehow the message got caught by my spam filter. I believe we'd like to keep the broker from becoming overwhelmed by loading the entire message to memory just for conversion purposes, so if we can avoid it by sticking with the core protocol, I think it's

RE: Artemis - Large Message - Core => AMQP

Yes, pretty much. Jan From: Robbie Gemmell<mailto:robbie.gemm...@gmail.com> Sent: pondělí 25. července 2022 14:04 To: users@activemq.apache.org<mailto:users@activemq.apache.org> Subject: Re: Artemis - Large Message - Core => AMQP By "in Java" I assume you more specific

Re: Artemis - Large Message - Core => AMQP

reate the Lambda in Java. Thank you!  > > Jan > > From: Robbie Gemmell<mailto:robbie.gemm...@gmail.com> > Sent: pondělí 25. července 2022 12:05 > To: users@activemq.apache.org<mailto:users@activemq.apache.org> > Subject: Re: Artemis - Large Message - Core => AMQP >

RE: Artemis - Large Message - Core => AMQP

want to stream the payloads due to the fact that these can take up to > hundreds of megabytes. > > Thank you. > Jan > > From: Clebert Suconic<mailto:clebert.suco...@gmail.com> > Sent: sobota 23. července 2022 20:50 > To: users@activemq.apache.org<mailto:users@activemq.apac

Re: Artemis - Large Message - Core => AMQP

an take up to > hundreds of megabytes. > > Thank you. > Jan > > From: Clebert Suconic<mailto:clebert.suco...@gmail.com> > Sent: sobota 23. července 2022 20:50 > To: users@activemq.apache.org<mailto:users@activemq.apache.org> > Subject: Re: Artemis - Larg

Re: Artemis - Large Message - Core => AMQP

The snagging described seems to be in the Core sending+conversion legs of things, so the receiving AMQP client wouldnt seem likely to make much difference currently. Once its converted any AMQP 1.0 client should be able to receive it really. On Fri, 22 Jul 2022 at 20:01, Clebert Suconic wrote: >

Re: Artemis - Large Message - Core => AMQP

The mailing lists strip basically all attachments so noone saw what you sent. You could attach it to the JIRA where the original was. On Fri, 22 Jul 2022 at 11:22, Andy Yar wrote: > > Hello, > Using the LargeServerMessageImpl was just an attempt providing a seemingly > easy way to introduce a

RE: Artemis - Large Message - Core => AMQP

Jan From: Clebert Suconic<mailto:clebert.suco...@gmail.com> Sent: sobota 23. července 2022 20:50 To: users@activemq.apache.org<mailto:users@activemq.apache.org> Subject: Re: Artemis - Large Message - Core => AMQP We could look at enhancing the converters. But the best would b

Re: Artemis - Large Message - Core => AMQP

If you want help with your core producer to generate a compatible message it’s a different thing. So far the issue was reported as a bug. I can certainly help next week. (From Monday ) I will make sure I connect on slack on Monday perhaps we could talk there. On Sat, Jul 23, 2022 at 2:49 PM

Re: Artemis - Large Message - Core => AMQP

We could look at enhancing the converters. But the best would be to change your producer to have the exact format the converter would have. On Sat, Jul 23, 2022 at 2:41 PM Clebert Suconic wrote: > Change your message in a way is compatible ? > > On Fri, Jul 22, 2022 at 3:36 PM Jan Šmucr >

Re: Artemis - Large Message - Core => AMQP

Change your message in a way is compatible ? On Fri, Jul 22, 2022 at 3:36 PM Jan Šmucr wrote: > The reason for this is that there's a whole infrastructure built using the > core protocol, and now we need to connect a Python-based Lambda capable of > receiving large messages. Is there any other,

Re: Artemis - Large Message - Core => AMQP

The reason for this is that there's a whole infrastructure built using the core protocol, and now we need to connect a Python-based Lambda capable of receiving large messages. Is there any other, core-compatible method? Jan Dne 22. 7. 2022 21:21 napsal uživatel Clebert Suconic : If you expect

Re: Artemis - Large Message - Core => AMQP

If you expect conversions to happen, you have to send messages from qpid-ms or core-jms client. On the case: ActiveMQConnectionFactory factory = new ActiveMQConnectionFactory(); Connection conn = factory.createConnection(...); Session session = conn.createSession(...) Producer producer =

Re: Artemis - Large Message - Core => AMQP

If you’re not using qpid JMS it will not work. On Fri, Jul 22, 2022 at 8:06 AM Andy Yar wrote: > There is another attempt employing AMQP test structures. It produces the > same incorrect message body. > > On Fri, Jul 22, 2022 at 12:21 PM Andy Yar wrote: > >> Hello, >> Using the

Re: Artemis - Large Message - Core => AMQP

There is another attempt employing AMQP test structures. It produces the same incorrect message body. On Fri, Jul 22, 2022 at 12:21 PM Andy Yar wrote: > Hello, > Using the LargeServerMessageImpl was just an attempt providing a seemingly > easy way to introduce a kind of Large Message into the

Re: Artemis - Large Message - Core => AMQP

Hello, Using the LargeServerMessageImpl was just an attempt providing a seemingly easy way to introduce a kind of Large Message into the test. I'm not familiar with the code base at all - so I simply tried to somehow provide the requested test replicating my "sending via Core -> receiving via

Re: Artemis - Large Message - Core => AMQP

AMQP to Core and Core to AMQP conversions expect you using JMS clients to generate your message. There are certain caveats that both clients will add to the messages. Usually I have seen more users doing weird conversions in AMQP when they use a C++ or non Java Client.. but on your case you used

Re: Artemis - Large Message - Core => AMQP

Are you using the LargeServerMessageImpl on your client, or that was just a "hack" to reproduce your issue. LargeServerMessageImpl was not meant to be used on the client. But if you're doing that just to show something you faced in production it's ok.. but using the LargeServerMessageImpl to

Re: Artemis - Large Message - Core => AMQP

Hello, Yes, the 2.23.1 test instance was freshly created. I've attached a test as a part of ARTEMIS-3897 . I hope it helps. On Sat, Jul 16, 2022 at 5:21 PM Clebert Suconic wrote: > Did you start with fresh data on 2.23.1. > > If you did

Re: Artemis - Large Message - Core => AMQP

Did you start with fresh data on 2.23.1. If you did please provide a self enclosing test reproducing your issue. On Fri, Jul 15, 2022 at 4:29 AM Andy Yar wrote: > A quick test using 2.23.1 results in the same error payload being received: > > "Message(address='test', durable=True, priority=4,

Re: Artemis - Large Message - Core => AMQP

A quick test using 2.23.1 results in the same error payload being received: "Message(address='test', durable=True, priority=4, annotations=AnnotationDict({symbol('x-opt-jms-dest'): byte(0), symbol('x-opt-jms-msg-type'): byte(0)}), properties={'JMSXDeliveryCount': None, '_AMQ_LARGE_SIZE': 67},

Re: Artemis - Large Message - Core => AMQP

There's been a few fixes in AMQP Large message. More prominently a fix with the JDBC implementation between 2.17 and HEAD. I would definitely recommend you to upgrade. On Thu, Jul 14, 2022 at 10:26 AM Justin Bertram wrote: > > I would expect this to work. Can you try this on the latest

Re: Artemis - Large Message Core => AMQP

It appears you sent the same message twice. I replied to your previous copy. Let me know if you don't receive it. Justin On Thu, Jul 14, 2022 at 9:23 AM Andy Yar wrote: > Hello, > Sending a message as a Large Message via Core protocol and receiving > it via AMQP on Artemis 2.17.0 ends with

Re: Artemis - Large Message - Core => AMQP

I would expect this to work. Can you try this on the latest release (i.e. 2.23.1) [1]? If it still doesn't work please open a Jira with all the details necessary to reproduce the problem. An actual test-case would be ideal. Thanks! Justin [1]

Artemis - Large Message Core => AMQP

Hello, Sending a message as a Large Message via Core protocol and receiving it via AMQP on Artemis 2.17.0 ends with receiving the following string as message body: "Conversion to AMQP error: Error reading in simpleString, length=y is greater than readableBytes=x" Broker lists the message as

Artemis - Large Message - Core => AMQP

Hello, Sending a message as a Large Message via Core protocol and receiving it via AMQP on Artemis 2.17.0 ends with receiving the following string as message body: "Conversion to AMQP error: Error reading in simpleString, length=y is greater than readableBytes=x" Broker lists the message as