nice one @jbertram https://github.com/apache/activemq-artemis/blob/master/artemis-cli/src/main/resources/schema/artemis-import-export.xsd
On Mon, Feb 6, 2017 at 4:37 PM, Justin Bertram <[email protected]> wrote: > Done - https://issues.apache.org/jira/browse/ARTEMIS-943. > > > Justin > > ----- Original Message ----- > From: "Christopher Shannon" <[email protected]> > To: [email protected] > Sent: Monday, February 6, 2017 2:33:17 PM > Subject: Re: [DISCUSS] ActiveMQ utility project name > > Yep, that is a good point. JAXB supports marshaling fragments by using the > stax XMLStreamWriter as a writer so the entire document doesn't get written > to memory at once. (The reverse is also true for reading a document as > XMLStreamReader can be used.) So we should be ok in terms of not writing > the whole thing in memory. > > On Mon, Feb 6, 2017 at 3:10 PM, Clebert Suconic <[email protected]> > wrote: > >> @CShannon: whatever you use, make sure it streams instead of caching / >> putting stuff in memory. >> >> I had been bitten by things like that before and I have been >> preferring using direct streaming because of that. (it was simpler at >> the time). >> >> Not saying you should use System.out.println like I did ;) (well >> something smiilar :) ) >> >> ... just be careful to not hold the whole thing in memory before >> sending down the stream, otherwise you won't be able to export large >> journals. >> >> On Mon, Feb 6, 2017 at 2:25 PM, Christopher Shannon >> <[email protected]> wrote: >> > Cool, thanks. I created a new Jira to create the JAXB classes from the >> > schema once that is done. >> > >> > On Mon, Feb 6, 2017 at 11:33 AM, Justin Bertram <[email protected]> >> wrote: >> > >> >> I'm actually working on a schema now as the existing importer/exporter >> >> needs updates to deal with the new addressing scheme. I'll let you know >> >> when I'm done. >> >> >> >> >> >> Justin >> >> >> >> ----- Original Message ----- >> >> From: "Clebert Suconic" <[email protected]> >> >> To: [email protected] >> >> Sent: Monday, February 6, 2017 10:27:08 AM >> >> Subject: Re: [DISCUSS] ActiveMQ utility project name >> >> >> >> I don't think so. Although we could add it. >> >> >> >> >> >> On Mon, Feb 6, 2017 at 11:03 AM Christopher Shannon < >> >> [email protected]> wrote: >> >> >> >> > Is there a schema for the Artemis import format? I was thinking it >> would >> >> > be nice to generate some JAXB classes from a schema that we could use >> >> when >> >> > exporting from KahaDB to XML. >> >> > >> >> > On Fri, Feb 3, 2017 at 5:08 PM, Timothy Bish <[email protected]> >> >> wrote: >> >> > >> >> > > On 02/03/2017 07:09 AM, Christopher Shannon wrote: >> >> > > >> >> > >> A Jira project has been created. >> >> > >> https://issues.apache.org/jira/browse/AMQCLI/ The permissions >> should >> >> > >> hopefully be set up correctly for PMC members and committers. >> >> > >> >> >> > >> I won't get a chance today but early next week I can start setting >> up >> >> > the >> >> > >> project skeleton (pom file, etc) so we can start working on moving >> >> stuff >> >> > >> into it. If someone else wants to work on that earlier, feel free. >> >> > >> >> >> > > >> >> > > I created some initial project bits to get things started. Looks >> like >> >> we >> >> > > still need to get the gitsvn2jira feature turned on. >> >> > > >> >> > > >> >> > > On Thu, Feb 2, 2017 at 11:59 AM, Jean-Baptiste Onofré < >> [email protected] >> >> > >> >> > >> wrote: >> >> > >> >> >> > >> Yes, it just takes some time for the first sync. >> >> > >>> >> >> > >>> Regards >> >> > >>> JB >> >> > >>> >> >> > >>> On Feb 2, 2017, 17:58, at 17:58, Christopher Shannon < >> >> > >>> [email protected]> wrote: >> >> > >>> >> >> > >>>> I believe the mirror should happen automatically within 24 hours. >> >> > >>>> >> >> > >>>> On Thu, Feb 2, 2017 at 10:57 AM, Andy Taylor < >> >> [email protected]> >> >> > >>>> wrote: >> >> > >>>> >> >> > >>>> can we get it mirrored in Github? >> >> > >>>>> >> >> > >>>>> On 2 February 2017 at 15:34, Christopher Shannon < >> >> > >>>>> [email protected]> wrote: >> >> > >>>>> >> >> > >>>>> The repository is created. >> >> > >>>>>> https://git-wip-us.apache.org/repos/asf?p=activemq-cli- >> >> > >>>>>> >> >> > >>>>> tools.git;a=summary >> >> > >>>>> >> >> > >>>>>> I guess the next step is to get a Jira project added for it. I >> >> can >> >> > >>>>>> >> >> > >>>>> put a >> >> > >>>> >> >> > >>>>> ticket in for that. >> >> > >>>>>> >> >> > >>>>>> On Thu, Feb 2, 2017 at 10:11 AM, Clebert Suconic < >> >> > >>>>>> [email protected]> >> >> > >>>>>> wrote: >> >> > >>>>>> >> >> > >>>>>> Artemis broker would be >> >> > >>>>>>>> slow with large XML. >> >> > >>>>>>>> >> >> > >>>>>>> The stream reader is not parsing the whole file..it is >> streaming >> >> > >>>>>>> >> >> > >>>>>> the >> >> > >>>> >> >> > >>>>> XML instead of loading the whole thing. >> >> > >>>>>>> It will be the same as if it was reading a lot of data from >> any >> >> > >>>>>>> >> >> > >>>>>> other >> >> > >>>> >> >> > >>>>> storage, the large XML won't make much a difference AFAIK. >> >> > >>>>>>> >> >> > >>>>>>> Gzip certainly works. I wasn't thinking of doing anything >> >> > >>>>>>>> >> >> > >>>>>>> crazy with >> >> > >>>> >> >> > >>>>> compression. What I was thinking of was just doing something >> >> > >>>>>>>> >> >> > >>>>>>> simple >> >> > >>>> >> >> > >>>>> like >> >> > >>>>>> >> >> > >>>>>>> have an optional flag the user could set for the command that >> >> > >>>>>>>> >> >> > >>>>>>> would >> >> > >>>> >> >> > >>>>> just >> >> > >>>>>> >> >> > >>>>>>> end up creating a GZIPOutputStream and write the XML directly >> >> > >>>>>>>> >> >> > >>>>>>> to a >> >> > >>>> >> >> > >>>>> gzip >> >> > >>>>> >> >> > >>>>>> file which would save time (and disk space) from having to >> >> > >>>>>>>> >> >> > >>>>>>> create the >> >> > >>>> >> >> > >>>>> XML >> >> > >>>>>> >> >> > >>>>>>> first and then compress it after the fact. >> >> > >>>>>>>> >> >> > >>>>>>> >> >> > >>>>>>> Yep, I thought the same.. it can definitely be done. >> >> > >>>>>>> >> >> > >>>>>>> >> >> > > >> >> > > -- >> >> > > Tim Bish >> >> > > twitter: @tabish121 >> >> > > blog: http://timbish.blogspot.com/ >> >> > > >> >> > > >> >> > >> >> -- >> >> Clebert Suconic >> >> >> >> >> >> -- >> Clebert Suconic >> -- Clebert Suconic
