Re: [xwiki-users] integrating data from JSPWiki/DokuWiki/mediawiki

2015-03-23 Thread Thomas Mortagne
On Mon, Mar 23, 2015 at 11:02 AM, Nicolas Delsaux
nicolas.dels...@gmx.fr wrote:


 Le 19/03/2015 16:10, vinc...@massol.net a écrit :

 Nice choice! :)

 Yeah, for now, as I'm only evaluating it, I'm rather happy.

 Yes, this is an old script written a long time ago (not by me, I just made
 it available on that page ;)), before XWiki Rendering (see
 http://rendering.xwiki.org) existed. I have no idea how well it works.

 My concern about this script is that its status regarding full wiki import
 is ... undetermined.


 So to summarize, we’re lacking some nice migrators to migrate from all
 those wikis to XWiki. We only have scripts maintained by the community.

 Now we’ve put in place all the infrastructure for such a migrator. We call
 it the Filters Application (a bad name IMO but it does more than just
 migrate content from wiki to wikis, it accepts any input and any output).
 See http://extensions.xwiki.org/xwiki/bin/view/Extension/Filter+Application

 Right now this Filters app supports only a few input/outputs:

 http://extensions.xwiki.org/xwiki/bin/view/Extension/Filter+Module#HExistingmodules

 Since there’s a confluence input module, it means you can give this Filter
 app a confluence zip as input and as output you can put an XWiki instance
 and it’ll import the content.


 So, from what I understand, my best  solution would be to write extensions
 to the filter module supporting JSPWiki and Dokuwiki. I could/should rely
 upon the Rendering framework which seems to understand both syntaxes with
 ease.

 Am I right ? And if so, what would be, to your mind, the estimated duration
 of such a development ?

This is the best long term solution yes and you benefit from all the
work done for other importer for all the bulletproofing in instance
output filter.

You can look at the module in
https://github.com/xwiki/xwiki-platform/tree/master/xwiki-platform-core/xwiki-platform-filter/xwiki-platform-filter-streams/
for inspiration.

For the estimated duration I don't really know since most of the time
depend on the format you are going to read and find a suitable
replacement in the existing generic events. I spend 90% of my time
just trying to understand the format when I did the Confluence module
and there is still possible improvements but I'm sure you can't have a
format that horrible in dokuwiki and jspwiki. Dokuwiki should not be
too hard unless there is a lot of new features to find equivalent to
compared to the last time I used it. I don't know JSPWiki except by
name so not much idea here.

A note on the existing syntaxes parsers in the rendering for dokuwiki
and jspwiki: there is a few tests but those are not the most tested
modules so you might find some differences compared to the standard
behavior in the last version of dokuwiki and jspwiki.

 Thanks anyway for the answer.

 --
 Nicolas Delsaux
 ___
 users mailing list
 users@xwiki.org
 http://lists.xwiki.org/mailman/listinfo/users



-- 
Thomas Mortagne
___
users mailing list
users@xwiki.org
http://lists.xwiki.org/mailman/listinfo/users


Re: [xwiki-users] integrating data from JSPWiki/DokuWiki/mediawiki

2015-03-23 Thread Thomas Mortagne
Actually I did not looked if there was a parser for dokuwiki and
jspwiki but I guess you can reuse a parser done for one of the
existing extensions.

On Mon, Mar 23, 2015 at 3:07 PM, Thomas Mortagne
thomas.morta...@xwiki.com wrote:
 On Mon, Mar 23, 2015 at 11:02 AM, Nicolas Delsaux
 nicolas.dels...@gmx.fr wrote:


 Le 19/03/2015 16:10, vinc...@massol.net a écrit :

 Nice choice! :)

 Yeah, for now, as I'm only evaluating it, I'm rather happy.

 Yes, this is an old script written a long time ago (not by me, I just made
 it available on that page ;)), before XWiki Rendering (see
 http://rendering.xwiki.org) existed. I have no idea how well it works.

 My concern about this script is that its status regarding full wiki import
 is ... undetermined.


 So to summarize, we’re lacking some nice migrators to migrate from all
 those wikis to XWiki. We only have scripts maintained by the community.

 Now we’ve put in place all the infrastructure for such a migrator. We call
 it the Filters Application (a bad name IMO but it does more than just
 migrate content from wiki to wikis, it accepts any input and any output).
 See http://extensions.xwiki.org/xwiki/bin/view/Extension/Filter+Application

 Right now this Filters app supports only a few input/outputs:

 http://extensions.xwiki.org/xwiki/bin/view/Extension/Filter+Module#HExistingmodules

 Since there’s a confluence input module, it means you can give this Filter
 app a confluence zip as input and as output you can put an XWiki instance
 and it’ll import the content.


 So, from what I understand, my best  solution would be to write extensions
 to the filter module supporting JSPWiki and Dokuwiki. I could/should rely
 upon the Rendering framework which seems to understand both syntaxes with
 ease.

 Am I right ? And if so, what would be, to your mind, the estimated duration
 of such a development ?

 This is the best long term solution yes and you benefit from all the
 work done for other importer for all the bulletproofing in instance
 output filter.

 You can look at the module in
 https://github.com/xwiki/xwiki-platform/tree/master/xwiki-platform-core/xwiki-platform-filter/xwiki-platform-filter-streams/
 for inspiration.

 For the estimated duration I don't really know since most of the time
 depend on the format you are going to read and find a suitable
 replacement in the existing generic events. I spend 90% of my time
 just trying to understand the format when I did the Confluence module
 and there is still possible improvements but I'm sure you can't have a
 format that horrible in dokuwiki and jspwiki. Dokuwiki should not be
 too hard unless there is a lot of new features to find equivalent to
 compared to the last time I used it. I don't know JSPWiki except by
 name so not much idea here.

 A note on the existing syntaxes parsers in the rendering for dokuwiki
 and jspwiki: there is a few tests but those are not the most tested
 modules so you might find some differences compared to the standard
 behavior in the last version of dokuwiki and jspwiki.

 Thanks anyway for the answer.

 --
 Nicolas Delsaux
 ___
 users mailing list
 users@xwiki.org
 http://lists.xwiki.org/mailman/listinfo/users



 --
 Thomas Mortagne



-- 
Thomas Mortagne
___
users mailing list
users@xwiki.org
http://lists.xwiki.org/mailman/listinfo/users


Re: [xwiki-users] integrating data from JSPWiki/DokuWiki/mediawiki

2015-03-23 Thread vinc...@massol.net
 




On 23 Mar 2015 at 15:07:41, Thomas Mortagne 
(thomas.morta...@xwiki.com(mailto:thomas.morta...@xwiki.com)) wrote:

 On Mon, Mar 23, 2015 at 11:02 AM, Nicolas Delsaux
 wrote:
 
 
  Le 19/03/2015 16:10, vinc...@massol.net a écrit :
 
  Nice choice! :)
 
  Yeah, for now, as I'm only evaluating it, I'm rather happy.
 
  Yes, this is an old script written a long time ago (not by me, I just made
  it available on that page ;)), before XWiki Rendering (see
  http://rendering.xwiki.org) existed. I have no idea how well it works.
 
  My concern about this script is that its status regarding full wiki import
  is ... undetermined.
 
 
  So to summarize, we’re lacking some nice migrators to migrate from all
  those wikis to XWiki. We only have scripts maintained by the community.
 
  Now we’ve put in place all the infrastructure for such a migrator. We call
  it the Filters Application (a bad name IMO but it does more than just
  migrate content from wiki to wikis, it accepts any input and any output).
  See http://extensions.xwiki.org/xwiki/bin/view/Extension/Filter+Application
 
  Right now this Filters app supports only a few input/outputs:
 
  http://extensions.xwiki.org/xwiki/bin/view/Extension/Filter+Module#HExistingmodules
 
  Since there’s a confluence input module, it means you can give this Filter
  app a confluence zip as input and as output you can put an XWiki instance
  and it’ll import the content.
 
 
  So, from what I understand, my best solution would be to write extensions
  to the filter module supporting JSPWiki and Dokuwiki. I could/should rely
  upon the Rendering framework which seems to understand both syntaxes with
  ease.
 
  Am I right ? And if so, what would be, to your mind, the estimated duration
  of such a development ?
  
 This is the best long term solution yes and you benefit from all the
 work done for other importer for all the bulletproofing in instance
 output filter.
  
 You can look at the module in
 https://github.com/xwiki/xwiki-platform/tree/master/xwiki-platform-core/xwiki-platform-filter/xwiki-platform-filter-streams/
 for inspiration.
  
 For the estimated duration I don't really know since most of the time
 depend on the format you are going to read and find a suitable
 replacement in the existing generic events. I spend 90% of my time
 just trying to understand the format when I did the Confluence module
 and there is still possible improvements but I'm sure you can't have a
 format that horrible in dokuwiki and jspwiki. Dokuwiki should not be
 too hard unless there is a lot of new features to find equivalent to
 compared to the last time I used it. I don't know JSPWiki except by
 name so not much idea here.
  
 A note on the existing syntaxes parsers in the rendering for dokuwiki
 and jspwiki: there is a few tests but those are not the most tested
 modules so you might find some differences compared to the standard
 behavior in the last version of dokuwiki and jspwiki.

Actually we don’t have any parser for the dokuwiki syntax in XWiki Rendering so 
the work to support Dokuwiki is not small (first someone needs to add support 
for it syntax in XWiki Rendering and then only we can implement a wiki importer 
for it).

For JSPWiki and MediaWiki it’s less work.

Thanks
-Vincent

  Thanks anyway for the answer.
 
  --
  Nicolas Delsaux

___
users mailing list
users@xwiki.org
http://lists.xwiki.org/mailman/listinfo/users


Re: [xwiki-users] integrating data from JSPWiki/DokuWiki/mediawiki

2015-03-23 Thread Nicolas Delsaux



Le 19/03/2015 16:10, vinc...@massol.net a écrit :

Nice choice! :)

Yeah, for now, as I'm only evaluating it, I'm rather happy.
Yes, this is an old script written a long time ago (not by me, I just 
made it available on that page ;)), before XWiki Rendering (see 
http://rendering.xwiki.org) existed. I have no idea how well it works.
My concern about this script is that its status regarding full wiki 
import is ... undetermined.


So to summarize, we’re lacking some nice migrators to migrate from all 
those wikis to XWiki. We only have scripts maintained by the community.


Now we’ve put in place all the infrastructure for such a migrator. We 
call it the Filters Application (a bad name IMO but it does more than 
just migrate content from wiki to wikis, it accepts any input and any 
output). See 
http://extensions.xwiki.org/xwiki/bin/view/Extension/Filter+Application


Right now this Filters app supports only a few input/outputs:
http://extensions.xwiki.org/xwiki/bin/view/Extension/Filter+Module#HExistingmodules

Since there’s a confluence input module, it means you can give this 
Filter app a confluence zip as input and as output you can put an 
XWiki instance and it’ll import the content.


So, from what I understand, my best  solution would be to write 
extensions to the filter module supporting JSPWiki and Dokuwiki. I 
could/should rely upon the Rendering framework which seems to understand 
both syntaxes with ease.


Am I right ? And if so, what would be, to your mind, the estimated 
duration of such a development ?

Thanks anyway for the answer.

--
Nicolas Delsaux
___
users mailing list
users@xwiki.org
http://lists.xwiki.org/mailman/listinfo/users


Re: [xwiki-users] integrating data from JSPWiki/DokuWiki/mediawiki

2015-03-19 Thread Thomas Mortagne
On Thu, Mar 19, 2015 at 3:37 PM, Nicolas Delsaux nicolas.dels...@gmx.fr wrote:
 Hi,
 I'm in organization where we have 3 unsynchronized wikis, implemented using
 the software named in subject (ie JSPWiki/DokuWiki/mediawiki).
 I would like to merge their content in one unique wiki, obviously
 implemented using XWiki (due to the excellent interview Vincent Massol and
 Ludovic Dubost gave to the castcodeurs podcast).
 I have seen there are extensions to have content of those legacy wiki
 imported into XWiki.
 However, i'm not sure I understand how they work.

 1 - JSPWiki to XWiki

 There seems to be an old (?) extension at
 http://extensions.xwiki.org/xwiki/bin/view/Extension/JSPWiki+To+XWiki+Conversion,
 documented by Vincent Massol. From  what I understand, the Java code in this
 extension has to be compiled independently, and run as a stand-alone program
 on the machine hosting the JSPWiki server. It will generate a XAR that can
 be injected into XWiki. Am I right ? If so, it is hardly an extension of
 XWiki, but rather a companion program (but I'm nitpicking). However, as a
 stand-alone program, isn't it available as an executable JAR somewhere ?

 2 - Dokuwiki to XWiki

 This time, it's a valid XWiki extension :
 http://extensions.xwiki.org/xwiki/bin/view/Extension/Import+DokuWiki+into+XWiki+Application
 which is easily installable using Extension manager (cool !). However, I
 wonder how it will work with XWiki 6.4.2 ...

 3 - mediawiki to XWiki

 This time ... it seems like there is no extension. or is it ?

Looks like there is
http://extensions.xwiki.org/xwiki/bin/view/Extension/Mediawiki+To+XWiki+Migration+Toolkit.
Last time I had to do that (a long time ago) I used
https://github.com/xwiki-contrib/sandbox/tree/master/xwiki-wikiimporter.


 bonus - xwiki-OLD to xwiki

 We also have some content in an old (5.0.1) version of XWiki. How do I
 migrate ?

 Conclusion - cheers

 I must confess I had never tried before XWiki, and my first impression is
 that it's a robust and perfectly usable wiki solution. The XWiki team did a
 really impressive work.

 --
 Nicolas Delsaux
 ___
 users mailing list
 users@xwiki.org
 http://lists.xwiki.org/mailman/listinfo/users



-- 
Thomas Mortagne
___
users mailing list
users@xwiki.org
http://lists.xwiki.org/mailman/listinfo/users


[xwiki-users] integrating data from JSPWiki/DokuWiki/mediawiki

2015-03-19 Thread Nicolas Delsaux

Hi,
I'm in organization where we have 3 unsynchronized wikis, implemented 
using the software named in subject (ie JSPWiki/DokuWiki/mediawiki).
I would like to merge their content in one unique wiki, obviously 
implemented using XWiki (due to the excellent interview Vincent Massol 
and Ludovic Dubost gave to the castcodeurs podcast).
I have seen there are extensions to have content of those legacy wiki 
imported into XWiki.

However, i'm not sure I understand how they work.

1 - JSPWiki to XWiki

There seems to be an old (?) extension at 
http://extensions.xwiki.org/xwiki/bin/view/Extension/JSPWiki+To+XWiki+Conversion, 
documented by Vincent Massol. From  what I understand, the Java code in 
this extension has to be compiled independently, and run as a 
stand-alone program on the machine hosting the JSPWiki server. It will 
generate a XAR that can be injected into XWiki. Am I right ? If so, it 
is hardly an extension of XWiki, but rather a companion program (but I'm 
nitpicking). However, as a stand-alone program, isn't it available as an 
executable JAR somewhere ?


2 - Dokuwiki to XWiki

This time, it's a valid XWiki extension : 
http://extensions.xwiki.org/xwiki/bin/view/Extension/Import+DokuWiki+into+XWiki+Application 
which is easily installable using Extension manager (cool !). However, I 
wonder how it will work with XWiki 6.4.2 ...


3 - mediawiki to XWiki

This time ... it seems like there is no extension. or is it ?

bonus - xwiki-OLD to xwiki

We also have some content in an old (5.0.1) version of XWiki. How do I 
migrate ?


Conclusion - cheers

I must confess I had never tried before XWiki, and my first impression 
is that it's a robust and perfectly usable wiki solution. The XWiki team 
did a really impressive work.


--
Nicolas Delsaux
___
users mailing list
users@xwiki.org
http://lists.xwiki.org/mailman/listinfo/users


Re: [xwiki-users] integrating data from JSPWiki/DokuWiki/mediawiki

2015-03-19 Thread vinc...@massol.net
Hi Nicolas,


On 19 Mar 2015 at 15:38:02, Nicolas Delsaux 
(nicolas.dels...@gmx.fr(mailto:nicolas.dels...@gmx.fr)) wrote:

 Hi,
 I'm in organization where we have 3 unsynchronized wikis, implemented
 using the software named in subject (ie JSPWiki/DokuWiki/mediawiki).
 I would like to merge their content in one unique wiki, obviously
 implemented using XWiki (due to the excellent interview Vincent Massol
 and Ludovic Dubost gave to the castcodeurs podcast).

Nice choice! :)

 I have seen there are extensions to have content of those legacy wiki
 imported into XWiki.
 However, i'm not sure I understand how they work.

I don’t know if you’ve seen this doc page which may provide a bit more 
information:
http://platform.xwiki.org/xwiki/bin/view/Features/Imports#HImportingfromanotherwiki

 1 - JSPWiki to XWiki
  
 There seems to be an old (?) extension at
 http://extensions.xwiki.org/xwiki/bin/view/Extension/JSPWiki+To+XWiki+Conversion,
 documented by Vincent Massol. From what I understand, the Java code in
 this extension has to be compiled independently, and run as a
 stand-alone program on the machine hosting the JSPWiki server. It will
 generate a XAR that can be injected into XWiki. Am I right ? If so, it
 is hardly an extension of XWiki, but rather a companion program (but I'm
 nitpicking). However, as a stand-alone program, isn't it available as an
 executable JAR somewhere ?

Yes, this is an old script written a long time ago (not by me, I just made it 
available on that page ;)), before XWiki Rendering (see 
http://rendering.xwiki.org) existed. I have no idea how well it works.

 2 - Dokuwiki to XWiki
  
 This time, it's a valid XWiki extension :
 http://extensions.xwiki.org/xwiki/bin/view/Extension/Import+DokuWiki+into+XWiki+Application
 which is easily installable using Extension manager (cool !). However, I
 wonder how it will work with XWiki 6.4.2 ...
  
 3 - mediawiki to XWiki
  
 This time ... it seems like there is no extension. or is it ?

So to summarize, we’re lacking some nice migrators to migrate from all those 
wikis to XWiki. We only have scripts maintained by the community.

Now we’ve put in place all the infrastructure for such a migrator. We call it 
the Filters Application (a bad name IMO but it does more than just migrate 
content from wiki to wikis, it accepts any input and any output). See 
http://extensions.xwiki.org/xwiki/bin/view/Extension/Filter+Application 

Right now this Filters app supports only a few input/outputs:
http://extensions.xwiki.org/xwiki/bin/view/Extension/Filter+Module#HExistingmodules

Since there’s a confluence input module, it means you can give this Filter app 
a confluence zip as input and as output you can put an XWiki instance and it’ll 
import the content.

We’re lacking input modules for the wikis you mentioned above: JSPWiki, 
Dokuwiki and MediaWiki.

So there are 4 solutions I can see at this stage:
* You import your content page by page (since XWiki can read natively the 
formats of the wikis you mentioned)
* You use one of the extension scripts from 
http://extensions.xwiki.org/xwiki/bin/view/Main/Tags?do=viewTagtag=migration 
but I don’t know what result you’ll get (I’ve never used them myself but I 
think the mediawiki ones are pretty good)
* You want to contribute/participate and we can guide you on how to write a 
Filter module. If you wish to see the code for the confluence one, it’s here: 
https://github.com/xwiki/xwiki-platform/tree/master/xwiki-platform-core/xwiki-platform-filter/xwiki-platform-filter-streams/xwiki-platform-filter-stream-confluencexml
* You want someone to do the work for you! Check the list of professional 
services at 
http://www.xwiki.org/xwiki/bin/view/Main/Support#HProfessionalSupport

 bonus - xwiki-OLD to xwiki

 We also have some content in an old (5.0.1) version of XWiki. How do I
 migrate ?

That’s relatively easy :) You can export and reimport for example, see 
http://platform.xwiki.org/xwiki/bin/view/AdminGuide/ImportExport

 Conclusion - cheers
  
 I must confess I had never tried before XWiki, and my first impression
 is that it's a robust and perfectly usable wiki solution. The XWiki team
 did a really impressive work.

Thanks, I hope you’ll enjoy it!

-Vincent

 Nicolas Delsaux

___
users mailing list
users@xwiki.org
http://lists.xwiki.org/mailman/listinfo/users