Re: [jira] [Commented] (CONNECTORS-518) Wiki Connector support for API authorization and security tokens

2012-09-10 Thread Karl Wright
adapidenied"/> > > it could be used to handle "session expired" situation, but should be > checked on every API request... > > > 2012/9/10 Karl Wright (JIRA) > >> >> [ >> https://issues.apache.org/jira/browse/CONNECTORS-518?page=com.atlas

Re: question about error handling during indexing

2012-09-10 Thread Karl Wright
Usually in these situations Solr returns a 500 error. The Solr Connector, at one point, used to retry indefinitely when such an error came back, but I believe there were changes to this logic and now it may well abort the job if this happens for more than a few hours straight. This is because the

Re: [VOTE] Release Apache ManifoldCF Sharepoint 2010 plugin 0.1, RC1

2012-09-10 Thread Karl Wright
Piergiorgio and I got things working on his box, so +1 from me. On Sun, Sep 9, 2012 at 12:52 PM, Karl Wright wrote: > Please vote +1 if you think the SharePoint 2010 plugin is ready for release. > > Tag in the usual place > (https://svn.apache.org/repos/asf/manifoldcf/integration/sha

Re: [VOTE] Release Apache ManifoldCF Sharepoint 2010 plugin 0.1, RC1

2012-09-11 Thread Karl Wright
Only one more vote needed! Karl On Mon, Sep 10, 2012 at 2:16 PM, Piergiorgio Lucidi wrote: > We have just finishing crawling my SharePoint 2010 instance correctly :) > > +1 from me. > > Piergiorgio > > 2012/9/10 Karl Wright > >> Piergiorgio and I got things wor

Re: ant test -> BUILD FAILED

2012-09-11 Thread Karl Wright
Hi Erlend, I posted a warning about this a few days back. You need to rerun ant make-core-deps. On Tue, Sep 11, 2012 at 9:02 AM, Erlend Garåsen wrote: > BUILD FAILED > /Users/erlendfg/tmp/mcf_2012/build.xml:870: The following error occurred > while executing this line: > /Users/erlendfg/tmp/mcf

[RESULT][VOTE] Release Apache ManifoldCF Sharepoint 2010 plugin 0.1, RC1

2012-09-12 Thread Karl Wright
91 folder documents(ppt, doc, etc). > 3) SharePoint List that has 798 items. > 4) Document Library that contains 127 aspx files. > > Here is my +1 for this vote. > > Ahmet > > --- On Mon, 9/10/12, Karl Wright wrote: > >> From: Karl Wright >> Subject: Re: [V

Re: Winding down the 0.7 release, already??

2012-09-13 Thread Karl Wright
d, Sep 5, 2012 at 2:07 PM, Karl Wright wrote: > I don't think there are any hard rules about what constitutes a 1.0 > release, except perhaps some subjective measure of completeness, and > some measure of backwards compatibility support. For example, Lucene > insures that every m

Re: Winding down the 0.7 release, already??

2012-09-13 Thread Karl Wright
at the Versioning page [2], I don't see any problem. > > Piergiorgio > > [1] - > http://maven.apache.org/ref/3.0.4/maven-artifact/xref/org/apache/maven/artifact/versioning/DefaultArtifactVersion.html > [2] - http://docs.codehaus.org/display/MAVEN/Versioning > > 2012/9/13

Does anyone want to be release engineer for the 1.0 release?

2012-09-14 Thread Karl Wright
We're not quite ready, but presuming we finish up with the CONNECTORS-515 ticket on time, does anyone want to be the release engineer for the ManifoldCF 1.0 release? The process is documented in the wiki if you want to read about it. Karl

Re: Japanese translation needed for CONNECTORS-486

2012-09-20 Thread Karl Wright
Thanks! Yes, the "how to build" page never was translated, so I think unless Abe-san has much time on his hands it will not happen now. The missing translations are covered in a ticket, I think, which is assigned to Hitoshi Ozawa. Karl On Thu, Sep 20, 2012 at 9:43 AM, Erlend Garåsen wrote: > >

[VOTE] Release Apache ManifoldCF 1.0, RC0

2012-09-20 Thread Karl Wright
Please vote +1 to release ManifoldCF 1.0, RC0. The release artifact can be found at: http://people.apache.org/~kwright/apache-manifoldcf-1.0 There is also an SVN tag at: https://svn.apache.org/repos/asf/manifoldcf/tags/release-1.0-RC0 Karl

Re: [VOTE] Release Apache ManifoldCF 1.0, RC0

2012-09-21 Thread Karl Wright
the ImportConfiguration tool. > > Otherwise, everything seems to work as expected. I have tested: > - Deployment on Resin 4 on Linux > - ant test on OS X. > - My new file encryption function. > > I'll wait with my vote until the above behaviour is explained. >

Re: [VOTE] Release Apache ManifoldCF 1.0, RC0

2012-09-21 Thread Karl Wright
wrote: > On 21.09.12 14.07, Karl Wright wrote: > >> If you think the agents process is running, and yet you cannot delete >> a job, you should see stuff in the manifoldcf log that would indicate >> what the trouble likely is. > > > solr-test02 mcf-1 $ /www/var/data

Re: [VOTE] Release Apache ManifoldCF 1.0, RC0

2012-09-21 Thread Karl Wright
en wrote: > On 21.09.12 14.47, Karl Wright wrote: >> >> A temporary error should not block a (non running) job from getting >> cleaned up. The job can't be deleted until it is stopped, and no >> outstanding documents are being worked on. >> >>

Re: [VOTE] Release Apache ManifoldCF 1.0, RC0

2012-09-21 Thread Karl Wright
Thanks - have a good weekend. I will also withhold my vote for this RC until this is ironed out. What I'm worried about is that all of the startup/shutdown model changes might have impacted ManifoldCF running on Resin, so I think it is essential we wait until this is resolved before declaring any

Re: [VOTE] Release Apache ManifoldCF 1.0, RC0

2012-09-21 Thread Karl Wright
to delete jobs and connections when you upgrade. Nor is unregistering/reregistering your connectors. I'm going to spin a new RC with the NPE fix and a bunch of other things - but I'm pretty certain the mystery is solved. Thanks, Karl On Fri, Sep 21, 2012 at 10:17 AM, Karl Wright wrot

[WITHDRAW][VOTE] Release Apache ManifoldCF 1.0, RC0

2012-09-21 Thread Karl Wright
Withdrawn; spinning RC1 now. Karl On Fri, Sep 21, 2012 at 2:55 PM, Karl Wright wrote: > Hi, > > I see what has happened here. You unregistered the connectors before > you deleted the job. That basically meant that the job cleanup can't > take place until the connecto

[VOTE] Release Apache ManifoldCF 1.0, RC1

2012-09-21 Thread Karl Wright
Please vote +1 to release ManifoldCF 1.0, RC1. The release artifact can be found at: http://people.apache.org/~kwright/apache-manifoldcf-1.0 There is also an SVN tag at: https://svn.apache.org/repos/asf/manifoldcf/tags/release-1.0-RC1 Fixes since RC0: CONNECTORS-532 CONNECTORS-533 CONNECTORS-

Re: [VOTE] Release Apache ManifoldCF 1.0, RC1

2012-09-23 Thread Karl Wright
Examined the distribution for leakage of files that shouldn't be there, ran ant rat-sources, and ran all tests. +1 from me. Karl On Fri, Sep 21, 2012 at 3:48 PM, Karl Wright wrote: > Please vote +1 to release ManifoldCF 1.0, RC1. The release artifact > can be found a

Re: [VOTE] Release Apache ManifoldCF 1.0, RC0

2012-09-24 Thread Karl Wright
Hi, please see below: On Mon, Sep 24, 2012 at 9:59 AM, Erlend Garåsen wrote: > On 21.09.12 20.55, Karl Wright wrote: > >> I see what has happened here. You unregistered the connectors before >> you deleted the job. That basically meant that the job cleanup can't

Re: [VOTE] Release Apache ManifoldCF 1.0, RC1

2012-09-24 Thread Karl Wright
olved this issue. > I tested other functionalities and it seems all ok. > > So I think that if we build another RC, this time it could be ok :) > > Piergiorgio > > 2012/9/23 Karl Wright > >> Examined the distribution for leakage of files that shouldn't be >>

[WITHDRAW][VOTE] Release Apache ManifoldCF 1.0, RC1

2012-09-24 Thread Karl Wright
Found an issue serious enough to block release. CONNECTORS-539. Canceling the vote on RC1. Karl On Mon, Sep 24, 2012 at 10:24 AM, Karl Wright wrote: > I think this is serious enough for a new RC. > > But first, let's try to be sure there aren't any other major issues...

[VOTE] Release Apache ManifoldCF 1.0, RC2

2012-09-24 Thread Karl Wright
Please vote +1 to release ManifoldCF 1.0, RC2. The release artifact can be found at: http://people.apache.org/~kwright/apache-manifoldcf-1.0 There is also an SVN tag at: https://svn.apache.org/repos/asf/manifoldcf/tags/release-1.0-RC2 Fixes since RC1: CONNECTORS-538 CONNECTORS-539 Karl

Re: [VOTE] Release Apache ManifoldCF 1.0, RC0

2012-09-24 Thread Karl Wright
p 24, 2012 at 10:09 AM, Karl Wright wrote: > Hi, please see below: > > On Mon, Sep 24, 2012 at 9:59 AM, Erlend Garåsen > wrote: >> On 21.09.12 20.55, Karl Wright wrote: >> >>> I see what has happened here. You unregistered the connectors before >>> you

Re: [VOTE] Release Apache ManifoldCF 1.0, RC2

2012-09-25 Thread Karl Wright
lassNotFoundException: org.apache.manifoldcf.apiservlet.APIServlet > : > : > 6156 [main] WARN /mcf-api-service - unavailable > javax.servlet.UnavailableException: > org.apache.manifoldcf.apiservlet.APIServlet > at org.eclipse.jetty.servlet.Holder.doStart(Holder.java:91) >

[WITHDRAW][VOTE] Release Apache ManifoldCF 1.0, RC2

2012-09-25 Thread Karl Wright
The jar is missing from the proprietary war. I've not been running that. So yes, I think this should be fixed, and the candidate withdrawn. Karl On Tue, Sep 25, 2012 at 3:19 AM, Karl Wright wrote: > Hmm, I don't see that here. > Karl > > > On Mon, Sep 24, 2012 a

[VOTE] Release Apache ManifoldCF 1.0, RC3

2012-09-25 Thread Karl Wright
Please vote +1 to release ManifoldCF 1.0, RC3. The release artifact can be found at: http://people.apache.org/~kwright/apache-manifoldcf-1.0 There is also an SVN tag at: https://svn.apache.org/repos/asf/manifoldcf/tags/release-1.0-RC3 Fixes since RC2: CONNECTORS-540

Re: [VOTE] Release Apache ManifoldCF 1.0, RC3

2012-09-25 Thread Karl Wright
ary in the same way > - checked signatures > > +1 from me > > Piergiorgio > > 2012/9/25 Karl Wright > >> Please vote +1 to release ManifoldCF 1.0, RC3. The release artifact >> can be found at: >> >> http://people.apache.org/~kwright/apach

Re: [VOTE] Release Apache ManifoldCF 1.0, RC3

2012-09-26 Thread Karl Wright
ar.gz) on OS X (64 bit Java 1.6). Ran ant test, > ant doc (and viewed the build content with Firefox( and ant build. > - Started MCF with Jetty from dist/example and dist/multiprocess-example > (HSQLDB). > > Erlend > > > On 25.09.12 12.17, Karl Wright wrote: >> >&

Re: [VOTE] Release Apache ManifoldCF 1.0, RC3

2012-09-26 Thread Karl Wright
ll have constructed > *three war files* ..." > > I can test this war file more properly if I get some basic information about > it. > > Erlend > > > On 26.09.12 12.47, Karl Wright wrote: >> >> Has anyone tried to deploy the combined war on any applicatio

Re: [VOTE] Release Apache ManifoldCF 1.0, RC3

2012-09-26 Thread Karl Wright
I have asked someone with > better server skills and Resin knowledge. > > Erlend > > > On 26.09.12 15.02, Erlend Garåsen wrote: >> >> On 26.09.12 14.39, Karl Wright wrote: >>> >>> I didn't do documentation (or tests) because it is experimental

Re: [VOTE] Release Apache ManifoldCF 1.0, RC3

2012-09-27 Thread Karl Wright
will find out why tomorrow after our Solr meeting. >> >> If I get a reply this evening, I will try to do a new test from home. >> >> Erlend >> >> On 26.09.12 17.55, Karl Wright wrote: >>> >>> Usually application servers unpack the war somewhere. U

[WITHDRAW][VOTE] Release Apache ManifoldCF 1.0, RC3

2012-09-27 Thread Karl Wright
Withdrawing candidate to fix CONNECTORS-544. Karl On Thu, Sep 27, 2012 at 1:02 PM, Karl Wright wrote: > I wrote a test for it here. Unfortunately, it fails because the war > does not include some key classes. > > I think even though this is an experimental feature, this is > suff

[VOTE] Release Apache ManifoldCF 1.0, RC4

2012-09-27 Thread Karl Wright
Please vote +1 to release ManifoldCF 1.0, RC4. The release artifact can be found at: http://people.apache.org/~kwright/apache-manifoldcf-1.0 There is also an SVN tag at: https://svn.apache.org/repos/asf/manifoldcf/tags/release-1.0-RC4 Fixes since RC3: CONNECTORS-544 (also added example script

Re: [VOTE] Release Apache ManifoldCF 1.0, RC4

2012-09-27 Thread Karl Wright
Ran all tests, tried the combined war, tried single-process example and multiprocess example. +1 (and I really hope this is the last RC for this release) Karl On Thu, Sep 27, 2012 at 5:30 PM, Karl Wright wrote: > Please vote +1 to release ManifoldCF 1.0, RC4. The release artifact >

[WITHDRAW][VOTE] Release Apache ManifoldCF 1.0, RC4

2012-09-28 Thread Karl Wright
Another serious build and example-related problem found: CONNECTORS-545. Karl On Thu, Sep 27, 2012 at 8:34 PM, Karl Wright wrote: > Ran all tests, tried the combined war, tried single-process example > and multiprocess example. > > +1 (and I really hope this is the last RC for

[VOTE] Release Apache ManifoldCF 1.0, RC5

2012-09-28 Thread Karl Wright
Please vote +1 to release ManifoldCF 1.0, RC5. The release artifact can be found at: http://people.apache.org/~kwright/apache-manifoldcf-1.0 There is also an SVN tag at: https://svn.apache.org/repos/asf/manifoldcf/tags/release-1.0-RC5 Fixes since RC4: CONNECTORS-545 Fixes since RC3: CONNECT

Re: [VOTE] Release Apache ManifoldCF 1.0, RC5

2012-09-28 Thread Karl Wright
will end this job before I leave because I'm afraid that MCF will try to > fetch these documents over and over again during this weekend. > > Erlend > > > On 28.09.12 09.58, Karl Wright wrote: >> >> Please vote +1 to release ManifoldCF 1.0, RC5. The release ar

Re: [VOTE] Release Apache ManifoldCF 1.0, RC5

2012-09-28 Thread Karl Wright
> > I'm pretty sure they are related to each other. > > I will end this job before I leave because I'm afraid that MCF will try to > fetch these documents over and over again during this weekend. > > Erlend > > > On 28.09.12 09.58, Karl Wright wrote:

Re: [VOTE] Release Apache ManifoldCF 1.0, RC5

2012-09-28 Thread Karl Wright
CONNECTORS-547 (index out of bounds) CONNECTORS-548 (cannot build with maven) Karl On Fri, Sep 28, 2012 at 7:26 AM, Karl Wright wrote: > "Meanwhile, the following is filling up my log: > FATAL 2012-09-28 11:42:32,112 (Worker thread '29') - Error tossed: > Strin

[WITHDRAW][VOTE] Release Apache ManifoldCF 1.0, RC5

2012-09-28 Thread Karl Wright
>> result code. >>> >>> Meanwhile, the following is filling up my log: >>> FATAL 2012-09-28 11:42:32,112 (Worker thread '29') - Error tossed: String >>> index out of range: -1 >>> java.lang.StringIndexOutOfBoundsException: String index

[VOTE] Release Apache ManifoldCF 1.0, RC6

2012-09-28 Thread Karl Wright
Please vote +1 to release ManifoldCF 1.0, RC6. The release artifact can be found at: http://people.apache.org/~kwright/apache-manifoldcf-1.0 There is also an SVN tag at: https://svn.apache.org/repos/asf/manifoldcf/tags/release-1.0-RC6 Fixes since RC5: CONNECTORS-547 CONNECTORS-548 (documentat

Re: [VOTE] Release Apache ManifoldCF 1.0, RC6

2012-09-28 Thread Karl Wright
Exercised it as I have before, and added postgresql and mysql tests. +1 Karl On Fri, Sep 28, 2012 at 9:38 AM, Karl Wright wrote: > Please vote +1 to release ManifoldCF 1.0, RC6. The release artifact > can be found at: > > http://people.apache.org/~kwright/apache-manifoldcf-1.0

[WITHDRAW][VOTE] Release Apache ManifoldCF 1.0, RC6

2012-09-30 Thread Karl Wright
Withdrawn because of CONNECTORS-549. Karl On Sun, Sep 30, 2012 at 8:07 AM, Piergiorgio Lucidi wrote: > -1 from me. > > I found an issue on the CMIS Connector (CONNECTORS-549), I'm committing the > patch to fix the problem. > We need another RC. > > Piergiorgio

[VOTE] Release Apache ManifoldCF 1.0, RC7

2012-09-30 Thread Karl Wright
Please vote +1 to release ManifoldCF 1.0, RC7. The release artifact can be found at: http://people.apache.org/~kwright/apache-manifoldcf-1.0 There is also an SVN tag at: https://svn.apache.org/repos/asf/manifoldcf/tags/release-1.0-RC7 Fixes since RC6: CONNECTORS-549 Fixes since RC5: CONNECT

Re: [VOTE] Release Apache ManifoldCF 1.0, RC7

2012-09-30 Thread Karl Wright
Ran all tests, just to be sure nothing got messed up. +1 from me. Karl On Sun, Sep 30, 2012 at 11:34 AM, Piergiorgio Lucidi wrote: > +1 from me: > > - checked signatures > - crawling against a CMIS repository > - tried to build using Maven and Ant > > Piergiorgio >

Re: [VOTE] Release Apache ManifoldCF 1.0, RC5

2012-10-02 Thread Karl Wright
No stack trace needed. If you read the rest of the mail, you will note that I was able to reproduce the issue using the URL you had provided. There have been two RC's since; we are on RC7 now. Karl On Tue, Oct 2, 2012 at 4:38 AM, Erlend Garåsen wrote: > On 28.09.12 13.31, Erlend Garåsen wrote

Re: [VOTE] Release Apache ManifoldCF 1.0, RC7

2012-10-02 Thread Karl Wright
> > 'ant all' command yields: > > BUILD FAILED > /manifoldcf/tags/release-1.0-RC7/build.xml:2529: A zip file cannot include > itself > > Ahmet > > > --- On Sun, 9/30/12, Karl Wright wrote: > >> From: Karl Wright >> Subject: Re: [VO

Re: [VOTE] Release Apache ManifoldCF 1.0, RC7

2012-10-02 Thread Karl Wright
Oh, and by the way, I used "ant image" to create the release, which calls the "create-source-zip" target. So it's still working for me just fine. Hmmm. Karl On Tue, Oct 2, 2012 at 2:41 PM, Karl Wright wrote: > The ant build hasn't changed in this regard, but

Re: [VOTE] Release Apache ManifoldCF 1.0, RC7

2012-10-02 Thread Karl Wright
Mine is: C:\wip\mcf\trunk>which ant c:\ant\apache-ant-1.8.4\bin/ant.bat Are you running on Windows, or Linux? Karl On Tue, Oct 2, 2012 at 2:54 PM, Ahmet Arslan wrote: >> This used to exclude the zip from itself. What version >> of ant are you using? > > Apache Ant(TM) version 1.8.2 compiled on

Re: [VOTE] Release Apache ManifoldCF 1.0, RC7

2012-10-02 Thread Karl Wright
Can you try changing the clause I noted earlier to remove the leading "/" from "/apache-manifoldcf-*", and see if that works? I'd hesitate to spin a new kit here unless there's evidence there's a viable fix. Karl On Tue, Oct 2, 2012 at 3:01 PM, Ahmet Arslan wrote: > >> Are you running on Windo

Re: [VOTE] Release Apache ManifoldCF 1.0, RC7

2012-10-02 Thread Karl Wright
Ok - this is likely a windows/linux difference then. I'll have to try it out on my linux system when I get home to be sure I catch all the pertinent cases. In any case, I'm not sure this is worth a respin, since the place it fails is building a distribution zip. Does everyone agree? Karl On Tu

Re: [VOTE] Release Apache ManifoldCF 1.0, RC7

2012-10-02 Thread Karl Wright
CONNECTORS-550 is the ticket. Karl On Tue, Oct 2, 2012 at 3:26 PM, Karl Wright wrote: > Ok - this is likely a windows/linux difference then. > > I'll have to try it out on my linux system when I get home to be sure > I catch all the pertinent cases. > > In any case, I

Re: [VOTE] Release Apache ManifoldCF 1.0, RC7

2012-10-03 Thread Karl Wright
tpParser.parseAvailable(HttpParser.java:218) > at > org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:51) > at > org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:586) > at > org.eclipse.jetty.io.nio.SelectChanne

Re: getMaxDocumentRequest problem

2012-10-03 Thread Karl Wright
Hi Maciej, It sounds like your loop condition must be somehow incorrect. You may not receive the full number of documents specified by getMaxDocumentRequest(), but rather a number less than that. We have a number of connectors that use document batches > 1, e.g. the LiveLink connector, so this i

[ANNOUNCE] Apache ManifoldCF 1.0 has been released!

2012-10-04 Thread Karl Wright
To all, Apache ManifoldCF 1.0 has been released. This release introduces support for SharePoint 2010, a new LDAP authority, many bug fixes, a new experimental deployment model (single-process combined war), and full MySQL support. Details can be found at: http://www.apache.org/dist/manifoldcf/a

Re: question about multiple languages

2012-10-08 Thread Karl Wright
Hi Maciej, Did you intend to send this to the Solr/Lucene dev list? This really isn't a ManifoldCF question. I can help a little perhaps. You are correct that stemming and normalization rules might well differ from language to language, but it is worth noting that for at least normalization it

Re: getMaxDocumentRequest problem

2012-10-09 Thread Karl Wright
when hitting abort - nothing happens (job process remains in > "aborting" state)... > > Problem is that it happens irregularly (sometime 10 documents, > sometime 1600 and sometime all documents are indexed). Tried to check > that locally but on first pass everything went ok

Re: getMaxDocumentRequest problem

2012-10-09 Thread Karl Wright
FWIW, getting thread dumps from the process running the agents process when it is "hung" may (or may not) help determine the underlying clause. Karl On Tue, Oct 9, 2012 at 9:21 AM, Karl Wright wrote: > What is your deployment model? Is this a multiprocess deployment? > What

Re: getMaxDocumentRequest problem

2012-10-09 Thread Karl Wright
d > just disappeared... > > How to enable debug logs so I could see verbose output from core functions? > > > 2012/10/9 Karl Wright : >> FWIW, getting thread dumps from the process running the agents process >> when it is "hung" may (or may not) help determ

Re: getMaxDocumentRequest problem

2012-10-09 Thread Karl Wright
What JVM are you using? Because frankly this cannot logically happen. The only other possibility is that your code is somehow throwing ManifoldCFExceptions of type ManifoldCFException.INTERRUPTED. Karl On Tue, Oct 9, 2012 at 10:20 AM, Maciej Liżewski wrote: > 2012/10/9 Karl Wri

Re: getMaxDocumentRequest problem

2012-10-09 Thread Karl Wright
ds are spawn... > > > > > 2012/10/9 Maciej Liżewski : >> 2012/10/9 Karl Wright : >>> "- all worker threads are gone," ??? >>> >>> Really?? >> >> yes... really.. this is why I am also writing that this is strange... >> this is lis

Re: getMaxDocumentRequest problem

2012-10-09 Thread Karl Wright
hat is possible :) > what exactly ManifoldCFException.INTERRUPTED is doing that could cause > such effects? > > > 2012/10/9 Karl Wright : >> What JVM are you using? Because frankly this cannot logically happen. >> >> The only other possibility i

Re: New committer: Ahmet Arslan

2012-10-09 Thread Karl Wright
ifoldcf.apache.org >> Date: Wednesday, September 5, 2012, 1:50 PM >> Hi Ahmet, >> >> a warm welcome from Rome! >> >> ^__^ >> >> Piergiorgio >> >> 2012/9/5 Erlend Garåsen >> >> > >> > Welcome to the MCF community, Ahmet! >> > >&

[PROPOSAL] Release a ManifoldCF 1.0.1 release

2012-10-09 Thread Karl Wright
Hi folks, Due to the potential severity of CONNECTORS-551, I think it might be a good idea to release a ManifoldCF 1.0.1 release which contains the fix for this ticket. Please can I have a show of "hands" as to whether people agree that this is serious enough to warrant such a release. Thanks! K

Re: [PROPOSAL] Release a ManifoldCF 1.0.1 release

2012-10-10 Thread Karl Wright
Ok, it looks like there is consensus. I will prepare the release-1.0-branch appropriately, and create a release candidate. Karl On Wed, Oct 10, 2012 at 5:28 AM, Erlend Garåsen wrote: > +1 > > Erlend > > > On 09.10.12 22.53, Karl Wright wrote: >> >> Hi folks, >&

[VOTE] Release Apache ManifoldCF 1.0.1, RC0

2012-10-13 Thread Karl Wright
Vote +1 to release Apache ManifoldCF 1.0.1, RC0. You can find a tag at: https://svn.apache.org/repos/asf/manifoldcf/tags/release-1.0.1-RC0 The artifact can be downloaded from: http://people.apache.org/~kwright/apache-manifoldcf-1.0.1 This patch release fixes the critical bug CONNECTORS-551. I

Re: [VOTE] Release Apache ManifoldCF 1.0.1, RC0

2012-10-14 Thread Karl Wright
Ran tests and checked documentation. +1 from me. Karl On Sat, Oct 13, 2012 at 6:16 PM, Karl Wright wrote: > Vote +1 to release Apache ManifoldCF 1.0.1, RC0. You can find a tag at: > > https://svn.apache.org/repos/asf/manifoldcf/tags/release-1.0.1-RC0 > > The artifact can be

Re: My talk about Apache ManifoldCF at LinuxDay Rome 2012

2012-10-15 Thread Karl Wright
Looks great - hope it goes well! I wish I could come but I *just* got back from Berlin yesterday, and I have responsibilities here thru Oct 31. Karl On Mon, Oct 15, 2012 at 4:17 AM, Piergiorgio Lucidi wrote: > Hi guys, > > I would like to share with you that at the next LinuxDay here in Rome I'

[WITHDRAW][VOTE] Release Apache ManifoldCF 1.0.1, RC0

2012-10-15 Thread Karl Wright
Looks like maven build is busted, see CONNECTORS-555. Karl On Sun, Oct 14, 2012 at 4:32 AM, Karl Wright wrote: > Ran tests and checked documentation. > > +1 from me. > > Karl > > On Sat, Oct 13, 2012 at 6:16 PM, Karl Wright wrote: >> Vote +1 to release Apache Mani

Re: Developing an Email Connector

2012-10-15 Thread Karl Wright
Sounds great! I can't wait to see it. Karl On Mon, Oct 15, 2012 at 6:31 AM, Erlend Garåsen wrote: > > Me and Karl had a short discussion about such a connector in Cambridge for > some months ago. Now I have created the following ticket regarding an Email > Connector: > https://issues.apache.or

Re: [DISCUSS] Java coding style

2012-10-15 Thread Karl Wright
As far as I'm concerned, either coding style is OK. But having the wrong number of spaces for indent is not. Nor is using tabs instead of spaces. The only other rule I think we should really enforce is for any significant changes to the style of a class to be checked in or patched independently

[VOTE] Release Apache ManifoldCF 1.0.1, RC1

2012-10-15 Thread Karl Wright
Vote +1 to release Apache ManifoldCF 1.0.1, RC1. You can find a tag at: https://svn.apache.org/repos/asf/manifoldcf/tags/release-1.0.1-RC1 The artifact can be downloaded from: http://people.apache.org/~kwright/apache-manifoldcf-1.0.1 This patch release fixes the critical bug CONNECTORS-551. I

Re: [VOTE] Release Apache ManifoldCF 1.0.1, RC1

2012-10-15 Thread Karl Wright
Downloaded artifacts, looked for leakage of maven "target" directories, and tried a maven build, which worked. +1 from me. Karl On Mon, Oct 15, 2012 at 7:34 PM, Karl Wright wrote: > Vote +1 to release Apache ManifoldCF 1.0.1, RC1. You can find a tag at: > > https://svn.a

New committer: Maciej Lizweski

2012-10-16 Thread Karl Wright
Please join me in welcoming Maciej as our newest committer and PMC member. Maciej brings with him knowledge of wikis, LDAP, and mail protocols, among many other skills. Welcome, Maciej! Karl

Some dev-related questions

2012-10-17 Thread Karl Wright
Hi Maciej, First advice is to post questions of this kind to dev@manifoldcf.apache.org. This functions in part as a repository of general knowledge, and it is searchable, so in the future others can maybe refer to answers there. Please see below for detailed answers. On Wed, Oct 17, 2012 at 4:3

Re: Some dev-related questions

2012-10-17 Thread Karl Wright
changes are only in > this single connector? > You always need to create a whole copy of trunk. svn is very efficient about copies so this is not a problem. Karl > 2012/10/17 Karl Wright > >> Hi Maciej, >> >> First advice is to post questions of this kind to >

[RESULT][VOTE] Release Apache ManifoldCF 1.0.1, RC1

2012-10-18 Thread Karl Wright
gt;> - executed integration tests >> - checked signatures >> - crawled a CMIS repository >> >> +1 from me >> >> PJ >> >> 2012/10/16 Karl Wright >> >> > Downloaded artifacts, looked for leakage of maven >> "target" >>

[ANNOUNCE] Apache ManifoldCF 1.0.1 has been released!

2012-10-21 Thread Karl Wright
This bug-fix release corrects one critical functional problem, which was detected after 1.0 was released, plus fixes the broken maven build. Plus we've included reworked how-to-build-and-deploy documentation. Please let me know of any problems! Karl

Re: My talk about Apache ManifoldCF at LinuxDay Rome 2012

2012-10-29 Thread Karl Wright
te ;) > > Piergiorgio > > [1] - > http://www.open4dev.com/journal/2012/10/28/apache-manifoldcf-at-linuxday-slides.html > > 2012/10/15 Karl Wright > >> Looks great - hope it goes well! I wish I could come but I *just* got >> back from Berlin yesterday, and I have responsibili

Re: My talk about Apache ManifoldCF at LinuxDay Rome 2012

2012-10-31 Thread Karl Wright
s. > At the end of the next week, after the Alfresco DevCon in Berlin, I can > work on this task for updating the website ;) > > Piergiorgio > > [1] - > http://www.open4dev.com/journal/2012/10/28/apache-manifoldcf-at-linuxday-slides.html > > 2012/10/15 Karl Wright > >

Anybody with a working SharePoint instance?

2012-11-10 Thread Karl Wright
Hi Ahmet and/or Piergiorgio, If you still have access to your SharePoint instances, I've got a favor to ask. Can you check out https://svn.apache.org/repos/asf/manifoldcf/branches/CONNECTORS-120, run "ant make-core-deps", and "ant build", and then try the SharePoint connector? I've converted ove

Re: Anybody with a working SharePoint instance?

2012-11-10 Thread Karl Wright
ache.xerces.parsers.XML11Configuration.parse(Unknown Source) > at org.apache.xerces.parsers.XMLParser.parse(Unknown Source) > at org.apache.xerces.parsers.AbstractSAXParser.parse(Unknown Source) > at org.apache.xerces.jaxp.SAXParserImpl$JAXPSAXParser.parse(Unknow

Re: Anybody with a working SharePoint instance?

2012-11-10 Thread Karl Wright
Ok, can you try it now? I think it is fixed. Karl On Sat, Nov 10, 2012 at 1:20 PM, Karl Wright wrote: > Thanks - it looks like I will need to have it go through a temporary > local file in order to work right. I'll make that change and let you > know. > > Karl > >

Re: Anybody with a working SharePoint instance?

2012-11-10 Thread Karl Wright
eam.(FileInputStream.java:116) > at > org.apache.manifoldcf.crawler.connectors.sharepoint.CommonsHTTPSender$FileBackedInputStream.(CommonsHTTPSender.java:488) > at > org.apache.manifoldcf.crawler.connectors.sharepoint.CommonsHTTPSender$ExecuteMethodThread.run(CommonsHTTP

Re: Anybody with a working SharePoint instance?

2012-11-11 Thread Karl Wright
Great! I've pulled this code up into trunk. Please, if anyone notices any problems, please let me know. Karl On Sat, Nov 10, 2012 at 10:10 PM, Ahmet Arslan wrote: > Hi Karl, > > Its all working for me now :) > > Thanks, > Ahmet > > --- On Sun, 11/11/12, Karl W

Anyone out there using RSS connector, who wants to help?

2012-11-16 Thread Karl Wright
Hi all, The branch https://svn.apache.org/repos/asf/manifoldcf/branches/CONNECTORS-120 contains an RSS connector that has been updated to use httpcomponents 4.2.2. I'd love for people who are in a position to do significant RSS crawling to try it out before I pull it into trunk. Any takers? Kar

RE: Anyone out there using RSS connector, who wants to help?

2012-11-18 Thread Karl Wright
-1 > ERROR 2012-11-17 23:02:27,329 (Worker thread '30') - > Exception tossed: Repeated service interruptions - failure > getting document version > org.apache.manifoldcf.core.interfaces.ManifoldCFException: > Repeated service interruptions - failure getting document > ver

Re: Anyone out there using RSS connector, who wants to help?

2012-11-18 Thread Karl Wright
o other servers... Karl On Sun, Nov 18, 2012 at 3:07 AM, Karl Wright wrote: > Odd. The problem is obviously the port of -1. But the code does not > attach a specific port to the URL in that case. > > I will try your example exactly when I have access to internet again. > > Karl &

Re: Anyone out there using RSS connector, who wants to help?

2012-11-18 Thread Karl Wright
The CONNECTORS-120 branch now also has a httpcomponents version of the wiki connector implemented. I think Maciej might be interested in trying that one out. Karl On Sun, Nov 18, 2012 at 1:04 PM, Karl Wright wrote: > Hi Ahmet, > > I tried your example, but it looked like it worked

Re: Anyone out there using RSS connector, who wants to help?

2012-11-20 Thread Karl Wright
ww.hurriyet.com.tr/robots.txt exists. >> >> Ahmet >> >> --- On Sun, 11/18/12, Karl Wright wrote: >> >> > From: Karl Wright >> > Subject: Re: Anyone out there using RSS connector, who wants to help? >> > To: "Ahmet Arslan" , "

Time to try out the web connector in branches/CONNECTORS-120

2012-11-21 Thread Karl Wright
I've ported the web connector, finally, to httpcomponents 4.2.2. This was a lot of work. The areas I anticipate there will be problems will be in exception handling and in session login. If anyone has session-protected sites they typically crawl, it would be great if you could try this code out!

Re: Anyone out there using RSS connector, who wants to help?

2012-11-24 Thread Karl Wright
e. Thanks! Karl On Tue, Nov 20, 2012 at 7:11 AM, Karl Wright wrote: > Thanks for the update! > > I'm working on the web connector now. That's going to require a bit more > work. > > Karl > > On Tue, Nov 20, 2012 at 7:09 AM, Maciej Liżewski > wrote: >&g

Next release scheduled for 12/31

2012-12-06 Thread Karl Wright
Hello all committers, This is a reminder that our next release is scheduled for 12/31/2012. There are a number of fairly major open tickets out there that I think are almost ready to be included in the release. I am especially thinking of the ldap authority enhancements, and the simple JDBC autho

Issues marked "fix in ManifoldCF next"

2012-12-07 Thread Karl Wright
Hi folks, I've created a ManifoldCF 1.2 release in JIRA and triaged some tickets I intend to work on for that release. I've also closed/resolved a fair number of tickets that were hanging around marked "fix in ManifoldCF next". You may want to do the same... Karl

Re: Largest crawl

2012-12-12 Thread Karl Wright
ManifoldCF scales based on how well the underlying database handles two kinds of queries - direct access to a row via an index, and reading from an index in ordered fashion. Both of these go up as log(n) assuming b-trees. I have personally done web crawls on the order of 5 million actual content

Heads up - Derby crawling broken on trunk

2012-12-12 Thread Karl Wright
The derby database support is not apparently able to discover database indexes properly at this time, and that is causing derby crawls to fail. I will be looking at this in detail this morning. Until then, tests don't work, they hang... Karl

Re: Heads up - Derby crawling broken on trunk

2012-12-12 Thread Karl Wright
Ok, this is now fixed. Karl On Wed, Dec 12, 2012 at 5:22 AM, Karl Wright wrote: > The derby database support is not apparently able to discover database > indexes properly at this time, and that is causing derby crawls to > fail. I will be looking at this in detail this morning. U

Re: Do we need an "org.apache.manifoldcf.core.DBClean" command class?

2012-12-18 Thread Karl Wright
DBDrop is in fact used internally by the tests we run. But you have to do the uninstall sequence in the correct order, otherwise, as you say, you are left with table dependencies. The correct order is this: org.apache.manifoldcf.crawler.UnRegisterAll org.apache.manifoldcf.authorities.UnRegisterA

Re: Do we need an "org.apache.manifoldcf.core.DBClean" command class?

2012-12-18 Thread Karl Wright
Hmm, somehow you lost a connector jar out of the connector-lib or connector-lib-proprietary area. Deleting the jars before you clean up the database is not going to work. ;-) Karl On Tue, Dec 18, 2012 at 10:26 AM, Erlend Garåsen wrote: > > Yes, I know the order is important. I tried to follow t

<    1   2   3   4   5   6   7   8   9   10   >