Hi Baptiste, The CMIS connector depends on Apache Chemistry as its client software. It is possible that either we are behind the release cycle, or there are bugs, in the version of Chemistry that we use. There is a ticket open for upgrade; I will see if this can be done painlessly, and if so let's see if that helps.
Karl On Fri, Aug 22, 2014 at 9:26 AM, Baptiste Berthier <[email protected]> wrote: > Hi, > > I have tested multiple CMIS request. I attach a document to show the > results of my test cause I don't manage to index all internal metadata from > Alfresco and I don't know why. > > thanks for your help > > Baptiste > > 2014-08-21 13:46 GMT+02:00 Karl Wright <[email protected]>: > > Hi Baptiste, >> >> The CMIS connector passes the query intact to the CMIS implementation. >> If it sees "*" as any of the fields in the select, it takes all metadata >> items it finds in the resultset. If the "select *" is somehow canceling >> the join, then try "select d.*,e.*,*". If that doesn't work, then >> document.getProperties() is simply not returning everything. >> >> Karl >> >> >> >> On Thu, Aug 21, 2014 at 7:15 AM, Baptiste Berthier <[email protected] >> > wrote: >> >>> I tried it and the fields title or description aren't indexed. I have >>> verified the result in Solr log message and there is not the title field or >>> the description field while they appeared when I was testing the query in >>> Chrome extension. I don't know why. >>> Baptiste >>> 2014-08-21 12:25 GMT+02:00 Karl Wright <[email protected]>: >>> >>> Hi Baptiste, >>>> >>>> Instead of "d.*,e.*", try just "*". The column selection in the CMIS >>>> connector is not very smart. >>>> >>>> Karl >>>> >>>> >>>> >>>> On Thu, Aug 21, 2014 at 3:18 AM, Baptiste Berthier < >>>> [email protected]> wrote: >>>> >>>>> Hi >>>>> >>>>> In order to get the field that I want (for example description, title) >>>>> with CMIS connector, I changed my CMIS request by using a join. Here is >>>>> the >>>>> CMIS request : >>>>> >>>>> SELECT d.*, e.* FROM cmis:document as d JOIN cmis:titled e ON >>>>> d.cmis:objectId = e.cmis:objectId WHERE d.cmis:name LIKE 'doc.pdf' >>>>> >>>>> I have verified the result in Chrome and there is well the content of >>>>> the description and title field. You can see it in the attach document. >>>>> So I have written the request in MCF and launched crawling but nothing >>>>> appears to be indexed in Solr. Do you think that that MCF supports CMIS >>>>> request with join ? >>>>> >>>>> Thanks for your reply. It helps me a lot in my work. >>>>> >>>>> Baptiste >>>>> >>>>> >>>>> 2014-08-20 15:46 GMT+02:00 Karl Wright <[email protected]>: >>>>> >>>>> Hi Baptiste, >>>>>> >>>>>> The current Alfresco connector will only work on older versions of >>>>>> Alfresco. It will not work, for example, on Alfresco One. We are trying >>>>>> to field an alfresco connector based on the REST API, but that API has >>>>>> not >>>>>> apparently stabilized yet. >>>>>> >>>>>> Thanks, >>>>>> Karl >>>>>> >>>>>> >>>>>> >>>>>> On Wed, Aug 20, 2014 at 9:41 AM, Baptiste Berthier < >>>>>> [email protected]> wrote: >>>>>> >>>>>>> Thanks a lot ! Indeed It works fine like that. To avoid to modify >>>>>>> the Alfresco's CMIS implementation, do you think, that I can index all >>>>>>> the >>>>>>> metadata that I want, by using the Alfresco connector instead of CMIS >>>>>>> connector ? >>>>>>> >>>>>>> Thanks a lot ! It works fine. I noticed that the properties of the >>>>>>> document and certains Alfresco's metadata are all indexes by Solr under >>>>>>> different field's name. >>>>>>> >>>>>>> Do you think, that it's possible to avoid to change the Alfresco's >>>>>>> CMIS implementation by using the existing Alfresco connector instead of >>>>>>> using CMIS connector ? >>>>>>> >>>>>>> Baptiste >>>>>>> >>>>>>> >>>>>>> 2014-08-20 12:06 GMT+02:00 Karl Wright <[email protected]>: >>>>>>> >>>>>>> Hi Baptiste, >>>>>>>> >>>>>>>> All the metadata names provided by the Alfresco CMIS implementation >>>>>>>> seem to be prefixed with "cmis:". For example, "cmis:createdBy" has a >>>>>>>> value of "admin". If you change your MCF mappings and/or Solr >>>>>>>> configuration to recognize these attribute names, they will be indexed. >>>>>>>> >>>>>>>> It does not appear that description or title are metadata that >>>>>>>> Alfresco's CMIS implementation includes. ManifoldCF cannot fix that >>>>>>>> because it is likely that it is Alfresco's implementation that is >>>>>>>> incomplete. >>>>>>>> >>>>>>>> Karl >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> On Wed, Aug 20, 2014 at 5:39 AM, Baptiste Berthier < >>>>>>>> [email protected]> wrote: >>>>>>>> >>>>>>>>> Hi >>>>>>>>> >>>>>>>>> I attached my Solr log messages. It seems that there is the id, >>>>>>>>> the name, the mime type as metadata but nothing about the description >>>>>>>>> or >>>>>>>>> the title that we could find in Alfresco. I don't know why. I would >>>>>>>>> like to >>>>>>>>> know what is the difference between Schema section in List output >>>>>>>>> connector >>>>>>>>> and the Solr field mapping when I configure a job. It seems that the >>>>>>>>> Solr >>>>>>>>> field mapping doesn't enable me to match field from Alfresco with Solr >>>>>>>>> field. >>>>>>>>> I will be interesting in the MCF 1.7 RC2 when it will be available. >>>>>>>>> Thanks >>>>>>>>> Baptiste >>>>>>>>> 2014-08-19 13:27 GMT+02:00 Karl Wright <[email protected]>: >>>>>>>>> >>>>>>>>> Hi Baptiste, >>>>>>>>>> >>>>>>>>>> I believe the problem is in how you have declared your Solr >>>>>>>>>> schema. >>>>>>>>>> >>>>>>>>>> If you look at the Solr log messages, the INFO statements show >>>>>>>>>> the information that ManifoldCF is sending to Solr. If that includes >>>>>>>>>> everything you are expecting, then the problem is on the Solr side. >>>>>>>>>> If >>>>>>>>>> not, it is on the ManifoldCF side. >>>>>>>>>> >>>>>>>>>> Also, I've recently fixed yet another issue with the CMIS >>>>>>>>>> connector, so you will want MCF 1.7 RC2 when it is available. >>>>>>>>>> >>>>>>>>>> Thank you, >>>>>>>>>> Karl >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> On Tue, Aug 19, 2014 at 7:10 AM, Baptiste Berthier < >>>>>>>>>> [email protected]> wrote: >>>>>>>>>> >>>>>>>>>>> Hi >>>>>>>>>>> >>>>>>>>>>> Thanks a lot for the link that you sent me last day. I installed >>>>>>>>>>> and tested MCF 1.7. I met some problems. I try to explain them in >>>>>>>>>>> the >>>>>>>>>>> attached document. >>>>>>>>>>> Do you have an idea about the problem that I have ? >>>>>>>>>>> >>>>>>>>>>> Thanks >>>>>>>>>>> >>>>>>>>>>> Baptiste >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> 2014-08-12 8:11 GMT+02:00 Karl Wright <[email protected]>: >>>>>>>>>>> >>>>>>>>>>> Hi Baptiste, >>>>>>>>>>>> >>>>>>>>>>>> You can download MCF 1.7 RC0 from: >>>>>>>>>>>> >>>>>>>>>>>> http://people.apache.org/~mingchun/apache-manifoldcf-1.7-RC0/ >>>>>>>>>>>> >>>>>>>>>>>> Please let me know what happens. >>>>>>>>>>>> Karl >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> On Mon, Aug 11, 2014 at 8:45 AM, Baptiste Berthier < >>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>> >>>>>>>>>>>>> I am using Apache ManifoldCF 1.6.1 but if the version 1.7 is >>>>>>>>>>>>> available in one or two days. I can wait. >>>>>>>>>>>>> >>>>>>>>>>>>> Thanks >>>>>>>>>>>>> Baptiste >>>>>>>>>>>>> >>>>>>>>>>>>> 2014-08-11 13:26 GMT+02:00 Karl Wright <[email protected]>: >>>>>>>>>>>>> >>>>>>>>>>>>> Hi Baptiste, >>>>>>>>>>>>>> >>>>>>>>>>>>>> I strongly suggest waiting for the first ManifoldCF 1.7 >>>>>>>>>>>>>> release candidate to be available for download. This should be >>>>>>>>>>>>>> available >>>>>>>>>>>>>> within a day or two. >>>>>>>>>>>>>> >>>>>>>>>>>>>> The alternative is that I can attach a full patch to the >>>>>>>>>>>>>> ticket from whatever version you are using to current trunk. >>>>>>>>>>>>>> Please let me >>>>>>>>>>>>>> know what your version is, first. >>>>>>>>>>>>>> >>>>>>>>>>>>>> Thanks, >>>>>>>>>>>>>> Karl >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> On Mon, Aug 11, 2014 at 6:46 AM, Baptiste Berthier < >>>>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>>>> >>>>>>>>>>>>>>> Thanks a lot. It works fine ! I have just one last question >>>>>>>>>>>>>>> concerning the CMIS connector used with Alfresco to get all >>>>>>>>>>>>>>> internal >>>>>>>>>>>>>>> metadata affected to a document by Alfresco. I used this kind >>>>>>>>>>>>>>> of cmis query >>>>>>>>>>>>>>> : select * from cmis:document where cmis:name in ('doc.pdf') >>>>>>>>>>>>>>> which doesn't >>>>>>>>>>>>>>> work. So you advised me to use trunk to commit my application >>>>>>>>>>>>>>> in order to >>>>>>>>>>>>>>> be able to use the query but I cannot use trunk because of the >>>>>>>>>>>>>>> internet >>>>>>>>>>>>>>> restriction in my enterprise. >>>>>>>>>>>>>>> So I'd like to know if it exists another query expression >>>>>>>>>>>>>>> that enables me to do what I want. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> Baptiste >>>>>>>>>>>>>>> 2014-08-11 9:53 GMT+02:00 Karl Wright <[email protected]>: >>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Hi Baptiste, >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> See >>>>>>>>>>>>>>>> http://manifoldcf.apache.org/release/trunk/en_US/how-to-build-and-deploy.html#Configuring+a+MySQL+database >>>>>>>>>>>>>>>> . >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> The instructions are similar to configuration of >>>>>>>>>>>>>>>> PostgreSQL, except that the properties.xml property >>>>>>>>>>>>>>>> org.apache.manifoldcf.databaseimplementationclass should be >>>>>>>>>>>>>>>> set to >>>>>>>>>>>>>>>> "org.apache.manifoldcf.core.database.DBInterfaceMySQL". >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> Karl >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> On Mon, Aug 11, 2014 at 3:05 AM, Baptiste Berthier < >>>>>>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> Thanks for your answer. I have just one question. I have >>>>>>>>>>>>>>>>> configured ManifoldCF to run on PostgreSQL but now I would >>>>>>>>>>>>>>>>> like to run it >>>>>>>>>>>>>>>>> on MySQL. I found a lot of documentation to configure it On >>>>>>>>>>>>>>>>> Postgresql but >>>>>>>>>>>>>>>>> nothing about the eventual possibility to configure it on >>>>>>>>>>>>>>>>> MySQL. Is it >>>>>>>>>>>>>>>>> possible to configure ManifoldCF on Mysql ? >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> Baptiste >>>>>>>>>>>>>>>>> 2014-08-08 14:10 GMT+02:00 Karl Wright <[email protected] >>>>>>>>>>>>>>>>> >: >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> Hi Baptiste, >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> The patch is not complete; other changes need to be made >>>>>>>>>>>>>>>>>> as well to fix the ticket. But if you are using trunk, you >>>>>>>>>>>>>>>>>> do not need to >>>>>>>>>>>>>>>>>> apply any patch; it's already committed. >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> Thanks, >>>>>>>>>>>>>>>>>> Karl >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> On Fri, Aug 8, 2014 at 7:36 AM, Baptiste Berthier < >>>>>>>>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> Hi, >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> I follow the answer of Karl Wright mentionned at >>>>>>>>>>>>>>>>>>> https://issues.apache.org/jira/i#browse/CONNECTORS-1002 >>>>>>>>>>>>>>>>>>> with this content : >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> So I understand that the internal metadata does not make >>>>>>>>>>>>>>>>>>> it through from Alfresco into CMIS. >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> The CMIS connector working against an Alfresco >>>>>>>>>>>>>>>>>>> repository depends completely on Alfresco's implementation >>>>>>>>>>>>>>>>>>> of CMIS. It is >>>>>>>>>>>>>>>>>>> not clear how complete Alfresco's implementation is. The >>>>>>>>>>>>>>>>>>> CMIS connector >>>>>>>>>>>>>>>>>>> code seems like it would definitely pick up most >>>>>>>>>>>>>>>>>>> properties, PROVIDED they >>>>>>>>>>>>>>>>>>> are explicitly mentioned in the CMIS query you provide: >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> //properties >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> List<Property<?>> properties = document.getProperties(); >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> String id = StringUtils.EMPTY; >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> for (Property<?> property : properties) { >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> String propertyId = property.getId(); >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> if(CmisRepositoryConnectorUtils.existsInSelectClause(cmisQuery, >>>>>>>>>>>>>>>>>>> propertyId)){ >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> if (propertyId.endsWith(Constants.PARAM_OBJECT_ID)) >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> id = (String) property.getValue(); >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> This is from roughly line 1129 of >>>>>>>>>>>>>>>>>>> CMISRepositoryConnector.java. If you can't figure out what >>>>>>>>>>>>>>>>>>> is going on, you >>>>>>>>>>>>>>>>>>> can modify this code to add System.out.println() statements >>>>>>>>>>>>>>>>>>> that should >>>>>>>>>>>>>>>>>>> shed some light on the problem. >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> Please also note that the CMIS connector may not be >>>>>>>>>>>>>>>>>>> resilient against changes to the query string. To be sure, >>>>>>>>>>>>>>>>>>> you may want to >>>>>>>>>>>>>>>>>>> delete your old job and create a new job with the changed >>>>>>>>>>>>>>>>>>> query string, to >>>>>>>>>>>>>>>>>>> be sure everything that needs to be recrawled actually gets >>>>>>>>>>>>>>>>>>> reprocessed. I >>>>>>>>>>>>>>>>>>> will create a different ticket to cover that issue. >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> I have modified the code in ManifoldCF but when I >>>>>>>>>>>>>>>>>>> compile with ant in the folder >>>>>>>>>>>>>>>>>>> apache-manifoldcf-1.6.1\connector\cmis, I >>>>>>>>>>>>>>>>>>> have the following error in >>>>>>>>>>>>>>>>>>> CMISRepositoryConnector.java : >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> "error : cannot find symbol >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> [javac] >>>>>>>>>>>>>>>>>>> if(CmisRepositoryConnectorUtils.existsInSelectClause(cmisQuery, >>>>>>>>>>>>>>>>>>> propertyId)){ >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> [javac] symbol : variable cmisQuery >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> [javac] location : class CmisRepositoryConnector >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> [javac] 1 error >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> Build failed >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> I don't know what I have to do to correct this error >>>>>>>>>>>>>>>>>>> which appears during compilation. >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> Thanks for your answer >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> Baptiste >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>> >>>>>>>>> >>>>>>>> >>>>>>> >>>>>> >>>>> >>>> >>> >> >
