Hi Udara, Please attach your toolbox
On Mon, May 5, 2014 at 9:02 AM, Udara Rathnayake <[email protected]> wrote: > Hi all, > > I tried the same toolbox in released BAM 2.4.1[1]. But still I get the > same secondary index creation failure, > > [2014-05-05 12:06:50,248] WARN > {org.wso2.carbon.databridge.persistence.cassandra.datastore.CassandraConnector} > - Secondary Index creation is not successful... > me.prettyprint.hector.api.exceptions.HInvalidRequestException: > InvalidRequestException(why:Illegal index name payload_brand_index) > > Everything(toolbox deployment,Stream definition creation in registry,event > publish to Cassandra) works as expected, only secondary index creation > fails with the above warning. > Please note that I'm not using customindexes here, only secondary indexes. > > @Bhathiya, > > In my toolbox I have following, > > streams.definitions=defn1 > streams.definitions.defn1.filename=org.wso2.social.activity > streams.definitions.defn1.username=admin > streams.definitions.defn1.password=admin > streams.definitions.defn1.description=This is the datastream for social > framework > streams.definitions.defn1.secondaryindexes=brand > > I don't see any space character in this definition(This is the same which > I have used early as well). > I guess you made the above comment based on the warning > message(why:Illegal index name payload_brand_index) > > [1] http://ec2-54-198-211-48.compute-1.amazonaws.com/chunk09/wso2bam > -2.4.1.zip > > Regards, > UdaraR > > > On Tue, Apr 22, 2014 at 2:55 AM, Bhathiya Jayasekara <[email protected]>wrote: > >> Hi Udara, >> >> On Mon, Mar 17, 2014 at 10:56 PM, Udara Rathnayake <[email protected]>wrote: >> >>> >>> >>> >>> On Mon, Mar 17, 2014 at 11:42 PM, Inosh Goonewardena <[email protected]>wrote: >>> >>>> Hi Udara, >>>> >>>> I have deployed your toolbox and check. Actually, custom index are >>>> getting created properly. Following are the corresponding IndexCF for the >>>> custom index properties you have defined. >>>> >>>> 867513878 >>>> 489450871 >>>> >>>> But there is a problem with secondary index creation. It's because >>>> there are dots('.') in attribute names. Following logs prints in console >>>> when deploying the toolbox. >>>> >>>> [2014-03-17 18:52:27,935] WARN >>>> {org.wso2.carbon.databridge.persistence.cassandra.datastore.CassandraConnector} >>>> - Secondary Index creation is not successful... >>>> me.prettyprint.hector.api.exceptions.HInvalidRequestException: >>>> InvalidRequestException(why:Illegal index name payload_actor.id_index). >>>> >>>> Actually, if you want to create secondary indexes, you can directly use >>>> 'Cassandra Keyspace' UI in management console too. But because you have >>>> dots in your column keys you are not allowed to do that in there too. I >>>> think it's better to use underscore instead of dot since those attributes >>>> are used as column keys. >>>> >>> >>> Even after I change attribute names it gives, >>> >>> [2014-03-18 11:20:05,512] WARN >>> {org.wso2.carbon.databridge.persistence.cassandra.datastore.CassandraConnector} >>> - Secondary Index creation is not successful... >>> me.prettyprint.hector.api.exceptions.HInvalidRequestException: >>> InvalidRequestException(why:Illegal index name payload_context_id_index) >>> >> >> I know this is an old email. :) Just read it. Hope you've already got >> solved the issue. Seems your index name started with a space character. >> That must be the reason for this error. >> >> Thanks, >> Bhathiya >> >> >>> >>> But even with (.) character within attribute name you can run "CREATE >>> INDEX ON" query on cqlsh without any trouble. >>> >>>> >>>> >>>> On Mon, Mar 17, 2014 at 6:47 PM, Udara Rathnayake <[email protected]>wrote: >>>> >>>>> >>>>> >>>>> >>>>> On Mon, Mar 17, 2014 at 11:09 PM, Inosh Goonewardena >>>>> <[email protected]>wrote: >>>>> >>>>>> On Mon, Mar 17, 2014 at 6:15 PM, Udara Rathnayake <[email protected]>wrote: >>>>>> >>>>>>> >>>>>>> Hi Inosh, >>>>>>> >>>>>>> On Mon, Mar 17, 2014 at 9:04 PM, Inosh Goonewardena <[email protected] >>>>>>> > wrote: >>>>>>> >>>>>>>> On Mon, Mar 17, 2014 at 4:13 PM, Udara Rathnayake >>>>>>>> <[email protected]>wrote: >>>>>>>> >>>>>>>>> Hi Inosh/Maninda, >>>>>>>>> >>>>>>>>> As per the chat I had with Maninda I have deployed a toolbox with >>>>>>>>> the following content. >>>>>>>>> >>>>>>>>> *wso2_social_data_publisher_def* >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> *{ 'streamId':'org.wso2.social.activity:4.0.0', >>>>>>>>> 'name':'org.wso2.social.activity', 'version':'4.0.0', >>>>>>>>> 'description': >>>>>>>>> 'store json object and mete-data describing each activity', >>>>>>>>> 'tags':['social', 'activity'], 'metaData':[ ], >>>>>>>>> 'correlationData':[ ], 'payloadData':[ >>>>>>>>> {'name':'id','type':'STRING'}, {'name':'context.id >>>>>>>>> <http://context.id>','type':'STRING'}, {'name':'actor.id >>>>>>>>> <http://actor.id>','type':'STRING'}, {'name':'tenant.id >>>>>>>>> <http://tenant.id>','type':'STRING'}, >>>>>>>>> {'name':'body','type':'STRING'} ]}* >>>>>>>>> >>>>>>>>> *streams.properties* >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> *streams.definitions=defn1streams.definitions.defn1.filename=wso2_social_data_publisher_def >>>>>>>>> streams.definitions.defn1.username=adminstreams.definitions.defn1.password=adminstreams.definitions.defn1.description=This >>>>>>>>> is the datastream published from wso2 >>>>>>>>> socialstreams.definitions.defn1.secondaryindexes=context.id >>>>>>>>> <http://context.id>,actor.id <http://actor.id>,tenant.id >>>>>>>>> <http://tenant.id> >>>>>>>>> streams.definitions.defn1.customindexes=context.id >>>>>>>>> <http://context.id>,id* >>>>>>>>> >>>>>>>>> Then I have published few activities using a simple client. >>>>>>>>> Everything(key-space creation, publishing activities) work >>>>>>>>> perfectly but I don't see any indexes when I browse the column family >>>>>>>>> though admin console. >>>>>>>>> >>>>>>>> >>>>>>>> In which keyspace did u check? IndexCF name is a random generated >>>>>>>> number and getting created in EVENT_INDEX_KEYSPACE. >>>>>>>> >>>>>>> >>>>>>> I checked column family information ( EVENT_KS > >>>>>>> org_wso2_social_activity) where we display Column Name, Validator Type, >>>>>>> Index Name, Actions details. For every colum index name value is "--NOT >>>>>>> INDEXED--". >>>>>>> >>>>>>> Yes. This is the correct place to check whether secondary indexes >>>>>> have been created. In your case it seems they are not created. >>>>>> >>>>>>> >>>>>>> Now I checked key-space information EVENT_INDEX_KS, still I don't >>>>>>> see any index related information there. >>>>>>> >>>>>> >>>>>> Here you have the Custom Index CFs. According to the current >>>>>> implementation separate CF created per index property. >>>>>> >>>>>> Can you share your toolbox with me so that I can have a look. >>>>>> >>>>> >>>>> Find the attached toolbox. >>>>> >>>>>> >>>>>>> Thanks for looking into this. >>>>>>> >>>>>>>> >>>>>>>>> I have used WSO2 BAM 2.4.1 alpha pack for this. >>>>>>>>> >>>>>>>>> What am I doing wrong here? >>>>>>>>> >>>>>>>>> Regards, >>>>>>>>> UdaraR >>>>>>>>> -- >>>>>>>>> *Udara Rathnayake* >>>>>>>>> Software Engineer >>>>>>>>> WSO2 Inc. : http://wso2.com >>>>>>>>> >>>>>>>>> Mobile : +94 772207239 >>>>>>>>> Twitter : http://twitter.com/udarakr >>>>>>>>> Blog : http://udarakr.blogspot.com >>>>>>>>> >>>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> -- >>>>>>>> Regards, >>>>>>>> >>>>>>>> Inosh Goonewardena >>>>>>>> Associate Technical Lead- WSO2 Inc. >>>>>>>> Mobile: +94779966317 >>>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> *Udara Rathnayake* >>>>>>> Software Engineer >>>>>>> WSO2 Inc. : http://wso2.com >>>>>>> >>>>>>> Mobile : +94 772207239 >>>>>>> Twitter : http://twitter.com/udarakr >>>>>>> Blog : http://udarakr.blogspot.com >>>>>>> >>>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> Regards, >>>>>> >>>>>> Inosh Goonewardena >>>>>> Associate Technical Lead- WSO2 Inc. >>>>>> Mobile: +94779966317 >>>>>> >>>>> >>>>> >>>>> >>>>> -- >>>>> *Udara Rathnayake* >>>>> Software Engineer >>>>> WSO2 Inc. : http://wso2.com >>>>> >>>>> Mobile : +94 772207239 >>>>> Twitter : http://twitter.com/udarakr >>>>> Blog : http://udarakr.blogspot.com >>>>> >>>>> >>>> >>>> >>>> -- >>>> Regards, >>>> >>>> Inosh Goonewardena >>>> Associate Technical Lead- WSO2 Inc. >>>> Mobile: +94779966317 >>>> >>> >>> >>> >>> -- >>> *Udara Rathnayake* >>> Software Engineer >>> WSO2 Inc. : http://wso2.com >>> >>> Mobile : +94 772207239 >>> Twitter : http://twitter.com/udarakr >>> Blog : http://udarakr.blogspot.com >>> >>> >>> _______________________________________________ >>> Dev mailing list >>> [email protected] >>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>> >>> >> >> >> -- >> *Bhathiya Jayasekara* >> *Software Engineer,* >> *WSO2 inc., http://wso2.com <http://wso2.com>* >> >> *Phone: +94715478185 <%2B94715478185>* >> *LinkedIn: http://www.linkedin.com/in/bhathiyaj >> <http://www.linkedin.com/in/bhathiyaj>* >> *Twitter: https://twitter.com/bhathiyax <https://twitter.com/bhathiyax>* >> *Blog: http://movingaheadblog.blogspot.com >> <http://movingaheadblog.blogspot.com/>* >> > > > > -- > *Udara Rathnayake* > Software Engineer > WSO2 Inc. : http://wso2.com > > Mobile : +94 772207239 > Twitter : http://twitter.com/udarakr > Blog : http://udarakr.blogspot.com > > -- Regards, Inosh Goonewardena Associate Technical Lead- WSO2 Inc. Mobile: +94779966317
_______________________________________________ Dev mailing list [email protected] http://wso2.org/cgi-bin/mailman/listinfo/dev
