Hi Inosh,
I tried the given toolbox, inside a fresh BAM 2.4.1 pack with the default
sample publisher. I still get the same warning[1].
I think this behavior has nothing to with my environment?
[1].
[2014-05-05 16:52:22,450] INFO
{org.wso2.carbon.bam.toolbox.deployer.core.BAMToolBoxDeployer} - Deploying
file:/home/udara/wso2/playground/wso2bam-2.4.1/repository/deployment/server/bam-toolbox/KPI_Phone_Retail_Store.tbox
[2014-05-05 16:52:22,944] INFO
{org.wso2.carbon.databridge.core.DataBridge} - admin connected
[2014-05-05 16:52:22,950] INFO
{org.wso2.carbon.databridge.streamdefn.registry.datastore.RegistryStreamDefinitionStore}
- Stream definition added to registry successfully :
org.wso2.bam.phone.retail.store.kpi:1.0.0
[2014-05-05 16:52:23,005] INFO
{org.wso2.carbon.ntask.core.impl.AbstractQuartzTaskManager} - Task
scheduled: [-1234][HIVE_TASK][phone_retail_store_script]
[2014-05-05 16:52:23,393] INFO
{org.wso2.carbon.bam.toolbox.deployer.core.BAMToolBoxDeployer} - Deployed
successfully file:
/home/udara/wso2/playground/wso2bam-2.4.1/repository/deployment/server/bam-toolbox/KPI_Phone_Retail_Store.tbox
[2014-05-05 16:52:31,154] INFO
{org.wso2.carbon.core.services.util.CarbonAuthenticationUtil} -
'[email protected] [-1234]' logged in at [2014-05-05 16:52:31,154+0530]
[2014-05-05 16:54:28,562] INFO
{org.wso2.carbon.databridge.core.DataBridge} - admin connected
[2014-05-05 16:54:28,607] INFO
{org.wso2.carbon.databridge.persistence.cassandra.datastore.ClusterFactory}
- Initializing cluster
[2014-05-05 16:54:30,593] INFO
{org.wso2.carbon.databridge.core.DataBridge} -
f95ff042-07db-4a28-8035-fc5189edfef6 disconnected
[2014-05-05 16:55:12,440] WARN
{org.wso2.carbon.databridge.persistence.cassandra.datastore.CassandraConnector}
- Secondary Index creation is not successful...
me.prettyprint.hector.api.exceptions.HInvalidRequestException:
InvalidRequestException(why:Illegal index name payload_brand_index)
Regards,
UdaraR
On Mon, May 5, 2014 at 4:38 PM, Inosh Goonewardena <[email protected]> wrote:
> Hi Udara,
>
> I couldn't try with your toolbox since I was unable to get your sample
> data publisher to work in the first go. Since I am on site I didn't spend
> time on fixing data publisher issue. However, I have tested secondary index
> creation with kpi-definition toolbox we ship with BAM by adding same
> attribute('brand') as secondary index and it is working properly. Please
> find the attached kpi-definition toolbox. Deploy it and publish data by
> using the standard samples. So until I further investigate what is wrong in
> your scenario, please use the working toolbox that I have attached and try
> to make your sample working.
>
>
> On Mon, May 5, 2014 at 11:29 AM, Udara Rathnayake <[email protected]> wrote:
>
>> Hi Inosh,
>>
>> Please find the modified kpi-definition sample which I have used to
>> publish data.
>>
>> Regards,
>> UdaraR
>>
>>
>> On Mon, May 5, 2014 at 1:32 PM, Udara Rathnayake <[email protected]> wrote:
>>
>>> Hi Inosh,
>>>
>>> I have attached the toolbox, Please note that I have modified HL7.tbox
>>> to suits with the kpi-definition BAM sample[1].
>>> In addition I have introduced 'brand' secondary index and modified
>>> kpi-definition sample[1] accordingly.
>>> Thanks.
>>>
>>> [1] <BAM_2.4.1_HOME>/samples/kpi-definition
>>>
>>> Regards,
>>> UdaraR
>>>
>>>
>>> On Mon, May 5, 2014 at 1:18 PM, Inosh Goonewardena <[email protected]>wrote:
>>>
>>>> Hi Udara,
>>>>
>>>> Please attach your toolbox
>>>>
>>>>
>>>> On Mon, May 5, 2014 at 9:02 AM, Udara Rathnayake <[email protected]>wrote:
>>>>
>>>>> Hi all,
>>>>>
>>>>> I tried the same toolbox in released BAM 2.4.1[1]. But still I get the
>>>>> same secondary index creation failure,
>>>>>
>>>>> [2014-05-05 12:06:50,248] WARN
>>>>> {org.wso2.carbon.databridge.persistence.cassandra.datastore.CassandraConnector}
>>>>> - Secondary Index creation is not successful...
>>>>> me.prettyprint.hector.api.exceptions.HInvalidRequestException:
>>>>> InvalidRequestException(why:Illegal index name payload_brand_index)
>>>>>
>>>>> Everything(toolbox deployment,Stream definition creation in
>>>>> registry,event publish to Cassandra) works as expected, only secondary
>>>>> index creation fails with the above warning.
>>>>> Please note that I'm not using customindexes here, only secondary
>>>>> indexes.
>>>>>
>>>>> @Bhathiya,
>>>>>
>>>>> In my toolbox I have following,
>>>>>
>>>>> streams.definitions=defn1
>>>>> streams.definitions.defn1.filename=org.wso2.social.activity
>>>>> streams.definitions.defn1.username=admin
>>>>> streams.definitions.defn1.password=admin
>>>>> streams.definitions.defn1.description=This is the datastream for
>>>>> social framework
>>>>> streams.definitions.defn1.secondaryindexes=brand
>>>>>
>>>>> I don't see any space character in this definition(This is the same
>>>>> which I have used early as well).
>>>>> I guess you made the above comment based on the warning
>>>>> message(why:Illegal index name payload_brand_index)
>>>>>
>>>>> [1] http://ec2-54-198-211-48.compute-1.amazonaws.com/chunk09/wso2bam
>>>>> -2.4.1.zip
>>>>>
>>>>> Regards,
>>>>> UdaraR
>>>>>
>>>>>
>>>>> On Tue, Apr 22, 2014 at 2:55 AM, Bhathiya Jayasekara <
>>>>> [email protected]> wrote:
>>>>>
>>>>>> Hi Udara,
>>>>>>
>>>>>> On Mon, Mar 17, 2014 at 10:56 PM, Udara Rathnayake
>>>>>> <[email protected]>wrote:
>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On Mon, Mar 17, 2014 at 11:42 PM, Inosh Goonewardena <[email protected]
>>>>>>> > wrote:
>>>>>>>
>>>>>>>> Hi Udara,
>>>>>>>>
>>>>>>>> I have deployed your toolbox and check. Actually, custom index are
>>>>>>>> getting created properly. Following are the corresponding IndexCF for
>>>>>>>> the
>>>>>>>> custom index properties you have defined.
>>>>>>>>
>>>>>>>> 867513878
>>>>>>>> 489450871
>>>>>>>>
>>>>>>>> But there is a problem with secondary index creation. It's because
>>>>>>>> there are dots('.') in attribute names. Following logs prints in
>>>>>>>> console
>>>>>>>> when deploying the toolbox.
>>>>>>>>
>>>>>>>> [2014-03-17 18:52:27,935] WARN
>>>>>>>> {org.wso2.carbon.databridge.persistence.cassandra.datastore.CassandraConnector}
>>>>>>>> - Secondary Index creation is not successful...
>>>>>>>> me.prettyprint.hector.api.exceptions.HInvalidRequestException:
>>>>>>>> InvalidRequestException(why:Illegal index name payload_actor.id_index).
>>>>>>>>
>>>>>>>> Actually, if you want to create secondary indexes, you can directly
>>>>>>>> use 'Cassandra Keyspace' UI in management console too. But because you
>>>>>>>> have
>>>>>>>> dots in your column keys you are not allowed to do that in there too. I
>>>>>>>> think it's better to use underscore instead of dot since those
>>>>>>>> attributes
>>>>>>>> are used as column keys.
>>>>>>>>
>>>>>>>
>>>>>>> Even after I change attribute names it gives,
>>>>>>>
>>>>>>> [2014-03-18 11:20:05,512] WARN
>>>>>>> {org.wso2.carbon.databridge.persistence.cassandra.datastore.CassandraConnector}
>>>>>>> - Secondary Index creation is not successful...
>>>>>>> me.prettyprint.hector.api.exceptions.HInvalidRequestException:
>>>>>>> InvalidRequestException(why:Illegal index name
>>>>>>> payload_context_id_index)
>>>>>>>
>>>>>>
>>>>>> I know this is an old email. :) Just read it. Hope you've already got
>>>>>> solved the issue. Seems your index name started with a space character.
>>>>>> That must be the reason for this error.
>>>>>>
>>>>>> Thanks,
>>>>>> Bhathiya
>>>>>>
>>>>>>
>>>>>>>
>>>>>>> But even with (.) character within attribute name you can run
>>>>>>> "CREATE INDEX ON" query on cqlsh without any trouble.
>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> On Mon, Mar 17, 2014 at 6:47 PM, Udara Rathnayake
>>>>>>>> <[email protected]>wrote:
>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On Mon, Mar 17, 2014 at 11:09 PM, Inosh Goonewardena <
>>>>>>>>> [email protected]> wrote:
>>>>>>>>>
>>>>>>>>>> On Mon, Mar 17, 2014 at 6:15 PM, Udara Rathnayake <
>>>>>>>>>> [email protected]> wrote:
>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> Hi Inosh,
>>>>>>>>>>>
>>>>>>>>>>> On Mon, Mar 17, 2014 at 9:04 PM, Inosh Goonewardena <
>>>>>>>>>>> [email protected]> wrote:
>>>>>>>>>>>
>>>>>>>>>>>> On Mon, Mar 17, 2014 at 4:13 PM, Udara Rathnayake <
>>>>>>>>>>>> [email protected]> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>>> Hi Inosh/Maninda,
>>>>>>>>>>>>>
>>>>>>>>>>>>> As per the chat I had with Maninda I have deployed a toolbox
>>>>>>>>>>>>> with the following content.
>>>>>>>>>>>>>
>>>>>>>>>>>>> *wso2_social_data_publisher_def*
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> *{ 'streamId':'org.wso2.social.activity:4.0.0',
>>>>>>>>>>>>> 'name':'org.wso2.social.activity', 'version':'4.0.0',
>>>>>>>>>>>>> 'description':
>>>>>>>>>>>>> 'store json object and mete-data describing each activity',
>>>>>>>>>>>>> 'tags':['social', 'activity'], 'metaData':[ ],
>>>>>>>>>>>>> 'correlationData':[ ], 'payloadData':[
>>>>>>>>>>>>> {'name':'id','type':'STRING'}, {'name':'context.id
>>>>>>>>>>>>> <http://context.id>','type':'STRING'}, {'name':'actor.id
>>>>>>>>>>>>> <http://actor.id>','type':'STRING'}, {'name':'tenant.id
>>>>>>>>>>>>> <http://tenant.id>','type':'STRING'},
>>>>>>>>>>>>> {'name':'body','type':'STRING'} ]}*
>>>>>>>>>>>>>
>>>>>>>>>>>>> *streams.properties*
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> *streams.definitions=defn1streams.definitions.defn1.filename=wso2_social_data_publisher_def
>>>>>>>>>>>>> streams.definitions.defn1.username=adminstreams.definitions.defn1.password=adminstreams.definitions.defn1.description=This
>>>>>>>>>>>>> is the datastream published from wso2
>>>>>>>>>>>>> socialstreams.definitions.defn1.secondaryindexes=context.id
>>>>>>>>>>>>> <http://context.id>,actor.id <http://actor.id>,tenant.id
>>>>>>>>>>>>> <http://tenant.id>
>>>>>>>>>>>>> streams.definitions.defn1.customindexes=context.id
>>>>>>>>>>>>> <http://context.id>,id*
>>>>>>>>>>>>>
>>>>>>>>>>>>> Then I have published few activities using a simple client.
>>>>>>>>>>>>> Everything(key-space creation, publishing activities) work
>>>>>>>>>>>>> perfectly but I don't see any indexes when I browse the column
>>>>>>>>>>>>> family
>>>>>>>>>>>>> though admin console.
>>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> In which keyspace did u check? IndexCF name is a random
>>>>>>>>>>>> generated number and getting created in EVENT_INDEX_KEYSPACE.
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> I checked column family information ( EVENT_KS >
>>>>>>>>>>> org_wso2_social_activity) where we display Column Name, Validator
>>>>>>>>>>> Type,
>>>>>>>>>>> Index Name, Actions details. For every colum index name value is
>>>>>>>>>>> "--NOT
>>>>>>>>>>> INDEXED--".
>>>>>>>>>>>
>>>>>>>>>>> Yes. This is the correct place to check whether secondary
>>>>>>>>>> indexes have been created. In your case it seems they are not
>>>>>>>>>> created.
>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> Now I checked key-space information EVENT_INDEX_KS, still I
>>>>>>>>>>> don't see any index related information there.
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Here you have the Custom Index CFs. According to the current
>>>>>>>>>> implementation separate CF created per index property.
>>>>>>>>>>
>>>>>>>>>> Can you share your toolbox with me so that I can have a look.
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Find the attached toolbox.
>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>> Thanks for looking into this.
>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>> I have used WSO2 BAM 2.4.1 alpha pack for this.
>>>>>>>>>>>>>
>>>>>>>>>>>>> What am I doing wrong here?
>>>>>>>>>>>>>
>>>>>>>>>>>>> Regards,
>>>>>>>>>>>>> UdaraR
>>>>>>>>>>>>> --
>>>>>>>>>>>>> *Udara Rathnayake*
>>>>>>>>>>>>> Software Engineer
>>>>>>>>>>>>> WSO2 Inc. : http://wso2.com
>>>>>>>>>>>>>
>>>>>>>>>>>>> Mobile : +94 772207239
>>>>>>>>>>>>> Twitter : http://twitter.com/udarakr
>>>>>>>>>>>>> Blog : http://udarakr.blogspot.com
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> --
>>>>>>>>>>>> Regards,
>>>>>>>>>>>>
>>>>>>>>>>>> Inosh Goonewardena
>>>>>>>>>>>> Associate Technical Lead- WSO2 Inc.
>>>>>>>>>>>> Mobile: +94779966317
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> --
>>>>>>>>>>> *Udara Rathnayake*
>>>>>>>>>>> Software Engineer
>>>>>>>>>>> WSO2 Inc. : http://wso2.com
>>>>>>>>>>>
>>>>>>>>>>> Mobile : +94 772207239
>>>>>>>>>>> Twitter : http://twitter.com/udarakr
>>>>>>>>>>> Blog : http://udarakr.blogspot.com
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>> Regards,
>>>>>>>>>>
>>>>>>>>>> Inosh Goonewardena
>>>>>>>>>> Associate Technical Lead- WSO2 Inc.
>>>>>>>>>> Mobile: +94779966317
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> *Udara Rathnayake*
>>>>>>>>> Software Engineer
>>>>>>>>> WSO2 Inc. : http://wso2.com
>>>>>>>>>
>>>>>>>>> Mobile : +94 772207239
>>>>>>>>> Twitter : http://twitter.com/udarakr
>>>>>>>>> Blog : http://udarakr.blogspot.com
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> Regards,
>>>>>>>>
>>>>>>>> Inosh Goonewardena
>>>>>>>> Associate Technical Lead- WSO2 Inc.
>>>>>>>> Mobile: +94779966317
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> *Udara Rathnayake*
>>>>>>> Software Engineer
>>>>>>> WSO2 Inc. : http://wso2.com
>>>>>>>
>>>>>>> Mobile : +94 772207239
>>>>>>> Twitter : http://twitter.com/udarakr
>>>>>>> Blog : http://udarakr.blogspot.com
>>>>>>>
>>>>>>>
>>>>>>> _______________________________________________
>>>>>>> Dev mailing list
>>>>>>> [email protected]
>>>>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> *Bhathiya Jayasekara*
>>>>>> *Software Engineer,*
>>>>>> *WSO2 inc., http://wso2.com <http://wso2.com>*
>>>>>>
>>>>>> *Phone: +94715478185 <%2B94715478185>*
>>>>>> *LinkedIn: http://www.linkedin.com/in/bhathiyaj
>>>>>> <http://www.linkedin.com/in/bhathiyaj>*
>>>>>> *Twitter: https://twitter.com/bhathiyax
>>>>>> <https://twitter.com/bhathiyax>*
>>>>>> *Blog: http://movingaheadblog.blogspot.com
>>>>>> <http://movingaheadblog.blogspot.com/>*
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> *Udara Rathnayake*
>>>>> Software Engineer
>>>>> WSO2 Inc. : http://wso2.com
>>>>>
>>>>> Mobile : +94 772207239
>>>>> Twitter : http://twitter.com/udarakr
>>>>> Blog : http://udarakr.blogspot.com
>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> Regards,
>>>>
>>>> Inosh Goonewardena
>>>> Associate Technical Lead- WSO2 Inc.
>>>> Mobile: +94779966317
>>>>
>>>
>>>
>>>
>>> --
>>> *Udara Rathnayake*
>>> Software Engineer
>>> WSO2 Inc. : http://wso2.com
>>>
>>> Mobile : +94 772207239
>>> Twitter : http://twitter.com/udarakr
>>> Blog : http://udarakr.blogspot.com
>>>
>>>
>>
>>
>> --
>> *Udara Rathnayake*
>> Software Engineer
>> WSO2 Inc. : http://wso2.com
>>
>> Mobile : +94 772207239
>> Twitter : http://twitter.com/udarakr
>> Blog : http://udarakr.blogspot.com
>>
>>
>
>
> --
> Regards,
>
> Inosh Goonewardena
> Associate Technical Lead- WSO2 Inc.
> Mobile: +94779966317
>
--
*Udara Rathnayake*
Software Engineer
WSO2 Inc. : http://wso2.com
Mobile : +94 772207239
Twitter : http://twitter.com/udarakr
Blog : http://udarakr.blogspot.com
_______________________________________________
Dev mailing list
[email protected]
http://wso2.org/cgi-bin/mailman/listinfo/dev
