gora-trunk - Build # 1729 - Still Failing

2017-08-23 Thread Apache Jenkins Server
The Apache Jenkins build system has built gora-trunk (build #1729)

Status: Still Failing

Check console output at https://builds.apache.org/job/gora-trunk/1729/ to view 
the results.

Re: [DISCUSS] Prepare Gora 0.8 Release Candidate?

2017-08-23 Thread Kevin Ratnasekera
Hi Lewis,

I do have some work to be pushed for PR [1] I will get this done merged to
master. I think it will be great if we can push this to release as well.

[1] https://github.com/apache/gora/pull/112

Regards
Kevin

On Thu, Aug 24, 2017 at 2:49 AM, lewis john mcgibbney 
wrote:

> Hi Folks,
> I think it would be good for us to think about preparing and VOTE'ing on an
> RC for 0.8.
> Is there anything we want to get into the codebase before we think about
> rolling one?
> Thanks
> Lewis
>
> --
> http://home.apache.org/~lewismc/
> @hectorMcSpector
> http://www.linkedin.com/in/lmcgibbney
>


[GitHub] gora pull request #120: Refactoring cassandra-cql module

2017-08-23 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/gora/pull/120


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[DISCUSS] Prepare Gora 0.8 Release Candidate?

2017-08-23 Thread lewis john mcgibbney
Hi Folks,
I think it would be good for us to think about preparing and VOTE'ing on an
RC for 0.8.
Is there anything we want to get into the codebase before we think about
rolling one?
Thanks
Lewis

-- 
http://home.apache.org/~lewismc/
@hectorMcSpector
http://www.linkedin.com/in/lmcgibbney


[jira] [Assigned] (GORA-298) Implement CassandraStore#getPartitions

2017-08-23 Thread Lewis John McGibbney (JIRA)

 [ 
https://issues.apache.org/jira/browse/GORA-298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney reassigned GORA-298:
-

Assignee: Madhawa Gunasekara

> Implement CassandraStore#getPartitions
> --
>
> Key: GORA-298
> URL: https://issues.apache.org/jira/browse/GORA-298
> Project: Apache Gora
>  Issue Type: Improvement
>  Components: gora-cassandra
>Affects Versions: 0.3
>Reporter: Lewis John McGibbney
>Assignee: Madhawa Gunasekara
> Fix For: 0.8
>
>
> It is noted that getParitions always returns one data partition from the 
> cluster.
> We need to fix this to successfully support MR in gora-cassandra.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


gora-trunk - Build # 1727 - Failure

2017-08-23 Thread Apache Jenkins Server
The Apache Jenkins build system has built gora-trunk (build #1727)

Status: Failure

Check console output at https://builds.apache.org/job/gora-trunk/1727/ to view 
the results.

[jira] [Commented] (GORA-298) Implement CassandraStore#getPartitions

2017-08-23 Thread Madhawa Gunasekara (JIRA)

[ 
https://issues.apache.org/jira/browse/GORA-298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139137#comment-16139137
 ] 

Madhawa Gunasekara commented on GORA-298:
-

Hi [~lewismc],

I haven't implemented this in GORA-497, I will look into this issue and fix 
this. 

Thanks,
Madhawa

> Implement CassandraStore#getPartitions
> --
>
> Key: GORA-298
> URL: https://issues.apache.org/jira/browse/GORA-298
> Project: Apache Gora
>  Issue Type: Improvement
>  Components: gora-cassandra
>Affects Versions: 0.3
>Reporter: Lewis John McGibbney
> Fix For: 0.8
>
>
> It is noted that getParitions always returns one data partition from the 
> cluster.
> We need to fix this to successfully support MR in gora-cassandra.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Assigned] (GORA-269) Add parameter for setting port used in the Cassandra Module

2017-08-23 Thread Lewis John McGibbney (JIRA)

 [ 
https://issues.apache.org/jira/browse/GORA-269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney reassigned GORA-269:
-

Assignee: Madhawa Gunasekara

> Add parameter for setting port used in the Cassandra Module
> ---
>
> Key: GORA-269
> URL: https://issues.apache.org/jira/browse/GORA-269
> Project: Apache Gora
>  Issue Type: Bug
>  Components: gora-cassandra
>Affects Versions: 0.4
>Reporter: Renato Javier Marroquín Mogrovejo
>Assignee: Madhawa Gunasekara
>Priority: Minor
> Fix For: 0.8
>
>
> We should add the port used when connecting to a Cassandra cluster. Right now 
> in both files (gora-mapping and gora-properties) we have to set the server 
> name along with the port, but this is sometimes confusing for users. 
>  gora.cassandrastore.servers=myserver:9160
> So adding:
>  gora.cassandrastore.port
> and:
>  PORT 
> inside the mapping file.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Resolved] (GORA-269) Add parameter for setting port used in the Cassandra Module

2017-08-23 Thread Lewis John McGibbney (JIRA)

 [ 
https://issues.apache.org/jira/browse/GORA-269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney resolved GORA-269.
---
Resolution: Fixed

implemented in GORA-497

> Add parameter for setting port used in the Cassandra Module
> ---
>
> Key: GORA-269
> URL: https://issues.apache.org/jira/browse/GORA-269
> Project: Apache Gora
>  Issue Type: Bug
>  Components: gora-cassandra
>Affects Versions: 0.4
>Reporter: Renato Javier Marroquín Mogrovejo
>Assignee: Madhawa Gunasekara
>Priority: Minor
> Fix For: 0.8
>
>
> We should add the port used when connecting to a Cassandra cluster. Right now 
> in both files (gora-mapping and gora-properties) we have to set the server 
> name along with the port, but this is sometimes confusing for users. 
>  gora.cassandrastore.servers=myserver:9160
> So adding:
>  gora.cassandrastore.port
> and:
>  PORT 
> inside the mapping file.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Assigned] (GORA-308) deleteByQuery() method is not implemented in CassandraStore

2017-08-23 Thread Lewis John McGibbney (JIRA)

 [ 
https://issues.apache.org/jira/browse/GORA-308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney reassigned GORA-308:
-

Assignee: Madhawa Gunasekara

> deleteByQuery() method is not implemented in CassandraStore
> ---
>
> Key: GORA-308
> URL: https://issues.apache.org/jira/browse/GORA-308
> Project: Apache Gora
>  Issue Type: Task
>  Components: gora-cassandra
>Affects Versions: 0.4
>Reporter: Lewis John McGibbney
>Assignee: Madhawa Gunasekara
> Fix For: 0.8
>
>
> This issue links to GORA-154 and should simply implement 
> CassandraStore#deleteByQuery()



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Resolved] (GORA-308) deleteByQuery() method is not implemented in CassandraStore

2017-08-23 Thread Lewis John McGibbney (JIRA)

 [ 
https://issues.apache.org/jira/browse/GORA-308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney resolved GORA-308.
---
Resolution: Fixed

implemented in GORA-497

> deleteByQuery() method is not implemented in CassandraStore
> ---
>
> Key: GORA-308
> URL: https://issues.apache.org/jira/browse/GORA-308
> Project: Apache Gora
>  Issue Type: Task
>  Components: gora-cassandra
>Affects Versions: 0.4
>Reporter: Lewis John McGibbney
>Assignee: Madhawa Gunasekara
> Fix For: 0.8
>
>
> This issue links to GORA-154 and should simply implement 
> CassandraStore#deleteByQuery()



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (GORA-269) Add parameter for setting port used in the Cassandra Module

2017-08-23 Thread Madhawa Gunasekara (JIRA)

[ 
https://issues.apache.org/jira/browse/GORA-269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139122#comment-16139122
 ] 

Madhawa Gunasekara commented on GORA-269:
-

Hi [~lewismc], 

Yes, I have implemented this. users need to use "gora.cassandrastore.port" 
property to set the port

Thanks,
Madhawa

> Add parameter for setting port used in the Cassandra Module
> ---
>
> Key: GORA-269
> URL: https://issues.apache.org/jira/browse/GORA-269
> Project: Apache Gora
>  Issue Type: Bug
>  Components: gora-cassandra
>Affects Versions: 0.4
>Reporter: Renato Javier Marroquín Mogrovejo
>Priority: Minor
> Fix For: 0.8
>
>
> We should add the port used when connecting to a Cassandra cluster. Right now 
> in both files (gora-mapping and gora-properties) we have to set the server 
> name along with the port, but this is sometimes confusing for users. 
>  gora.cassandrastore.servers=myserver:9160
> So adding:
>  gora.cassandrastore.port
> and:
>  PORT 
> inside the mapping file.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (GORA-308) deleteByQuery() method is not implemented in CassandraStore

2017-08-23 Thread Madhawa Gunasekara (JIRA)

[ 
https://issues.apache.org/jira/browse/GORA-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139119#comment-16139119
 ] 

Madhawa Gunasekara commented on GORA-308:
-

Hi [~lewismc], 

Yes, I have implemented this. and also enabled the tests in TestBaseDataStore 
as well.

Thanks,
Madhawa

> deleteByQuery() method is not implemented in CassandraStore
> ---
>
> Key: GORA-308
> URL: https://issues.apache.org/jira/browse/GORA-308
> Project: Apache Gora
>  Issue Type: Task
>  Components: gora-cassandra
>Affects Versions: 0.4
>Reporter: Lewis John McGibbney
> Fix For: 0.8
>
>
> This issue links to GORA-154 and should simply implement 
> CassandraStore#deleteByQuery()



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Resolved] (GORA-299) o.a.g.cassandra.CassandraStore#newQuery() should not use query.setFields(getFieldsToQuery(null));

2017-08-23 Thread Lewis John McGibbney (JIRA)

 [ 
https://issues.apache.org/jira/browse/GORA-299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney resolved GORA-299.
---
Resolution: Fixed

Implemented in GORA-497

> o.a.g.cassandra.CassandraStore#newQuery() should not use 
> query.setFields(getFieldsToQuery(null));
> -
>
> Key: GORA-299
> URL: https://issues.apache.org/jira/browse/GORA-299
> Project: Apache Gora
>  Issue Type: Improvement
>  Components: gora-cassandra
>Affects Versions: 0.3
>Reporter: Lewis John McGibbney
>Assignee: Madhawa Gunasekara
> Fix For: 0.8
>
>
> o.a.g.store.impl.DataStoreBase#getFieldsToQuery states
> {code:title=DataStoreBase.java|borderStyle=solid}
> /** Checks whether the fields argument is null, 
>   * and if so returns all the fields of the Persistent object, 
>   * else returns the argument.
>   */
> {code}
> Right now we do not have the functionality to do field queries in 
> CassandraStore so we need to implement this. Hence the reason the following 
> tests are skipped
> {code:title=TestCassandraStore.java|borderStyle=solid}
>   @Ignore("skipped until some bugs are fixed")
>   @Override
>   public void testQuery() throws IOException {}
>   @Ignore("skipped until some bugs are fixed")
>   @Override
>   public void testQueryStartKey() throws IOException {}
>   @Ignore("skipped until some bugs are fixed")
>   @Override
>   public void testQueryEndKey() throws IOException {}
>   @Ignore("skipped until some bugs are fixed")
>   @Override
>   public void testQueryKeyRange() throws IOException {}
>   @Ignore("skipped until some bugs are fixed")
>   @Override
>   public void testQueryWebPageSingleKey() throws IOException {}
>   @Ignore("skipped until some bugs are fixed")
>   @Override
>   public void testQueryWebPageSingleKeyDefaultFields() throws IOException {}
>   @Ignore("skipped until some bugs are fixed")
>   @Override
>   public void testQueryWebPageQueryEmptyResults() throws IOException {}
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Assigned] (GORA-299) o.a.g.cassandra.CassandraStore#newQuery() should not use query.setFields(getFieldsToQuery(null));

2017-08-23 Thread Lewis John McGibbney (JIRA)

 [ 
https://issues.apache.org/jira/browse/GORA-299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney reassigned GORA-299:
-

Assignee: Madhawa Gunasekara

> o.a.g.cassandra.CassandraStore#newQuery() should not use 
> query.setFields(getFieldsToQuery(null));
> -
>
> Key: GORA-299
> URL: https://issues.apache.org/jira/browse/GORA-299
> Project: Apache Gora
>  Issue Type: Improvement
>  Components: gora-cassandra
>Affects Versions: 0.3
>Reporter: Lewis John McGibbney
>Assignee: Madhawa Gunasekara
> Fix For: 0.8
>
>
> o.a.g.store.impl.DataStoreBase#getFieldsToQuery states
> {code:title=DataStoreBase.java|borderStyle=solid}
> /** Checks whether the fields argument is null, 
>   * and if so returns all the fields of the Persistent object, 
>   * else returns the argument.
>   */
> {code}
> Right now we do not have the functionality to do field queries in 
> CassandraStore so we need to implement this. Hence the reason the following 
> tests are skipped
> {code:title=TestCassandraStore.java|borderStyle=solid}
>   @Ignore("skipped until some bugs are fixed")
>   @Override
>   public void testQuery() throws IOException {}
>   @Ignore("skipped until some bugs are fixed")
>   @Override
>   public void testQueryStartKey() throws IOException {}
>   @Ignore("skipped until some bugs are fixed")
>   @Override
>   public void testQueryEndKey() throws IOException {}
>   @Ignore("skipped until some bugs are fixed")
>   @Override
>   public void testQueryKeyRange() throws IOException {}
>   @Ignore("skipped until some bugs are fixed")
>   @Override
>   public void testQueryWebPageSingleKey() throws IOException {}
>   @Ignore("skipped until some bugs are fixed")
>   @Override
>   public void testQueryWebPageSingleKeyDefaultFields() throws IOException {}
>   @Ignore("skipped until some bugs are fixed")
>   @Override
>   public void testQueryWebPageQueryEmptyResults() throws IOException {}
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (GORA-299) o.a.g.cassandra.CassandraStore#newQuery() should not use query.setFields(getFieldsToQuery(null));

2017-08-23 Thread Madhawa Gunasekara (JIRA)

[ 
https://issues.apache.org/jira/browse/GORA-299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139115#comment-16139115
 ] 

Madhawa Gunasekara commented on GORA-299:
-

Hi [~lewismc],

Yes, I have implemented this.  and also I have enable the test cases as well. 

Thanks,
Madhawa

> o.a.g.cassandra.CassandraStore#newQuery() should not use 
> query.setFields(getFieldsToQuery(null));
> -
>
> Key: GORA-299
> URL: https://issues.apache.org/jira/browse/GORA-299
> Project: Apache Gora
>  Issue Type: Improvement
>  Components: gora-cassandra
>Affects Versions: 0.3
>Reporter: Lewis John McGibbney
> Fix For: 0.8
>
>
> o.a.g.store.impl.DataStoreBase#getFieldsToQuery states
> {code:title=DataStoreBase.java|borderStyle=solid}
> /** Checks whether the fields argument is null, 
>   * and if so returns all the fields of the Persistent object, 
>   * else returns the argument.
>   */
> {code}
> Right now we do not have the functionality to do field queries in 
> CassandraStore so we need to implement this. Hence the reason the following 
> tests are skipped
> {code:title=TestCassandraStore.java|borderStyle=solid}
>   @Ignore("skipped until some bugs are fixed")
>   @Override
>   public void testQuery() throws IOException {}
>   @Ignore("skipped until some bugs are fixed")
>   @Override
>   public void testQueryStartKey() throws IOException {}
>   @Ignore("skipped until some bugs are fixed")
>   @Override
>   public void testQueryEndKey() throws IOException {}
>   @Ignore("skipped until some bugs are fixed")
>   @Override
>   public void testQueryKeyRange() throws IOException {}
>   @Ignore("skipped until some bugs are fixed")
>   @Override
>   public void testQueryWebPageSingleKey() throws IOException {}
>   @Ignore("skipped until some bugs are fixed")
>   @Override
>   public void testQueryWebPageSingleKeyDefaultFields() throws IOException {}
>   @Ignore("skipped until some bugs are fixed")
>   @Override
>   public void testQueryWebPageQueryEmptyResults() throws IOException {}
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (GORA-308) deleteByQuery() method is not implemented in CassandraStore

2017-08-23 Thread Lewis John McGibbney (JIRA)

[ 
https://issues.apache.org/jira/browse/GORA-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139105#comment-16139105
 ] 

Lewis John McGibbney commented on GORA-308:
---

[~madhawa] is this implemented in GORA-497 ?

> deleteByQuery() method is not implemented in CassandraStore
> ---
>
> Key: GORA-308
> URL: https://issues.apache.org/jira/browse/GORA-308
> Project: Apache Gora
>  Issue Type: Task
>  Components: gora-cassandra
>Affects Versions: 0.4
>Reporter: Lewis John McGibbney
> Fix For: 0.8
>
>
> This issue links to GORA-154 and should simply implement 
> CassandraStore#deleteByQuery()



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (GORA-299) o.a.g.cassandra.CassandraStore#newQuery() should not use query.setFields(getFieldsToQuery(null));

2017-08-23 Thread Lewis John McGibbney (JIRA)

[ 
https://issues.apache.org/jira/browse/GORA-299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139106#comment-16139106
 ] 

Lewis John McGibbney commented on GORA-299:
---

[~madhawa] is this implemented in GORA-497 ?

> o.a.g.cassandra.CassandraStore#newQuery() should not use 
> query.setFields(getFieldsToQuery(null));
> -
>
> Key: GORA-299
> URL: https://issues.apache.org/jira/browse/GORA-299
> Project: Apache Gora
>  Issue Type: Improvement
>  Components: gora-cassandra
>Affects Versions: 0.3
>Reporter: Lewis John McGibbney
> Fix For: 0.8
>
>
> o.a.g.store.impl.DataStoreBase#getFieldsToQuery states
> {code:title=DataStoreBase.java|borderStyle=solid}
> /** Checks whether the fields argument is null, 
>   * and if so returns all the fields of the Persistent object, 
>   * else returns the argument.
>   */
> {code}
> Right now we do not have the functionality to do field queries in 
> CassandraStore so we need to implement this. Hence the reason the following 
> tests are skipped
> {code:title=TestCassandraStore.java|borderStyle=solid}
>   @Ignore("skipped until some bugs are fixed")
>   @Override
>   public void testQuery() throws IOException {}
>   @Ignore("skipped until some bugs are fixed")
>   @Override
>   public void testQueryStartKey() throws IOException {}
>   @Ignore("skipped until some bugs are fixed")
>   @Override
>   public void testQueryEndKey() throws IOException {}
>   @Ignore("skipped until some bugs are fixed")
>   @Override
>   public void testQueryKeyRange() throws IOException {}
>   @Ignore("skipped until some bugs are fixed")
>   @Override
>   public void testQueryWebPageSingleKey() throws IOException {}
>   @Ignore("skipped until some bugs are fixed")
>   @Override
>   public void testQueryWebPageSingleKeyDefaultFields() throws IOException {}
>   @Ignore("skipped until some bugs are fixed")
>   @Override
>   public void testQueryWebPageQueryEmptyResults() throws IOException {}
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (GORA-298) Implement CassandraStore#getPartitions

2017-08-23 Thread Lewis John McGibbney (JIRA)

[ 
https://issues.apache.org/jira/browse/GORA-298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139108#comment-16139108
 ] 

Lewis John McGibbney commented on GORA-298:
---

[~madhawa] is this implemented in GORA-497 ?

> Implement CassandraStore#getPartitions
> --
>
> Key: GORA-298
> URL: https://issues.apache.org/jira/browse/GORA-298
> Project: Apache Gora
>  Issue Type: Improvement
>  Components: gora-cassandra
>Affects Versions: 0.3
>Reporter: Lewis John McGibbney
> Fix For: 0.8
>
>
> It is noted that getParitions always returns one data partition from the 
> cluster.
> We need to fix this to successfully support MR in gora-cassandra.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Resolved] (GORA-107) Fully annotate Javadoc's for methods in org.apache.gora.cassandra.store.*

2017-08-23 Thread Lewis John McGibbney (JIRA)

 [ 
https://issues.apache.org/jira/browse/GORA-107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney resolved GORA-107.
---
Resolution: Won't Fix

Superseded by ISSUE-497

> Fully annotate Javadoc's for methods in org.apache.gora.cassandra.store.*
> -
>
> Key: GORA-107
> URL: https://issues.apache.org/jira/browse/GORA-107
> Project: Apache Gora
>  Issue Type: Improvement
>  Components: documentation, gora-cassandra
>Affects Versions: 0.1.1-incubating
>Reporter: Lewis John McGibbney
>Assignee: Henry Saputra
> Fix For: 0.8
>
>
> Some classes e.g. CassandraMapping, contain absolutely not Javadoc at all. 
> This needs to be addressed. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Resolved] (GORA-205) Dedup CassandraMapping and CassandraMappingManager

2017-08-23 Thread Lewis John McGibbney (JIRA)

 [ 
https://issues.apache.org/jira/browse/GORA-205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney resolved GORA-205.
---
Resolution: Won't Fix

Superseded by ISSUE-497

> Dedup CassandraMapping and CassandraMappingManager
> --
>
> Key: GORA-205
> URL: https://issues.apache.org/jira/browse/GORA-205
> Project: Apache Gora
>  Issue Type: Improvement
>  Components: gora-cassandra
>Affects Versions: 0.2.1
>Reporter: Lewis John McGibbney
>Priority: Minor
> Fix For: 0.8
>
>
> We have a pile of what looks lie deduplication between these two classes.
> We should make a determination of what is required and then document it 
> within the appropriate class.
> This will enable easy navigation of keyspace definition etc. from within 
> gora-cassandra. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Resolved] (GORA-209) Specify query timeout for Hector usage in gora-cassandra

2017-08-23 Thread Lewis John McGibbney (JIRA)

 [ 
https://issues.apache.org/jira/browse/GORA-209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney resolved GORA-209.
---
Resolution: Won't Fix

Superseded by ISSUE-497

> Specify query timeout for Hector usage in gora-cassandra
> 
>
> Key: GORA-209
> URL: https://issues.apache.org/jira/browse/GORA-209
> Project: Apache Gora
>  Issue Type: Bug
>  Components: gora-cassandra
>Affects Versions: 0.2.1
>Reporter: Lewis John McGibbney
>Priority: Minor
> Fix For: 0.8
>
>
> There is an interesting discussion going on over at Hector Dev list regarding 
> improving Hector to support time outs for queries running for over X seconds.
> https://groups.google.com/forum/?fromgroups=#!topic/hector-dev/9a0-u9oXjk4
> Once something results from this, we should improve gora-cassandra to also 
> leverage timeouts for queries which time out.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Resolved] (GORA-214) use batched Mutations available in Hector Mutator

2017-08-23 Thread Lewis John McGibbney (JIRA)

 [ 
https://issues.apache.org/jira/browse/GORA-214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney resolved GORA-214.
---
Resolution: Won't Fix

Superseded by ISSUE-497

> use batched Mutations available in Hector Mutator
> -
>
> Key: GORA-214
> URL: https://issues.apache.org/jira/browse/GORA-214
> Project: Apache Gora
>  Issue Type: Improvement
>  Components: gora-cassandra
>Reporter: Roland von Herget
>Assignee: Roland von Herget
> Fix For: 0.8
>
> Attachments: GORA-214-prove-of-concept-0.2.patch, 
> GORA-214-trunk-concept.patch
>
>
> Cassandra & Hector offer a lot of possibilities to batch mutations together.
> This means Hector will not send data out to Cassandra until it receives the 
> command to do so [execute()].
> Really useful is this feature if you have to addOrUpdate two or more columns 
> for one key (in one cf), it will then limit load on Cassandra, too.
> A small prove of concept patch against 0.2 is attached.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Resolved] (GORA-215) expose Hector's CassandraHostConfigurator possibilities

2017-08-23 Thread Lewis John McGibbney (JIRA)

 [ 
https://issues.apache.org/jira/browse/GORA-215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney resolved GORA-215.
---
Resolution: Won't Fix

Hector replaced by ISSUE-497

> expose Hector's CassandraHostConfigurator possibilities 
> 
>
> Key: GORA-215
> URL: https://issues.apache.org/jira/browse/GORA-215
> Project: Apache Gora
>  Issue Type: Improvement
>  Components: gora-cassandra
>Reporter: Roland von Herget
>Priority: Minor
> Fix For: 0.8
>
>
> There are a lot of tuning possibilities inside CassandraHostConfigurator, 
> lets use them ;)
> e.g.:
> cassandraHostConfigurator.setRunAutoDiscoveryAtStartup(true);
> cassandraHostConfigurator.setAutoDiscoverHosts(true);
> cassandraHostConfigurator.setHosts(this.cassandraMapping.getHostName()); // 
> can hold more than one IP
> cassandraHostConfigurator.setLoadBalancingPolicy(new 
> LeastActiveBalancingPolicy()); // new DynamicLoadBalancingPolicy
> [extracted from my hand crafted "config" inside CassandraClient]



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Resolved] (GORA-327) Upgrade to Cassandra 2.0.7

2017-08-23 Thread Lewis John McGibbney (JIRA)

 [ 
https://issues.apache.org/jira/browse/GORA-327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney resolved GORA-327.
---
Resolution: Fixed

Addressed in GORA-497

> Upgrade to Cassandra 2.0.7
> --
>
> Key: GORA-327
> URL: https://issues.apache.org/jira/browse/GORA-327
> Project: Apache Gora
>  Issue Type: Bug
>  Components: gora-cassandra
>Affects Versions: 0.4
>Reporter: Lewis John McGibbney
>Priority: Minor
> Fix For: 0.8
>
>
> Standard upgrade.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Resolved] (GORA-416) Error when populating data into Cassandra super column - InvalidRequestException(why:supercolumn parameter is not optional for super CF sc

2017-08-23 Thread Lewis John McGibbney (JIRA)

 [ 
https://issues.apache.org/jira/browse/GORA-416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney resolved GORA-416.
---
Resolution: Won't Fix

> Error when populating data into Cassandra super column - 
> InvalidRequestException(why:supercolumn parameter is not optional for super 
> CF sc
> --
>
> Key: GORA-416
> URL: https://issues.apache.org/jira/browse/GORA-416
> Project: Apache Gora
>  Issue Type: Bug
>  Components: gora-cassandra
>Affects Versions: 0.6
> Environment: Nutch 2.4-SNAPSHOT, Gora 0.6.1-SNAPSHOT, Hadoop 2.5.2, 
> Cassandra 2.0.7
>Reporter: Lewis John McGibbney
>Assignee: Lewis John McGibbney
> Fix For: 0.8
>
> Attachments: GORA-416.patch
>
>
> Error when populating data into Cassandra super column.
> {code}
> lmcgibbn@LMC-032857 /usr/local/2webgui/runtime/local(master) $ ./bin/nutch 
> fetch 1425410774-370456822
> FetcherJob: starting at 2015-03-03 11:27:57
> FetcherJob: batchId: 1425410774-370456822
> FetcherJob: threads: 10
> FetcherJob: parsing: false
> FetcherJob: resuming: false
> FetcherJob : timelimit set for : -1
> 2015-03-03 11:27:58.101 java[3267:1903] Unable to load realm info from 
> SCDynamicStore
> Using queue mode : byHost
> Fetcher: threads: 10
> QueueFeeder finished: total 1 records. Hit by time limit :0
> fetching http://nutch.apache.org/ (queue crawl delay=5000ms)
> -finishing thread FetcherThread1, activeThreads=1
> -finishing thread FetcherThread2, activeThreads=1
> -finishing thread FetcherThread3, activeThreads=1
> -finishing thread FetcherThread4, activeThreads=1
> -finishing thread FetcherThread5, activeThreads=1
> -finishing thread FetcherThread6, activeThreads=1
> -finishing thread FetcherThread7, activeThreads=1
> -finishing thread FetcherThread8, activeThreads=1
> Fetcher: throughput threshold: -1
> -finishing thread FetcherThread9, activeThreads=1
> Fetcher: throughput threshold sequence: 5
> -finishing thread FetcherThread0, activeThreads=0
> 0/0 spinwaiting/active, 1 pages, 0 errors, 0.2 0 pages/s, 82 82 kb/s, 0 URLs 
> in 0 queues
> -activeThreads=0
> me.prettyprint.hector.api.exceptions.HInvalidRequestException: 
> InvalidRequestException(why:supercolumn parameter is not optional for super 
> CF sc)
>   at 
> me.prettyprint.cassandra.service.ExceptionsTranslatorImpl.translate(ExceptionsTranslatorImpl.java:52)
>   at 
> me.prettyprint.cassandra.connection.HConnectionManager.operateWithFailover(HConnectionManager.java:260)
>   at 
> me.prettyprint.cassandra.model.ExecutingKeyspace.doExecuteOperation(ExecutingKeyspace.java:113)
>   at 
> me.prettyprint.cassandra.model.MutatorImpl.execute(MutatorImpl.java:243)
>   at 
> me.prettyprint.cassandra.model.MutatorImpl.insert(MutatorImpl.java:69)
>   at 
> org.apache.gora.cassandra.store.HectorUtils.insertColumn(HectorUtils.java:46)
>   at 
> org.apache.gora.cassandra.store.CassandraClient.addColumn(CassandraClient.java:293)
>   at 
> org.apache.gora.cassandra.store.CassandraStore.addOrUpdateField(CassandraStore.java:512)
>   at 
> org.apache.gora.cassandra.store.CassandraStore.addOrUpdateField(CassandraStore.java:598)
>   at 
> org.apache.gora.cassandra.store.CassandraStore.flush(CassandraStore.java:316)
>   at 
> org.apache.gora.cassandra.store.CassandraStore.close(CassandraStore.java:160)
>   at 
> org.apache.gora.mapreduce.GoraRecordWriter.close(GoraRecordWriter.java:56)
>   at 
> org.apache.hadoop.mapred.ReduceTask$NewTrackingRecordWriter.close(ReduceTask.java:550)
>   at 
> org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:629)
>   at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:389)
>   at 
> org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
>   at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>   at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>   at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>   at java.lang.Thread.run(Thread.java:745)
> Caused by: InvalidRequestException(why:supercolumn parameter is not optional 
> for super CF sc)
>   at 
> org.apache.cassandra.thrift.Cassandra$batch_mutate_result$batch_mutate_resultStandardScheme.read(Cassandra.java:28082)
>   at 
> org.apache.cassandra.thrift.Cassandra$batch_mutate_result$batch_mutate_resultStandardScheme.read(Cassandra.java:28068)
>   at 
> org.apache.cassandra.thrift.Cassandra$batch_mutate_result.read(Cassandra.java:28002)
>   at 

[jira] [Closed] (GORA-416) Error when populating data into Cassandra super column - InvalidRequestException(why:supercolumn parameter is not optional for super CF sc

2017-08-23 Thread Lewis John McGibbney (JIRA)

 [ 
https://issues.apache.org/jira/browse/GORA-416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney closed GORA-416.
-

> Error when populating data into Cassandra super column - 
> InvalidRequestException(why:supercolumn parameter is not optional for super 
> CF sc
> --
>
> Key: GORA-416
> URL: https://issues.apache.org/jira/browse/GORA-416
> Project: Apache Gora
>  Issue Type: Bug
>  Components: gora-cassandra
>Affects Versions: 0.6
> Environment: Nutch 2.4-SNAPSHOT, Gora 0.6.1-SNAPSHOT, Hadoop 2.5.2, 
> Cassandra 2.0.7
>Reporter: Lewis John McGibbney
>Assignee: Lewis John McGibbney
> Fix For: 0.8
>
> Attachments: GORA-416.patch
>
>
> Error when populating data into Cassandra super column.
> {code}
> lmcgibbn@LMC-032857 /usr/local/2webgui/runtime/local(master) $ ./bin/nutch 
> fetch 1425410774-370456822
> FetcherJob: starting at 2015-03-03 11:27:57
> FetcherJob: batchId: 1425410774-370456822
> FetcherJob: threads: 10
> FetcherJob: parsing: false
> FetcherJob: resuming: false
> FetcherJob : timelimit set for : -1
> 2015-03-03 11:27:58.101 java[3267:1903] Unable to load realm info from 
> SCDynamicStore
> Using queue mode : byHost
> Fetcher: threads: 10
> QueueFeeder finished: total 1 records. Hit by time limit :0
> fetching http://nutch.apache.org/ (queue crawl delay=5000ms)
> -finishing thread FetcherThread1, activeThreads=1
> -finishing thread FetcherThread2, activeThreads=1
> -finishing thread FetcherThread3, activeThreads=1
> -finishing thread FetcherThread4, activeThreads=1
> -finishing thread FetcherThread5, activeThreads=1
> -finishing thread FetcherThread6, activeThreads=1
> -finishing thread FetcherThread7, activeThreads=1
> -finishing thread FetcherThread8, activeThreads=1
> Fetcher: throughput threshold: -1
> -finishing thread FetcherThread9, activeThreads=1
> Fetcher: throughput threshold sequence: 5
> -finishing thread FetcherThread0, activeThreads=0
> 0/0 spinwaiting/active, 1 pages, 0 errors, 0.2 0 pages/s, 82 82 kb/s, 0 URLs 
> in 0 queues
> -activeThreads=0
> me.prettyprint.hector.api.exceptions.HInvalidRequestException: 
> InvalidRequestException(why:supercolumn parameter is not optional for super 
> CF sc)
>   at 
> me.prettyprint.cassandra.service.ExceptionsTranslatorImpl.translate(ExceptionsTranslatorImpl.java:52)
>   at 
> me.prettyprint.cassandra.connection.HConnectionManager.operateWithFailover(HConnectionManager.java:260)
>   at 
> me.prettyprint.cassandra.model.ExecutingKeyspace.doExecuteOperation(ExecutingKeyspace.java:113)
>   at 
> me.prettyprint.cassandra.model.MutatorImpl.execute(MutatorImpl.java:243)
>   at 
> me.prettyprint.cassandra.model.MutatorImpl.insert(MutatorImpl.java:69)
>   at 
> org.apache.gora.cassandra.store.HectorUtils.insertColumn(HectorUtils.java:46)
>   at 
> org.apache.gora.cassandra.store.CassandraClient.addColumn(CassandraClient.java:293)
>   at 
> org.apache.gora.cassandra.store.CassandraStore.addOrUpdateField(CassandraStore.java:512)
>   at 
> org.apache.gora.cassandra.store.CassandraStore.addOrUpdateField(CassandraStore.java:598)
>   at 
> org.apache.gora.cassandra.store.CassandraStore.flush(CassandraStore.java:316)
>   at 
> org.apache.gora.cassandra.store.CassandraStore.close(CassandraStore.java:160)
>   at 
> org.apache.gora.mapreduce.GoraRecordWriter.close(GoraRecordWriter.java:56)
>   at 
> org.apache.hadoop.mapred.ReduceTask$NewTrackingRecordWriter.close(ReduceTask.java:550)
>   at 
> org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:629)
>   at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:389)
>   at 
> org.apache.hadoop.mapred.LocalJobRunner$Job$ReduceTaskRunnable.run(LocalJobRunner.java:319)
>   at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>   at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>   at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>   at java.lang.Thread.run(Thread.java:745)
> Caused by: InvalidRequestException(why:supercolumn parameter is not optional 
> for super CF sc)
>   at 
> org.apache.cassandra.thrift.Cassandra$batch_mutate_result$batch_mutate_resultStandardScheme.read(Cassandra.java:28082)
>   at 
> org.apache.cassandra.thrift.Cassandra$batch_mutate_result$batch_mutate_resultStandardScheme.read(Cassandra.java:28068)
>   at 
> org.apache.cassandra.thrift.Cassandra$batch_mutate_result.read(Cassandra.java:28002)
>   at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:78)
>   at 
> 

[jira] [Closed] (GORA-395) NPE occurs in o.a.g.cassandra.query.CassandraResult when accessing cc (=null) and setting the unionField (title)

2017-08-23 Thread Lewis John McGibbney (JIRA)

 [ 
https://issues.apache.org/jira/browse/GORA-395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney closed GORA-395.
-

> NPE occurs in o.a.g.cassandra.query.CassandraResult when accessing cc (=null) 
> and setting the unionField (title)
> 
>
> Key: GORA-395
> URL: https://issues.apache.org/jira/browse/GORA-395
> Project: Apache Gora
>  Issue Type: Bug
>  Components: gora-cassandra
>Affects Versions: 0.5
>Reporter: Lewis John McGibbney
> Fix For: 0.8
>
>
> This issue was reported a while back over on the Nutch Jira in NUTCH-1791.
> The comments and context for resolving this issue can be found over there as 
> well as advice on how we should be addressing this one.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Resolved] (GORA-395) NPE occurs in o.a.g.cassandra.query.CassandraResult when accessing cc (=null) and setting the unionField (title)

2017-08-23 Thread Lewis John McGibbney (JIRA)

 [ 
https://issues.apache.org/jira/browse/GORA-395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney resolved GORA-395.
---
Resolution: Won't Fix

> NPE occurs in o.a.g.cassandra.query.CassandraResult when accessing cc (=null) 
> and setting the unionField (title)
> 
>
> Key: GORA-395
> URL: https://issues.apache.org/jira/browse/GORA-395
> Project: Apache Gora
>  Issue Type: Bug
>  Components: gora-cassandra
>Affects Versions: 0.5
>Reporter: Lewis John McGibbney
> Fix For: 0.8
>
>
> This issue was reported a while back over on the Nutch Jira in NUTCH-1791.
> The comments and context for resolving this issue can be found over there as 
> well as advice on how we should be addressing this one.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Closed] (GORA-399) Gora-Cassandra should handle Strings inside Union types as CharSequences

2017-08-23 Thread Lewis John McGibbney (JIRA)

 [ 
https://issues.apache.org/jira/browse/GORA-399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney closed GORA-399.
-

> Gora-Cassandra should handle Strings inside Union types as CharSequences 
> -
>
> Key: GORA-399
> URL: https://issues.apache.org/jira/browse/GORA-399
> Project: Apache Gora
>  Issue Type: Bug
>  Components: gora-cassandra
>Reporter: Renato Javier Marroquín Mogrovejo
>Assignee: Renato Javier Marroquín Mogrovejo
> Fix For: 0.8
>
> Attachments: GORA-399.patch
>
>
> In previous releases of Gora, the data beans compiled were all using 
> avro.Utf8 classes, but now we are compiling them to use CharSequence.
> This leads to NPE and the Gora-Cassandra module to eat some the actual causes 
> of the problem.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (GORA-399) Gora-Cassandra should handle Strings inside Union types as CharSequences

2017-08-23 Thread Lewis John McGibbney (JIRA)

 [ 
https://issues.apache.org/jira/browse/GORA-399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney updated GORA-399:
--
Fix Version/s: 0.8

> Gora-Cassandra should handle Strings inside Union types as CharSequences 
> -
>
> Key: GORA-399
> URL: https://issues.apache.org/jira/browse/GORA-399
> Project: Apache Gora
>  Issue Type: Bug
>  Components: gora-cassandra
>Reporter: Renato Javier Marroquín Mogrovejo
>Assignee: Renato Javier Marroquín Mogrovejo
> Fix For: 0.8
>
> Attachments: GORA-399.patch
>
>
> In previous releases of Gora, the data beans compiled were all using 
> avro.Utf8 classes, but now we are compiling them to use CharSequence.
> This leads to NPE and the Gora-Cassandra module to eat some the actual causes 
> of the problem.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Closed] (GORA-497) Migrate CassandraThrift to CQL

2017-08-23 Thread Lewis John McGibbney (JIRA)

 [ 
https://issues.apache.org/jira/browse/GORA-497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney closed GORA-497.
-

> Migrate CassandraThrift to CQL 
> ---
>
> Key: GORA-497
> URL: https://issues.apache.org/jira/browse/GORA-497
> Project: Apache Gora
>  Issue Type: Improvement
>  Components: gora-cassandra
>Reporter: Madhawa Gunasekara
>Assignee: Madhawa Gunasekara
>  Labels: gsoc2017
> Fix For: 0.8
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Closed] (GORA-499) Potential NPE issue

2017-08-23 Thread Lewis John McGibbney (JIRA)

 [ 
https://issues.apache.org/jira/browse/GORA-499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney closed GORA-499.
-

> Potential NPE issue
> ---
>
> Key: GORA-499
> URL: https://issues.apache.org/jira/browse/GORA-499
> Project: Apache Gora
>  Issue Type: Bug
>  Components: gora-cassandra
>Reporter: JC
>Assignee: JC
>Priority: Minor
> Fix For: 0.7
>
>
> Dear Gora developers
> In recent git repository, I've found the following lines in 
> gora-cassandra/src/main/java/org/apache/gora/cassandra/store/CassandraClient.java.
> {code:java}
> String opConsisLvl = (readOpConsLvl!=null || 
> !readOpConsLvl.isEmpty())?readOpConsLvl:DEFAULT_HECTOR_CONSIS_LEVEL;
>   
> ccl.setDefaultReadConsistencyLevel(HConsistencyLevel.valueOf(opConsisLvl));
>   LOG.debug("Hector read consistency configured to '" + opConsisLvl + 
> "'.");
>   opConsisLvl = (writeOpConsLvl!=null || 
> !writeOpConsLvl.isEmpty())?writeOpConsLvl:DEFAULT_HECTOR_CONSIS_LEVEL;
> {code}
> It seems, if readOpConsLvl or writeOpConsLvl is null, there could be 
> NullPointerException as the comparison operator is "||" rather using "&&". I 
> have no idea if this is an actual bug but just reporting. Thanks!



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Resolved] (GORA-497) Migrate CassandraThrift to CQL

2017-08-23 Thread Lewis John McGibbney (JIRA)

 [ 
https://issues.apache.org/jira/browse/GORA-497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney resolved GORA-497.
---
Resolution: Fixed

This issue has been committed to master branch in order for us to continue with 
refinements...
Thank you [~madhawa]
Excellent work so far.. let's keep iterating

> Migrate CassandraThrift to CQL 
> ---
>
> Key: GORA-497
> URL: https://issues.apache.org/jira/browse/GORA-497
> Project: Apache Gora
>  Issue Type: Improvement
>  Components: gora-cassandra
>Reporter: Madhawa Gunasekara
>Assignee: Madhawa Gunasekara
>  Labels: gsoc2017
> Fix For: 0.8
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (GORA-497) Migrate CassandraThrift to CQL

2017-08-23 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/GORA-497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139078#comment-16139078
 ] 

ASF GitHub Bot commented on GORA-497:
-

Github user asfgit closed the pull request at:

https://github.com/apache/gora/pull/110


> Migrate CassandraThrift to CQL 
> ---
>
> Key: GORA-497
> URL: https://issues.apache.org/jira/browse/GORA-497
> Project: Apache Gora
>  Issue Type: Improvement
>  Components: gora-cassandra
>Reporter: Madhawa Gunasekara
>Assignee: Madhawa Gunasekara
>  Labels: gsoc2017
> Fix For: 0.8
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[GitHub] gora pull request #110: [WIP] GORA-497 : Rewrite Cassandra data store

2017-08-23 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/gora/pull/110


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Updated] (GORA-521) Document Cassandra Datastore at Apache Gora site.

2017-08-23 Thread Madhawa Gunasekara (JIRA)

 [ 
https://issues.apache.org/jira/browse/GORA-521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Madhawa Gunasekara updated GORA-521:

Attachment: cassandra.patch

Hi [~lewismc]

Please find the attached documentation.

Thanks,
Madhawa

> Document Cassandra Datastore at Apache Gora site.
> -
>
> Key: GORA-521
> URL: https://issues.apache.org/jira/browse/GORA-521
> Project: Apache Gora
>  Issue Type: Task
>  Components: gora-cassandra
>Reporter: Madhawa Gunasekara
>Assignee: Madhawa Gunasekara
> Attachments: cassandra.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (GORA-497) Migrate CassandraThrift to CQL

2017-08-23 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/GORA-497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16138913#comment-16138913
 ] 

ASF GitHub Bot commented on GORA-497:
-

Github user madhawa-gunasekara commented on a diff in the pull request:

https://github.com/apache/gora/pull/110#discussion_r134845082
  
--- Diff: 
gora-cassandra-cql/src/test/java/org/apache/gora/cassandra/store/TestNativeSerializationWithUDT.java
 ---
@@ -0,0 +1,84 @@
+/**
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ * 
+ * http://www.apache.org/licenses/LICENSE-2.0
+ * 
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.gora.cassandra.store;
+
+import org.apache.gora.cassandra.GoraCassandraTestDriver;
+import 
org.apache.gora.cassandra.example.generated.nativeSerialization.Customer;
+import 
org.apache.gora.cassandra.example.generated.nativeSerialization.Document;
+import org.junit.After;
+import org.junit.AfterClass;
+import org.junit.Assert;
+import org.junit.BeforeClass;
+import org.junit.Test;
+
+import java.util.Properties;
+
+public class TestNativeSerializationWithUDT {
+
+  private static GoraCassandraTestDriver testDriver = new 
GoraCassandraTestDriver();
+  private static CassandraStore documentCassandraStore;
+  private static Properties parameter;
+
+  @BeforeClass
+  public static void setUpClass() throws Exception {
+setProperties();
+testDriver.setParameters(parameter);
+testDriver.setUpClass();
+documentCassandraStore = (CassandraStore) 
testDriver.createDataStore(String.class, Document.class);
+  }
+
+  private static void setProperties() {
+parameter = new Properties();
+parameter.setProperty(CassandraStoreParameters.CASSANDRA_SERVERS, 
"localhost");
+parameter.setProperty(CassandraStoreParameters.PORT, "9042");
+
parameter.setProperty(CassandraStoreParameters.CASSANDRA_SERIALIZATION_TYPE, 
"native");
+parameter.setProperty(CassandraStoreParameters.PROTOCOL_VERSION, "3");
+parameter.setProperty(CassandraStoreParameters.CLUSTER_NAME, "Test 
Cluster");
+parameter.setProperty("gora.cassandrastore.mapping.file", 
"nativeUDT/gora-cassandra-mapping.xml");
+  }
+
+  @AfterClass
+  public static void tearDownClass() throws Exception {
+testDriver.tearDownClass();
+  }
+
+  @After
+  public void tearDown() throws Exception {
+testDriver.tearDown();
+  }
+
+  /**
+   * This is for testGetNested() with UDT dataType with native 
serialization.
+   */
+  @Test
+  public void testSimplePutAndGEt() {
--- End diff --

It's my pleasure 


> Migrate CassandraThrift to CQL 
> ---
>
> Key: GORA-497
> URL: https://issues.apache.org/jira/browse/GORA-497
> Project: Apache Gora
>  Issue Type: Improvement
>  Components: gora-cassandra
>Reporter: Madhawa Gunasekara
>Assignee: Madhawa Gunasekara
>  Labels: gsoc2017
> Fix For: 0.8
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[GitHub] gora pull request #110: [WIP] GORA-497 : Rewrite Cassandra data store

2017-08-23 Thread madhawa-gunasekara
Github user madhawa-gunasekara commented on a diff in the pull request:

https://github.com/apache/gora/pull/110#discussion_r134845082
  
--- Diff: 
gora-cassandra-cql/src/test/java/org/apache/gora/cassandra/store/TestNativeSerializationWithUDT.java
 ---
@@ -0,0 +1,84 @@
+/**
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ * 
+ * http://www.apache.org/licenses/LICENSE-2.0
+ * 
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+
+package org.apache.gora.cassandra.store;
+
+import org.apache.gora.cassandra.GoraCassandraTestDriver;
+import 
org.apache.gora.cassandra.example.generated.nativeSerialization.Customer;
+import 
org.apache.gora.cassandra.example.generated.nativeSerialization.Document;
+import org.junit.After;
+import org.junit.AfterClass;
+import org.junit.Assert;
+import org.junit.BeforeClass;
+import org.junit.Test;
+
+import java.util.Properties;
+
+public class TestNativeSerializationWithUDT {
+
+  private static GoraCassandraTestDriver testDriver = new 
GoraCassandraTestDriver();
+  private static CassandraStore documentCassandraStore;
+  private static Properties parameter;
+
+  @BeforeClass
+  public static void setUpClass() throws Exception {
+setProperties();
+testDriver.setParameters(parameter);
+testDriver.setUpClass();
+documentCassandraStore = (CassandraStore) 
testDriver.createDataStore(String.class, Document.class);
+  }
+
+  private static void setProperties() {
+parameter = new Properties();
+parameter.setProperty(CassandraStoreParameters.CASSANDRA_SERVERS, 
"localhost");
+parameter.setProperty(CassandraStoreParameters.PORT, "9042");
+
parameter.setProperty(CassandraStoreParameters.CASSANDRA_SERIALIZATION_TYPE, 
"native");
+parameter.setProperty(CassandraStoreParameters.PROTOCOL_VERSION, "3");
+parameter.setProperty(CassandraStoreParameters.CLUSTER_NAME, "Test 
Cluster");
+parameter.setProperty("gora.cassandrastore.mapping.file", 
"nativeUDT/gora-cassandra-mapping.xml");
+  }
+
+  @AfterClass
+  public static void tearDownClass() throws Exception {
+testDriver.tearDownClass();
+  }
+
+  @After
+  public void tearDown() throws Exception {
+testDriver.tearDown();
+  }
+
+  /**
+   * This is for testGetNested() with UDT dataType with native 
serialization.
+   */
+  @Test
+  public void testSimplePutAndGEt() {
--- End diff --

It's my pleasure 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] gora pull request #110: [WIP] GORA-497 : Rewrite Cassandra data store

2017-08-23 Thread madhawa-gunasekara
Github user madhawa-gunasekara commented on a diff in the pull request:

https://github.com/apache/gora/pull/110#discussion_r134844996
  
--- Diff: 
gora-cassandra-cql/src/test/java/org/apache/gora/cassandra/store/TestCassandraStoreWithNativeSerialization.java
 ---
@@ -0,0 +1,305 @@
+/*
+ *  Licensed to the Apache Software Foundation (ASF) under one or more
+ *  contributor license agreements.  See the NOTICE file distributed with
+ *  this work for additional information regarding copyright ownership.
+ *  The ASF licenses this file to You under the Apache License, Version 2.0
+ *  (the "License"); you may not use this file except in compliance with
+ *  the License.  You may obtain a copy of the License at
+ *
+ *  http://www.apache.org/licenses/LICENSE-2.0
+ *
+ *  Unless required by applicable law or agreed to in writing, software
+ *  distributed under the License is distributed on an "AS IS" BASIS,
+ *  WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or 
implied.
+ *  See the License for the specific language governing permissions and
+ *  limitations under the License.
+ */
+
+package org.apache.gora.cassandra.store;
+
+import org.apache.gora.cassandra.GoraCassandraTestDriver;
+import 
org.apache.gora.cassandra.example.generated.nativeSerialization.ComplexTypes;
+import 
org.apache.gora.cassandra.example.generated.nativeSerialization.User;
+import org.apache.gora.cassandra.query.CassandraQuery;
+import org.apache.gora.query.Query;
+import org.apache.gora.query.Result;
+import org.apache.gora.store.DataStore;
+import org.apache.gora.util.GoraException;
+import org.junit.After;
+import org.junit.AfterClass;
+import org.junit.Assert;
+import org.junit.BeforeClass;
+import org.junit.Test;
+
+import java.time.Instant;
+import java.util.ArrayList;
+import java.util.Arrays;
+import java.util.Date;
+import java.util.HashMap;
+import java.util.HashSet;
+import java.util.Map;
+import java.util.Properties;
+import java.util.UUID;
+
+/**
+ * This class tests Cassandra Store functionality with Cassandra Native 
Serialization.
+ */
+public class TestCassandraStoreWithNativeSerialization {
+  private static GoraCassandraTestDriver testDriver = new 
GoraCassandraTestDriver();
+  private static DataStore userDataStore;
+  private static Properties parameter;
+
+  @BeforeClass
+  public static void setUpClass() throws Exception {
+setProperties();
+testDriver.setParameters(parameter);
+testDriver.setUpClass();
+userDataStore = testDriver.createDataStore(UUID.class, User.class);
+  }
+
+  private static void setProperties() {
+parameter = new Properties();
+parameter.setProperty(CassandraStoreParameters.CASSANDRA_SERVERS, 
"localhost");
+parameter.setProperty(CassandraStoreParameters.PORT, "9042");
+
parameter.setProperty(CassandraStoreParameters.CASSANDRA_SERIALIZATION_TYPE, 
"native");
+parameter.setProperty(CassandraStoreParameters.PROTOCOL_VERSION, "3");
+parameter.setProperty(CassandraStoreParameters.CLUSTER_NAME, "Test 
Cluster");
+parameter.setProperty("gora.cassandrastore.mapping.file", 
"nativeSerialization/gora-cassandra-mapping.xml");
+  }
+
+  @After
+  public void tearDown() throws Exception {
+testDriver.tearDown();
+  }
+
+  @AfterClass
+  public static void tearDownClass() throws Exception {
+testDriver.tearDownClass();
+  }
+
+  /**
+   * In this test case, put and get behavior of the data store are testing.
+   */
+  @Test
+  public void testSimplePutAndGet() {
+UUID id = UUID.randomUUID();
+User user1 = new User(id, "madhawa", Date.from(Instant.now()));
+// storing data;
+userDataStore.put(id, user1);
+// get data;
+User olduser = userDataStore.get(id);
+Assert.assertEquals(olduser.getName(), user1.getName());
+Assert.assertEquals(olduser.getDateOfBirth(), user1.getDateOfBirth());
+  }
+
+  /**
+   * In this test case, put and delete behavior of the data store are 
testing.
+   */
+  @Test
+  public void testSimplePutDeleteAndGet() {
+UUID id = UUID.randomUUID();
+User user1 = new User(id, "kasun", Date.from(Instant.now()));
+// storing data;
+userDataStore.put(id, user1);
+// get data;
+User olduser = userDataStore.get(user1.getUserId());
+Assert.assertEquals(olduser.getName(), user1.getName());
+Assert.assertEquals(olduser.getDateOfBirth(), user1.getDateOfBirth());
+// delete data;
+userDataStore.delete(user1.getUserId());
+// get data
+User deletedUser = userDataStore.get(id);
+