[jira] [Commented] (BAHIR-102) Support pushing down query predicates using Cloudant Query / CouchDB Mango Query

2017-04-13 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15968106#comment-15968106
 ] 

ASF GitHub Bot commented on BAHIR-102:
--

Github user asfgit closed the pull request at:

https://github.com/apache/bahir/pull/41


> Support pushing down query predicates using Cloudant Query / CouchDB Mango 
> Query
> 
>
> Key: BAHIR-102
> URL: https://issues.apache.org/jira/browse/BAHIR-102
> Project: Bahir
>  Issue Type: Improvement
>Reporter: Yang Lei
>Assignee: Yang Lei
>
> The feature of Cloudant Query / ChoudDB Mango Query is stated here: 
> https://blog.couchdb.org/2016/08/03/feature-mango-query/.
> Will enable pushing down first level AND column filtering to _find selector 
> to replace _all_docs for the database query; will continue using skip+limit 
> to offer partition and parallel loading.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-102) Support pushing down query predicates using Cloudant Query / CouchDB Mango Query

2017-04-13 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15968105#comment-15968105
 ] 

ASF subversion and git services commented on BAHIR-102:
---

Commit fd4c35fc9f7ebb57464d231cf5d66e7bc4096a1b in bahir's branch 
refs/heads/master from [~yanglei]
[ https://git-wip-us.apache.org/repos/asf?p=bahir.git;h=fd4c35f ]

[BAHIR-102] Initial support of Cloudant Query and examples

Add optimization to use query in particular scenarios.

Closes #41.


> Support pushing down query predicates using Cloudant Query / CouchDB Mango 
> Query
> 
>
> Key: BAHIR-102
> URL: https://issues.apache.org/jira/browse/BAHIR-102
> Project: Bahir
>  Issue Type: Improvement
>Reporter: Yang Lei
>Assignee: Yang Lei
>
> The feature of Cloudant Query / ChoudDB Mango Query is stated here: 
> https://blog.couchdb.org/2016/08/03/feature-mango-query/.
> Will enable pushing down first level AND column filtering to _find selector 
> to replace _all_docs for the database query; will continue using skip+limit 
> to offer partition and parallel loading.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-102) Support pushing down query predicates using Cloudant Query / CouchDB Mango Query

2017-04-11 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964691#comment-15964691
 ] 

ASF GitHub Bot commented on BAHIR-102:
--

Github user lresende commented on the issue:

https://github.com/apache/bahir/pull/41
  
LGTM, merging if there are no more comments.


> Support pushing down query predicates using Cloudant Query / CouchDB Mango 
> Query
> 
>
> Key: BAHIR-102
> URL: https://issues.apache.org/jira/browse/BAHIR-102
> Project: Bahir
>  Issue Type: Improvement
>Reporter: Yang Lei
>Assignee: Yang Lei
>
> The feature of Cloudant Query / ChoudDB Mango Query is stated here: 
> https://blog.couchdb.org/2016/08/03/feature-mango-query/.
> Will enable pushing down first level AND column filtering to _find selector 
> to replace _all_docs for the database query; will continue using skip+limit 
> to offer partition and parallel loading.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-102) Support pushing down query predicates using Cloudant Query / CouchDB Mango Query

2017-04-10 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15963436#comment-15963436
 ] 

ASF GitHub Bot commented on BAHIR-102:
--

Github user ApacheBahir commented on the issue:

https://github.com/apache/bahir/pull/41
  
Build successful
 



> Support pushing down query predicates using Cloudant Query / CouchDB Mango 
> Query
> 
>
> Key: BAHIR-102
> URL: https://issues.apache.org/jira/browse/BAHIR-102
> Project: Bahir
>  Issue Type: Improvement
>Reporter: Yang Lei
>Assignee: Yang Lei
>
> The feature of Cloudant Query / ChoudDB Mango Query is stated here: 
> https://blog.couchdb.org/2016/08/03/feature-mango-query/.
> Will enable pushing down first level AND column filtering to _find selector 
> to replace _all_docs for the database query; will continue using skip+limit 
> to offer partition and parallel loading.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-102) Support pushing down query predicates using Cloudant Query / CouchDB Mango Query

2017-04-10 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15963437#comment-15963437
 ] 

ASF GitHub Bot commented on BAHIR-102:
--

Github user ApacheBahir commented on the issue:

https://github.com/apache/bahir/pull/41
  

Refer to this link for build results (access rights to CI server needed): 
http://169.45.79.58:8080/job/bahir_spark_pr_builder/55/



> Support pushing down query predicates using Cloudant Query / CouchDB Mango 
> Query
> 
>
> Key: BAHIR-102
> URL: https://issues.apache.org/jira/browse/BAHIR-102
> Project: Bahir
>  Issue Type: Improvement
>Reporter: Yang Lei
>Assignee: Yang Lei
>
> The feature of Cloudant Query / ChoudDB Mango Query is stated here: 
> https://blog.couchdb.org/2016/08/03/feature-mango-query/.
> Will enable pushing down first level AND column filtering to _find selector 
> to replace _all_docs for the database query; will continue using skip+limit 
> to offer partition and parallel loading.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-102) Support pushing down query predicates using Cloudant Query / CouchDB Mango Query

2017-04-10 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15963290#comment-15963290
 ] 

ASF GitHub Bot commented on BAHIR-102:
--

Github user yanglei99 commented on a diff in the pull request:

https://github.com/apache/bahir/pull/41#discussion_r110727111
  
--- Diff: sql-cloudant/README.md ---
@@ -62,6 +62,8 @@ cloudant.protocol|https|protocol to use to transfer data: 
http or https
 cloudant.host||cloudant host url
 cloudant.username||cloudant userid
 cloudant.password||cloudant password
+cloudant.useQuery|false|When enabled, for query not using index or view, 
_find will be used instead of _all_docs, some query predicates will be driven 
into datastore. However, RDD partition is ONE during _find, so parallel loading 
is not achieved
--- End diff --

I can use something @lresende suggested : the data source will look for 
ways to optimize the query execution by pushing down some of the query 
predicates into the data store.



> Support pushing down query predicates using Cloudant Query / CouchDB Mango 
> Query
> 
>
> Key: BAHIR-102
> URL: https://issues.apache.org/jira/browse/BAHIR-102
> Project: Bahir
>  Issue Type: Improvement
>Reporter: Yang Lei
>Assignee: Yang Lei
>
> The feature of Cloudant Query / ChoudDB Mango Query is stated here: 
> https://blog.couchdb.org/2016/08/03/feature-mango-query/.
> Will enable pushing down first level AND column filtering to _find selector 
> to replace _all_docs for the database query; will continue using skip+limit 
> to offer partition and parallel loading.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-102) Support pushing down query predicates using Cloudant Query / CouchDB Mango Query

2017-04-10 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15963287#comment-15963287
 ] 

ASF GitHub Bot commented on BAHIR-102:
--

Github user yanglei99 commented on a diff in the pull request:

https://github.com/apache/bahir/pull/41#discussion_r110726384
  
--- Diff: sql-cloudant/README.md ---
@@ -62,6 +62,8 @@ cloudant.protocol|https|protocol to use to transfer data: 
http or https
 cloudant.host||cloudant host url
 cloudant.username||cloudant userid
 cloudant.password||cloudant password
+cloudant.useQuery|false|When enabled, for query not using index or view, 
_find will be used instead of _all_docs, some query predicates will be driven 
into datastore. However, RDD partition is ONE during _find, so parallel loading 
is not achieved
--- End diff --

"some of the query predicates will be driven into datastore", as we do not 
do a full SQL translation for all the query predicates. 



> Support pushing down query predicates using Cloudant Query / CouchDB Mango 
> Query
> 
>
> Key: BAHIR-102
> URL: https://issues.apache.org/jira/browse/BAHIR-102
> Project: Bahir
>  Issue Type: Improvement
>Reporter: Yang Lei
>Assignee: Yang Lei
>
> The feature of Cloudant Query / ChoudDB Mango Query is stated here: 
> https://blog.couchdb.org/2016/08/03/feature-mango-query/.
> Will enable pushing down first level AND column filtering to _find selector 
> to replace _all_docs for the database query; will continue using skip+limit 
> to offer partition and parallel loading.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-102) Support pushing down query predicates using Cloudant Query / CouchDB Mango Query

2017-04-10 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15963285#comment-15963285
 ] 

ASF GitHub Bot commented on BAHIR-102:
--

Github user yanglei99 commented on a diff in the pull request:

https://github.com/apache/bahir/pull/41#discussion_r110726127
  
--- Diff: sql-cloudant/README.md ---
@@ -62,6 +62,8 @@ cloudant.protocol|https|protocol to use to transfer data: 
http or https
 cloudant.host||cloudant host url
 cloudant.username||cloudant userid
 cloudant.password||cloudant password
+cloudant.useQuery|false|When enabled, for query not using index or view, 
_find will be used instead of _all_docs, some query predicates will be driven 
into datastore. However, RDD partition is ONE during _find, so parallel loading 
is not achieved
--- End diff --

I chose the word useQuery, as Query is Cloudant's special word.  Also when 
useQuery is not used, pushing down can also happens for primary key (_id) 
query. So the above will not be accurate. 



> Support pushing down query predicates using Cloudant Query / CouchDB Mango 
> Query
> 
>
> Key: BAHIR-102
> URL: https://issues.apache.org/jira/browse/BAHIR-102
> Project: Bahir
>  Issue Type: Improvement
>Reporter: Yang Lei
>Assignee: Yang Lei
>
> The feature of Cloudant Query / ChoudDB Mango Query is stated here: 
> https://blog.couchdb.org/2016/08/03/feature-mango-query/.
> Will enable pushing down first level AND column filtering to _find selector 
> to replace _all_docs for the database query; will continue using skip+limit 
> to offer partition and parallel loading.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-102) Support pushing down query predicates using Cloudant Query / CouchDB Mango Query

2017-04-10 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15963277#comment-15963277
 ] 

ASF GitHub Bot commented on BAHIR-102:
--

Github user lresende commented on a diff in the pull request:

https://github.com/apache/bahir/pull/41#discussion_r110724252
  
--- Diff: sql-cloudant/README.md ---
@@ -62,6 +62,8 @@ cloudant.protocol|https|protocol to use to transfer data: 
http or https
 cloudant.host||cloudant host url
 cloudant.username||cloudant userid
 cloudant.password||cloudant password
+cloudant.useQuery|false|When enabled, for query not using index or view, 
_find will be used instead of _all_docs, some query predicates will be driven 
into datastore. However, RDD partition is ONE during _find, so parallel loading 
is not achieved
--- End diff --

my $ 0.02c, how about something like this... :

Clouding.optimizeQuery | false | When the optimizeQuery is enabled, the 
data source will look for ways to optimize the query execution by rewriting it 
or pushing down the execution to the data store. One example is the utilization 
of explicit _find with query predicates to be executed in the datastore instead 
of _all_docs. However, as RDD partition is ONE during _find, parallel loading 
is not achieved.


> Support pushing down query predicates using Cloudant Query / CouchDB Mango 
> Query
> 
>
> Key: BAHIR-102
> URL: https://issues.apache.org/jira/browse/BAHIR-102
> Project: Bahir
>  Issue Type: Improvement
>Reporter: Yang Lei
>Assignee: Yang Lei
>
> The feature of Cloudant Query / ChoudDB Mango Query is stated here: 
> https://blog.couchdb.org/2016/08/03/feature-mango-query/.
> Will enable pushing down first level AND column filtering to _find selector 
> to replace _all_docs for the database query; will continue using skip+limit 
> to offer partition and parallel loading.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-102) Support pushing down query predicates using Cloudant Query / CouchDB Mango Query

2017-04-10 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15963173#comment-15963173
 ] 

ASF GitHub Bot commented on BAHIR-102:
--

Github user emlaver commented on a diff in the pull request:

https://github.com/apache/bahir/pull/41#discussion_r110706772
  
--- Diff: sql-cloudant/README.md ---
@@ -62,6 +62,8 @@ cloudant.protocol|https|protocol to use to transfer data: 
http or https
 cloudant.host||cloudant host url
 cloudant.username||cloudant userid
 cloudant.password||cloudant password
+cloudant.useQuery|false|When enabled, for query not using index or view, 
_find will be used instead of _all_docs, some query predicates will be driven 
into datastore. However, RDD partition is ONE during _find, so parallel loading 
is not achieved
--- End diff --

Ok - I'm still having a hard time understanding the statement `some of the 
query predicates will be driven into datastore`.  What do you mean by driven? 
Does it have to do with `partitions used to drive JsonStoreRDD loading query 
result in parallel` ?
Also, `As RDD partition is ONE during _find` - one what? set to one 
partition for the `jsonstore.rdd.partitions` configuration? 
And for `parallel loading is not achieved` - This sounds awkward to me.  Is 
it not achieved because the `_find` endpoint only supports one partition? 


> Support pushing down query predicates using Cloudant Query / CouchDB Mango 
> Query
> 
>
> Key: BAHIR-102
> URL: https://issues.apache.org/jira/browse/BAHIR-102
> Project: Bahir
>  Issue Type: Improvement
>Reporter: Yang Lei
>Assignee: Yang Lei
>
> The feature of Cloudant Query / ChoudDB Mango Query is stated here: 
> https://blog.couchdb.org/2016/08/03/feature-mango-query/.
> Will enable pushing down first level AND column filtering to _find selector 
> to replace _all_docs for the database query; will continue using skip+limit 
> to offer partition and parallel loading.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-102) Support pushing down query predicates using Cloudant Query / CouchDB Mango Query

2017-04-10 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15963174#comment-15963174
 ] 

ASF GitHub Bot commented on BAHIR-102:
--

Github user emlaver commented on a diff in the pull request:

https://github.com/apache/bahir/pull/41#discussion_r110706837
  
--- Diff: sql-cloudant/README.md ---
@@ -62,6 +62,8 @@ cloudant.protocol|https|protocol to use to transfer data: 
http or https
 cloudant.host||cloudant host url
 cloudant.username||cloudant userid
 cloudant.password||cloudant password
+cloudant.useQuery|false|When enabled, for query not using index or view, 
_find will be used instead of _all_docs, some query predicates will be driven 
into datastore. However, RDD partition is ONE during _find, so parallel loading 
is not achieved
+cloudant.queryLimit|25|the limit set onto _find query
--- End diff --

Ok great, thanks.


> Support pushing down query predicates using Cloudant Query / CouchDB Mango 
> Query
> 
>
> Key: BAHIR-102
> URL: https://issues.apache.org/jira/browse/BAHIR-102
> Project: Bahir
>  Issue Type: Improvement
>Reporter: Yang Lei
>Assignee: Yang Lei
>
> The feature of Cloudant Query / ChoudDB Mango Query is stated here: 
> https://blog.couchdb.org/2016/08/03/feature-mango-query/.
> Will enable pushing down first level AND column filtering to _find selector 
> to replace _all_docs for the database query; will continue using skip+limit 
> to offer partition and parallel loading.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-102) Support pushing down query predicates using Cloudant Query / CouchDB Mango Query

2017-04-10 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15963115#comment-15963115
 ] 

ASF GitHub Bot commented on BAHIR-102:
--

Github user yanglei99 commented on a diff in the pull request:

https://github.com/apache/bahir/pull/41#discussion_r110701584
  
--- Diff: sql-cloudant/README.md ---
@@ -62,6 +62,8 @@ cloudant.protocol|https|protocol to use to transfer data: 
http or https
 cloudant.host||cloudant host url
 cloudant.username||cloudant userid
 cloudant.password||cloudant password
+cloudant.useQuery|false|When enabled, for query not using index or view, 
_find will be used instead of _all_docs, some query predicates will be driven 
into datastore. However, RDD partition is ONE during _find, so parallel loading 
is not achieved
--- End diff --

how about this: 
cloudant.useQuery|false|By default _all_docs endpoint is used if 
configuration 'view' and 'index' (see below) are not set. When useQuery is 
enabled, _find endpoint will be used in place of _all_docs, some of the query 
predicates will be driven into datastore. As RDD partition is ONE during _find, 
parallel loading is not achieved


> Support pushing down query predicates using Cloudant Query / CouchDB Mango 
> Query
> 
>
> Key: BAHIR-102
> URL: https://issues.apache.org/jira/browse/BAHIR-102
> Project: Bahir
>  Issue Type: Improvement
>Reporter: Yang Lei
>Assignee: Yang Lei
>
> The feature of Cloudant Query / ChoudDB Mango Query is stated here: 
> https://blog.couchdb.org/2016/08/03/feature-mango-query/.
> Will enable pushing down first level AND column filtering to _find selector 
> to replace _all_docs for the database query; will continue using skip+limit 
> to offer partition and parallel loading.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-102) Support pushing down query predicates using Cloudant Query / CouchDB Mango Query

2017-04-10 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15963110#comment-15963110
 ] 

ASF GitHub Bot commented on BAHIR-102:
--

Github user yanglei99 commented on a diff in the pull request:

https://github.com/apache/bahir/pull/41#discussion_r110700478
  
--- Diff: sql-cloudant/README.md ---
@@ -62,6 +62,8 @@ cloudant.protocol|https|protocol to use to transfer data: 
http or https
 cloudant.host||cloudant host url
 cloudant.username||cloudant userid
 cloudant.password||cloudant password
+cloudant.useQuery|false|When enabled, for query not using index or view, 
_find will be used instead of _all_docs, some query predicates will be driven 
into datastore. However, RDD partition is ONE during _find, so parallel loading 
is not achieved
+cloudant.queryLimit|25|the limit set onto _find query
--- End diff --

Will change the cloudant.queryLimit|25 comment as you suggested



> Support pushing down query predicates using Cloudant Query / CouchDB Mango 
> Query
> 
>
> Key: BAHIR-102
> URL: https://issues.apache.org/jira/browse/BAHIR-102
> Project: Bahir
>  Issue Type: Improvement
>Reporter: Yang Lei
>Assignee: Yang Lei
>
> The feature of Cloudant Query / ChoudDB Mango Query is stated here: 
> https://blog.couchdb.org/2016/08/03/feature-mango-query/.
> Will enable pushing down first level AND column filtering to _find selector 
> to replace _all_docs for the database query; will continue using skip+limit 
> to offer partition and parallel loading.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-102) Support pushing down query predicates using Cloudant Query / CouchDB Mango Query

2017-04-10 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15963085#comment-15963085
 ] 

ASF GitHub Bot commented on BAHIR-102:
--

Github user emlaver commented on a diff in the pull request:

https://github.com/apache/bahir/pull/41#discussion_r110697369
  
--- Diff: sql-cloudant/README.md ---
@@ -62,6 +62,8 @@ cloudant.protocol|https|protocol to use to transfer data: 
http or https
 cloudant.host||cloudant host url
 cloudant.username||cloudant userid
 cloudant.password||cloudant password
+cloudant.useQuery|false|When enabled, for query not using index or view, 
_find will be used instead of _all_docs, some query predicates will be driven 
into datastore. However, RDD partition is ONE during _find, so parallel loading 
is not achieved
+cloudant.queryLimit|25|the limit set onto _find query
--- End diff --

`The maximum number of results returned when querying the _find endpoint`


> Support pushing down query predicates using Cloudant Query / CouchDB Mango 
> Query
> 
>
> Key: BAHIR-102
> URL: https://issues.apache.org/jira/browse/BAHIR-102
> Project: Bahir
>  Issue Type: Improvement
>Reporter: Yang Lei
>Assignee: Yang Lei
>
> The feature of Cloudant Query / ChoudDB Mango Query is stated here: 
> https://blog.couchdb.org/2016/08/03/feature-mango-query/.
> Will enable pushing down first level AND column filtering to _find selector 
> to replace _all_docs for the database query; will continue using skip+limit 
> to offer partition and parallel loading.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-102) Support pushing down query predicates using Cloudant Query / CouchDB Mango Query

2017-04-10 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15963082#comment-15963082
 ] 

ASF GitHub Bot commented on BAHIR-102:
--

Github user yanglei99 commented on a diff in the pull request:

https://github.com/apache/bahir/pull/41#discussion_r110697071
  
--- Diff: sql-cloudant/README.md ---
@@ -62,6 +62,8 @@ cloudant.protocol|https|protocol to use to transfer data: 
http or https
 cloudant.host||cloudant host url
 cloudant.username||cloudant userid
 cloudant.password||cloudant password
+cloudant.useQuery|false|When enabled, for query not using index or view, 
_find will be used instead of _all_docs, some query predicates will be driven 
into datastore. However, RDD partition is ONE during _find, so parallel loading 
is not achieved
--- End diff --

Setting the flag to true does not guarantee using _find. As find is only 
used to replace the _all_docs query, which will be done under condition that it 
is not a _view nor _index query. That is the reason the description is stated 
the way it is



> Support pushing down query predicates using Cloudant Query / CouchDB Mango 
> Query
> 
>
> Key: BAHIR-102
> URL: https://issues.apache.org/jira/browse/BAHIR-102
> Project: Bahir
>  Issue Type: Improvement
>Reporter: Yang Lei
>Assignee: Yang Lei
>
> The feature of Cloudant Query / ChoudDB Mango Query is stated here: 
> https://blog.couchdb.org/2016/08/03/feature-mango-query/.
> Will enable pushing down first level AND column filtering to _find selector 
> to replace _all_docs for the database query; will continue using skip+limit 
> to offer partition and parallel loading.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-102) Support pushing down query predicates using Cloudant Query / CouchDB Mango Query

2017-04-10 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15963077#comment-15963077
 ] 

ASF GitHub Bot commented on BAHIR-102:
--

Github user emlaver commented on a diff in the pull request:

https://github.com/apache/bahir/pull/41#discussion_r110696516
  
--- Diff: sql-cloudant/README.md ---
@@ -62,6 +62,8 @@ cloudant.protocol|https|protocol to use to transfer data: 
http or https
 cloudant.host||cloudant host url
 cloudant.username||cloudant userid
 cloudant.password||cloudant password
+cloudant.useQuery|false|When enabled, for query not using index or view, 
_find will be used instead of _all_docs, some query predicates will be driven 
into datastore. However, RDD partition is ONE during _find, so parallel loading 
is not achieved
--- End diff --

This description is a bit unclear.  How about: `When set to true, the _find 
endpoint will be queried.  The _all_docs endpoint will be used when set to 
false (default setting).  Note: When querying against the _find endpoint, RDD 
partition is limited to one so parallel loading is not an available option.`  
Also, I'm having a hard time understanding this: `some query predicates will be 
driven into datastore`.


> Support pushing down query predicates using Cloudant Query / CouchDB Mango 
> Query
> 
>
> Key: BAHIR-102
> URL: https://issues.apache.org/jira/browse/BAHIR-102
> Project: Bahir
>  Issue Type: Improvement
>Reporter: Yang Lei
>Assignee: Yang Lei
>
> The feature of Cloudant Query / ChoudDB Mango Query is stated here: 
> https://blog.couchdb.org/2016/08/03/feature-mango-query/.
> Will enable pushing down first level AND column filtering to _find selector 
> to replace _all_docs for the database query; will continue using skip+limit 
> to offer partition and parallel loading.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-102) Support pushing down query predicates using Cloudant Query / CouchDB Mango Query

2017-04-07 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15961561#comment-15961561
 ] 

ASF GitHub Bot commented on BAHIR-102:
--

Github user ApacheBahir commented on the issue:

https://github.com/apache/bahir/pull/41
  

Refer to this link for build results (access rights to CI server needed): 
http://169.45.79.58:8080/job/bahir_spark_pr_builder/54/



> Support pushing down query predicates using Cloudant Query / CouchDB Mango 
> Query
> 
>
> Key: BAHIR-102
> URL: https://issues.apache.org/jira/browse/BAHIR-102
> Project: Bahir
>  Issue Type: Improvement
>Reporter: Yang Lei
>Assignee: Yang Lei
>
> The feature of Cloudant Query / ChoudDB Mango Query is stated here: 
> https://blog.couchdb.org/2016/08/03/feature-mango-query/.
> Will enable pushing down first level AND column filtering to _find selector 
> to replace _all_docs for the database query; will continue using skip+limit 
> to offer partition and parallel loading.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-102) Support pushing down query predicates using Cloudant Query / CouchDB Mango Query

2017-04-07 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15961560#comment-15961560
 ] 

ASF GitHub Bot commented on BAHIR-102:
--

Github user ApacheBahir commented on the issue:

https://github.com/apache/bahir/pull/41
  
Build successful
 



> Support pushing down query predicates using Cloudant Query / CouchDB Mango 
> Query
> 
>
> Key: BAHIR-102
> URL: https://issues.apache.org/jira/browse/BAHIR-102
> Project: Bahir
>  Issue Type: Improvement
>Reporter: Yang Lei
>Assignee: Yang Lei
>
> The feature of Cloudant Query / ChoudDB Mango Query is stated here: 
> https://blog.couchdb.org/2016/08/03/feature-mango-query/.
> Will enable pushing down first level AND column filtering to _find selector 
> to replace _all_docs for the database query; will continue using skip+limit 
> to offer partition and parallel loading.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-102) Support pushing down query predicates using Cloudant Query / CouchDB Mango Query

2017-04-07 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15961559#comment-15961559
 ] 

ASF GitHub Bot commented on BAHIR-102:
--

Github user lresende commented on the issue:

https://github.com/apache/bahir/pull/41
  
ok to test


> Support pushing down query predicates using Cloudant Query / CouchDB Mango 
> Query
> 
>
> Key: BAHIR-102
> URL: https://issues.apache.org/jira/browse/BAHIR-102
> Project: Bahir
>  Issue Type: Improvement
>Reporter: Yang Lei
>Assignee: Yang Lei
>
> The feature of Cloudant Query / ChoudDB Mango Query is stated here: 
> https://blog.couchdb.org/2016/08/03/feature-mango-query/.
> Will enable pushing down first level AND column filtering to _find selector 
> to replace _all_docs for the database query; will continue using skip+limit 
> to offer partition and parallel loading.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BAHIR-102) Support pushing down query predicates using Cloudant Query / CouchDB Mango Query

2017-04-07 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BAHIR-102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15961557#comment-15961557
 ] 

ASF GitHub Bot commented on BAHIR-102:
--

Github user ApacheBahir commented on the issue:

https://github.com/apache/bahir/pull/41
  
Can one of the admins verify this patch?


> Support pushing down query predicates using Cloudant Query / CouchDB Mango 
> Query
> 
>
> Key: BAHIR-102
> URL: https://issues.apache.org/jira/browse/BAHIR-102
> Project: Bahir
>  Issue Type: Improvement
>Reporter: Yang Lei
>Assignee: Yang Lei
>
> The feature of Cloudant Query / ChoudDB Mango Query is stated here: 
> https://blog.couchdb.org/2016/08/03/feature-mango-query/.
> Will enable pushing down first level AND column filtering to _find selector 
> to replace _all_docs for the database query; will continue using skip+limit 
> to offer partition and parallel loading.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)