[GitHub] incubator-hawq issue #839: HAWQ-983. Fix bug that minirepro generates wrong ...

2016-08-05 Thread hsyuan 
Github user hsyuan commented on the issue:

https://github.com/apache/incubator-hawq/pull/839
  
@changleicn @liming01 Please take a look.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Created] (HAWQ-983) Minirepro generate wrong dependency order of objects and miss CTE relations

2016-08-05 Thread Haisheng Yuan (JIRA) 
Haisheng Yuan created HAWQ-983:
--

 Summary: Minirepro generate wrong dependency order of objects and 
miss CTE relations
 Key: HAWQ-983
 URL: https://issues.apache.org/jira/browse/HAWQ-983
 Project: Apache HAWQ
  Issue Type: Bug
  Components: Command Line Tools
Reporter: Haisheng Yuan
Assignee: Lei Chang


The minirepro generate scripts in the wrong dependency order if dtabase 
relations are in different schemas. In addition, it misses relations in CTE and 
function objects.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HAWQ-982) PL/Python with psycopg2 cannot connect to remote postgres

2016-08-05 Thread Lei Chang (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HAWQ-982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei Chang updated HAWQ-982:
---
Fix Version/s: backlog

> PL/Python with psycopg2 cannot connect to remote postgres
> -
>
> Key: HAWQ-982
> URL: https://issues.apache.org/jira/browse/HAWQ-982
> Project: Apache HAWQ
>  Issue Type: Bug
>  Components: Core
>Reporter: Lei Chang
>Assignee: Ruilong Huo
> Fix For: backlog
>
>
> For one use case I want to connect to external postgreSQL database from HAWQ 
> PL/Python procedure.
> I use python psycopg2 library.
> Remote postgreSQL server reject connecion from HAWQ  with 
> this error :  FATAL  unsupported frontend protocol 28675.0: server supports 
> 1.0 to 3.0.
> The same python code is running well from OS level.
> I wonder if  it is  HAWQ or PostgreSQL PL/Python interpreter related issiue.
> Any help or pointers would be great.
> ---
> my code below:
> CREATE OR REPLACE FUNCTION dchoma.connection_test( ) RETURNS text AS
> $$
> import psycopg2
> try:
> conn = psycopg2.connect("dbname='database_name' user='user' 
> host='remote_host' password='pass' port=5432")
> return "Connection successful "
> except Exception , msg :
> return "Exception: {m}".format(m=msg)
> $$
> LANGUAGE 'plpythonu' VOLATILE;
> select * from dchoma.connection_test();
> HAWQ version 2.0.1.0 build dev ( compiled from github)
> Remote database version:  PostgreSQL 9.2.15 on x86_64-redhat-linux-gnu, 
> compiled by gcc (GCC) 4.8.5 20150623 (Red Hat 4.8.5-4), 64-bit
> OS: CentOS 7-1511
> i found similar issiue here, but the problem is not solved.
> https://discuss.zendesk.com/hc/en-us/community/posts/200793368-greenplum-dblink-postgresql-remote-is-error



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (HAWQ-982) PL/Python with psycopg2 cannot connect to remote postgres

2016-08-05 Thread Lei Chang (JIRA) 
Lei Chang created HAWQ-982:
--

 Summary: PL/Python with psycopg2 cannot connect to remote postgres
 Key: HAWQ-982
 URL: https://issues.apache.org/jira/browse/HAWQ-982
 Project: Apache HAWQ
  Issue Type: Bug
  Components: Core
Reporter: Lei Chang
Assignee: Lei Chang



For one use case I want to connect to external postgreSQL database from HAWQ 
PL/Python procedure.
I use python psycopg2 library.
Remote postgreSQL server reject connecion from HAWQ  with 
this error :  FATAL  unsupported frontend protocol 28675.0: server supports 1.0 
to 3.0.
The same python code is running well from OS level.

I wonder if  it is  HAWQ or PostgreSQL PL/Python interpreter related issiue.
Any help or pointers would be great.

---
my code below:

CREATE OR REPLACE FUNCTION dchoma.connection_test( ) RETURNS text AS
$$
import psycopg2

try:
conn = psycopg2.connect("dbname='database_name' user='user' 
host='remote_host' password='pass' port=5432")
return "Connection successful "
except Exception , msg :
return "Exception: {m}".format(m=msg)
$$
LANGUAGE 'plpythonu' VOLATILE;

select * from dchoma.connection_test();


HAWQ version 2.0.1.0 build dev ( compiled from github)
Remote database version:  PostgreSQL 9.2.15 on x86_64-redhat-linux-gnu, 
compiled by gcc (GCC) 4.8.5 20150623 (Red Hat 4.8.5-4), 64-bit
OS: CentOS 7-1511

i found similar issiue here, but the problem is not solved.
https://discuss.zendesk.com/hc/en-us/community/posts/200793368-greenplum-dblink-postgresql-remote-is-error




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (HAWQ-982) PL/Python with psycopg2 cannot connect to remote postgres

2016-08-05 Thread Lei Chang (JIRA) 

 [ 
https://issues.apache.org/jira/browse/HAWQ-982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lei Chang updated HAWQ-982:
---
Assignee: Ruilong Huo  (was: Lei Chang)

> PL/Python with psycopg2 cannot connect to remote postgres
> -
>
> Key: HAWQ-982
> URL: https://issues.apache.org/jira/browse/HAWQ-982
> Project: Apache HAWQ
>  Issue Type: Bug
>  Components: Core
>Reporter: Lei Chang
>Assignee: Ruilong Huo
> Fix For: backlog
>
>
> For one use case I want to connect to external postgreSQL database from HAWQ 
> PL/Python procedure.
> I use python psycopg2 library.
> Remote postgreSQL server reject connecion from HAWQ  with 
> this error :  FATAL  unsupported frontend protocol 28675.0: server supports 
> 1.0 to 3.0.
> The same python code is running well from OS level.
> I wonder if  it is  HAWQ or PostgreSQL PL/Python interpreter related issiue.
> Any help or pointers would be great.
> ---
> my code below:
> CREATE OR REPLACE FUNCTION dchoma.connection_test( ) RETURNS text AS
> $$
> import psycopg2
> try:
> conn = psycopg2.connect("dbname='database_name' user='user' 
> host='remote_host' password='pass' port=5432")
> return "Connection successful "
> except Exception , msg :
> return "Exception: {m}".format(m=msg)
> $$
> LANGUAGE 'plpythonu' VOLATILE;
> select * from dchoma.connection_test();
> HAWQ version 2.0.1.0 build dev ( compiled from github)
> Remote database version:  PostgreSQL 9.2.15 on x86_64-redhat-linux-gnu, 
> compiled by gcc (GCC) 4.8.5 20150623 (Red Hat 4.8.5-4), 64-bit
> OS: CentOS 7-1511
> i found similar issiue here, but the problem is not solved.
> https://discuss.zendesk.com/hc/en-us/community/posts/200793368-greenplum-dblink-postgresql-remote-is-error



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (HAWQ-256) Integrate Security with Apache Ranger

2016-08-05 Thread Don Bosco Durai (JIRA) 

[ 
https://issues.apache.org/jira/browse/HAWQ-256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15409208#comment-15409208
 ] 

Don Bosco Durai commented on HAWQ-256:
--

[~lilima], this is looking good. Just couple of comments:

1. 4.3 is not needed. The policies will be cached in Ranger REST Service
2. Section 6: REST API interface - We should get reviewed with few folks in the 
Ranger team. There could be already something which we could use and extend
3. Section 6 - We should review the Hive model. SQL command might have multiple 
resources and different actions on them. E.g. Join, CTAS, etc. So single 
resource might not work. It needs to be be complex object



> Integrate Security with Apache Ranger
> -
>
> Key: HAWQ-256
> URL: https://issues.apache.org/jira/browse/HAWQ-256
> Project: Apache HAWQ
>  Issue Type: New Feature
>  Components: PXF, Security
>Reporter: Michael Andre Pearce (IG)
>Assignee: Lili Ma
> Fix For: backlog
>
> Attachments: HAWQRangerSupportDesign.pdf
>
>
> Integrate security with Apache Ranger for a unified Hadoop security solution. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] incubator-hawq pull request #837: HAWQ-779 support pxf filter pushdwon at th...

2016-08-05 Thread jiadexin 
GitHub user jiadexin opened a pull request:

https://github.com/apache/incubator-hawq/pull/837

HAWQ-779 support pxf filter pushdwon at the 'CREATE PLAN' stage ,and …

1.support  pxf filter pushdwon at the 'CREATE PLAN' stage -- 
src/backend/optimizer/plan/createplan.c
2.Due to '1' causes produce HAWQ-953 error, modify HiveDataFragmenter.java
3.add 'Date type'  filter and  'HDOP_LIKE' op -- 
pxffilters.h,pxffilters.c,FilterParser.java , and update the corresponding test 
-- FilterParserTest.java,pxffilters_test.c
4.Due to '2' cause,modified HBaseFilterBuilder.java to handle 'HDOP_LIKE' 
op.
5. 'Date filter' and  'HDOP_LIKE' used in 
pxf-solr/pxf-jdbc(https://github.com/inspur-insight/pxf-plugin)
6.By this amendment, I think: 'PXF Filter' architecture coupling is too 
high, I just want to add new types and op, but had to modify other components 
.i hope to improve the architecture .



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/inspur-insight/incubator-hawq HAWQ-779

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-hawq/pull/837.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #837


commit 3518b4af22af281909140bc011884420de540cc6
Author: Devin Jia 
Date:   2016-08-05T07:05:50Z

HAWQ-779 support pxf filter pushdwon at the 'CREATE PLAN' stage ,and more 
filter type & op




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-hawq issue #835: HAWQ-980. hawq does not handle guc value with spa...

2016-08-05 Thread paul-guo- 
Github user paul-guo- commented on the issue:

https://github.com/apache/incubator-hawq/pull/835
  
@wengyanqing 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-hawq issue #835: HAWQ-980. hawq does not handle guc value with spa...

2016-08-05 Thread paul-guo- 
Github user paul-guo- commented on the issue:

https://github.com/apache/incubator-hawq/pull/835
  
@ictmalili @zhangh43 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---