[jira] [Closed] (HAWQ-1483) cache lookup failure

2018-07-25 Thread Radar Lei (JIRA)


 [ 
https://issues.apache.org/jira/browse/HAWQ-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Radar Lei closed HAWQ-1483.
---
Resolution: Cannot Reproduce

> cache lookup failure
> 
>
> Key: HAWQ-1483
> URL: https://issues.apache.org/jira/browse/HAWQ-1483
> Project: Apache HAWQ
>  Issue Type: Bug
>Reporter: Rahul Iyer
>Assignee: Radar Lei
>Priority: Major
> Fix For: 2.4.0.0-incubating
>
>
> I'm getting a failure when performing a distinct count with another immutable 
> aggregate. We found this issue when running MADlib on HAWQ 2.0.0. Please find 
> below a simple repro. 
> Setup: 
> {code}
> CREATE TABLE example_data(
> id SERIAL,
> outlook text,
> temperature float8,
> humidity float8,
> windy text,
> class text) ;
> COPY example_data (outlook, temperature, humidity, windy, class) FROM stdin 
> DELIMITER ',' NULL '?' ;
> sunny, 85, 85, false, Don't Play
> sunny, 80, 90, true, Don't Play
> overcast, 83, 78, false, Play
> rain, 70, 96, false, Play
> rain, 68, 80, false, Play
> rain, 65, 70, true, Don't Play
> overcast, 64, 65, true, Play
> sunny, 72, 95, false, Don't Play
> sunny, 69, 70, false, Play
> rain, 75, 80, false, Play
> sunny, 75, 70, true, Play
> overcast, 72, 90, true, Play
> overcast, 81, 75, false, Play
> rain, 71, 80, true, Don't Play
> \.
> create function grt_sfunc(agg_state point, el float8)
> returns point
> immutable
> language plpgsql
> as $$
> declare
>   greatest_sum float8;
>   current_sum float8;
> begin
>   current_sum := agg_state[0] + el;
>   if agg_state[1] < current_sum then
> greatest_sum := current_sum;
>   else
> greatest_sum := agg_state[1];
>   end if;
>   return point(current_sum, greatest_sum);
> end;
> $$;
> create function grt_finalfunc(agg_state point)
> returns float8
> immutable
> strict
> language plpgsql
> as $$
> begin
>   return agg_state[1];
> end;
> $$;
> create aggregate greatest_running_total (float8)
> (
> sfunc = grt_sfunc,
> stype = point,
> finalfunc = grt_finalfunc
> );
> {code}
> Error: 
> {code}
> select count(distinct outlook), greatest_running_total(humidity::integer) 
> from example_data;
> {code} 
> {code}
> ERROR:  cache lookup failed for function 0 (fmgr.c:223)
> {code}
> Execution goes through if I remove the {{distinct}} or if I add another 
> column for the {{count(distinct)}}. 
> {code:sql}
> select count(distinct outlook) as c1, count(distinct windy) as c2, 
> greatest_running_total(humidity) from example_data;
> {code}
> {code}
>  c1 | c2 | greatest_running_total
> ++
>   3 |  2 |
> (1 row)
> {code}
> {code:sql}
> select count(outlook) as c1, greatest_running_total(humidity) from 
> example_data;
> {code}
> {code}
>  count | greatest_running_total
> ---+
> 14 |
> (1 row)
> {code}
> It's an older build - I don't have the resources at present to test this on 
> the latest HAWQ. 
> {code}
> select version();
>   
>   version
> ---
>  PostgreSQL 8.2.15 (Greenplum Database 4.2.0 build 1) (HAWQ 2.0.0.0 build 
> 22126) on x86_64-unknown-linux-gnu, compiled by GCC gcc (GCC) 4.4.2 compiled 
> on Apr 25 2016 09:52:54
> (1 row)
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[GitHub] incubator-hawq pull request #1382: Relogin from keytab when security is enab...

2018-07-25 Thread benchristel
GitHub user benchristel opened a pull request:

https://github.com/apache/incubator-hawq/pull/1382

Relogin from keytab when security is enabled instead of using the TOKEN

- We are now supporting Kerberos login with GPDB, which unlike HAWQ does
  not pass the TOKEN parameter. Thus, we re-login from the local keytab
  to authenticate the user.

Co-authored-by: Lav Jain 
Co-authored-by: Ben Christel 
Co-authored-by: Shivram Mani 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/lavjain/incubator-hawq kerberize_pxf

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-hawq/pull/1382.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1382


commit ea87935819ac7952181869caab0e5fd82842fa05
Author: Lav Jain 
Date:   2018-07-25T21:06:37Z

Relogin from keytab when security is enabled instead of using the TOKEN

- We are now supporting Kerberos login with GPDB, which unlike HAWQ does
  not pass the TOKEN parameter. Thus, we re-login from the local keytab
  to authenticate the user.

Co-authored-by: Lav Jain 
Co-authored-by: Ben Christel 
Co-authored-by: Shivram Mani 




---


[jira] [Commented] (HAWQ-1483) cache lookup failure

2018-07-25 Thread Radar Lei (JIRA)


[ 
https://issues.apache.org/jira/browse/HAWQ-1483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16555476#comment-16555476
 ] 

Radar Lei commented on HAWQ-1483:
-

Can not reproduce in latest 2.3.0.0 version, should already been fixed.

> cache lookup failure
> 
>
> Key: HAWQ-1483
> URL: https://issues.apache.org/jira/browse/HAWQ-1483
> Project: Apache HAWQ
>  Issue Type: Bug
>Reporter: Rahul Iyer
>Assignee: Radar Lei
>Priority: Major
> Fix For: 2.4.0.0-incubating
>
>
> I'm getting a failure when performing a distinct count with another immutable 
> aggregate. We found this issue when running MADlib on HAWQ 2.0.0. Please find 
> below a simple repro. 
> Setup: 
> {code}
> CREATE TABLE example_data(
> id SERIAL,
> outlook text,
> temperature float8,
> humidity float8,
> windy text,
> class text) ;
> COPY example_data (outlook, temperature, humidity, windy, class) FROM stdin 
> DELIMITER ',' NULL '?' ;
> sunny, 85, 85, false, Don't Play
> sunny, 80, 90, true, Don't Play
> overcast, 83, 78, false, Play
> rain, 70, 96, false, Play
> rain, 68, 80, false, Play
> rain, 65, 70, true, Don't Play
> overcast, 64, 65, true, Play
> sunny, 72, 95, false, Don't Play
> sunny, 69, 70, false, Play
> rain, 75, 80, false, Play
> sunny, 75, 70, true, Play
> overcast, 72, 90, true, Play
> overcast, 81, 75, false, Play
> rain, 71, 80, true, Don't Play
> \.
> create function grt_sfunc(agg_state point, el float8)
> returns point
> immutable
> language plpgsql
> as $$
> declare
>   greatest_sum float8;
>   current_sum float8;
> begin
>   current_sum := agg_state[0] + el;
>   if agg_state[1] < current_sum then
> greatest_sum := current_sum;
>   else
> greatest_sum := agg_state[1];
>   end if;
>   return point(current_sum, greatest_sum);
> end;
> $$;
> create function grt_finalfunc(agg_state point)
> returns float8
> immutable
> strict
> language plpgsql
> as $$
> begin
>   return agg_state[1];
> end;
> $$;
> create aggregate greatest_running_total (float8)
> (
> sfunc = grt_sfunc,
> stype = point,
> finalfunc = grt_finalfunc
> );
> {code}
> Error: 
> {code}
> select count(distinct outlook), greatest_running_total(humidity::integer) 
> from example_data;
> {code} 
> {code}
> ERROR:  cache lookup failed for function 0 (fmgr.c:223)
> {code}
> Execution goes through if I remove the {{distinct}} or if I add another 
> column for the {{count(distinct)}}. 
> {code:sql}
> select count(distinct outlook) as c1, count(distinct windy) as c2, 
> greatest_running_total(humidity) from example_data;
> {code}
> {code}
>  c1 | c2 | greatest_running_total
> ++
>   3 |  2 |
> (1 row)
> {code}
> {code:sql}
> select count(outlook) as c1, greatest_running_total(humidity) from 
> example_data;
> {code}
> {code}
>  count | greatest_running_total
> ---+
> 14 |
> (1 row)
> {code}
> It's an older build - I don't have the resources at present to test this on 
> the latest HAWQ. 
> {code}
> select version();
>   
>   version
> ---
>  PostgreSQL 8.2.15 (Greenplum Database 4.2.0 build 1) (HAWQ 2.0.0.0 build 
> 22126) on x86_64-unknown-linux-gnu, compiled by GCC gcc (GCC) 4.4.2 compiled 
> on Apr 25 2016 09:52:54
> (1 row)
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HAWQ-1639) Unexpected internal error when truncate and alter in a transaction

2018-07-25 Thread Radar Lei (JIRA)


[ 
https://issues.apache.org/jira/browse/HAWQ-1639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16555442#comment-16555442
 ] 

Radar Lei commented on HAWQ-1639:
-

Please check if you hit the limitation.

[https://hawq.incubator.apache.org/docs/userguide/2.1.0.0-incubating/reference/sql/ALTER-TABLE.html]
h2. Limitations

HAWQ does not support using {{ALTER TABLE}} to {{ADD}} or {{DROP}} a column in 
an existing Parquet table.

> Unexpected internal error when truncate and alter in a transaction
> --
>
> Key: HAWQ-1639
> URL: https://issues.apache.org/jira/browse/HAWQ-1639
> Project: Apache HAWQ
>  Issue Type: Bug
>  Components: Core
>Affects Versions: 2.3.0.0-incubating
>Reporter: TaoJIn
>Assignee: Radar Lei
>Priority: Major
> Fix For: backlog
>
>
> hdb=# select version();
>   
>  version  
>    
>    
>  
> --
>  --
>   PostgreSQL 8.2.15 (Greenplum Database 4.2.0 build 1) (HAWQ 
> 2.3.0.0-incubating build dev) on x86_64-unknown-linux-gnu, compiled by GCC 
> gcc (GCC) 4.8.5 20150623 (R
>  ed Hat 4.8.5-16) compiled on May  4 2018 06:27:27
>  (1 row)
>  
>  hdb=# begin;
>  BEGIN
>  hdb=# select * from test limit 2;
>   a  
>  
>   asdfsdgrtecvxbfgdh
>   asdfsdgrtecvxbfgdh
>  (2 rows)
>  
>  hdb=# truncate table test;
>  TRUNCATE TABLE
>  hdb=# select * from test limit 2;
>   a 
>  ---
>  (0 rows)
>  
>  hdb=# alter table test add column b varchar(20) default '';
>  ALTER TABLE
>  hdb=# commit;
>  ERROR:  Unexpected internal error (appendonlywriter.c:525)
>  hdb=# rollback;
>  WARNING:  there is no transaction in progress
>  ROLLBACK
>  hdb=#



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (HAWQ-1643) How to solve this problem in HAWQ install on centos 7 with version 2.1.0 ?

2018-07-25 Thread Radar Lei (JIRA)


[ 
https://issues.apache.org/jira/browse/HAWQ-1643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16555432#comment-16555432
 ] 

Radar Lei commented on HAWQ-1643:
-

I did not see this error before.

Please make sure all the dependencies are installed.

You can refer to: 
https://cwiki.apache.org/confluence/display/HAWQ/Build+and+Install#idq3fsX3CO

> How to solve this problem in HAWQ install on centos 7 with version 2.1.0 ?
> --
>
> Key: HAWQ-1643
> URL: https://issues.apache.org/jira/browse/HAWQ-1643
> Project: Apache HAWQ
>  Issue Type: Task
>Reporter: ercengsha
>Assignee: Radar Lei
>Priority: Major
>
> Hello managers,Here are Problem Descript below:
> this problems raised in process of make 
>  
> gcc -O3 -std=gnu99  -Wall -Wmissing-prototypes -Wpointer-arith  
> -Wendif-labels -Wformat-security -fno-strict-aliasing -fwrapv 
> -fno-aggressive-loop-optimizations  -I/usr/include/libxml2 -fpic -I. 
> -I../../src/include -D_GNU_SOURCE  -I***- 
> incubating/depends/libhdfs3/build/install/usr/local/hawq/include -I ***-  -c 
> -o sqlparse.o sqlparse.c
>  *+sqlparse.y: In function ‘orafce_sql_yyparse’:+*
>  *+sqlparse.y:88:17: error: ‘result’ undeclared (first use in this function)+*
>    *+elements \{*((void*)result) = $1; }+*
>                         *+^+*
>  *+sqlparse.y:88:17: note: each undeclared identifier is reported only once 
> for each function it appears in+*
>  make[2]: *** [sqlparse.o] Error 1
>  make[2]: *** Waiting for unfinished jobs
>  make[2]: Leaving directory `***`
>  make[1]: *** [all] Error 2
>  make[1]: Leaving directory `***`
>  make: *** [all] Error 2



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Resolved] (HAWQ-1593) Vectorized execution condition check in plan tree

2018-07-25 Thread Radar Lei (JIRA)


 [ 
https://issues.apache.org/jira/browse/HAWQ-1593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Radar Lei resolved HAWQ-1593.
-
Resolution: Fixed

Resolve this issue since the fix is merged.

> Vectorized execution condition check in plan tree 
> --
>
> Key: HAWQ-1593
> URL: https://issues.apache.org/jira/browse/HAWQ-1593
> Project: Apache HAWQ
>  Issue Type: Sub-task
>  Components: Query Execution
>Reporter: WANG Weinan
>Assignee: zhangshujie
>Priority: Major
> Fix For: 2.4.0.0-incubating
>
>
> check and assign "v" tag in plan tree each node.
> if a node is a leaf node and all expression can be vectorized execute, assign 
> a "v" tag 
> if a node's all child nodes are assigned "v" tag and all expression can be 
> vectorized execute, assign a "v" tag



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Resolved] (HAWQ-1592) vectorized data types initialization and relevant function definetion

2018-07-25 Thread Radar Lei (JIRA)


 [ 
https://issues.apache.org/jira/browse/HAWQ-1592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Radar Lei resolved HAWQ-1592.
-
Resolution: Fixed

Resolve this issue since the fix is merged.

> vectorized data types initialization and relevant function definetion
> -
>
> Key: HAWQ-1592
> URL: https://issues.apache.org/jira/browse/HAWQ-1592
> Project: Apache HAWQ
>  Issue Type: Sub-task
>  Components: Query Execution
>Reporter: WANG Weinan
>Assignee: zhangshujie
>Priority: Major
> Fix For: 2.4.0.0-incubating
>
>
> * vectorization data type initialization
>  * type relevant operation declaration
>  * expose these types in the catalog table
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)