Re: Remain with HAWQ project or not?

2018-05-07 Thread Paul Guo
Yes. Thanks Radar to drive HAWQ graduation. 2018-05-08 12:02 GMT+08:00 Lirong Jian : > Yes, I would like to remain a committer. > > Lirong > > Lirong Jian > HashData Inc. > > 2018-05-08 10:04 GMT+08:00 Hubert Zhang : > > > Yes. > > > > On Tue, May 8, 2018 at 9:30 AM, Lili Ma wrote: > > > > > Yes

Re: error from configure script

2018-03-20 Thread Paul Guo
Do you have bzip2-devel installed via yum? It seems that bzip2 1.0.5 worked fine with HAWQ on my centos6 environment. 2018-03-20 17:53 GMT+08:00 李明庆 : > Hi. My env is CentOS release 6.8 . > > env: > > # bzip2 --version > > bzip2, a block-sorting file compressor. Version 1.0.6, 6-Sept-2010.

Re: [ANNOUNCE] Apache HAWQ 2.2.0.0-incubating Released

2017-07-13 Thread Paul Guo
Congratulations. Now we have the first binary release, I think it is not far for HAWQ to graduate. Also +1 for Yi. 2017-07-13 17:09 GMT+08:00 Amy Bai : > Congrats! +1 for Yi , the top committer to be next release manager. > > On Thu, Jul 13, 2017 at 5:07 PM, 陶征霖 wrote: > > > +1 for Yi, the top c

[jira] [Created] (HAWQ-1478) Enable hawq build on suse11

2017-05-31 Thread Paul Guo (JIRA)
Paul Guo created HAWQ-1478: -- Summary: Enable hawq build on suse11 Key: HAWQ-1478 URL: https://issues.apache.org/jira/browse/HAWQ-1478 Project: Apache HAWQ Issue Type: Bug Reporter: Paul

Re: New committer: Xiang Sheng

2017-05-16 Thread Paul Guo
Congratulations, Xiang. 2017-05-17 10:21 GMT+08:00 Ruilong Huo : > Well deserved! Congratulations Xiang! > > Best regards, > Ruilong Huo > > On Wed, May 17, 2017 at 10:15 AM, Brian Lu wrote: > > > Congratulations Xiang! > > > > Best Regards, > > Brian > > > > On Wed, May 17, 2017 at 10:15 AM, Iv

[jira] [Created] (HAWQ-1460) WAL Send Server process should exit if postmaster on master is killed

2017-05-09 Thread Paul Guo (JIRA)
Paul Guo created HAWQ-1460: -- Summary: WAL Send Server process should exit if postmaster on master is killed Key: HAWQ-1460 URL: https://issues.apache.org/jira/browse/HAWQ-1460 Project: Apache HAWQ

[jira] [Created] (HAWQ-1459) Tweak the feature test related entries in makefiles.

2017-05-09 Thread Paul Guo (JIRA)
Paul Guo created HAWQ-1459: -- Summary: Tweak the feature test related entries in makefiles. Key: HAWQ-1459 URL: https://issues.apache.org/jira/browse/HAWQ-1459 Project: Apache HAWQ Issue Type: Bug

[jira] [Created] (HAWQ-1457) Shared memory for SegmentStatus and MetadataCache should not be allocated on segments.

2017-05-09 Thread Paul Guo (JIRA)
Paul Guo created HAWQ-1457: -- Summary: Shared memory for SegmentStatus and MetadataCache should not be allocated on segments. Key: HAWQ-1457 URL: https://issues.apache.org/jira/browse/HAWQ-1457 Project

[jira] [Created] (HAWQ-1455) Wrong results on CTAS query over catalog

2017-05-05 Thread Paul Guo (JIRA)
Paul Guo created HAWQ-1455: -- Summary: Wrong results on CTAS query over catalog Key: HAWQ-1455 URL: https://issues.apache.org/jira/browse/HAWQ-1455 Project: Apache HAWQ Issue Type: Bug

An deadlock issue (between entrydb and QD)

2017-04-28 Thread Paul Guo
While looking at a ctas issue which involves join of some catalog tables we found that entrydb is not using the catalog tables for the query db thus the query result will be wrong. Further looking at the issue, it seems that it is a regression that was introduced by a fix for a deadlock bug HAWQ-51

[jira] [Created] (HAWQ-1444) Need to replace gettimeofday() with clock_gettime() for related timeout checking code

2017-04-26 Thread Paul Guo (JIRA)
Paul Guo created HAWQ-1444: -- Summary: Need to replace gettimeofday() with clock_gettime() for related timeout checking code Key: HAWQ-1444 URL: https://issues.apache.org/jira/browse/HAWQ-1444 Project

Re: s/gettimeofday/clock_gettime/ in hawq?

2017-04-25 Thread Paul Guo
Exactly. 2017-04-25 22:40 GMT+08:00 Lei Chang : > Good catch. There are a lot of uses of getimeofday for timeout. > > clock_gettime is also affected by NTP if NTP moves time back except > that CLOCK_MONOTONIC > option is used. > > Thanks > Lei > > > On Mon,

Slow "make distclean"

2017-04-24 Thread Paul Guo
I just tired to build a hawq from scratch, however "make distclean" is quite slow in the following step, make[1]: Leaving directory `/data/github/incubator-hawq2/src' make -C pxf distclean make[1]: Entering directory `/data/github/incubator-hawq2/pxf' ./gradlew clean % Total% Received % Xfer

Re: s/gettimeofday/clock_gettime/ in hawq?

2017-04-24 Thread Paul Guo
org/onlinepubs/9699919799/ > functions/gettimeofday.html > > Regards > Mike > > ____ > From: Paul Guo > Sent: Monday, April 24, 2017 6:36 AM > To: dev@hawq.incubator.apache.org > Subject: s/gettimeofday/clock_gettime/ in hawq? > >

Re: [VOTE] Apache HAWQ Incubator "powered by" logo vote

2017-04-23 Thread Paul Guo
I'd like for the log, with "HAWQ" text, but without drop shadow. 2017-04-23 5:08 GMT+08:00 Alex (Oleksandr) Diachenko : > +1 for HAWQ logo, with "HAWQ" text, with drop shadow > > On Sat, Apr 22, 2017 at 9:11 AM, Lili Ma wrote: > > > +1 HAWQ logo, with "HAWQ" text, with drop shadow > > > > On Sa

s/gettimeofday/clock_gettime/ in hawq?

2017-04-23 Thread Paul Guo
Hi, HAWQ sometimes use gettimeofday() syscall for some timeout check in various module, however it could be affected by ntp, so the timeout checking logic could be wrong sometimes. I would propose to use clock_gettime() to replace it on Linux (I have not investigated the alternative on other platf

Re: [VOTE]: Apache HAWQ 2.2.0.0-incubating Release (RC2)

2017-04-12 Thread Paul Guo
+1 Tried compiling with simple options and then installing the binaries, also tried installing with the rpm packets following the wiki page. I tested some simple queries with the default setting. 2017-04-12 16:39 GMT+08:00 Radar Da lei : > +1 > > Following the install wiki page step by step, I

Re: [VOTE]: Apache HAWQ 2.2.0.0-incubating Release

2017-04-05 Thread Paul Guo
+1 Download src package, build and simple test on centos7.x Download rpm packages, install following the page below, and simple test on centos7.x https://cwiki.apache.org/confluence/display/HAWQ/Build+Package+and+Install+with+RPM Checked release note, etc document. 2017-04-05 15:39 GMT+08:00

Re: DRAFT: ASF HAWQ Incubator PMC report for April 2017

2017-04-01 Thread Paul Guo
Compute - A SQL engine based on Apache HAWQ by Chen >> Xia, >> > > > Database Expert in Alibaba Cloud >> > > > >> > > > 2. A significant push by the dev community has been made to review >> > > > and merge the project's Pull Requ

[jira] [Created] (HAWQ-1413) Generate tools/bin/gppylib/data/*.json automatically

2017-03-27 Thread Paul Guo (JIRA)
Paul Guo created HAWQ-1413: -- Summary: Generate tools/bin/gppylib/data/*.json automatically Key: HAWQ-1413 URL: https://issues.apache.org/jira/browse/HAWQ-1413 Project: Apache HAWQ Issue Type: Bug

Re: Need help on HAWQ Build

2017-03-15 Thread Paul Guo
Hi Ketan, As Kyle said, we include Google Test in our code, however if we look at the Makefile in the root path, i.e. GNUmakefile.in, we build it before building other components automatically. Generally speaking, to install hawq, you install those dependencies (refer the installation wiki or co

[jira] [Created] (HAWQ-1386) Mask some generated files for pljava feature testing for git.

2017-03-14 Thread Paul Guo (JIRA)
Paul Guo created HAWQ-1386: -- Summary: Mask some generated files for pljava feature testing for git. Key: HAWQ-1386 URL: https://issues.apache.org/jira/browse/HAWQ-1386 Project: Apache HAWQ Issue

Re: Questions about filesystem / filespace / tablespace

2017-03-14 Thread Paul Guo
Hi Kyle, I'm not sure whether I understand your point correctly, but for FUSE which allows userspace file system implementation on Linux, users uses the filesystem (e.g. S3 in your example) as a block storage, accesses it via standard sys calls like open, close, read, write although some behaviour

Re: Apache HAWQ 2.2.0.0-incubating release plan and timeframe

2017-03-09 Thread Paul Guo
Just one thing: I do not think we should connect the next release with the commercial linux release Red Hat 7. 2017-03-10 14:15 GMT+08:00 stanly sheng : > Hi Ruilong, > > Release version : Apache HAWQ 2.2.0.0-incubator ? Apache HAWQ > 2.2.0.0-incubating ? > > Thanks > > 2017-03-10 13:28 GMT+08:00

Re: Thinking of how to fix HAWQ-1381

2017-03-07 Thread Paul Guo
Intersting. sprintf kind of unsafe functions should be really avoided unless some strong limitation in fmt is set. Maybe you could enlarge the array length and use snprintf, but it risks truncating and you need to append NULL byte for string if needed, or you allocate the size in need. 2017-03-08

[jira] [Created] (HAWQ-1379) Do not send options multiple times in build_startup_packet()

2017-03-06 Thread Paul Guo (JIRA)
Paul Guo created HAWQ-1379: -- Summary: Do not send options multiple times in build_startup_packet() Key: HAWQ-1379 URL: https://issues.apache.org/jira/browse/HAWQ-1379 Project: Apache HAWQ Issue

[jira] [Created] (HAWQ-1378) Elaborate the "invalid command-line arguments for server process" error.

2017-03-06 Thread Paul Guo (JIRA)
Paul Guo created HAWQ-1378: -- Summary: Elaborate the "invalid command-line arguments for server process" error. Key: HAWQ-1378 URL: https://issues.apache.org/jira/browse/HAWQ-1378 Project: A

Fwd: Apache HAWQ graduation update (Mar 1st, 2017)

2017-03-01 Thread Paul Guo
Hello everyone, I'd update some progress for the graduation. 1. Apache HAWQ 2.1.0.0-incubating has been released. This is the 2nd release for our project. It is a source release. You could download from the page below. http://hawq.incubator.apache.org/ 2. We have three new committers: Lisa O

Apache HAWQ graduation update (Mar 1st, 2017)

2017-03-01 Thread Paul Guo
Hello everyone, I'd update some progress for the graduation. 1. Apache HAWQ 2.1.0.0-incubating has been released. This is the 2nd release for our project. It is a source release. You could download from the page below. http://hawq.incubator.apache.org/ 2. We have three new committers: Lisa O

[jira] [Created] (HAWQ-1361) Remove ErrorTable in installcheck-good since it is in feature test suite now.

2017-02-23 Thread Paul Guo (JIRA)
Paul Guo created HAWQ-1361: -- Summary: Remove ErrorTable in installcheck-good since it is in feature test suite now. Key: HAWQ-1361 URL: https://issues.apache.org/jira/browse/HAWQ-1361 Project: Apache HAWQ

[jira] [Created] (HAWQ-1348) Some hawq utility helps should say default timeout is 600 seconds

2017-02-21 Thread Paul Guo (JIRA)
Paul Guo created HAWQ-1348: -- Summary: Some hawq utility helps should say default timeout is 600 seconds Key: HAWQ-1348 URL: https://issues.apache.org/jira/browse/HAWQ-1348 Project: Apache HAWQ

Re: [VOTE] Release Apache HAWQ 2.1.0.0-incubating (RC4)

2017-02-21 Thread Paul Guo
+1 ("paulguo") compile and install, basic license check, regression/feature testing. 2017-02-21 18:04 GMT+08:00 Xiang Sheng : > +1 for successfully mvn verify && configure && make && make install && > hawq start > > On Tue, Feb 21, 2017 at 4:09 PM, Hubert Zhang wrote: > > > +1 > > > > On Mon,

[jira] [Created] (HAWQ-1347) QD should check segment health only

2017-02-21 Thread Paul Guo (JIRA)
Paul Guo created HAWQ-1347: -- Summary: QD should check segment health only Key: HAWQ-1347 URL: https://issues.apache.org/jira/browse/HAWQ-1347 Project: Apache HAWQ Issue Type: Bug

Re: Notice: Will clean the to-be-private branch in Apache HAWQ public repository

2017-02-16 Thread Paul Guo
+1. I guess all HAWQ-* branches should be removed at least. 2.0.0.0-incubating branch is for 2.0.0.0-incubating? 2017-02-16 13:08 GMT+08:00 Yandong Yao : > +1 for this cleanup > > On Wed, Feb 15, 2017 at 2:01 PM, Lili Ma wrote: > > > Hi team, > > > > This page describes the process of contribut

[jira] [Created] (HAWQ-1337) Log stack info before forward signal sigsegv, sigill or sigbus in CdbProgramErrorHandler()

2017-02-15 Thread Paul Guo (JIRA)
Paul Guo created HAWQ-1337: -- Summary: Log stack info before forward signal sigsegv, sigill or sigbus in CdbProgramErrorHandler() Key: HAWQ-1337 URL: https://issues.apache.org/jira/browse/HAWQ-1337 Project

[jira] [Created] (HAWQ-1335) Need to refactor some QD error handling code.

2017-02-15 Thread Paul Guo (JIRA)
Paul Guo created HAWQ-1335: -- Summary: Need to refactor some QD error handling code. Key: HAWQ-1335 URL: https://issues.apache.org/jira/browse/HAWQ-1335 Project: Apache HAWQ Issue Type: Bug

[jira] [Created] (HAWQ-1334) QD thread should set error code if failing so that the main process for the query could exit soon

2017-02-15 Thread Paul Guo (JIRA)
Paul Guo created HAWQ-1334: -- Summary: QD thread should set error code if failing so that the main process for the query could exit soon Key: HAWQ-1334 URL: https://issues.apache.org/jira/browse/HAWQ-1334

[jira] [Created] (HAWQ-1327) Move ID from struct SegStatData to struct SegInfoData so that ID could be used in QD.

2017-02-13 Thread Paul Guo (JIRA)
Paul Guo created HAWQ-1327: -- Summary: Move ID from struct SegStatData to struct SegInfoData so that ID could be used in QD. Key: HAWQ-1327 URL: https://issues.apache.org/jira/browse/HAWQ-1327 Project

[jira] [Created] (HAWQ-1326) Cancel the query if one of the segments for the query crashes

2017-02-13 Thread Paul Guo (JIRA)
Paul Guo created HAWQ-1326: -- Summary: Cancel the query if one of the segments for the query crashes Key: HAWQ-1326 URL: https://issues.apache.org/jira/browse/HAWQ-1326 Project: Apache HAWQ Issue

Re: No email notification anymore for JIRA creation

2017-02-07 Thread Paul Guo
OK. Thanks. Will contact the apache infra team. 2017-02-08 9:39 GMT+08:00 Yandong Yao : > I encountered email issue before, have filed Apache INFRA JIRA and get it > resolved. > > On Tue, Feb 7, 2017 at 7:34 PM, Paul Guo wrote: > > > I'm not able to receive such kind

No email notification anymore for JIRA creation

2017-02-07 Thread Paul Guo
I'm not able to receive such kind of emails while previously I could. I did not modify my JIRA setting recently so I suspect whether some privileged administrative behaviours on Apache JIRA caused this or there is something wrong on Apache Infra. Anyone has similar experience? Or the HAWQ JIRA admi

Re: [VOTE]: Apache HAWQ 2.1.0.0-incubating Release Candidate 3 (RC3)

2017-02-07 Thread Paul Guo
; > > > > +1. Built, ran feature test & installcheck-good successfully. > > > > > > > > On Tue, Feb 7, 2017 at 12:01 PM, Yi Jin wrote: > > > > > > > > > Checked > > > > > > > > > > 1) download cod

Check segment node status in QD polling.

2017-02-06 Thread Paul Guo
I encountered a QD timeout issue recently. This happens when: 1) One of the segment node panick and then restarted. 2) Other segments hangs in interconnect (there will be retry until timeout). QD stays at loop of poll() until either QE reports error after interconnect timeout or libpq (QD<->QE)

Re: [VOTE]: Apache HAWQ 2.1.0.0-incubating Release Candidate 3 (RC3)

2017-02-06 Thread Paul Guo
Ed, I think we could extend the deadline a bit since I know some people was just back from vacation. 2017-02-03 18:07 GMT+08:00 Ed Espino : > This is the vote for Apache HAWQ (incubating) 2.1.0.0-incubating Release > Candidate 3 (RC3). This is a Source only release. > > The vote will run for at

Re: New Committer: Lisa Owen

2017-02-06 Thread Paul Guo
Congratulations! 2017-02-01 15:49 GMT+08:00 Roman Shaposhnik : > Congratulations Lisa! > > Here's to many more contributions to come! > > Thanks, > Roman. > > On Tue, Jan 31, 2017 at 4:25 PM, Ed Espino wrote: > > The Project Management Committee (PMC) for Apache HAWQ (incubating) has > > invited

Re: License Header info

2017-01-27 Thread Paul Guo
Unless the license header could not be practically added (e.g. .ans files for test). You will need to add the file(s) in pom.xml to avoid RAT check for this case. 2017-01-28 5:07 GMT+08:00 Roman Shaposhnik : > Actually, you really are required to apply license header to every file > nowdays. > >

Re: Have created one tech documents page to HAWQ wiki page and attached Ranger design doc

2017-01-24 Thread Paul Guo
Thanks. We now have a place to put internals related documents which will really benefit developers who are not that familiar with the HAWQ implementation. 2017-01-25 13:22 GMT+08:00 Ruilong Huo : > Great to have the page for hawq design doc. TDE is also available there: > https://cwiki.apache.or

Re: HAWQ graduation update

2017-01-24 Thread Paul Guo
concerns we'd need a volunteer to modify it accordingly. We at least have several small things below need to do 1) We need to add design doc to wiki and include recent projects. 2) We'd better have a clear roadmap (at least for short time). 2017-01-17 16:32 GMT+08:00 Paul Guo : > W

HAWQ graduation update

2017-01-17 Thread Paul Guo
While it seems that it is the time for us to kick off the work for HAWQ graduation from ASF, i.e. removing the "incubator" cap. There are a lot of details in the page below about this, http://incubator.apache.org/guides/graduation.html I'd sum up some related work in the last week. 1. Provide p

Re: [VOTE]: Apache HAWQ 2.1.0.0-incubating Release

2017-01-12 Thread Paul Guo
Is there a solution to avoid this in the future? Maybe add this check in Apache Jenkins? I mean whether there are some tools or commands to check this automatically or at least this should be reflected on the releasing document on wiki. 2017-01-12 22:10 GMT+08:00 Ruilong Huo : > -1 for the releas

Re: Apache Jenkins Service: CI for RAT execution proposal

2017-01-12 Thread Paul Guo
I saw apache Jenkins services (Besides travis) seem to have been enabled for each PR though I do not know what is checked in it. What is the difference? Thanks. 2017-01-12 14:01 GMT+08:00 Ed Espino : > For this Apache HAWQ dev community, I would like to setup an Apache Jenkins > job to run Apache

Re: Different storage backends in HAWQ?

2017-01-11 Thread Paul Guo
HAWQ supports row oriented format also (AO Table). For block storage & posix fs, I suspect you could use gpdb since gpdb uses local storage though probably a bit additional work is needed. For object storage (e.g. S3 interface), this is an interesting topic. There have been a JIRA for this though t

Fwd: Welcome to attend HAWQ meetup on 12th Jan in Beijing office

2017-01-08 Thread Paul Guo
+ dev email list also. -- Forwarded message -- From: Lili Ma Date: 2017-01-09 13:31 GMT+08:00 Subject: Welcome to attend HAWQ meetup on 12th Jan in Beijing office To: u...@hawq.incubator.apache.org Hi All, We will host a HAWQ meetup in Beijing office 12th Jan in Pivotal Beijing

[jira] [Created] (HAWQ-1260) Remove temp tables after hawq restart

2017-01-05 Thread Paul Guo (JIRA)
Paul Guo created HAWQ-1260: -- Summary: Remove temp tables after hawq restart Key: HAWQ-1260 URL: https://issues.apache.org/jira/browse/HAWQ-1260 Project: Apache HAWQ Issue Type: Bug

Re: Publishing HAWQ dev docker images

2017-01-03 Thread Paul Guo
Thanks, Richard. I've reviewed the patch. Anyone who is interested on this please gives suggestions on the patch if needed. We expect this in the code base ASAP to benefit developers earlier. 2017-01-03 17:36 GMT+08:00 Richard Guo : > Thank you Roman for the help. > HAWQ-1248

Re: Publishing HAWQ dev docker images

2016-12-28 Thread Paul Guo
Richard, both hdfs and hawq could run in single node. hdfs: one datanode and one name node. hawq: one seg and one master. 2016-12-29 10:38 GMT+08:00 Richard Guo : > Good suggestion to have the hawq cluster with specific version > pre-installed and pre-configured in docker. > I will have an invest

Re: Enforce "Fix version" when closing a fixed JIRA

2016-12-28 Thread Paul Guo
e clue on the hawq version which > has > > the fix available. > > > > Best regards, > > Ruilong Huo > > > > On Wed, Dec 28, 2016 at 1:23 PM, Paul Guo wrote: > > > > > I noticed that when I close a JIRA after I fixed it, the version info > is >

Re: Publishing HAWQ dev docker images

2016-12-27 Thread Paul Guo
Good job. My suggestion is that we could check in docker files (build shell script or makefile if needed) into hawq repo at least. How long do you need to create a docker image with your docker file? Thanks. 2016-12-28 13:55 GMT+08:00 Richard Guo : > Hi everyone, > > HAWQ team is building HAWQ

Enforce "Fix version" when closing a fixed JIRA

2016-12-27 Thread Paul Guo
I noticed that when I close a JIRA after I fixed it, the version info is not mandatory. I think we should enforce this info. Anyone has any concern on this idea? Thanks.

[jira] [Created] (HAWQ-1241) No need of ext/python in *PATH in file greenplum_path.sh

2016-12-27 Thread Paul Guo (JIRA)
Paul Guo created HAWQ-1241: -- Summary: No need of ext/python in *PATH in file greenplum_path.sh Key: HAWQ-1241 URL: https://issues.apache.org/jira/browse/HAWQ-1241 Project: Apache HAWQ Issue Type

[jira] [Created] (HAWQ-1240) Fix bug of plan refinement for cursor operation

2016-12-27 Thread Paul Guo (JIRA)
Paul Guo created HAWQ-1240: -- Summary: Fix bug of plan refinement for cursor operation Key: HAWQ-1240 URL: https://issues.apache.org/jira/browse/HAWQ-1240 Project: Apache HAWQ Issue Type: Bug

Re: nested loop and merge join are disabled by default in legacy planner?

2016-12-22 Thread Paul Guo
table b respectively. So in the first path no plan is > generated. And then root->config->mpp_trying_fallback_plan is set to true, > which enables all join method and try them all. You can check the function > add_paths_to_joinrel which is called for join path generation. > > 20

Re: DISCUSSION NEEDED: 2.1.0.0-incubating - what to do with unresolved JIRAs

2016-12-22 Thread Paul Guo
Just notice this thread. Could JIRA enforce or auto set a specific version? Ideally we could set a new JIRA as backlog but JIRA auto-change the version as the next one when the JIRA is resolved. 2016-12-23 10:18 GMT+08:00 Hong : > Agree with Lei. "Fixed in a version" would be the next release( >

Re: Apache HAWQ 2.1.0.0-incubating Release Jira Dashboard

2016-12-22 Thread Paul Guo
I think the default version should be "backlog" by default when creating JIRA. 2016-12-22 15:45 GMT+08:00 Ed Espino : > HAWQ dev, > > I have updated the version string from 2.0.1.0-incubating to > 2.1.0.0-incubating. I have put together the following Apache HAWQ > 2.1.0.0-incubating Release Jira

[jira] [Created] (HAWQ-1230) Introduce macro __MAYBE_UNUSED_FUNC to surpress "unused funtion" warnings.

2016-12-21 Thread Paul Guo (JIRA)
Paul Guo created HAWQ-1230: -- Summary: Introduce macro __MAYBE_UNUSED_FUNC to surpress "unused funtion" warnings. Key: HAWQ-1230 URL: https://issues.apache.org/jira/browse/HAWQ-1230 Project: A

nested loop and merge join are disabled by default in legacy planner?

2016-12-21 Thread Paul Guo
{ {"enable_nestloop", PGC_USERSET, QUERY_TUNING_METHOD, gettext_noop("Enables the planner's use of nested-loop join plans."), NULL }, &enable_nestloop, false, NULL, NULL }, { {"enable_mergejoin", PGC_USERSET, QUERY_TUNING_MET

Re: Apache HAWQ 2.0.1.0-incubating Release Plan/Timeframe

2016-12-20 Thread Paul Guo
I think we should avoid setting the version as 2.1.1.0-incubating given there is no 2.1.0.0-incubating yet. Maybe 2.1.0.0-incubating? 2016-12-21 9:35 GMT+08:00 Ed Espino : > Yandong ... Good point. +1 to having the release version as > "2.1.1.0-incubating". The next will be set to "2.1.2.0-incub

Please close apache JIRAs

2016-12-19 Thread Paul Guo
Below are JIRAs which are not labeled as closed or resolved after code checkin. Please close them youselves. Each line includes author and title. Thanks. abai_AT_pivotal.io [HAWQ-955] Add script for feature test running in parallel cjameson_AT_pivotal.io [HAWQ-537] 'make distdir' can't handle file

Re: overcommit_memory setting in cluster with hawq and hadoop deployed

2016-12-18 Thread Paul Guo
Exactly. I've encountered or heard some scenarios hawq fails to stop or recover after abnormal process exiting (usually during development or pl functionality). HAWQ needs to be more robust (isolation, recovery, retry, etc) against them. 2016-12-17 13:53 GMT+08:00 Lei Chang : > This issue has bee

Re: unrecognized configuration parameter "ONETARY"

2016-12-18 Thread Paul Guo
You could grep the log to see whether there is "ONETARY" setting before this error occurs, and also grep configuration files and related test files to find who tried to set this. 2016-12-14 22:36 GMT+08:00 Jon Roberts : > I'm getting the error message: unrecognized configuration parameter > "ONET

[jira] [Created] (HAWQ-1214) Remove resource_parameters in calculate_planner_segment_num()

2016-12-12 Thread Paul Guo (JIRA)
Paul Guo created HAWQ-1214: -- Summary: Remove resource_parameters in calculate_planner_segment_num() Key: HAWQ-1214 URL: https://issues.apache.org/jira/browse/HAWQ-1214 Project: Apache HAWQ Issue

sync related issues in hdfs IO

2016-12-11 Thread Paul Guo
1) In MirroredAppendOnly_FlushAndClose() { int ret; errno = 0; ret = FileSync(open->primaryFile); if (ret != 0) *primaryError = errno; } FileClose(open->primaryFile); If I understand the code correctly, MirroredAppendOnly_DoO

Re: Turning off DoS protection in hawq

2016-12-11 Thread Paul Guo
By the way, just checked the doc. At least there is no need to set the kernel tunable below since the default value is that. net.ipv4.ip_forward = 0 2016-12-11 20:13 GMT+08:00 Ruilong Huo : > Thanks Zhanwei for the clarification. > > It is worthwhile to understand the highest tcp connection fr

Re: Design doc of [TDE support in HAWQ]

2016-12-07 Thread Paul Guo
I'm not able to open the design pdf file. Not sure whether other people saw this. I'm wondering whether it is possible to send the content on email directly? Thanks. 2016-12-08 15:16 GMT+08:00 Ma Hongxu : > TDE design doc (ver0.1) is here: > > https://issues.apache.org/jira/secure/attachment/ > 1

[jira] [Created] (HAWQ-1199) guc enable_prefer_list_to_rm does not work.

2016-12-06 Thread Paul Guo (JIRA)
Paul Guo created HAWQ-1199: -- Summary: guc enable_prefer_list_to_rm does not work. Key: HAWQ-1199 URL: https://issues.apache.org/jira/browse/HAWQ-1199 Project: Apache HAWQ Issue Type: Bug

Re: Apache HAWQ release manager volunteer

2016-12-06 Thread Paul Guo
+1. Thanks. 2016-12-07 11:12 GMT+08:00 Ed Espino : > HAWQ dev community, > > I am volunteering to be the release manager for the second Apache HAWQ > release. I will be following the guidelines set forth in the project's > Release Management wiki section as well as the Apache documentation: > >

Re: Warnings and indent issues in HAWQ code.

2016-12-04 Thread Paul Guo
7 GMT+08:00 Hong Wu : > Thanks Paul to point it out. I will start fixing these warnings as possible > as I can! > > Hong > > 2016-12-01 14:17 GMT+08:00 Paul Guo : > > > I'm proposing the Macros below at first to help eliminate some "unused" > > variabl

"unrecognized configuration parameter" in masterdd/pg_log/startup.log

2016-12-02 Thread Paul Guo
I happened to check the log and found some confusing logs. Have not looked into this yet. Anyone sawq this before? 2016-12-02 09:28:05.942583 GMT,,,p366111,th4549860160,,,seg-1,"LOG","0","NOTE: Recognized configuration: hawq_dfs_url=localhost:8020/hawq_default""processXMLNo

[jira] [Created] (HAWQ-1186) Remove with-thrift in src/Makefile.global.in

2016-12-02 Thread Paul Guo (JIRA)
Paul Guo created HAWQ-1186: -- Summary: Remove with-thrift in src/Makefile.global.in Key: HAWQ-1186 URL: https://issues.apache.org/jira/browse/HAWQ-1186 Project: Apache HAWQ Issue Type: Bug

[jira] [Created] (HAWQ-1185) Support multiple parameters setting in one hawq config command.

2016-12-01 Thread Paul Guo (JIRA)
Paul Guo created HAWQ-1185: -- Summary: Support multiple parameters setting in one hawq config command. Key: HAWQ-1185 URL: https://issues.apache.org/jira/browse/HAWQ-1185 Project: Apache HAWQ Issue

Re: Improve code quality of Apache HAWQ

2016-12-01 Thread Paul Guo
Hong, Thanks for the long-list advice. About style. It is more than simple pg style or indent issue. It should include more: e.g. naming convention, at least I have saw two naming style in a file I just happen to check, cdbpartition.c selectHashPartition() build_rename_part_recurse() L

tab width issue for code review

2016-12-01 Thread Paul Guo
We assume tab width as 4 in HAWQ code, while github assumes 8 for the PR page. It seems that so far we can just work around this by appending "?ts=4" in your PR URL.

[jira] [Created] (HAWQ-1183) Writable external table with Hash distribution shows slow performance

2016-12-01 Thread Paul Guo (JIRA)
Paul Guo created HAWQ-1183: -- Summary: Writable external table with Hash distribution shows slow performance Key: HAWQ-1183 URL: https://issues.apache.org/jira/browse/HAWQ-1183 Project: Apache HAWQ

[jira] [Created] (HAWQ-1182) Add Macro for unused argument and variable.

2016-12-01 Thread Paul Guo (JIRA)
Paul Guo created HAWQ-1182: -- Summary: Add Macro for unused argument and variable. Key: HAWQ-1182 URL: https://issues.apache.org/jira/browse/HAWQ-1182 Project: Apache HAWQ Issue Type: Bug

Re: Warnings and indent issues in HAWQ code.

2016-11-30 Thread Paul Guo
ARG(x) ((void)x) +#endif + +#ifndef UNUSED_ARG +#define UNUSED_ARG(x) ((void)x) +#endif + #ifdef __cplusplus } /* extern "C" */ #endif 2016-12-01 10:26 GMT+08:00 Yandong Yao : > Great, +dev@hawq.incubator.apache.org > > On Thu, Dec 1, 2016 at 9:54 AM, Paul Gu

Re: Has anyone meet this problem before for running hawq: libxml doesn't match

2016-11-30 Thread Paul Guo
You may check the log for some clues. Besides, I just quickly check the configure file, the related checking code in rather simple, you could have a quick debugging. 2016-11-30 22:53 GMT+08:00 Lili Ma : > Hi All, > > Has anyone meet this problem when trying to configure or make hawq source > code

[jira] [Created] (HAWQ-1153) Add global init file for feature test.

2016-11-11 Thread Paul Guo (JIRA)
Paul Guo created HAWQ-1153: -- Summary: Add global init file for feature test. Key: HAWQ-1153 URL: https://issues.apache.org/jira/browse/HAWQ-1153 Project: Apache HAWQ Issue Type: Bug

[jira] [Created] (HAWQ-1125) Running pl/python related feature_test cases failed with error "cache lookup failed for language"

2016-10-26 Thread Paul Guo (JIRA)
Paul Guo created HAWQ-1125: -- Summary: Running pl/python related feature_test cases failed with error "cache lookup failed for language" Key: HAWQ-1125 URL: https://issues.apache.org/jira/browse

[jira] [Created] (HAWQ-1097) Makefile is not friendly to ORCA updating

2016-10-11 Thread Paul Guo (JIRA)
Paul Guo created HAWQ-1097: -- Summary: Makefile is not friendly to ORCA updating Key: HAWQ-1097 URL: https://issues.apache.org/jira/browse/HAWQ-1097 Project: Apache HAWQ Issue Type: Bug

[jira] [Created] (HAWQ-1092) Setting lc_collate and lc_ctype through hawq init does not work.

2016-10-09 Thread Paul Guo (JIRA)
Paul Guo created HAWQ-1092: -- Summary: Setting lc_collate and lc_ctype through hawq init does not work. Key: HAWQ-1092 URL: https://issues.apache.org/jira/browse/HAWQ-1092 Project: Apache HAWQ

Re: [VOTE] Apache HAWQ 2.0.0.0-incubating RC4

2016-09-28 Thread Paul Guo
+1. Built and simply tested on a centos 6.7 system. Also run license check. 2016-09-28 2:59 GMT+08:00 Goden Yao : > Hi All , just a reminder that we're looking to close the vote by Friday > 12pm. > Please reply this thread with you opinions after downloading the tarball > binary. > > On Mon, Sep

[jira] [Created] (HAWQ-1081) Check missing perl modules (at least JSON) in configure

2016-09-27 Thread Paul Guo (JIRA)
Paul Guo created HAWQ-1081: -- Summary: Check missing perl modules (at least JSON) in configure Key: HAWQ-1081 URL: https://issues.apache.org/jira/browse/HAWQ-1081 Project: Apache HAWQ Issue Type

[jira] [Created] (HAWQ-1077) QE process spins due to an bug in ao snappy code

2016-09-26 Thread Paul Guo (JIRA)
Paul Guo created HAWQ-1077: -- Summary: QE process spins due to an bug in ao snappy code Key: HAWQ-1077 URL: https://issues.apache.org/jira/browse/HAWQ-1077 Project: Apache HAWQ Issue Type: Bug

Re: New build time dependency: perl-JSON

2016-09-20 Thread Paul Guo
entos/workspace/incubator-hawq/tools/bin/gppylib/data/2.0.json \ > \ > -filemap caqlfilemap.json \ > -uniqdef uniqdef.json \ > -basedef basedef.json \ > -gperf gperf.init -infiles caql.files > catquery.c.perl > sed -e 's/^#line [0-9]* "gperf.init"//&

Re: New build time dependency: perl-JSON

2016-09-20 Thread Paul Guo
This perl module and it users in hawq ( e.g. tidycat.pl etc) are normally not required unless developers need to manipulate (add/modify/remove) the catalog table, which seldom occurs during development. 2016-09-21 5:52 GMT+08:00 Ed Espino : > With the removal of the perl-JSON source code from HAW

Re: Network interconnect settings in IaaS environments

2016-09-17 Thread Paul Guo
Note some L2 tunables may quite depend on NIC driver the virtual machine (vm) is using. e.g. for PCI SR-IOV vf or PCI assignment, the NIC in a vm behaves like a physical NIC, some L2 tuneables may be set to usual default values, however for some virtual NIC implemented as para-virtulization, those

Re: [Vote] Shrink a Git Repository

2016-09-12 Thread Paul Guo
Does this affect an existing cloned repo (i.e. do we need to re-clone a fresh repo if we want to check in something)? Does this affect "git checkout $tag"? (I need to rebase to an old release.) 2016-09-12 18:36 GMT+08:00 Ming Li : > Hi Ed, > > Here I just delete below large files from git repo,

[jira] [Created] (HAWQ-1043) Enforce -Werror for HAWQ (At least for code under src/backend/cdb and src/backend/resourcemanager)

2016-09-11 Thread Paul Guo (JIRA)
Paul Guo created HAWQ-1043: -- Summary: Enforce -Werror for HAWQ (At least for code under src/backend/cdb and src/backend/resourcemanager) Key: HAWQ-1043 URL: https://issues.apache.org/jira/browse/HAWQ-1043

Re: enforce -Werror (if gcc) in hawq?

2016-09-07 Thread Paul Guo
s, the issue is that the > > >> report could not be sent to the coverity scan server automatically. > > >> > > >> ps: I think Chunlin <https://github.com/wcl14> is starting working on > > the > > >> defects generated by coverity. > &g

Re: Push Lantency Problem of Large Commits

2016-09-07 Thread Paul Guo
It looks that mirror is done via the git hook on the apache git repo, https://help.github.com/articles/about-github-mirrors/ I guess the synchronization slowness issue is on the Apache server side. I think you could ask it along with the git consistency issue on the apache infrastructure email list

  1   2   3   >