Re: [VOTE]: Apache HAWQ 2.1.0.0-incubating Release Candidate 3 (RC3)

2017-02-06 Thread Radar Da lei
+1 Downloaded & compiled & make simple tests successfully. Regards, Radar On Tue, Feb 7, 2017 at 12:13 PM, Ming Li wrote: > +1. Built, ran feature test & installcheck-good successfully. > > On Tue, Feb 7, 2017 at 12:01 PM, Yi Jin wrote: > > > Checked > > > > 1) download code, unzip and build

Re: [VOTE] Release Apache HAWQ 2.1.0.0-incubating (RC4)

2017-02-21 Thread Radar Da lei
+1 Downloaded source tarball, compiled, installed, initialized successfully. Regards, Radar On Tue, Feb 21, 2017 at 6:33 PM, Ivan Weng wrote: > +1 > > Compile, install, license check and basic test are OK in my laptop. > > > Regards, > Ivan > > On Tue, Feb 21, 2017 at 6:26 PM, Paul Guo wrot

Re: PR build of Jenkins failed

2017-02-26 Thread Radar Da lei
Recently jenkins failures seems like environment issue of Apache jenkins build host. We might file a ticket to solve it. I checked previously build which reported as success, seems it will actually failed to do "./configure", the reason is the docker image used to build HAWQ is out of date. This m

Re: Apache Jenkins PR build job (HAWQ-build-pullrequest) update

2017-02-27 Thread Radar Da lei
Thanks Ed, it looks great! +1 Regards, Radar On Tue, Feb 28, 2017 at 7:21 AM, Ed Espino wrote: > Radar, > > As you mentioned last night, the PR build job hosted on the Apache Jenkins > job HAWQ-build-pullrequest can fail and there was no indication it had > failed in the PR check. Lav and I qui

Re: Issue : hawq init cluster

2017-03-21 Thread Radar Da lei
Hi Ketan, >From the log, seems like a failure of 'hawq scp' command or a 'scp' command. Please make sure you have set password-less ssh, you can verify it by run a simple scp command between your nodes without input any password. Regards, Radar On Tue, Mar 21, 2017 at 11:24 PM, Kyle Dunn wrote

Re: Running 'hawq restart --reload' failed

2017-03-23 Thread Radar Da lei
As 'hawq stop cluster --reload' didn't actually stop the cluster, so the next action 'hawq start cluster' will fail. We should let the '--reload' option not available to the 'hawq restart' command. Another option is to re-write the 'hawq restart' command to make it cleaner. Regards, Radar On Fr

Re: [VOTE]: Apache HAWQ 2.2.0.0-incubating Release

2017-04-04 Thread Radar Da lei
Downloaded the source tarball on Mac, RAT check passed. Build and install with the source tarball successfully. Basic query check passed. Downloaded the binary rpm tarball on CentOS7, installed and initialized hadoop with bigtop repo successfully, install all the HAWQ/PXF/Ranger-plugin successfull

Re: [VOTE]: Apache HAWQ 2.2.0.0-incubating Release (RC2)

2017-04-12 Thread Radar Da lei
+1 Following the install wiki page step by step, I spend only 15 minutes to get Bigtop Hadoop and HAWQ binary tarball installed and initialized successfully on a brand new RHEL 7 server. Compile and install passed with the release source tarball. RAT checks passed. Verified the previous bugs ar

Re: New committer: Xiang Sheng

2017-05-16 Thread Radar Da lei
Congratulations Xiang! Regards, Radar On Wed, May 17, 2017 at 10:21 AM, Ruilong Huo wrote: > Well deserved! Congratulations Xiang! > > Best regards, > Ruilong Huo > > On Wed, May 17, 2017 at 10:15 AM, Brian Lu wrote: > > > Congratulations Xiang! > > > > Best Regards, > > Brian > > > > On Wed,

Re: [VOTE]: Apache HAWQ 2.2.0.0-incubating Release (RC3)

2017-06-28 Thread Radar Da lei
+1 I downloaded the source code tarball, RAT check passed. Compiled, installed and initialized HAWQ successfully. InstallCheck-good tests passed. I also downloaded the binary release tarball, installed all the packages by following the wiki page on a clean redhat 7 vm: https://cwiki.apache.org/co

Re: Cannot set assignee on Apache JIRA

2015-09-29 Thread Radar Da lei
JIRA ID:rlei Full Name: Radar Lei Regards, Radar On Tue, Sep 29, 2015 at 9:17 PM, 陶征霖 wrote: > JIRA ID: ztao1987 > Full Name: Zhenglin Tao > > 2015-09-29 10:44 GMT+08:00 Lirong Jian : > > > JIRA ID: jian > > Full Name: Lirong Jian > > > > Thanks, > > Lirong > > > > 2015-09-28 16:56 GMT

Re: Apache HAWQ Jenkins credential/admin

2015-11-02 Thread Radar Da lei
Hi Goden, Please +me as the one for Beijing/China. Thanks. Regards, Radar On Tue, Nov 3, 2015 at 6:44 AM, Ting(Goden) Yao wrote: > To facilitate hawq build process, I've checked with Roman and we'd like to > have a couple more folks to help manage HAWQ Jenkins jobs. > > Given the current geogr

Re: Apache HAWQ Jenkins credential/admin

2015-11-09 Thread Radar Da lei
Hi Roman, Would you help to add my Jenkins credential, then I can do some CI jobs for coming releases. My Jenkins ID is 'rlei'. Thanks a lot. Regards, Radar On Tue, Nov 3, 2015 at 10:43 AM, Radar Da lei wrote: > Hi Goden, > > Please +me as the one for Beijing/China.

Re: Apache HAWQ Jenkins credential/admin

2015-11-10 Thread Radar Da lei
hould be done in a day or two. >> >> Thanks, >> Roman. >> >> On Mon, Nov 9, 2015 at 10:36 PM, Radar Da lei wrote: >> > Hi Roman, >> > >> > Would you help to add my Jenkins credential, then I can do some CI jobs >> for >> > com

Build Apache HAWQ bianry tarball with third party libraries

2015-11-24 Thread Radar Da lei
Hi Roman, I plan to build out an Apache HAWQ binary tarball for users to download, so they can install HAWQ easier. But this will require we include all the third party libraries in the tarball(currently we requires user to manually install them on each node), I'm not quite sure if this action ha

Re: Build Apache HAWQ bianry tarball with third party libraries

2015-11-26 Thread Radar Da lei
Thank you Roman. This is very helpful, I will try to make a binary out for demo and review. Before that, it won't be public available. Regards, Radar On Wed, Nov 25, 2015 at 7:14 PM, Roman Shaposhnik wrote: > On Tue, Nov 24, 2015 at 6:16 PM, Radar Da lei wrote: > > Hi Roman,

Re: Propose an Apache HAWQ Release

2015-12-23 Thread Radar Da lei
Hi Roman, For item 0 and 1, I'm working on this, and there is a jira for it: https://issues.apache.org/jira/browse/HAWQ-271 These python source code will be removed, and user need to install them before install hawq, maybe by using python pip install. Thanks. Regards, Radar On Thu, Dec 24,

Re: What's blocking our formal release candidate

2016-01-05 Thread Radar Da lei
FYI. For HAWQ-271, I have finished the code changes, will submit for review today. Thanks. Regards, Radar On Wed, Jan 6, 2016 at 7:28 AM, Ting(Goden) Yao wrote: > Roman and I just found one more pending for the release: > https://issues.apache.org/jira/browse/HAWQ-103 > need to replace vendor

Re: Almost there!

2016-01-06 Thread Radar Da lei
Hi Roman, I will check this, hope can remove it by today. Thanks. Regards, Radar On Thu, Jan 7, 2016 at 11:05 AM, Roman Shaposhnik wrote: > Hi! > > amazing progress with cleaning up RAT results. > Right now the very last hurdle is: >tools/bin/src/netperf-2.4.3.tar.gz > that is still presen

Re: [VOTE] HAWQ 2.0.0-beta-incubating RC4

2016-01-26 Thread Radar Da lei
+1 Downloaded and tested. Regards, Radar On Tue, Jan 26, 2016 at 3:59 PM, Zhanwei Wang wrote: > +1 > > Downloaded, deployed and tested > > On Thu, Jan 21, 2016 at 7:34 AM, Ting(Goden) Yao wrote: > > > This is the 1st release for Apache HAWQ (incubating), version: > > 2.0.0-beta-incubating > >

Re: Init weirdness

2016-02-24 Thread Radar Da lei
Hi Konstantin, Do you mean the step we read properties in hawq-site.xml, and then re-write them to the file '_mgmt_config' ? This is to read some parameters easier when doing hawq init. The file will be generate during each 'hawq init', then it's useless. In the plan, it will be generated into '

Re: Init weirdness

2016-02-24 Thread Radar Da lei
the > script, I see that there's a number of attempts to remove properties from > the > hawq-site file. E.g. > > remove_property_xml("hawq_standby_address_host", "%s/etc/hawq-site.xml" > % self.GPHOME) > > which would be the subject of the issue we

Re: Init weirdness

2016-02-25 Thread Radar Da lei
t of this thing would be quite entertaining, to say > the least. > > Cos > > On Thu, Feb 25, 2016 at 03:00PM, Radar Da lei wrote: > > When doing 'hawq init', we will check the segments number and dynamic to > > decide some property values, for example 'def

Re: ssh'ing around the cluster

2016-02-27 Thread Radar Da lei
Hi Konstantin, Never see this error before. 1. Did you do 'source greenplum_path.sh' before init HAWQ? 2. HAWQ does not support 'root' user, so no need to use sudo. 3. Did you set up SSH password-less on the machine? Thanks. Regards, Radar On Sun, Feb 28, 2016 at 6:44 AM, Konstantin Boudnik w

Re: HAWQ integration to Apache bigdata stack: remaining steps

2016-04-26 Thread Radar Da lei
Hi Konstantin, Thanks for list these items out. For 'External dependencies' part, do you mean 'libthrift' or 'libhdfs'? I see all the links above point to libhdfs. 1. If you mean 'libhdfs', now it's already in HAWQ's source code, it is located in 'depends/libhdfs3', we should build it as the

Re: Rpmbuild Hawq Failed

2016-06-02 Thread Radar Da lei
It requires these because you defined the requirements in your rpm spec file. If you want to deal dependencies by yourself, then you can remove these requirements and add 'AutoReqProv:no' to your spec file. To deal these dependencies by yourself, you can use yum to install all the dependencies

Add python modules back into HAWQ code

2016-06-17 Thread Radar Da lei
Hi All, Previously we removed all the third-party python modules from HAWQ code for License incompatible concerns. After that, users need to install many python modules by themselves. But in some environment, use pip to install python modules are painful. As my check, only 'paramiko' is not comp

Re: First HAWQ release

2016-06-20 Thread Radar Da lei
Hi Vineet, Quicklz already been removed. I will cut a branch now. Thanks. Regards, Radar On Tue, Jun 21, 2016 at 9:27 AM, Vineet Goel wrote: > +1 to the proposed release name and cutting a release branch asap. > Sounds like we need to find a good commit point right after the Apache > release

Re: First HAWQ release

2016-06-21 Thread Radar Da lei
h name did you use > for the branch? > > On Mon, Jun 20, 2016 at 10:21 PM Radar Da lei wrote: > > > Hi Vineet, > > > > Quicklz already been removed. I will cut a branch now. > > > > Thanks. > > > > Regards, > > Radar > > > >

Re: HAWQ Jenkins build failure

2016-06-21 Thread Radar Da lei
Might be some merge issues or Apache's environment issue. Now it working fine without any changes. Thanks. Regards, Radar On Wed, Jun 22, 2016 at 6:02 AM, Shivram Mani wrote: > Recently most of the HAWQ builds have been failing and are not quite > related to the code/pull request. > > -- > shi

Re: Improve code organization for HAWQ?

2016-06-25 Thread Radar Da lei
Sounds great! So we can do a completely 'distclean' by simply delete the files in the build folder. +1 Regards, Radar On Sat, Jun 25, 2016 at 4:12 PM, Jiali Yao wrote: > Cool suggestion. Then we can easily compile the result for different > configuration. > > Thanks > Jiali > > > On Sat, Jun 25

Re: About the commit

2016-06-27 Thread Radar Da lei
Agree to keep the commit clean. If you already hit the 'Merge' commit issue, another way to make it clean by use 'git cherry-pick $commit_number' to save your commit in another branch, then get it back after you did clean. Regards, Radar On Tue, Jun 28, 2016 at 9:42 AM, Jiali Yao wrote: > +1 o

Re: how I rmpbuild the HAWQ

2016-06-29 Thread Radar Da lei
Hi Yuansong, Recently we added some python modules back into Apache HAWQ, include 'psi', so I think the latest version HAWQ can resolve your issue. See: https://issues.apache.org/jira/browse/HAWQ-837 Then there is only one python module 'paramiko' you need to install on the environment by yourse

Re: Replace git submodule with git clone + file with commit number?

2016-06-29 Thread Radar Da lei
+1 Since 'git clone' is called automatically in Makefile, I feel this is much better than use submodule. Regards, Radar On Thu, Jun 30, 2016 at 10:07 AM, Lili Ma wrote: > Hi Paul, > > I have one question, you mentioned "if I update gp-xerces commit number in > the commit file gp-xerces.commit m

Re: Replace git submodule with git clone + file with commit number?

2016-06-30 Thread Radar Da lei
ich indicate we will use commit a. And then sometime > later, > >>> we want to use b, then we commit gp-xerces.commit to b right? And we > >>> will have multiple .commit file for each submodule now. right? > >>> gp-xerces: > >>> commit c > &g

Re: Confusion around HAWQ versions in JIRA

2016-07-05 Thread Radar Da lei
For Lei's proposal, I would prefer option 1 for below reasons: 1. Save time we may spend to solve incompatible issues. 2. It will be hard to maintain semantic version if we increase major version every time when we are changing catalog and interface. If so, HAWQ version will reach 10.0.0 very soon

Re: Replace git submodule with git clone + file with commit number?

2016-07-06 Thread Radar Da lei
There might be a better way, but I don't think let user run a script before make is a good idea. This makefile is not so complex yet so I feel this way is ok. Thanks. Regards, Radar On Wed, Jul 6, 2016 at 7:35 PM, Gmail wrote: > I think the method using git clone is fine. > > But I suggest we

Re: [VOTE] HAWQ 2.0.0-incubating Release

2016-07-06 Thread Radar Da lei
Since we have a lot of commits for this release after creating the branch. I will re-create the branch. So the first blocking issue is gone. Nothing need to be merged. Any concerns, please let me know. Thanks. Regards, Radar On Thu, Jul 7, 2016 at 2:04 AM, Ting(Goden) Yao wrote: > So we have 2

Re: [VOTE] HAWQ 2.0.0-incubating Release

2016-07-06 Thread Radar Da lei
the next release > scope (unless selective back-porting is necessary to meet the first release > scope). > > Thanks > -Vineet > > > On Wed, Jul 6, 2016 at 6:39 PM, Radar Da lei wrote: > > > Since we have a lot of commits for this release after creating the > b

Re: [VOTE] HAWQ 2.0.0-incubating Release

2016-07-06 Thread Radar Da lei
tting > our first release out asap? > I think Goden, as the release manager should make that call. > > Thanks > -Vineet > > > > On Wed, Jul 6, 2016 at 7:02 PM, Radar Da lei wrote: > > > Hi Vineet, > > > > Merge or re-create the branch is almost the sam

Re: [VOTE] HAWQ 2.0.0-incubating Release

2016-07-08 Thread Radar Da lei
issue , then I'll check and respin > the > >> > voting process. > >> > I've also updated JIRA release version for this one to > >> "*2.0.0.0-incubating*" > >> > to be consistent as well as wiki page. > >> > > >> >

Re: [VOTE] HAWQ 2.0.0-incubating Release

2016-07-11 Thread Radar Da lei
Hi Goden, I have pushed commits of 'HAWQ-892 <https://issues.apache.org/jira/browse/HAWQ-892>' and 'HAWQ-901 <https://issues.apache.org/jira/browse/HAWQ-901>' into branch '2.0.0.0-incubating'. Thanks. Regards, Radar On Sat, Jul 9, 2016 at 12:0

Re: question on pg_hba.conf updates

2016-07-11 Thread Radar Da lei
Hi Vineet, While doing HAWQ cluster init, we will collect master/standby/segment ip addresses and update pg_hba.conf. After hawq init, content of 'pg_hba.conf' on each node should be different. When a cluster adding a new standby, this will get pg_hba.conf updated on all the nodes. Activate stand

Re: question on pg_hba.conf updates

2016-07-11 Thread Radar Da lei
? > > Thanks. > > On Tue, Jul 12, 2016 at 10:49 AM, Radar Da lei wrote: > > > Hi Vineet, > > > > While doing HAWQ cluster init, we will collect master/standby/segment ip > > addresses and update pg_hba.conf. After hawq init, content of > 'pg_hba.con

Re: question on pg_hba.conf updates

2016-07-11 Thread Radar Da lei
t in case when > master is crashed after user add some entries in pg_hba.conf. > Thought? > > Jiali > > > On Tue, Jul 12, 2016 at 11:12 AM, Radar Da lei wrote: > > > Hi Ming, > > > > If user manually added some entires into pg_hba.conf and they want it be >

Re: [VOTE] HAWQ 2.0.0-incubating Release

2016-07-14 Thread Radar Da lei
ry (i.e. > >> when > >> > related options are specified in configure command. > >> > > >> > 2. The thrift info has been in the ImportLogs file. I'd suggest move > >> this > >> > (probably > >> > with more de

Re: HAWQ 2.0.0-incubating Release

2016-07-18 Thread Radar Da lei
I have merged fixes for 'HAWQ-622', 'HAWQ-926', 'HAWQ-915' into '2.0.0.0-incubating' branch. There seems no blocker issues left. Regards, Radar On Sat, Jul 16, 2016 at 5:05 AM, Goden Yao wrote: > Thanks Alan. > > Just a reminder - when you do commits in master, please check the JIRA > associa

Re: HAWQ 2.0.0-incubating Release

2016-07-18 Thread Radar Da lei
if (retval < 0) > > > ~~ ^ ~ > > > gpnetbenchClient.c:231:6: warning: no previous prototype for function > > 'print_headers' [-Wmissing-prototypes] > > > void print_headers() > > > ^ > >

Re: HAWQ 2.0.0-incubating Release

2016-07-18 Thread Radar Da lei
'git push -f' kind of dangerous, re-create the branch should be a safe way. Thanks. Regards, Radar On Tue, Jul 19, 2016 at 11:21 AM, Hong Wu wrote: > Why not use `push -f` instead? > > xunzhang > > 2016-07-19 11:19 GMT+08:00 Radar Da lei : > > > When I was m

Re: [VOTE] HAWQ 2.0.0.0-incubating (RC2)

2016-07-22 Thread Radar Da lei
I downloaded the source code tarball, compiled successfully, started a single cluster successfully. +1 Regards, Radar On Fri, Jul 22, 2016 at 4:50 PM, Amy Bai wrote: > I downloaded the source tarball, and compiled successfully. +1 > > Thanks > Amy > > > From: Goden Yao > > Date: Wed, Jul 20,

Replace python module paramiko with pexpect

2016-08-11 Thread Radar Da lei
Hi All, Currently HAWQ use 'paramiko' to sync password-less ssh keys between the cluster nodes. It works fine, but 'paramiko' have license compatible issues with Apache HAWQ. So we removed that part code, then users need to install it manually by pip install. Only 'hawq ssh-exkeys ...' command us

Re: etc/_mgmt_config file -- is it required ?

2016-08-12 Thread Radar Da lei
Hi Alex, This file is generated and required during 'hawq init', after hawq init, we do not need it anymore. We can file a jira to remove it after 'hawq init' executed successfully. Thanks. Regards, Radar On Fri, Aug 12, 2016 at 5:20 AM, Alexander Denissov wrote: > I was trying to upgrade H

Re: [jira] [Commented] (HAWQ-1028) Add '-d' option for hawq state to be compatible with Ambari

2016-09-08 Thread Radar Da lei
Since this is only for compatibility, I think we should not document it. Thanks. Regards, Radar On Fri, Sep 9, 2016 at 6:33 AM, Jane Beckman wrote: > Seconding Lisa's query. Assuming this is only for compatibility, and should > not be documented? > > On Mon, Aug 29, 2016 at 1:30 PM, Lisa Owen (

Re: [Vote] Shrink a Git Repository

2016-09-12 Thread Radar Da lei
I don't feel like the shrink is necessary, for a slow network, 177MB to 100MB does not help much. It will make all the users to delete their current git repo and redo the clone. And it might not be a simple git clone, will need to do a lot changes on local git settings, e.g. remotes, branches merg

Re: [VOTE] Apache HAWQ 2.0.0.0-incubating RC3

2016-09-17 Thread Radar Da lei
Downloaded, compiled, installed and initialized Apache HAWQ 2.0.0.0-incubating RC3 successfully. +1 Regards, Radar On Sun, Sep 18, 2016 at 2:20 PM, Ruilong Huo wrote: > Downloaded, reviewed, compiled and installed Apache HAWQ 2.0.0.0-incubating > RC3 successfully. > The RAT check also succeede

Re: [VOTE] Apache HAWQ 2.0.0.0-incubating RC4

2016-09-28 Thread Radar Da lei
Ran RAT checks, build, install and ran simple queries. All passed. +1 Regards, Radar On Wed, Sep 28, 2016 at 5:58 PM, Paul Guo wrote: > +1. Built and simply tested on a centos 6.7 system. Also run license check. > > 2016-09-28 2:59 GMT+08:00 Goden Yao : > > > Hi All , just a reminder that we'r

Re: new committer: Paul Guo

2016-11-03 Thread Radar Da lei
Congratulations! Regards, Radar On Fri, Nov 4, 2016 at 1:39 PM, Zhanwei Wang wrote: > Congratulations! > > > > Best Regards > > Zhanwei Wang > wan...@apache.org > > > > > 在 2016年11月4日,下午1:25,Ivan Weng 写道: > > > > Congratulations! > > > > > > Regards, > > Ivan > > > > On Fri, Nov 4, 2016 at 1:2

Re: New Committer: Hong Wu

2016-11-03 Thread Radar Da lei
Congratulations Hong! Regards, Radar On Fri, Nov 4, 2016 at 2:16 PM, Ruilong Huo wrote: > Congratulations Hong! > > Best regards, > Ruilong Huo > > On Fri, Nov 4, 2016 at 1:39 PM, Zhanwei Wang wrote: > > > Congratulations! > > > > > > > > Best Regards > > > > Zhanwei Wang > > wan...@apache.org

Re: unrecognized configuration parameter "ONETARY"

2016-12-20 Thread Radar Da lei
Hi Ming, 'hawq_lc_monetary' is only used to store user defined '--lc-monetary' value then pass below option to initdb: '--lc-monetary=${hawq_lc_monetary} ' So finally we give '--lc-monetary=en_US.utf8 ' to initdb. Base on this I don't think the GUC 'ONETARY' have any dependencies with hawq

Re: hawq stop cluster error

2016-12-21 Thread Radar Da lei
Hi Kai, This seems like pygresql install issue. Are you using latest hawq? How do you reinstall pygresql? Make sure you don't see any compile errors while making pygresql. Thanks. Regards, Radar On Thu, Dec 22, 2016 at 3:27 PM, Ma Hongxu wrote: > Hi kai > > It seems that you didn't source g

Re: hawq安装求助

2016-12-22 Thread Radar Da lei
Hi Xingyao, 你好,这个文章讲的是在rhel/centos 7上的编译安装,步骤相对要简单。如果你必须要在centos6上编译安装的话,请参考以下文档(注意选择 Redhat/CentOS 6.X的Tab): https://cwiki.apache.org/confluence/display/HAWQ/Build+and+Install 可能你还需要注意以下几点: 1. 有几个包是需要自己手工下载源文件编译安装的,比如thrift/boost/protobuf/curl(因为6上的yum源没有提供这么高的版本)。 2. 多添加一些CentOS的yum 源,光有EPEL的