Reformat the log in pure txt
20151110:22:25:31:197931 gpstart:easydmp69:gpadmin-[INFO]:-Process results... 20151110:22:25:31:197931 gpstart:easydmp69:gpadmin-[INFO]:----------------------------------------------------- 20151110:22:25:31:197931 gpstart:easydmp69:gpadmin-[INFO]:- Successful segment starts = 3 20151110:22:25:31:197931 gpstart:easydmp69:gpadmin-[INFO]:- Failed segment starts = 0 20151110:22:25:31:197931 gpstart:easydmp69:gpadmin-[INFO]:- Skipped segment starts (segments are marked down in configuration) = 0 20151110:22:25:31:197931 gpstart:easydmp69:gpadmin-[INFO]:----------------------------------------------------- 20151110:22:25:31:197931 gpstart:easydmp69:gpadmin-[INFO]:- 20151110:22:25:31:197931 gpstart:easydmp69:gpadmin-[INFO]:-Successfully started 3 of 3 segment instances 20151110:22:25:31:197931 gpstart:easydmp69:gpadmin-[INFO]:----------------------------------------------------- 20151110:22:25:31:197931 gpstart:easydmp69:gpadmin-[INFO]:-Starting Master instance easydmp69.xipu directory /data/hawq/master/gpseg-1 20151110:22:25:34:197931 gpstart:easydmp69:gpadmin-[INFO]:-Command pg_ctl reports Master easydmp69.xipu instance active 20151110:22:25:34:197931 gpstart:easydmp69:gpadmin-[WARNING]:-error 'ERROR: failed to acquire resources on segment 1 ' in 'SET CLIENT_MIN_MESSAGES='ERROR'' 20151110:22:25:34:197931 gpstart:easydmp69:gpadmin-[INFO]:-Check status of database with gpstate utility 20151110:22:25:34:184226 gpinitsystem:easydmp69:gpadmin-[INFO]:-Completed restart of Greenplum instance in production mode 20151110:22:25:34:184226 gpinitsystem:easydmp69:gpadmin-[INFO]:-Prepare to create filespace on hdfs 20151110:22:25:34:184226 gpinitsystem:easydmp69:gpadmin-[INFO]:-Create filespace dfs_system 20151110:22:25:35:184226 gpinitsystem:easydmp69:gpadmin-[INFO]:-Create tablespace dfs_default 20151110:22:25:35:184226 gpinitsystem:easydmp69:gpadmin-[INFO]:-Update template0 tablespace 20151110:22:25:35:184226 gpinitsystem:easydmp69:gpadmin-[WARN]: 20151110:22:25:35:184226 gpinitsystem:easydmp69:gpadmin-[WARN]:-Failed to create dfs filespace; review gpinitsystem output to 20151110:22:25:35:184226 gpinitsystem:easydmp69:gpadmin-[WARN]:- determine why this step failed and reinitialize cluster after resolving 20151110:22:25:35:184226 gpinitsystem:easydmp69:gpadmin-[WARN]:- issues. Not all initialization tasks have completed so the cluster 20151110:22:25:35:184226 gpinitsystem:easydmp69:gpadmin-[WARN]:- should not be used. 20151110:22:25:35:184226 gpinitsystem:easydmp69:gpadmin-[WARN]:-gpinitsystem will now try to stop the cluster 20151110:22:25:35:184226 gpinitsystem:easydmp69:gpadmin-[WARN]: 20151110:22:25:35:198856 gpstop:easydmp69:gpadmin-[INFO]:-Starting gpstop with args: -a -i -d /data/hawq/master/gpseg-1 20151110:22:25:35:198856 gpstop:easydmp69:gpadmin-[INFO]:-Gathering information and validating the environment... 20151110:22:25:36:198856 gpstop:easydmp69:gpadmin-[INFO]:-Obtaining Greenplum Master catalog information 20151110:22:25:36:198856 gpstop:easydmp69:gpadmin-[INFO]:-Obtaining Segment details from master... 20151110:22:25:37:198856 gpstop:easydmp69:gpadmin-[INFO]:-Greenplum Version: 'postgres (HAWQ) 4.2.0 build 1' 20151110:22:25:37:198856 gpstop:easydmp69:gpadmin-[INFO]:-There are 0 connections to the database 20151110:22:25:37:198856 gpstop:easydmp69:gpadmin-[INFO]:-Commencing Master instance shutdown with mode='immediate' 20151110:22:25:37:198856 gpstop:easydmp69:gpadmin-[INFO]:-Master host=easydmp69.xipu 20151110:22:25:37:198856 gpstop:easydmp69:gpadmin-[INFO]:-Commencing Master instance shutdown with mode=immediate 20151110:22:25:37:198856 gpstop:easydmp69:gpadmin-[INFO]:-Master segment instance directory=/data/hawq/master/gpseg-1 20151110:22:25:39:198856 gpstop:easydmp69:gpadmin-[INFO]:-No standby master host configured 20151110:22:25:40:198856 gpstop:easydmp69:gpadmin-[INFO]:-Commencing parallel segment instance shutdown, please wait... ..... 20151110:22:25:45:198856 gpstop:easydmp69:gpadmin-[INFO]:----------------------------------------------------- 20151110:22:25:45:198856 gpstop:easydmp69:gpadmin-[INFO]:- Segments stopped successfully = 3 20151110:22:25:45:198856 gpstop:easydmp69:gpadmin-[INFO]:- Segments with errors during stop = 0 20151110:22:25:45:198856 gpstop:easydmp69:gpadmin-[INFO]:----------------------------------------------------- 20151110:22:25:45:198856 gpstop:easydmp69:gpadmin-[INFO]:-Successfully shutdown 3 of 3 segment instances 20151110:22:25:45:198856 gpstop:easydmp69:gpadmin-[INFO]:-Database successfully shutdown with no errors reported 20151110:22:25:45:184226 gpinitsystem:easydmp69:gpadmin-[INFO]:-Successfully shutdown the Greenplum instance 20151110:22:25:45:184226 gpinitsystem:easydmp69:gpadmin-[WARN]: 20151110:22:25:45:184226 gpinitsystem:easydmp69:gpadmin-[WARN]:-Failed to create dfs filespace; review gpinitsystem output to 20151110:22:25:45:184226 gpinitsystem:easydmp69:gpadmin-[WARN]:- determine why this step failed and reinitialize cluster after resolving 20151110:22:25:45:184226 gpinitsystem:easydmp69:gpadmin-[WARN]:- issues. Not all initialization tasks have completed so the cluster 20151110:22:25:45:184226 gpinitsystem:easydmp69:gpadmin-[WARN]:- should not be used. 20151110:22:25:45:184226 gpinitsystem:easydmp69:gpadmin-[WARN]: 20151110:22:25:45:gpinitsystem:easydmp69:gpadmin-[FATAL]: create dfs filespace failed; Script Exiting! ------------------ Original ------------------ From: "Yiming Liu";<[email protected]>; Date: Tue, Nov 10, 2015 10:30 PM To: "dev"<[email protected]>; Subject: Re: Install failed when initdb (creating template0 instead template1) The gpinitsystem.log has the following log, and no postgres process could be found by ps -eaf20151110:22:25:31:197931 gpstart:easydmp69:gpadmin-[INFO]:-Process results... 20151110:22:25:31:197931 gpstart:easydmp69:gpadmin-[INFO]:----------------------------------------------------- 20151110:22:25:31:197931 gpstart:easydmp69:gpadmin-[INFO]:- Successful segment starts = 3 20151110:22:25:31:197931 gpstart:easydmp69:gpadmin-[INFO]:- Failed segment starts = 0 20151110:22:25:31:197931 gpstart:easydmp69:gpadmin-[INFO]:- Skipped segment starts (segments are marked down in configuration) = 0 20151110:22:25:31:197931 gpstart:easydmp69:gpadmin-[INFO]:----------------------------------------------------- 20151110:22:25:31:197931 gpstart:easydmp69:gpadmin-[INFO]:- 20151110:22:25:31:197931 gpstart:easydmp69:gpadmin-[INFO]:-Successfully started 3 of 3 segment instances 20151110:22:25:31:197931 gpstart:easydmp69:gpadmin-[INFO]:----------------------------------------------------- 20151110:22:25:31:197931 gpstart:easydmp69:gpadmin-[INFO]:-Starting Master instance easydmp69.xipu directory /data/hawq/master/gpseg-1 20151110:22:25:34:197931 gpstart:easydmp69:gpadmin-[INFO]:-Command pg_ctl reports Master easydmp69.xipu instance active 20151110:22:25:34:197931 gpstart:easydmp69:gpadmin-[WARNING]:-error 'ERROR: failed to acquire resources on segment 1 ' in 'SET CLIENT_MIN_MESSAGES='ERROR'' 20151110:22:25:34:197931 gpstart:easydmp69:gpadmin-[INFO]:-Check status of database with gpstate utility 20151110:22:25:34:184226 gpinitsystem:easydmp69:gpadmin-[INFO]:-Completed restart of Greenplum instance in production mode 20151110:22:25:34:184226 gpinitsystem:easydmp69:gpadmin-[INFO]:-Prepare to create filespace on hdfs 20151110:22:25:34:184226 gpinitsystem:easydmp69:gpadmin-[INFO]:-Create filespace dfs_system 20151110:22:25:35:184226 gpinitsystem:easydmp69:gpadmin-[INFO]:-Create tablespace dfs_default 20151110:22:25:35:184226 gpinitsystem:easydmp69:gpadmin-[INFO]:-Update template0 tablespace 20151110:22:25:35:184226 gpinitsystem:easydmp69:gpadmin-[WARN]: 20151110:22:25:35:184226 gpinitsystem:easydmp69:gpadmin-[WARN]:-Failed to create dfs filespace; review gpinitsystem output to 20151110:22:25:35:184226 gpinitsystem:easydmp69:gpadmin-[WARN]:- determine why this step failed and reinitialize cluster after resolving 20151110:22:25:35:184226 gpinitsystem:easydmp69:gpadmin-[WARN]:- issues. Not all initialization tasks have completed so the cluster 20151110:22:25:35:184226 gpinitsystem:easydmp69:gpadmin-[WARN]:- should not be used. 20151110:22:25:35:184226 gpinitsystem:easydmp69:gpadmin-[WARN]:-gpinitsystem will now try to stop the cluster 20151110:22:25:35:184226 gpinitsystem:easydmp69:gpadmin-[WARN]: 20151110:22:25:35:198856 gpstop:easydmp69:gpadmin-[INFO]:-Starting gpstop with args: -a -i -d /data/hawq/master/gpseg-1 20151110:22:25:35:198856 gpstop:easydmp69:gpadmin-[INFO]:-Gathering information and validating the environment... 20151110:22:25:36:198856 gpstop:easydmp69:gpadmin-[INFO]:-Obtaining Greenplum Master catalog information 20151110:22:25:36:198856 gpstop:easydmp69:gpadmin-[INFO]:-Obtaining Segment details from master... 20151110:22:25:37:198856 gpstop:easydmp69:gpadmin-[INFO]:-Greenplum Version: 'postgres (HAWQ) 4.2.0 build 1' 20151110:22:25:37:198856 gpstop:easydmp69:gpadmin-[INFO]:-There are 0 connections to the database 20151110:22:25:37:198856 gpstop:easydmp69:gpadmin-[INFO]:-Commencing Master instance shutdown with mode='immediate' 20151110:22:25:37:198856 gpstop:easydmp69:gpadmin-[INFO]:-Master host=easydmp69.xipu 20151110:22:25:37:198856 gpstop:easydmp69:gpadmin-[INFO]:-Commencing Master instance shutdown with mode=immediate 20151110:22:25:37:198856 gpstop:easydmp69:gpadmin-[INFO]:-Master segment instance directory=/data/hawq/master/gpseg-1 20151110:22:25:39:198856 gpstop:easydmp69:gpadmin-[INFO]:-No standby master host configured 20151110:22:25:40:198856 gpstop:easydmp69:gpadmin-[INFO]:-Commencing parallel segment instance shutdown, please wait... ..... 20151110:22:25:45:198856 gpstop:easydmp69:gpadmin-[INFO]:----------------------------------------------------- 20151110:22:25:45:198856 gpstop:easydmp69:gpadmin-[INFO]:- Segments stopped successfully = 3 20151110:22:25:45:198856 gpstop:easydmp69:gpadmin-[INFO]:- Segments with errors during stop = 0 20151110:22:25:45:198856 gpstop:easydmp69:gpadmin-[INFO]:----------------------------------------------------- 20151110:22:25:45:198856 gpstop:easydmp69:gpadmin-[INFO]:-Successfully shutdown 3 of 3 segment instances 20151110:22:25:45:198856 gpstop:easydmp69:gpadmin-[INFO]:-Database successfully shutdown with no errors reported 20151110:22:25:45:184226 gpinitsystem:easydmp69:gpadmin-[INFO]:-Successfully shutdown the Greenplum instance 20151110:22:25:45:184226 gpinitsystem:easydmp69:gpadmin-[WARN]: 20151110:22:25:45:184226 gpinitsystem:easydmp69:gpadmin-[WARN]:-Failed to create dfs filespace; review gpinitsystem output to 20151110:22:25:45:184226 gpinitsystem:easydmp69:gpadmin-[WARN]:- determine why this step failed and reinitialize cluster after resolving 20151110:22:25:45:184226 gpinitsystem:easydmp69:gpadmin-[WARN]:- issues. Not all initialization tasks have completed so the cluster 20151110:22:25:45:184226 gpinitsystem:easydmp69:gpadmin-[WARN]:- should not be used. 20151110:22:25:45:184226 gpinitsystem:easydmp69:gpadmin-[WARN]: 20151110:22:25:45:gpinitsystem:easydmp69:gpadmin-[FATAL]: create dfs filespace failed; Script Exiting! ------------------ Original ------------------ From: "Lei Chang";<[email protected]>; Date: Mon, Nov 9, 2015 05:48 PM To: "dev"<[email protected]>; Subject: Re: Install failed when initdb (creating template0 instead template1) Can you show the logs in your home directory ~/gpAdminLogs and run "ps -eaf | grep postgres" on your master and segment nodes? Thanks Lei On Mon, Nov 9, 2015 at 4:32 PM, Yiming Liu <[email protected]> wrote: > it will say "database postgres does not exist" > > > > > ------------------ Original ------------------ > From: "Lei Chang";<[email protected]>; > Date: Mon, Nov 9, 2015 04:27 PM > To: "dev"<[email protected]>; > > Subject: Re: Install failed when initdb (creating template0 instead > template1) > > > > Looks your database has been created. > > Can you try "psql -d postgres"? > > Cheers > Lei > > > > > On Mon, Nov 9, 2015 at 11:13 AM, Yiming Liu <[email protected]> > wrote: > > > My mistake. Thank you, I did follow the HAWQ tutorial: > > http://hawq.docs.pivotal.io/docs-hawq/topics/install-ambari.html, > > installed by Ambari. I have no idea why the log shows "creating template0 > > database in /data/hawq/master/gpseg-1/base/1 ...". But the initdb source > > code (at > > > https://github.com/apache/incubator-hawq/blob/96779dd2ecd6a215da8789079116915caa99d408/src/bin/initdb/initdb.c > > line 1547) has only the code "printf(_("creating template1 database in > > %s/base/1 ... "), pg_data);" > > > > > > > > > > ------------------ ???????? ------------------ > > ??????: "Zhanwei Wang"<[email protected]>; > > ????????: 2015??11??9??(??????) ????9:46 > > ??????: "dev"<[email protected]>; > > ????: Re: Install failed when initdb (creating template0 instead template1) > > > > > > > > Hi Yiming > > > > The tutorial you mentioned is for Greenplum Database, not for HAWQ. You > can > > find HAWQ documents for 1.3 version in this link. > > > > http://hawq.docs.pivotal.io/ > > > > > > > > On Sun, Nov 8, 2015 at 4:21 PM, Yiming Liu <[email protected]> > > wrote: > > > > > Hi HAWQ experts, > > > > > > I"m trying to deploy HAWQ to my cluster, following the tutorial: > > > http://gpdb.docs.pivotal.io/4330/install_guide/install_guide.html > > > > > > My HAWQ version is 1.3.1.0. But the installation failed, the console > > shows > > > "no gpadmin database" when I tried to connect psql. I have on master > > node, > > > and three segments nodes. When I checked the log file > gpinitsystem.log, I > > > found there are some warnings when initdb. > > > I tried to google the source code and found the initdb in HAWQ repo is > > > just "creating template1 database", but my warning was "create > template0 > > > database". There may be something wrong. Could you give me some help? > > > > > > Following are the detail logs: > > > > > > 20151108:14:34:47:586892 gpinitsystem:easydmp69:gpadmin-[INFO]:-Start > > > Function ARRAY_REORDER > > > 20151108:14:34:47:586892 gpinitsystem:easydmp69:gpadmin-[INFO]:-End > > > Function ARRAY_REORDER > > > 20151108:14:34:47:586892 gpinitsystem:easydmp69:gpadmin-[INFO]:-Start > > > Function CREATE_QD_DB > > > 20151108:14:34:47:586892 > gpinitsystem:easydmp69:gpadmin-[INFO]:-Building > > > the Master instance database, please wait... > > > 20151108:14:34:47:586892 > > > gpinitsystem:easydmp69:gpadmin-[INFO]:-Initializing Master Postgres > > > instance /data/hawq/master/gpseg-1 > > > 20151108:14:34:47:586892 > > gpinitsystem:easydmp69:gpadmin-[INFO]:-Commencing > > > local /usr/local/hawq/./bin/initdb -E UNICODE -D > > /data/hawq/master/gpseg-1 > > > --locale=en_US.utf8 --max_connection > > > s=250 --shared_buffers=128000kB --is_filerep_mirrored=no > > > --backend_output=/data/hawq/master/gpseg-1.initdb --content_id=-1 > > > The files belonging to this database system will be owned by user > > > "gpadmin". > > > This user must also own the server process. > > > > > > The database cluster will be initialized with locale en_US.utf8. > > > > > > creating directory /data/hawq/master/gpseg-1 ... ok > > > creating subdirectories ... ok > > > selecting default max_connections ... 250 > > > selecting default shared_buffers/max_fsm_pages ... 125MB/200000 > > > creating configuration files ... ok > > > creating template0 database in /data/hawq/master/gpseg-1/base/1 ... > > > 2015-11-08 06:34:48.283753 > > > > GMT,,,p591743,th2143004704,,,,0,,,seg-1,,,,,"WARNING","01000","""fsync"": > > > can not be set by the user and will be > > > ignored.",,,,,,,,"set_config_option","guc.c",9434, > > > ok > > > loading file-system persistent tables for template0 (mirrored = false) > > ... > > > 2015-11-08 06:34:53.276569 > > > > GMT,,,p591746,th-949397472,,,,0,,,seg-1,,,,,"WARNING","01000","""fsync"": > > > can not be set by the user and will be > > > ignored.",,,,,,,,"set_config_option","guc.c",9434, > > > ok > > > initializing pg_authid ... 2015-11-08 06:34:54.387948 > > > > > > GMT,,,p591749,th-1923487712,,,,0,,,seg-1,,,,,"WARNING","01000","""fsync"": > > > can not be set by the user and will be > > > ignored.",,,,,,,,"set_config_option","guc.c",9434, > > > ok > > > initializing dependencies ... 2015-11-08 06:34:55.414991 > > > > GMT,,,p591751,th329537568,,,,0,,,seg-1,,,,,"WARNING","01000","""fsync"": > > > can not be set by the user and will be > > > ignored.",,,,,,,,"set_config_option","guc.c",9434, > > > ok > > > creating system views ... 2015-11-08 06:34:56.604558 > > > > GMT,,,p591753,th128555040,,,,0,,,seg-1,,,,,"WARNING","01000","""fsync"": > > > can not be set by the user and will be > > > ignored.",,,,,,,,"set_config_option","guc.c",9434, > > > ok > > > loading system objects' descriptions ... 2015-11-08 06:34:57.714915 > > > > GMT,,,p591755,th-134670304,,,,0,,,seg-1,,,,,"WARNING","01000","""fsync"": > > > can not be set by the user and will be > > > ignored.",,,,,,,,"set_config_option","guc.c",9434, > > > ok > > > creating conversions ... 2015-11-08 06:34:59.020746 > > > > GMT,,,p591759,th1800534048,,,,0,,,seg-1,,,,,"WARNING","01000","""fsync"": > > > can not be set by the user and will be > > > ignored.",,,,,,,,"set_config_option","guc.c",9434, > > > ok > > > setting privileges on built-in objects ... 2015-11-08 06:35:07.921545 > > > > > > GMT,,,p591762,th-1349728224,,,,0,,,seg-1,,,,,"WARNING","01000","""fsync"": > > > can not be set by the user and will be > > > ignored.",,,,,,,,"set_config_option","guc.c",9434, > > > ok > > > creating information schema ... 2015-11-08 06:35:08.803969 > > > > > > GMT,,,p591765,th-1857652704,,,,0,,,seg-1,,,,,"WARNING","01000","""fsync"": > > > can not be set by the user and will be > > > ignored.",,,,,,,,"set_config_option","guc.c",9434, > > > 2015-11-08 06:35:10.726271 > > > > > > GMT,,,p591767,th-1193289696,,,,0,,,seg-1,,,,,"WARNING","01000","""fsync"": > > > can not be set by the user and will be > > > ignored.",,,,,,,,"set_config_option","guc.c",9434, > > > ok > > > creating HAWQ schema ... 2015-11-08 06:35:11.565366 > > > > GMT,,,p591769,th159533088,,,,0,,,seg-1,,,,,"WARNING","01000","""fsync"": > > > can not be set by the user and will be > > > ignored.",,,,,,,,"set_config_option","guc.c",9434, > > > ok > > > vacuuming database template0 ... 2015-11-08 06:35:12.913042 > > > GMT,,,p591771,th43874336,,,,0,,,seg-1,,,,,"WARNING","01000","""fsync"": > > can > > > not be set by the user and will be > > > ignored.",,,,,,,,"set_config_option","guc.c",9434, > > > ok > > > updating content id ... 2015-11-08 06:35:19.245955 > > > > GMT,,,p591775,th136087584,,,,0,,,seg-1,,,,,"WARNING","01000","""fsync"": > > > can not be set by the user and will be > > > ignored.",,,,,,,,"set_config_option","guc.c",9434, > > > ok > > > > > > WARNING: enabling "trust" authentication for local connections > > > You can change this by editing pg_hba.conf or using the -A option the > > > next time you run initdb. > > > > > > Success. You can now start the database server using: > > > > > > /usr/local/hawq/./bin/postgres -D /data/hawq/master/gpseg-1 > > > or > > > /usr/local/hawq/./bin/pg_ctl -D /data/hawq/master/gpseg-1 -l > logfile > > > start > > > > > > > > > Thank you very much. > > > > > > Yiming Liu. > > > > > > > > > > -- > > Best Regards > > ---------- > > > > Zhanwei Wang > > >
