[jira] [Assigned] (HAWQ-1385) hawq_ctl stop failed when master is down
[
https://issues.apache.org/jira/browse/HAWQ-1385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hongxu Ma reassigned HAWQ-1385:
---
Assignee: Hongxu Ma (was: Ed Espino)
> hawq_ctl stop failed when master is down
>
>
> Key: HAWQ-1385
> URL: https://issues.apache.org/jira/browse/HAWQ-1385
> Project: Apache HAWQ
> Issue Type: Bug
> Components: Command Line Tools
>Reporter: Hongxu Ma
>Assignee: Hongxu Ma
> Fix For: 2.2.0.0-incubating
>
>
> example (master is down):
> hawq activate standby
> hawq stop allsegments
> error output:
> {code}
> 20170314:03:49:36:005905
> hawq_activate:centos7-datanode3:gpadmin-[INFO]:-20170314:03:49:36:005933
> hawq_stop:centos7-datanode3:gpadmin-[ERROR]:-Failed to connect to database,
> this script can only be run when the database is up
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Created] (HAWQ-1385) hawq_ctl stop failed when master is down
Hongxu Ma created HAWQ-1385:
---
Summary: hawq_ctl stop failed when master is down
Key: HAWQ-1385
URL: https://issues.apache.org/jira/browse/HAWQ-1385
Project: Apache HAWQ
Issue Type: Bug
Components: Command Line Tools
Reporter: Hongxu Ma
Assignee: Ed Espino
Fix For: 2.2.0.0-incubating
example (master is down):
hawq activate standby
hawq stop allsegments
error output:
{code}
20170314:03:49:36:005905
hawq_activate:centos7-datanode3:gpadmin-[INFO]:-20170314:03:49:36:005933
hawq_stop:centos7-datanode3:gpadmin-[ERROR]:-Failed to connect to database,
this script can only be run when the database is up
{code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[GitHub] incubator-hawq issue #1163: HAWQ-1379. Do not send options multiple times in...
Github user huor commented on the issue: https://github.com/apache/incubator-hawq/pull/1163 LGTM +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-hawq issue #1162: HAWQ-1378. Elaborate the "invalid command-line a...
Github user huor commented on the issue: https://github.com/apache/incubator-hawq/pull/1162 LGTM +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Comment Edited] (HAWQ-1270) Plugged storage back-ends for HAWQ
[
https://issues.apache.org/jira/browse/HAWQ-1270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901627#comment-15901627
]
Kyle R Dunn edited comment on HAWQ-1270 at 3/14/17 12:58 AM:
-
>From what I can tell, [this |
>https://github.com/apache/incubator-hawq/blob/master/src/bin/gpfilesystem/hdfs/gpfshdfs.c]
> IS the interface.
When you look at the {{pg_filesystem}} table, it lists the exact functions
required for a new backend:
{code}
SELECT * from pg_filesystem ;
-[ RECORD 1 ]--+--
fsysname | hdfs
fsysconnfn | gpfs_hdfs_connect
fsysdisconnfn | gpfs_hdfs_disconnect
fsysopenfn | gpfs_hdfs_openfile
fsysclosefn| gpfs_hdfs_closefile
fsysseekfn | gpfs_hdfs_seek
fsystellfn | gpfs_hdfs_tell
fsysreadfn | gpfs_hdfs_read
fsyswritefn| gpfs_hdfs_write
fsysflushfn| gpfs_hdfs_sync
fsysdeletefn | gpfs_hdfs_delete
fsyschmodfn| gpfs_hdfs_chmod
fsysmkdirfn| gpfs_hdfs_createdirectory
fsystruncatefn | gpfs_hdfs_truncate
fsysgetpathinfofn | gpfs_hdfs_getpathinfo
fsysfreefileinfofn | gpfs_hdfs_freefileinfo
fsyslibfile| $libdir/gpfshdfs.so
fsysowner | 10
fsystrusted| f
fsysacl|
{code}
was (Author: kdunn926):
>From what I can tell, [this |
>https://github.com/apache/incubator-hawq/blob/master/src/bin/gpfilesystem/hdfs/gpfshdfs.c]
> IS the interface.
When you look at the {{pg_filesystems}} table, it lists the exact functions
required for a new backend:
{code}
SELECT * from pg_filesystem ;
-[ RECORD 1 ]--+--
fsysname | hdfs
fsysconnfn | gpfs_hdfs_connect
fsysdisconnfn | gpfs_hdfs_disconnect
fsysopenfn | gpfs_hdfs_openfile
fsysclosefn| gpfs_hdfs_closefile
fsysseekfn | gpfs_hdfs_seek
fsystellfn | gpfs_hdfs_tell
fsysreadfn | gpfs_hdfs_read
fsyswritefn| gpfs_hdfs_write
fsysflushfn| gpfs_hdfs_sync
fsysdeletefn | gpfs_hdfs_delete
fsyschmodfn| gpfs_hdfs_chmod
fsysmkdirfn| gpfs_hdfs_createdirectory
fsystruncatefn | gpfs_hdfs_truncate
fsysgetpathinfofn | gpfs_hdfs_getpathinfo
fsysfreefileinfofn | gpfs_hdfs_freefileinfo
fsyslibfile| $libdir/gpfshdfs.so
fsysowner | 10
fsystrusted| f
fsysacl|
{code}
> Plugged storage back-ends for HAWQ
> --
>
> Key: HAWQ-1270
> URL: https://issues.apache.org/jira/browse/HAWQ-1270
> Project: Apache HAWQ
> Issue Type: Improvement
>Reporter: Dmitry Buzolin
>Assignee: Ed Espino
>
> Since HAWQ only depends on Hadoop and Parquet for columnar format support, I
> would like to propose pluggable storage backend design for Hawq. Hadoop is
> already supported but there is Ceph - a distributed, storage system which
> offers standard Posix compliant file system, object and a block storage. Ceph
> is also data location aware, written in C++. and is more sophisticated
> storage backend compare to Hadoop at this time. It provides replicated and
> erasure encoded storage pools, Other great features of Ceph are: snapshots
> and an algorithmic approach to map data to the nodes rather than having
> centrally managed namenodes. I don't think HDFS offers any of these features.
> In terms of performance, Ceph should be faster than HFDS since it is written
> on C++ and because it doesn't have scalability limitations when mapping data
> to storage pools, compare to Hadoop, where name node is such point of
> contention.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HAWQ-1383) docs - pl/pgsql page cleanup
[ https://issues.apache.org/jira/browse/HAWQ-1383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15907657#comment-15907657 ] ASF GitHub Bot commented on HAWQ-1383: -- Github user lisakowen closed the pull request at: https://github.com/apache/incubator-hawq-docs/pull/101 > docs - pl/pgsql page cleanup > > > Key: HAWQ-1383 > URL: https://issues.apache.org/jira/browse/HAWQ-1383 > Project: Apache HAWQ > Issue Type: Improvement > Components: Documentation >Reporter: Lisa Owen >Assignee: David Yozie > > various updates to pl/pgsql page: > - move polymorphic types discussion to a more general section > - remove dblink reference > - use actual pl/pgsql examples, not SQL examples > - other miscellanous clean-up and clarifications -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Closed] (HAWQ-1371) QE process hang in shared input scan
[
https://issues.apache.org/jira/browse/HAWQ-1371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Amy closed HAWQ-1371.
-
Resolution: Fixed
> QE process hang in shared input scan
>
>
> Key: HAWQ-1371
> URL: https://issues.apache.org/jira/browse/HAWQ-1371
> Project: Apache HAWQ
> Issue Type: Bug
> Components: Query Execution
>Reporter: Amy
>Assignee: Amy
> Fix For: backlog
>
>
> process hang on some segment node while QD and QE on other segment nodes
> terminated.
> {code}
> on segment test2:
> [gpadmin@test2 ~]$ pp
> gpadmin 21614 0.0 1.2 788636 407428 ? Ss Feb26 1:19
> /usr/local/hawq_2_1_0_0/bin/postgres -D
> /data/pulse-agent-data/HAWQ-main-FeatureTest-opt-YARN/product/segmentdd -p
> 31100 --silent-mode=true -M segment -i
> gpadmin 21615 0.0 0.0 279896 6952 ?Ss Feb26 0:08 postgres:
> port 31100, logger process
> gpadmin 21618 0.0 0.0 282128 6980 ?Ss Feb26 0:00 postgres:
> port 31100, stats collector process
> gpadmin 21619 0.0 0.0 788636 7280 ?Ss Feb26 0:11 postgres:
> port 31100, writer process
> gpadmin 21620 0.0 0.0 788636 7064 ?Ss Feb26 0:01 postgres:
> port 31100, checkpoint process
> gpadmin 21621 0.0 0.0 793048 11752 ?SFeb26 0:19 postgres:
> port 31100, segment resource manager
> gpadmin 91760 0.0 0.0 861000 16840 ?TNsl Feb26 0:07 postgres:
> port 31100, gpadmin parquetola... 10.32.35.141(15250) con558 seg4 cmd2
> slice11 MPPEXEC SELECT
> gpadmin 91762 0.0 0.0 861064 17116 ?SNsl Feb26 0:08 postgres:
> port 31100, gpadmin parquetola... 10.32.35.141(15253) con558 seg5 cmd2
> slice11 MPPEXEC SELECT
> gpadmin 216648 0.0 0.0 103244 788 pts/0S+ 19:54 0:00 grep
> postgres
> {code}
> QE stack trace is:
> {code}
> (gdb) bt
> #0 0x0032214e1523 in select () from /lib64/libc.so.6
> #1 0x0069c2fa in shareinput_writer_waitdone (ctxt=0x1dae520,
> share_id=0, nsharer_xslice=7) at nodeShareInputScan.c:989
> #2 0x00695798 in ExecEndMaterial (node=0x1d2eb50) at
> nodeMaterial.c:512
> #3 0x0067048d in ExecEndNode (node=0x1d2eb50) at execProcnode.c:1681
> #4 0x0069c6b5 in ExecEndShareInputScan (node=0x1d2e6f0) at
> nodeShareInputScan.c:382
> #5 0x0067042a in ExecEndNode (node=0x1d2e6f0) at execProcnode.c:1674
> #6 0x006ac9be in ExecEndSequence (node=0x1d23890) at
> nodeSequence.c:165
> #7 0x006705f0 in ExecEndNode (node=0x1d23890) at execProcnode.c:1583
> #8 0x0069a0ab in ExecEndResult (node=0x1d214a0) at nodeResult.c:481
> #9 0x0067060d in ExecEndNode (node=0x1d214a0) at execProcnode.c:1575
> #10 0x0069a0ab in ExecEndResult (node=0x1d20860) at nodeResult.c:481
> #11 0x0067060d in ExecEndNode (node=0x1d20860) at execProcnode.c:1575
> #12 0x00698fd2 in ExecEndMotion (node=0x1d20320) at nodeMotion.c:1230
> #13 0x00670434 in ExecEndNode (node=0x1d20320) at execProcnode.c:1713
> #14 0x00669da7 in ExecEndPlan (planstate=0x1d20320, estate=0x1cb6b40)
> at execMain.c:2896
> #15 0x0066a311 in ExecutorEnd (queryDesc=0x1cabf20) at execMain.c:1407
> #16 0x006195f2 in PortalCleanupHelper (portal=0x1cbcc40) at
> portalcmds.c:365
> #17 PortalCleanup (portal=0x1cbcc40) at portalcmds.c:317
> #18 0x00900544 in AtAbort_Portals () at portalmem.c:693
> #19 0x004e697f in AbortTransaction () at xact.c:2800
> #20 0x004e7565 in AbortCurrentTransaction () at xact.c:3377
> #21 0x007ed0fa in PostgresMain (argc=,
> argv=, username=0x1b47f10 "gpadmin") at postgres.c:4630
> #22 0x007a05d0 in BackendRun () at postmaster.c:5915
> #23 BackendStartup () at postmaster.c:5484
> #24 ServerLoop () at postmaster.c:2163
> #25 0x007a3399 in PostmasterMain (argc=Unhandled dwarf expression
> opcode 0xf3
> ) at postmaster.c:1454
> #26 0x004a52e9 in main (argc=9, argv=0x1b0cd10) at main.c:226
> (gdb) p CurrentTransactionState->state
> $1 = TRANS_ABORT
> (gdb) p pctxt->donefd
> No symbol "pctxt" in current context.
> (gdb) f 1
> #1 0x0069c2fa in shareinput_writer_waitdone (ctxt=0x1dae520,
> share_id=0, nsharer_xslice=7) at nodeShareInputScan.c:989
> 989 nodeShareInputScan.c: No such file or directory.
> in nodeShareInputScan.c
> (gdb) p pctxt->donefd
> $2 = 15
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[GitHub] incubator-hawq pull request #1170: HAWQ-1371. Fix QE process hang in shared ...
Github user amyrazz44 closed the pull request at: https://github.com/apache/incubator-hawq/pull/1170 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
