[GitHub] incubator-hawq issue #1002: HAWQ-1130. Draft implementation.
Github user sansanichfb commented on the issue: https://github.com/apache/incubator-hawq/pull/1002 Regarding performance comparison - I tried running HCatalog queries subsequently in new sessions - CAQL query with ORDER BY and WHERE oid > maxOid faster than SPI query ~ 12 times. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Commented] (HAWQ-1134) Add Bigtop layout specific pxf-private classpath
[ https://issues.apache.org/jira/browse/HAWQ-1134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15638179#comment-15638179 ] Goden Yao commented on HAWQ-1134: - Sure > Add Bigtop layout specific pxf-private classpath > > > Key: HAWQ-1134 > URL: https://issues.apache.org/jira/browse/HAWQ-1134 > Project: Apache HAWQ > Issue Type: Improvement > Components: PXF >Reporter: Roman Shaposhnik >Assignee: Roman Shaposhnik > > Currently PXF ships with HDP and PHD specific classpath files. It would be > great to have Bigtop specific one. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HAWQ-1134) Add Bigtop layout specific pxf-private classpath
[ https://issues.apache.org/jira/browse/HAWQ-1134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15637866#comment-15637866 ] Roman Shaposhnik commented on HAWQ-1134: Would it be ok to commit it now and refactor later? > Add Bigtop layout specific pxf-private classpath > > > Key: HAWQ-1134 > URL: https://issues.apache.org/jira/browse/HAWQ-1134 > Project: Apache HAWQ > Issue Type: Improvement > Components: PXF >Reporter: Roman Shaposhnik >Assignee: Roman Shaposhnik > > Currently PXF ships with HDP and PHD specific classpath files. It would be > great to have Bigtop specific one. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HAWQ-1146) docs - some hawq reload commands missing
[ https://issues.apache.org/jira/browse/HAWQ-1146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15636950#comment-15636950 ] ASF GitHub Bot commented on HAWQ-1146: -- GitHub user lisakowen opened a pull request: https://github.com/apache/incubator-hawq-docs/pull/53 HAWQ-1146 - ensure all hawq stop -u references include updated appropriate files to include cluster in hawq stop -u commands. You can merge this pull request into a Git repository by running: $ git pull https://github.com/lisakowen/incubator-hawq-docs feature/hawqreload-fix-invocs Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-hawq-docs/pull/53.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #53 commit bef3b00c463cfde5318933cb42c852443ea94b2f Author: Lisa Owen Date: 2016-11-04T16:43:52Z ensure all hawq stop -u references include > docs - some hawq reload commands missing > - > > Key: HAWQ-1146 > URL: https://issues.apache.org/jira/browse/HAWQ-1146 > Project: Apache HAWQ > Issue Type: Bug > Components: Documentation >Reporter: Lisa Owen >Assignee: David Yozie > Fix For: 2.0.1.0-incubating > > > reloading HAWQ config without restart is invoked with the following command: > - hawq stop [-u | --reload] > some of the references to this command in the docs are missing the . > validate all references and correct the ones that are inconsistent. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (HAWQ-1144) Register into a 2-level partition table, hawq register didn't throw error, and indicates that hawq register succeed, but no data can be selected out.
[
https://issues.apache.org/jira/browse/HAWQ-1144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lin Wen resolved HAWQ-1144.
---
Resolution: Fixed
> Register into a 2-level partition table, hawq register didn't throw error,
> and indicates that hawq register succeed, but no data can be selected out.
> -
>
> Key: HAWQ-1144
> URL: https://issues.apache.org/jira/browse/HAWQ-1144
> Project: Apache HAWQ
> Issue Type: Bug
> Components: Command Line Tools
>Reporter: Lili Ma
>Assignee: Lin Wen
> Fix For: 2.0.1.0-incubating
>
>
> Register into a 2-level partition table, hawq register didn't throw error,
> and indicates that hawq register succeed, but no data can be selected out.
> Reproduce Steps:
> 1. Create a one-level partition table
> {code}
> create table parquet_wt (id SERIAL,a1 int,a2 char(5),a3 numeric,a4 boolean
> DEFAULT false ,a5 char DEFAULT 'd',a6 text,a7 timestamp,a8 character
> varying(705),a9 bigint,a10 date,a11 varchar(600),a12 text,a13 decimal,a14
> real,a15 bigint,a16 int4 ,a17 bytea,a18 timestamp with time zone,a19
> timetz,a20 path,a21 box,a22 macaddr,a23 interval,a24 character
> varying(800),a25 lseg,a26 point,a27 double precision,a28 circle,a29 int4,a30
> numeric(8),a31 polygon,a32 date,a33 real,a34 money,a35 cidr,a36 inet,a37
> time,a38 text,a39 bit,a40 bit varying(5),a41 smallint,a42 int ) WITH
> (appendonly=true, orientation=parquet) distributed randomly Partition by
> range(a1) (start(1) end(5000) every(1000) );
> {code}
> 2. insert some data into this table
> {code}
> insert into parquet_wt
> (a1,a2,a3,a4,a5,a6,a7,a8,a9,a10,a11,a12,a13,a14,a15,a16,a17,a18,a19,a20,a21,a22,a23,a24,a25,a26,a27,a28,a29,a30,a31,a32,a33,a34,a35,a36,a37,a38,a39,a40,a41,a42)
> values(generate_series(1,20),'M',2011,'t','a','This is news of today:
> Deadlock between Republicans and Democrats over how best to reduce the U.S.
> deficit, and over what period, has blocked an agreement to allow the raising
> of the $14.3 trillion debt ceiling','2001-12-24 02:26:11','U.S. House of
> Representatives Speaker John Boehner, the top Republican in Congress who has
> put forward a deficit reduction plan to be voted on later on Thursday said he
> had no control over whether his bill would avert a credit
> downgrade.',generate_series(2490,2505),'2011-10-11','The
> Republican-controlled House is tentatively scheduled to vote on Boehner
> proposal this afternoon at around 6 p.m. EDT (2200 GMT). The main Republican
> vote counter in the House, Kevin McCarthy, would not say if there were enough
> votes to pass the bill.','WASHINGTON:House Speaker John Boehner says his plan
> mixing spending cuts in exchange for raising the nations $14.3 trillion debt
> limit is not perfect but is as large a step that a divided government can
> take that is doable and signable by President Barack Obama.The Ohio
> Republican says the measure is an honest and sincere attempt at compromise
> and was negotiated with Democrats last weekend and that passing it would end
> the ongoing debt crisis. The plan blends $900 billion-plus in spending cuts
> with a companion increase in the nations borrowing
> cap.','1234.56',323453,generate_series(3452,3462),7845,'0011','2005-07-16
> 01:51:15+1359','2001-12-13
> 01:51:15','((1,2),(0,3),(2,1))','((2,3)(4,5))','08:00:2b:01:02:03','1-2','Republicans
> had been working throughout the day Thursday to lock down support for their
> plan to raise the nations debt ceiling, even as Senate Democrats vowed to
> swiftly kill it if
> passed.','((2,3)(4,5))','(6,7)',11.222,'((4,5),7)',32,3214,'(1,0,2,3)','2010-02-21',43564,'$1,000.00','192.168.1','126.1.3.4','12:30:45','Johnson
> & Johnsons McNeil Consumer Healthcare announced the voluntary dosage
> reduction today. Labels will carry new dosing instructions this fall.The
> company says it will cut the maximum dosage of Regular Strength Tylenol and
> other acetaminophen-containing products in 2012.Acetaminophen is safe when
> used as directed, says Edwin Kuffner, MD, McNeil vice president of
> over-the-counter medical affairs. But, when too much is taken, it can cause
> liver damage.The action is intended to cut the risk of such accidental
> overdoses, the company says in a news release.','1','0',12,23);
> {code}
> 3. extract the metadata out for the table
> {code}
> hawq extract -d postgres -o ~/parquet.yaml parquet_wt
> {code}
> 4. create a two-level partition table
> {code}
> CREATE TABLE parquet_wt_subpartgzip2
> (id SERIAL,a1
> int,a2 char(5),a3 numeric,a4 boolean DEFAULT false ,a5 char DEFAULT 'd',a6
> text,a7 timestamp,a8
[GitHub] incubator-hawq pull request #1003: Hawq-1144. Register to a multi-level part...
Github user linwen closed the pull request at: https://github.com/apache/incubator-hawq/pull/1003 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-hawq issue #1003: Hawq-1144. Register to a multi-level partition t...
Github user zhangh43 commented on the issue: https://github.com/apache/incubator-hawq/pull/1003 +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-hawq pull request #1003: Hawq-1144. Register to a multi-level part...
GitHub user linwen opened a pull request: https://github.com/apache/incubator-hawq/pull/1003 Hawq-1144. Register to a multi-level partition table should fail. Please review, Thanks! You can merge this pull request into a Git repository by running: $ git pull https://github.com/linwen/incubator-hawq hawq-1144 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-hawq/pull/1003.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1003 commit f26a8fa392f39546dd3bf5cf2e89b340d311e596 Author: Wen Lin Date: 2016-11-04T03:19:17Z HAWQ-1144. Register to a multi-level partition table should fail. commit 3257dec253d74b06960e30a187e9da15fd93de67 Author: Wen Lin Date: 2016-11-04T07:10:44Z fix sql --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] [Updated] (HAWQ-1147) Analyze will ERROR after register multiple parquet data files to a parquet table while enable debug and cassert in hawq configure
[
https://issues.apache.org/jira/browse/HAWQ-1147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
hongwu updated HAWQ-1147:
-
Affects Version/s: 2.0.1.0-incubating
> Analyze will ERROR after register multiple parquet data files to a parquet
> table while enable debug and cassert in hawq configure
> -
>
> Key: HAWQ-1147
> URL: https://issues.apache.org/jira/browse/HAWQ-1147
> Project: Apache HAWQ
> Issue Type: Bug
> Components: Core
>Affects Versions: 2.0.1.0-incubating
>Reporter: Xiang Sheng
>Assignee: Lei Chang
> Fix For: 2.0.1.0-incubating
>
>
> Enable debug and cassert in hawq configure, analyze will report Unexpected
> internal error after register multiple parquet data files to the table.
> reproduce steps:
> reproduce steps:
> 1. ./configure --enable-debug --enable-cassert
> 2. make -j8
> 3. make install
> 4. hawq init cluster -a
> 5. hadoop fs -mkdir hdfs://localhost:8020/hawq_register_test
> 6. hadoop fs -put
> $hawq_home/src/test/feature/ManagementTool/test_hawq_register_hawq.paq
> hdfs://localhost:8020/hawq_register_test/hawq1.paq
> 7. create table t (i int) with (appendonly=true, orientation=parquet);
> 8. hawq register -d postgres -f
> hdfs://localhost:8020/hawq_register_test/hawq1.paq t
> 9.
> postgres=# select oid from pg_class where relname = 't';
> oid
>+--+
> 24586
> (1 row)
> postgres=# select * from pg_aoseg.pg_paqseg_24586;
> segno | eof | tupcount | eofuncompressed
> ---+-+--+-
> 1 | 657 | -1 | -1
> (1 rows)
> postgres=#analyze t;
> FATAL: Unexpected internal error (analyze.c:1718)
> DETAIL: FailedAssertion("!(relTuples > -1.0)", File: "analyze.c", Line: 1718)
> HINT: Process 43356 will wait for gp_debug_linger=120 seconds before
> termination.
> Note that its locks and other resources will not be released until then.
> server closed the connection unexpectedly
> This probably means the server terminated abnormally
> before or while processing the request.
> The connection to the server was lost. Attempting reset: Succeeded
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
