Chao Sun created HIVE-10434:
---
Summary: Cancel connection to HS2 when remote Spark driver process
has failed [Spark Branch]
Key: HIVE-10434
URL: https://issues.apache.org/jira/browse/HIVE-10434
Project
---
On April 22, 2015, 12:30 a.m., Chao Sun wrote:
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/33422
: https://reviews.apache.org/r/33422/diff/
Testing
---
Tested on my own cluster, and it worked.
Thanks,
Chao Sun
Chao Sun created HIVE-10433:
---
Summary: Cancel connection when remote driver process exited with
error code [Spark Branch]
Key: HIVE-10433
URL: https://issues.apache.org/jira/browse/HIVE-10433
Project: Hive
---
Tested on my own cluster, and it worked.
Thanks,
Chao Sun
+1. Looking forward to seeing it get implemented.
On Thu, Apr 16, 2015 at 12:11 AM, Owen O'Malley owen.omal...@gmail.com
wrote:
+1
Thanks for taking the initiative and starting this.
.. Owen
On Apr 15, 2015, at 23:46, Sergey Shelukhin ser...@apache.org wrote:
Hi.
We’ve been
Congrats Mithun!
On Tue, Apr 14, 2015 at 3:29 PM, Chris Drome cdr...@yahoo-inc.com.invalid
wrote:
Congratulations Mithun!
On Tuesday, April 14, 2015 2:57 PM, Carl Steinbach c...@apache.org
wrote:
The Apache Hive PMC has voted to make Mithun Radhakrishnan a committer on
the Apache
Hi Xiaohe,
You can try TPC-DS from https://github.com/hortonworks/hive-testbench.
It contains large number of queries with complex joins.
Chao
On Wed, Apr 1, 2015 at 9:30 PM, xiaohe lan zombiexco...@gmail.com wrote:
Hi All,
I am new to Hive. Just set up a 5 node Hadoop environment and want
Hey Lefty,
You need to use the ftp protocol, not http.
After clicking the link, you'll need to remove http://; from the address
bar.
Best,
Chao
On Wed, Apr 1, 2015 at 9:41 PM, Lefty Leverenz leftylever...@gmail.com
wrote:
Andrés, I followed that link and got the dread 404 Not Found:
The
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/32692/#review78380
---
Ship it!
Ship It!
- Chao Sun
On March 31, 2015, 5:01 p.m., Na
Congrats everyone!
On Mon, Mar 23, 2015 at 11:33 AM, Alexander Pivovarov apivova...@gmail.com
wrote:
Congrats to Matt, Jimmy and Sergio!
On Mon, Mar 23, 2015 at 11:30 AM, Chaoyu Tang ct...@cloudera.com wrote:
Congratulations to Jimmy and Sergio!
On Mon, Mar 23, 2015 at 2:08 PM, Carl
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/31942/#review76102
---
Ship it!
Ship It!
- Chao Sun
On March 11, 2015, 5:48 p.m
+1
1. Build src with hadoop-1 and hadoop-2, tested the generated bin with some
DDL/DML queries.
2. Tested the bin with some DDL/DML queries.
3. Verified signature for bin and src, both asc and md5.
Chao
On Thu, Feb 19, 2015 at 1:55 AM, Szehon Ho sze...@cloudera.com wrote:
+1
1. Verified
I tested apache-hive.1.1.0-bin and I also got the same error as Szehon
reported.
On Wed, Feb 18, 2015 at 3:48 PM, Brock Noland br...@cloudera.com wrote:
Hi,
On Wed, Feb 18, 2015 at 2:21 PM, Gopal Vijayaraghavan gop...@apache.org
wrote:
Hi,
From the release branch, I noticed that the
- Tried to build the src for both hadoop-1 and hadoop-2, and some simple
DDL/DML queries from generated bin. They worked fine.
- Tried to run some simple DDL/DML queries from the bin, and worked fine.
- Verified PGP signature and MD5 sum for both src and bin. They are OK.
+1
On Mon, Feb 16,
No, there's no such way. You need to rebuild the project from source after
applying the patch.
Please checkout
https://cwiki.apache.org/confluence/display/Hive/HowToContribute for more
details.
Chao
On Thu, Feb 12, 2015 at 4:05 AM, Srinivas Thunga srinivas.thu...@gmail.com
wrote:
Hi Team,
, 2015, 1:05 a.m., Chao Sun wrote:
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/30388/
---
(Updated Jan. 29, 2015, 1:05 a.m
---
auto_join25.q
Thanks,
Chao Sun
,
Chao Sun
Congrats!!!
On Wed, Jan 28, 2015 at 1:21 PM, Vaibhav Gumashta vgumas...@hortonworks.com
wrote:
Congratulations e’one!
—Vaibhav
On Jan 28, 2015, at 1:20 PM, Xuefu Zhang xzh...@cloudera.commailto:
xzh...@cloudera.com wrote:
Congratulations to all!
--Xuefu
On Wed, Jan 28, 2015 at 1:15
Congrats!!!
On Wed, Jan 28, 2015 at 1:21 PM, Vaibhav Gumashta vgumas...@hortonworks.com
wrote:
Congratulations e’one!
—Vaibhav
On Jan 28, 2015, at 1:20 PM, Xuefu Zhang xzh...@cloudera.commailto:
xzh...@cloudera.com wrote:
Congratulations to all!
--Xuefu
On Wed, Jan 28, 2015 at 1:15
://reviews.apache.org/r/30388/diff/
Testing
---
auto_join25.q
Thanks,
Chao Sun
- Tried to build the src for both hadoop-1 and hadoop-2, and some simple
queries from generated bin. They worked fine.
- Tried to run some simple queries from the bin, and worked fine.
- Checked RELEASE_NOTES, NOTICE, README.txt. The copy right in the NOTICE
file needs to be updated to
/results/clientpositive/spark/union_remove_7.q.out
ql/src/test/results/clientpositive/spark/union_remove_8.q.out
ql/src/test/results/clientpositive/spark/union_remove_9.q.out
Thanks,
Chao Sun
/spark/union_remove_6.q.out
ql/src/test/results/clientpositive/spark/union_remove_7.q.out
ql/src/test/results/clientpositive/spark/union_remove_8.q.out
ql/src/test/results/clientpositive/spark/union_remove_9.q.out
Thanks,
Chao Sun
. To reply, visit:
https://reviews.apache.org/r/29111/#review65257
---
On Dec. 16, 2014, 7:02 p.m., Chao Sun wrote:
---
This is an automatically generated e-mail. To reply, visit:
https
/union_remove_9.q.out
Thanks,
Chao Sun
., Chao Sun wrote:
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/28889/
---
(Updated Dec. 11, 2014, 10:36 p.m.)
Review request
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/28889/#review64959
---
On Dec. 11, 2014, 10:36 p.m., Chao Sun wrote:
---
This is an automatically
join25.q
join26.q
join27.q
join30.q
join36.q
join37.q
join38.q
join39.q
join40.q
join_empty.q
join_filters_overlap.q
join_map_ppr.q
mapjoin1.q
mapjoin_distinct.q
mapjoin_filter_onerjoin.q
mapjoin_hook.q
mapjoin_tester.q
semijoin.q
skewjoin.q
table_access_keys_stats.q
Thanks,
Chao Sun
mapjoin1.q
mapjoin_distinct.q
mapjoin_filter_onerjoin.q
mapjoin_hook.q
mapjoin_tester.q
semijoin.q
skewjoin.q
table_access_keys_stats.q
Thanks,
Chao Sun
/hadoop/hive/ql/optimizer/ConstantPropagateProcFactory.java
https://reviews.apache.org/r/28791/#comment107348
trailing whitespace.
- Chao Sun
On Dec. 10, 2014, 6:09 p.m., Ted Xu wrote:
---
This is an automatically generated e-mail
On Dec. 10, 2014, 6:16 p.m., Chao Sun wrote:
I don't think optimize_nullscan and vector_decimal_aggregate are related.
Ashutosh can correct me if I'm wrong.
- Chao
---
This is an automatically generated e-mail. To reply, visit
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/28791/#review64666
---
Ship it!
Ship It!
- Chao Sun
On Dec. 11, 2014, 1:36 a.m., Ted
join39.q
join40.q
join_empty.q
join_filters_overlap.q
join_map_ppr.q
mapjoin1.q
mapjoin_distinct.q
mapjoin_filter_onerjoin.q
mapjoin_hook.q
mapjoin_tester.q
semijoin.q
skewjoin.q
table_access_keys_stats.q
Thanks,
Chao Sun
question: do you
think it would be good to have a new test case for this? Maybe someone that
just like join38.q, but uses common join and set number of reducers to be a
number greater than one?
- Chao Sun
On Dec. 7, 2014, 9:30 a.m., Ted Xu wrote
a.m.)
Review request for hive, Ashutosh Chauhan and Chao Sun.
Bugs: HIVE-9025
https://issues.apache.org/jira/browse/HIVE-9025
Repository: hive
Description
---
HIVE-5771 introduced a bug that when all partition columns are constants, the
partition is transformed
On Dec. 5, 2014, 2:27 a.m., Chao Sun wrote:
ql/src/java/org/apache/hadoop/hive/ql/optimizer/spark/SparkMapJoinOptimizer.java,
line 111
https://reviews.apache.org/r/28727/diff/1/?file=782895#file782895line111
why check twice here?
Jimmy Xiang wrote:
estimatedBuckets could
On Dec. 5, 2014, 2:27 a.m., Chao Sun wrote:
ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/SparkMapJoinResolver.java,
line 96
https://reviews.apache.org/r/28727/diff/1/?file=782893#file782893line96
I'm wondering if we can get rid of containsOp, and replace
/28727/#comment106306
why check twice here?
- Chao Sun
On Dec. 4, 2014, 11:38 p.m., Jimmy Xiang wrote:
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/28727
/spark/bucketmapjoin10.q.out 4188ad8
ql/src/test/results/clientpositive/spark/bucketmapjoin11.q.out e4a98ba
Diff: https://reviews.apache.org/r/28464/diff/
Testing
---
bucketmapjoin10.q and bucketmapjoin11.q now return correct results
Thanks,
Chao Sun
/SparkMapJoinResolver.java
96481f1
ql/src/java/org/apache/hadoop/hive/ql/plan/MapredLocalWork.java 6fbdcd2
Diff: https://reviews.apache.org/r/28299/diff/
Testing
---
Thanks,
Chao Sun
is strange.
Diffs
-
ql/src/java/org/apache/hadoop/hive/ql/optimizer/spark/SparkMapJoinOptimizer.java
4bfc26f
Diff: https://reviews.apache.org/r/28307/diff/
Testing
---
Thanks,
Chao Sun
p.m., Chao Sun wrote:
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/28299/
---
(Updated Nov. 20, 2014, 9:43 p.m.)
Review
/org/apache/hadoop/hive/ql/optimizer/physical/SparkMapJoinResolver.java
96481f1
ql/src/java/org/apache/hadoop/hive/ql/plan/MapredLocalWork.java 6fbdcd2
Diff: https://reviews.apache.org/r/28299/diff/
Testing
---
Thanks,
Chao Sun
.q, and auto_join27.q. They now generates
correct results.
Thanks,
Chao Sun
---
On Nov. 19, 2014, 11:35 p.m., Chao Sun wrote:
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/28145
.q, and auto_join27.q. They now generates
correct results.
Thanks,
Chao Sun
correct results.
Thanks,
Chao Sun
Diff: https://reviews.apache.org/r/28145/diff/
Testing
---
Tested with auto_join30.q, auto_join31.q, and auto_join27.q. They now generates
correct results.
Thanks,
Chao Sun
/SparkReduceSinkMapJoinProc.java
83d54bd
Diff: https://reviews.apache.org/r/28045/diff/
Testing
---
Thanks,
Chao Sun
a MapredLocalWork,
we need to do the same thing in SparkReduceRecordHandler as well.
Diffs
-
ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkReduceRecordHandler.java
21ac7ab
Diff: https://reviews.apache.org/r/28051/diff/
Testing
---
Thanks,
Chao Sun
On Nov. 15, 2014, 2:34 a.m., Szehon Ho wrote:
ql/src/java/org/apache/hadoop/hive/ql/exec/spark/ShuffleTran.java, line 39
https://reviews.apache.org/r/28064/diff/1/?file=764642#file764642line39
OK, does spark handle that if we pass NONE in by doing no-op? If
that's the case,
/optimizer/physical/SparkMapJoinResolver.java
4b9a6cb
ql/src/java/org/apache/hadoop/hive/ql/plan/MapredLocalWork.java 785e4a0
Diff: https://reviews.apache.org/r/28017/diff/
Testing
---
Thanks,
Chao Sun
://reviews.apache.org/r/28017/#review61373
---
On Nov. 14, 2014, 12:03 a.m., Chao Sun wrote:
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r
---
Thanks,
Chao Sun
/SparkHashTableSinkOperator.java
https://reviews.apache.org/r/27933/#comment102640
Don't need this check anymore.
ql/src/java/org/apache/hadoop/hive/ql/exec/SparkHashTableSinkOperator.java
https://reviews.apache.org/r/27933/#comment102639
Can we use SPARKHASHTABLESINK, or something similar?
- Chao Sun
On Nov. 13, 2014, 12:34 a.m., Chao Sun wrote:
ql/src/java/org/apache/hadoop/hive/ql/exec/SparkHashTableSinkOperator.java,
line 326
https://reviews.apache.org/r/27933/diff/2/?file=760734#file760734line326
Can we use SPARKHASHTABLESINK, or something similar?
Jimmy Xiang wrote
-
ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/SparkMapJoinResolver.java
a8b7ac6
Diff: https://reviews.apache.org/r/27955/diff/
Testing
---
Thanks,
Chao Sun
limit: -1
Processor Tree:
ListSink
{noformat}
Diffs (updated)
-
ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/SparkMapJoinResolver.java
a8b7ac6
Diff: https://reviews.apache.org/r/27955/diff/
Testing
---
Thanks,
Chao Sun
---
On Nov. 13, 2014, 2:29 a.m., Chao Sun wrote:
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/27955
/apache/hadoop/hive/ql/optimizer/physical/SparkMapJoinResolver.java
PRE-CREATION
ql/src/java/org/apache/hadoop/hive/ql/plan/SparkWork.java 46d02bf
Diff: https://reviews.apache.org/r/27627/diff/
Testing
---
Thanks,
Chao Sun
on each
other, which isn't true in general.Let's say the are two works (w1 and w2),
each having a map join operator. w1 and w2 are connected to w3 via HTS. w3
also contains map join operator. Dependency in this scenario will be
graphic rather than linear.
Chao Sun wrote:
I
/27627/#review60482
---
On Nov. 7, 2014, 6:07 p.m., Chao Sun wrote:
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/27627
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/27627/#review60380
---
On Nov. 7, 2014, 6:07 p.m., Chao Sun wrote
generated e-mail. To reply, visit:
https://reviews.apache.org/r/27627/#review60403
---
On Nov. 7, 2014, 6:07 p.m., Chao Sun wrote:
---
This is an automatically generated e-mail. To reply
on each
other, which isn't true in general.Let's say the are two works (w1 and w2),
each having a map join operator. w1 and w2 are connected to w3 via HTS. w3
also contains map join operator. Dependency in this scenario will be
graphic rather than linear.
Chao Sun wrote:
I
/r/27627/diff/
Testing
---
Thanks,
Chao Sun
/SparkMapJoinResolver.java
PRE-CREATION
ql/src/java/org/apache/hadoop/hive/ql/plan/SparkWork.java 66fd6b6
Diff: https://reviews.apache.org/r/27627/diff/
Testing
---
Thanks,
Chao Sun
/optimizer/physical/SparkMapJoinResolver.java
PRE-CREATION
Diff: https://reviews.apache.org/r/27627/diff/
Testing
---
Thanks,
Chao Sun
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/27627/#review60034
---
On Nov. 5, 2014, 5:51 p.m., Chao Sun wrote
. 5, 2014, 5:51 p.m., Chao Sun wrote:
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/27627/
---
(Updated Nov. 5, 2014, 5:51 p.m
://reviews.apache.org/r/27640/
---
(Updated Nov. 5, 2014, 8:29 p.m.)
Review request for hive, Chao Sun, Jimmy Xiang, Szehon Ho, and Xuefu Zhang.
Repository: hive-git
Description
---
This replaces ReduceSinks
/org/apache/hadoop/hive/ql/io/IOContext.java 5fb3b13
Diff: https://reviews.apache.org/r/27117/diff/
Testing
---
All multi-insertion related tests are passing on my local machine.
Thanks,
Chao Sun
groupby8_map.q
groupby8_map_skew.q
groupby8_noskew.q
groupby9.q
groupby_complex_types.q
groupby_complex_types_multi_single_reducer.q
groupby_multi_insert_common_distinct.q
pcr.q
smb_mapjoin_13.q
smb_mapjoin_15.q
smb_mapjoin_16.q
table_access_keys_stats.q
Thanks,
Chao Sun
,
Chao Sun
Maybe it's because the patch didn't apply?
2014-10-24 17:14:50,934 INFO
LocalCommand$CollectLogPolicy.handleOutput:69 The patch does not
appear to apply with p0, p1, or p2
2014-10-24 17:14:50,938 INFO
LocalCommand$CollectLogPolicy.handleOutput:69 + exit 1
2014-10-24 17:14:50,939 ERROR
/SparkUtilities.java 0f21b46
Diff: https://reviews.apache.org/r/27046/diff/
Testing
---
Thanks,
Chao Sun
ql/src/java/org/apache/hadoop/hive/ql/io/HiveContextAwareRecordReader.java
58e1ceb
Diff: https://reviews.apache.org/r/27117/diff/
Testing
---
All multi-insertion related tests are passing on my local machine.
Thanks,
Chao Sun
---
Thanks,
Chao Sun
---
On Oct. 22, 2014, 5:50 p.m., Chao Sun wrote:
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/27046/
---
(Updated Oct. 22
---
On Oct. 22, 2014, 5:50 p.m., Chao Sun wrote:
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/27046
/org/apache/hadoop/hive/ql/exec/spark/SparkUtilities.java 0f21b46
Diff: https://reviews.apache.org/r/27046/diff/
Testing
---
Thanks,
Chao Sun
we have a dir for spark only tests.
Chao Sun wrote:
I also wanted to make this as a spark-only test.
But the feature hasn't been implemented yet (I think Szehon is working on
it).
I made the file name to start with spark_ so in future we can move it
to spark-only test directory
splitting
won't generate duplicate FSs.
Thanks,
Chao Sun
spark_multi_insert_spill_work.q to check splitting
won't generate duplicate FSs.
Thanks,
Chao Sun
!
- Chao
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/26706/#review57445
---
On Oct. 20, 2014, 9:10 p.m., Chao Sun wrote
: https://reviews.apache.org/r/26706/diff/
Testing
---
All multi-insertion related results are regenerated, and manually checked
against the old results.
Also I created a new test spark_multi_insert_spill_work.q to check splitting
won't generate duplicate FSs.
Thanks,
Chao Sun
://reviews.apache.org/r/26706/#review57286
---
On Oct. 17, 2014, 9:24 p.m., Chao Sun wrote:
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org
spark_multi_insert_spill_work.q to check splitting
won't generate duplicate FSs.
Thanks,
Chao Sun
.q.out 6730010
ql/src/test/results/clientpositive/spark/vectorized_ptf.q.out 909378b
Diff: https://reviews.apache.org/r/26706/diff/
Testing
---
Thanks,
Chao Sun
/clientpositive/spark/vectorized_shufflejoin.q.out e8751a6
ql/src/test/results/clientpositive/spark/vectorized_timestamp_funcs.q.out
abf1d86
Diff: https://reviews.apache.org/r/26884/diff/
Testing
---
All test results are regenerated.
Thanks,
Chao Sun
/clientpositive/spark/union_remove_6.q.out 6730010
ql/src/test/results/clientpositive/spark/vectorized_ptf.q.out 909378b
ql/src/test/results/clientpositive/spark_multi_insert_split_work.q.out
PRE-CREATION
Diff: https://reviews.apache.org/r/26706/diff/
Testing
---
Thanks,
Chao Sun
the old results.
Also I created a new test spark_multi_insert_spill_work.q to check splitting
won't generate duplicate FSs.
Thanks,
Chao Sun
/vectorized_ptf.q.out 909378b
Diff: https://reviews.apache.org/r/26706/diff/
Testing
---
Thanks,
Chao Sun
/src/test/results/clientpositive/spark/union19.q.out 2fefe8e
ql/src/test/results/clientpositive/spark/union_remove_6.q.out 147f1fe
ql/src/test/results/clientpositive/spark/vectorized_ptf.q.out e12943c
Diff: https://reviews.apache.org/r/26706/diff/
Testing
---
Thanks,
Chao Sun
/SparkPlanGenerator.java
8e251df
ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkTran.java e770158
Diff: https://reviews.apache.org/r/26569/diff/
Testing
---
Thanks,
Chao Sun
: https://reviews.apache.org/r/26569/diff/
Testing
---
Thanks,
Chao Sun
/SparkPlanGenerator.java
8e251df
ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkTran.java e770158
Diff: https://reviews.apache.org/r/26569/diff/
Testing
---
Thanks,
Chao Sun
/ql/exec/spark/SparkTran.java e770158
Diff: https://reviews.apache.org/r/26569/diff/
Testing
---
Thanks,
Chao Sun
201 - 300 of 344 matches
Mail list logo
