[jira] [Updated] (HIVE-7729) Enable q-tests for ANALYZE TABLE feature.

[ https://issues.apache.org/jira/browse/HIVE-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7729: Component/s: Spark Enable q-tests for ANALYZE TABLE feature

[jira] [Updated] (HIVE-7729) Enable q-tests for ANALYZE TABLE feature.

[ https://issues.apache.org/jira/browse/HIVE-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7729: Environment: (was: Enable q-tests for ANALYZE TABLE feature since automatic test environment

[jira] [Updated] (HIVE-7729) Enable q-tests for ANALYZE TABLE feature.

[ https://issues.apache.org/jira/browse/HIVE-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7729: Description: Enable q-tests for ANALYZE TABLE feature since automatic test environment is ready

[jira] [Commented] (HIVE-7142) Hive multi serialization encoding support

[ https://issues.apache.org/jira/browse/HIVE-7142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096801#comment-14096801 ] Chengxiang Li commented on HIVE-7142: - Thanks very much [~leftylev], i've send

Review Request 24729: HIVE-7677 Implement native HiveReduceFunction

ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkRecordHandler.java PRE-CREATION ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkReduceRecordHandler.java PRE-CREATION Diff: https://reviews.apache.org/r/24729/diff/ Testing --- Thanks, chengxiang li

Re: Review Request 24729: HIVE-7677 Implement native HiveReduceFunction

/SparkRecordHandler.java PRE-CREATION ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkReduceRecordHandler.java PRE-CREATION Diff: https://reviews.apache.org/r/24729/diff/ Testing --- Thanks, chengxiang li

[jira] [Updated] (HIVE-7677) Implement native HiveReduceFunction

[ https://issues.apache.org/jira/browse/HIVE-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7677: Status: Patch Available (was: Open) Implement native HiveReduceFunction

[jira] [Resolved] (HIVE-7726) Refactor to reuse common logic between SparkMapRecordHandler and ExecMapper.

[ https://issues.apache.org/jira/browse/HIVE-7726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li resolved HIVE-7726. - Resolution: Duplicate It's duplicate with resolved HIVE-7327, we would just reopen HIVE-7327

[jira] [Resolved] (HIVE-7727) Refactor to reuse common logic between SparkReduceRecordHandler and ExecReducer

[ https://issues.apache.org/jira/browse/HIVE-7727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li resolved HIVE-7727. - Resolution: Duplicate it's duplicate with HIVE-7328, we would just reopen HIVE-7328. Refactor

[jira] [Resolved] (HIVE-7675) Implement native HiveMapFunction

[ https://issues.apache.org/jira/browse/HIVE-7675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li resolved HIVE-7675. - Resolution: Fixed Implement native HiveMapFunction

[jira] [Reopened] (HIVE-7327) Refactoring: make Hive map side data processing reusable

[ https://issues.apache.org/jira/browse/HIVE-7327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li reopened HIVE-7327: - We have implement native HiveMapFunction instead of using ExecMapper directly in HIVE-7675, reopen

[jira] [Reopened] (HIVE-7328) Refactoring: make Hive reduce side data processing reusable

[ https://issues.apache.org/jira/browse/HIVE-7328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li reopened HIVE-7328: - We have implement native HiveReduceFunction instead of using ExecRedecer directly in HIVE-7677

Re: Review Request 24377: HIVE-7142 Hive multi serialization encoding support

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/24377/#review50388 --- On Aug. 12, 2014, 2:18 a.m., chengxiang li wrote: --- This is an automatically generated e

Re: Review Request 24377: HIVE-7142 Hive multi serialization encoding support

/DelimitedJSONSerDe.java 179f9b5 serde/src/java/org/apache/hadoop/hive/serde2/SerDeUtils.java b7fb048 serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazySimpleSerDe.java fb55c70 Diff: https://reviews.apache.org/r/24377/diff/ Testing --- Thanks, chengxiang li

[jira] [Updated] (HIVE-7142) Hive multi serialization encoding support

[ https://issues.apache.org/jira/browse/HIVE-7142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7142: Attachment: HIVE-7142.4.patch Hive multi serialization encoding support

[jira] [Created] (HIVE-7709) Create SparkReporter

Chengxiang Li created HIVE-7709: --- Summary: Create SparkReporter Key: HIVE-7709 URL: https://issues.apache.org/jira/browse/HIVE-7709 Project: Hive Issue Type: Task Components: Spark

[jira] [Updated] (HIVE-7709) Create SparkReporter

[ https://issues.apache.org/jira/browse/HIVE-7709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7709: Issue Type: Sub-task (was: Task) Parent: HIVE-7292 Create SparkReporter

[jira] [Updated] (HIVE-7707) Optimize SparkMapRecordHandler implementation

[ https://issues.apache.org/jira/browse/HIVE-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7707: Attachment: HIVE-7707.1-spark.patch Optimize SparkMapRecordHandler implementation

[jira] [Updated] (HIVE-7707) Optimize SparkMapRecordHandler implementation

[ https://issues.apache.org/jira/browse/HIVE-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7707: Status: Patch Available (was: Open) Optimize SparkMapRecordHandler implementation

Re: Review Request 24689: HIVE-7707 Optimize SparkMapRecordHandler implementation

--- Thanks, chengxiang li

Review Request 24689: HIVE-7707 Optimize SparkMapRecordHandler implementation

/HiveMapFunction.java 7befaee ql/src/java/org/apache/hadoop/hive/ql/exec/spark/HiveMapFunctionResultList.java 8e05011 ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkMapRecordHandler.java 52324c9 Diff: https://reviews.apache.org/r/24689/diff/ Testing --- Thanks, chengxiang li

[jira] [Commented] (HIVE-7677) Implement native HiveReduceFunction

[ https://issues.apache.org/jira/browse/HIVE-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14095024#comment-14095024 ] Chengxiang Li commented on HIVE-7677: - HIVE-7493 try to adapt HiveReduceFunction input

[jira] [Updated] (HIVE-7643) ExecMapper static states lead to unpredictable query result.[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-7643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7643: Attachment: HIVE-7643.1-spark.patch As step 1 of HIVE-7675, Clone the implementation of ExecMapper

Review Request 24629: HIVE-7643 ExecMapper static states lead to unpredictable query result.

/hadoop/hive/ql/exec/spark/HiveMapFunctionResultList.java 90be4d6 ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkRecordHandler.java PRE-CREATION Diff: https://reviews.apache.org/r/24629/diff/ Testing --- Thanks, chengxiang li

Re: Review Request 24629: HIVE-7643 ExecMapper static states lead to unpredictable query result.

ql/src/java/org/apache/hadoop/hive/ql/exec/spark/HiveMapFunctionResultList.java 90be4d6 ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkRecordHandler.java PRE-CREATION Diff: https://reviews.apache.org/r/24629/diff/ Testing --- Thanks, chengxiang li

[jira] [Updated] (HIVE-7643) ExecMapper static states lead to unpredictable query result.[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-7643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7643: Status: Patch Available (was: Open) ExecMapper static states lead to unpredictable query result

[jira] [Created] (HIVE-7707) Optimize SparkRecordHandler implementation

Chengxiang Li created HIVE-7707: --- Summary: Optimize SparkRecordHandler implementation Key: HIVE-7707 URL: https://issues.apache.org/jira/browse/HIVE-7707 Project: Hive Issue Type: Improvement

[jira] [Updated] (HIVE-7643) ExecMapper static states lead to unpredictable query result.[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-7643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7643: Attachment: HIVE-7643.2-spark.patch ExecMapper static states lead to unpredictable query result

Re: Review Request 24629: HIVE-7643 ExecMapper static states lead to unpredictable query result.

/spark/HiveMapFunctionResultList.java 90be4d6 ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkMapRecordHandler.java PRE-CREATION Diff: https://reviews.apache.org/r/24629/diff/ Testing --- Thanks, chengxiang li

[jira] [Updated] (HIVE-7707) Optimize SparkMapRecordHandler implementation

[ https://issues.apache.org/jira/browse/HIVE-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7707: Summary: Optimize SparkMapRecordHandler implementation (was: Optimize SparkRecordHandler

[jira] [Updated] (HIVE-7675) Implement native HiveMapFunction

[ https://issues.apache.org/jira/browse/HIVE-7675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7675: Issue Type: Sub-task (was: New Feature) Parent: HIVE-7292 Implement native

[jira] [Created] (HIVE-7675) Implement native HiveMapFunction

Chengxiang Li created HIVE-7675: --- Summary: Implement native HiveMapFunction Key: HIVE-7675 URL: https://issues.apache.org/jira/browse/HIVE-7675 Project: Hive Issue Type: New Feature

[jira] [Created] (HIVE-7677) Implement native HiveReduceFunction

Chengxiang Li created HIVE-7677: --- Summary: Implement native HiveReduceFunction Key: HIVE-7677 URL: https://issues.apache.org/jira/browse/HIVE-7677 Project: Hive Issue Type: New Feature

[jira] [Updated] (HIVE-7677) Implement native HiveReduceFunction

[ https://issues.apache.org/jira/browse/HIVE-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7677: Issue Type: Sub-task (was: New Feature) Parent: HIVE-7292 Implement native

[jira] [Updated] (HIVE-7643) ExecMapper static states lead to unpredictable query result.[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-7643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7643: Summary: ExecMapper static states lead to unpredictable query result.[Spark Branch

[jira] [Updated] (HIVE-7675) Implement native HiveMapFunction

[ https://issues.apache.org/jira/browse/HIVE-7675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7675: Description: Currently, Hive on Spark depend on ExecMapper to execute operator logic, full stack

Re: Review Request 24377: HIVE-7142 Hive multi serialization encoding support

/hive/serde2/SerDeUtils.java b7fb048 serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazySimpleSerDe.java fb55c70 Diff: https://reviews.apache.org/r/24377/diff/ Testing --- Thanks, chengxiang li

Re: Review Request 24377: HIVE-7142 Hive multi serialization encoding support

--- On Aug. 6, 2014, 9:11 a.m., chengxiang li wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/24377

[jira] [Updated] (HIVE-7142) Hive multi serialization encoding support

[ https://issues.apache.org/jira/browse/HIVE-7142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7142: Attachment: HIVE-7142.3.patch Hive multi serialization encoding support

Re: Review Request 24445: HIVE-7642, Set hive input format by configuration.

/ql/exec/spark/SparkPlanGenerator.java 45eff67 Diff: https://reviews.apache.org/r/24445/diff/ Testing --- Thanks, chengxiang li

[jira] [Updated] (HIVE-7642) Set hive input format by configuration.[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-7642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7642: Attachment: HIVE-7642.2-spark.patch Set hive input format by configuration.[Spark Branch

[jira] [Commented] (HIVE-7142) Hive multi serialization encoding support

[ https://issues.apache.org/jira/browse/HIVE-7142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14092610#comment-14092610 ] Chengxiang Li commented on HIVE-7142: - Hi, [~navis], this jira is trying to support

[jira] [Assigned] (HIVE-7675) Implement native HiveMapFunction

[ https://issues.apache.org/jira/browse/HIVE-7675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li reassigned HIVE-7675: --- Assignee: Chengxiang Li Implement native HiveMapFunction

[jira] [Updated] (HIVE-7642) Set hive input format by configuration.[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-7642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7642: Attachment: HIVE-7642.3-spark.patch Set hive input format by configuration.[Spark Branch

Re: Review Request 24445: HIVE-7642, Set hive input format by configuration.

/ql/exec/spark/SparkPlanGenerator.java 45eff67 Diff: https://reviews.apache.org/r/24445/diff/ Testing --- Thanks, chengxiang li

Re: Review Request 24377: HIVE-7142 Hive multi serialization encoding support

/apache/hadoop/hive/serde2/DelimitedJSONSerDe.java 179f9b5 serde/src/java/org/apache/hadoop/hive/serde2/SerDeUtils.java b7fb048 serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazySimpleSerDe.java fb55c70 Diff: https://reviews.apache.org/r/24377/diff/ Testing --- Thanks, chengxiang

[jira] [Resolved] (HIVE-7332) Create SparkClient, interface to Spark cluster

[ https://issues.apache.org/jira/browse/HIVE-7332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li resolved HIVE-7332. - Resolution: Fixed Create SparkClient, interface to Spark cluster

[jira] [Commented] (HIVE-7332) Create SparkClient, interface to Spark cluster

[ https://issues.apache.org/jira/browse/HIVE-7332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14092479#comment-14092479 ] Chengxiang Li commented on HIVE-7332: - Added HIVE-7438, HIVE-7439 to track job status

[jira] [Created] (HIVE-7642) Set hive input format by configuration.

Chengxiang Li created HIVE-7642: --- Summary: Set hive input format by configuration. Key: HIVE-7642 URL: https://issues.apache.org/jira/browse/HIVE-7642 Project: Hive Issue Type: Bug

[jira] [Updated] (HIVE-7642) Set hive input format by configuration.

[ https://issues.apache.org/jira/browse/HIVE-7642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7642: Status: Patch Available (was: Open) Set hive input format by configuration

[jira] [Updated] (HIVE-7642) Set hive input format by configuration.[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-7642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7642: Summary: Set hive input format by configuration.[Spark Branch] (was: Set hive input format

[jira] [Updated] (HIVE-7642) Set hive input format by configuration.

[ https://issues.apache.org/jira/browse/HIVE-7642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7642: Attachment: HIVE-7642.1-spark.patch Set hive input format by configuration

Review Request 24445: HIVE-7642, Set hive input format by configuration.

Diff: https://reviews.apache.org/r/24445/diff/ Testing --- Thanks, chengxiang li

[jira] [Created] (HIVE-7643) ExecMapper statis states lead to unpredictable query result.[Spark Branch]

Chengxiang Li created HIVE-7643: --- Summary: ExecMapper statis states lead to unpredictable query result.[Spark Branch] Key: HIVE-7643 URL: https://issues.apache.org/jira/browse/HIVE-7643 Project: Hive

[jira] [Updated] (HIVE-7643) ExecMapper statis states lead to unpredictable query result.[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-7643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7643: Description: ExecMapper contain static states, static variable done for example. Spark executor may

[jira] [Updated] (HIVE-7643) ExecMapper statis states lead to unpredictable query result.[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-7643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7643: Description: ExecMapper contain static states, static variable done for example. Spark executor

[jira] [Resolved] (HIVE-7640) Support Hive TABLESAMPLE

[ https://issues.apache.org/jira/browse/HIVE-7640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li resolved HIVE-7640. - Resolution: Fixed Support Hive TABLESAMPLE Key: HIVE

[jira] [Commented] (HIVE-7640) Support Hive TABLESAMPLE

[ https://issues.apache.org/jira/browse/HIVE-7640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089085#comment-14089085 ] Chengxiang Li commented on HIVE-7640: - Mainly table sampling features are workable

[jira] [Updated] (HIVE-7142) Hive multi serialization encoding support

[ https://issues.apache.org/jira/browse/HIVE-7142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7142: Description: Hive only support serialize/deserialize in UTF-8, real world users want to load

[jira] [Updated] (HIVE-7142) Hive multi serialization encoding support

[ https://issues.apache.org/jira/browse/HIVE-7142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7142: Description: Currently Hive only support serialize data into UTF-8 charset bytes or deserialize

[jira] [Updated] (HIVE-7142) Hive multi serialization encoding support

[ https://issues.apache.org/jira/browse/HIVE-7142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7142: Status: Patch Available (was: Open) Hive multi serialization encoding support

[jira] [Updated] (HIVE-7142) Hive multi serialization encoding support

[ https://issues.apache.org/jira/browse/HIVE-7142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7142: Attachment: HIVE-7142.2.patch Hive multi serialization encoding support

Review Request 24377: HIVE-7142 Hive multi serialization encoding support

://reviews.apache.org/r/24377/diff/ Testing --- Thanks, chengxiang li

Re: Review Request 24377: HIVE-7142 Hive multi serialization encoding support

/apache/hadoop/hive/serde2/lazy/LazySimpleSerDe.java fb55c70 Diff: https://reviews.apache.org/r/24377/diff/ Testing --- Thanks, chengxiang li

Re: Review Request 24377: HIVE-7142 Hive multi serialization encoding support

/LazySimpleSerDe.java fb55c70 Diff: https://reviews.apache.org/r/24377/diff/ Testing --- Thanks, chengxiang li

[jira] [Commented] (HIVE-7627) FSStatsPublisher does fit into Spark multi-thread task mode[Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-7627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14088744#comment-14088744 ] Chengxiang Li commented on HIVE-7627: - Root cause: FSStatsPublisher collect table

[jira] [Commented] (HIVE-7626) Add jar through CLI did not loaded by Spark executor[Spark Branck]

[ https://issues.apache.org/jira/browse/HIVE-7626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14088748#comment-14088748 ] Chengxiang Li commented on HIVE-7626: - Thanks, Szehon. Add jar through CLI did

[jira] [Updated] (HIVE-7613) Research optimization of auto convert join to map join[Spark branch]

[ https://issues.apache.org/jira/browse/HIVE-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7613: Priority: Minor (was: Major) Research optimization of auto convert join to map join[Spark branch

[jira] [Updated] (HIVE-7640) Support Hive TABLESAMPLE

[ https://issues.apache.org/jira/browse/HIVE-7640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7640: Issue Type: Sub-task (was: Task) Parent: HIVE-7292 Support Hive TABLESAMPLE

[jira] [Created] (HIVE-7640) Support Hive TABLESAMPLE

Chengxiang Li created HIVE-7640: --- Summary: Support Hive TABLESAMPLE Key: HIVE-7640 URL: https://issues.apache.org/jira/browse/HIVE-7640 Project: Hive Issue Type: Task Components

[jira] [Created] (HIVE-7613) Research and verify optimization of auto convert join to map join[Spark branch]

Chengxiang Li created HIVE-7613: --- Summary: Research and verify optimization of auto convert join to map join[Spark branch] Key: HIVE-7613 URL: https://issues.apache.org/jira/browse/HIVE-7613 Project

Re: Review Request 24221: HIVE-7567, support automatic adjusting reducer number for hive on spark job

/GenSparkUtils.java 6dca6c9 ql/src/java/org/apache/hadoop/hive/ql/parse/spark/OptimizeSparkProcContext.java PRE-CREATION ql/src/java/org/apache/hadoop/hive/ql/parse/spark/SparkCompiler.java 3840318 Diff: https://reviews.apache.org/r/24221/diff/ Testing --- Thanks, chengxiang li

[jira] [Updated] (HIVE-7567) support automatic calculating reduce task number [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-7567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7567: Attachment: HIVE-7567.5-spark.patch rebase the branch and update patch. support automatic

Re: Review Request 24221: HIVE-7567, support automatic adjusting reducer number for hive on spark job

/GenSparkUtils.java 6dca6c9 ql/src/java/org/apache/hadoop/hive/ql/parse/spark/OptimizeSparkProcContext.java PRE-CREATION ql/src/java/org/apache/hadoop/hive/ql/parse/spark/SparkCompiler.java 3840318 Diff: https://reviews.apache.org/r/24221/diff/ Testing --- Thanks, chengxiang li

[jira] [Updated] (HIVE-7567) support automatic calculating reduce task number [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-7567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7567: Attachment: HIVE-7567.6-spark.patch fix minor style issues. support automatic calculating reduce

[jira] [Updated] (HIVE-7613) Research and verify optimization of auto convert join to map join[Spark branch]

[ https://issues.apache.org/jira/browse/HIVE-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7613: Description: ConvertJoinMapJoin is an optimization the replaces a common join(aka shuffle join

[jira] [Updated] (HIVE-7613) Research optimization of auto convert join to map join[Spark branch]

[ https://issues.apache.org/jira/browse/HIVE-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7613: Issue Type: Task (was: Bug) Summary: Research optimization of auto convert join to map join

[jira] [Created] (HIVE-7626) Add jar through CLI did not loaded by Spark executor[Spark Branck]

Chengxiang Li created HIVE-7626: --- Summary: Add jar through CLI did not loaded by Spark executor[Spark Branck] Key: HIVE-7626 URL: https://issues.apache.org/jira/browse/HIVE-7626 Project: Hive

[jira] [Updated] (HIVE-7626) Add jar through CLI did not loaded by Spark executor[Spark Branck]

[ https://issues.apache.org/jira/browse/HIVE-7626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7626: Attachment: HIVE-7626.1-spark.patch Add jar through CLI did not loaded by Spark executor[Spark

[jira] [Assigned] (HIVE-7626) Add jar through CLI did not loaded by Spark executor[Spark Branck]

[ https://issues.apache.org/jira/browse/HIVE-7626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li reassigned HIVE-7626: --- Assignee: Chengxiang Li Add jar through CLI did not loaded by Spark executor[Spark Branck

Review Request 24362: HIVE-7626 Add jar through CLI did not loaded by Spark executor

--- Thanks, chengxiang li

[jira] [Updated] (HIVE-7626) Add jar through CLI did not loaded by Spark executor[Spark Branck]

[ https://issues.apache.org/jira/browse/HIVE-7626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7626: Status: Patch Available (was: Open) Add jar through CLI did not loaded by Spark executor[Spark

[jira] [Updated] (HIVE-7597) Support analyze table

[ https://issues.apache.org/jira/browse/HIVE-7597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7597: Status: Patch Available (was: Open) Support analyze table

[jira] [Updated] (HIVE-7597) Support analyze table

[ https://issues.apache.org/jira/browse/HIVE-7597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7597: Attachment: HIVE-7597.1-spark.patch Support analyze table

Review Request 24363: HIVE-7597 Support analyze table

://reviews.apache.org/r/24363/diff/ Testing --- Thanks, chengxiang li

[jira] [Created] (HIVE-7627) FSStatsPublisher does fit into Spark multi-thread task mode[Spark Branch]

Chengxiang Li created HIVE-7627: --- Summary: FSStatsPublisher does fit into Spark multi-thread task mode[Spark Branch] Key: HIVE-7627 URL: https://issues.apache.org/jira/browse/HIVE-7627 Project: Hive

Re: Review Request 24362: HIVE-7626 Add jar through CLI did not loaded by Spark executor

://reviews.apache.org/r/24362/diff/ Testing --- Thanks, chengxiang li

[jira] [Commented] (HIVE-7597) Support analyze table

[ https://issues.apache.org/jira/browse/HIVE-7597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14087178#comment-14087178 ] Chengxiang Li commented on HIVE-7597: - There is a known issue on FSStatsPublisher

Re: Review Request 24363: HIVE-7597 Support analyze table

/parse/spark/SparkProcessAnalyzeTable.java c6bc03b Diff: https://reviews.apache.org/r/24363/diff/ Testing --- Thanks, chengxiang li

[jira] [Updated] (HIVE-7597) Support analyze table

[ https://issues.apache.org/jira/browse/HIVE-7597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7597: Attachment: HIVE-7597.2-spark.patch rebase the patch Support analyze table

Re: Review Request 24363: HIVE-7597 Support analyze table

/SparkProcessAnalyzeTable.java c6bc03b Diff: https://reviews.apache.org/r/24363/diff/ Testing --- Thanks, chengxiang li

[jira] [Updated] (HIVE-7597) Support analyze table

[ https://issues.apache.org/jira/browse/HIVE-7597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7597: Attachment: HIVE-7597.3-spark.patch Support analyze table

[jira] [Updated] (HIVE-7567) support automatic calculating reduce task number [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-7567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7567: Attachment: HIVE-7567.3-spark.patch support automatic calculating reduce task number [Spark Branch

Re: Review Request 24221: HIVE-7567, support automatic adjusting reducer number for hive on spark job

ql/src/java/org/apache/hadoop/hive/ql/parse/spark/OptimizeSparkProcContext.java PRE-CREATION ql/src/java/org/apache/hadoop/hive/ql/parse/spark/SparkCompiler.java 3840318 Diff: https://reviews.apache.org/r/24221/diff/ Testing --- Thanks, chengxiang li

[jira] [Updated] (HIVE-7567) support automatic calculating reduce task number [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-7567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7567: Attachment: (was: HIVE-7567.3-spark.patch) support automatic calculating reduce task number

Re: Review Request 24221: HIVE-7567, support automatic adjusting reducer number for hive on spark job

PRE-CREATION ql/src/java/org/apache/hadoop/hive/ql/parse/spark/SparkCompiler.java 3840318 Diff: https://reviews.apache.org/r/24221/diff/ Testing --- Thanks, chengxiang li

[jira] [Updated] (HIVE-7567) support automatic calculating reduce task number [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-7567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7567: Attachment: HIVE-7567.3-spark.patch support automatic calculating reduce task number [Spark Branch

[jira] [Updated] (HIVE-7567) support automatic calculating reduce task number [Spark Branch]

[ https://issues.apache.org/jira/browse/HIVE-7567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7567: Attachment: HIVE-7567.4-spark.patch support automatic calculating reduce task number [Spark Branch

Re: Review Request 24221: HIVE-7567, support automatic adjusting reducer number for hive on spark job

PRE-CREATION ql/src/java/org/apache/hadoop/hive/ql/parse/spark/SparkCompiler.java 3840318 Diff: https://reviews.apache.org/r/24221/diff/ Testing --- Thanks, chengxiang li

[jira] [Commented] (HIVE-7567) support automatic calculating reduce task number

[ https://issues.apache.org/jira/browse/HIVE-7567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14084221#comment-14084221 ] Chengxiang Li commented on HIVE-7567: - Link Review: [https://reviews.apache.org/r/24221

<    2   3   4   5   6   7   8   >