[jira] [Created] (SPARK-15743) Prevent saving with all-column partitioning

Dongjoon Hyun created SPARK-15743: - Summary: Prevent saving with all-column partitioning Key: SPARK-15743 URL: https://issues.apache.org/jira/browse/SPARK-15743 Project: Spark Issue Type:

[jira] [Updated] (SPARK-15744) Rename two TungstenAggregation*Suites and update error messages/comments

[ https://issues.apache.org/jira/browse/SPARK-15744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-15744: -- Description: For consistency, this issue updates some remaining

[jira] [Created] (SPARK-15744) Rename two TungstenAggregation*Suites and update error messages/comments

Dongjoon Hyun created SPARK-15744: - Summary: Rename two TungstenAggregation*Suites and update error messages/comments Key: SPARK-15744 URL: https://issues.apache.org/jira/browse/SPARK-15744 Project:

[jira] [Updated] (SPARK-15807) Support varargs for dropDuplicates in Dataset/DataFrame

[ https://issues.apache.org/jira/browse/SPARK-15807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-15807: -- Description: This issue adds `varargs`-types `dropDuplicates` functions in

[jira] [Created] (SPARK-15913) Dispatcher.stopped should be enclosed by synchronized block.

Dongjoon Hyun created SPARK-15913: - Summary: Dispatcher.stopped should be enclosed by synchronized block. Key: SPARK-15913 URL: https://issues.apache.org/jira/browse/SPARK-15913 Project: Spark

[jira] [Updated] (SPARK-15913) Dispatcher.stopped should be enclosed by synchronized block.

[ https://issues.apache.org/jira/browse/SPARK-15913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-15913: -- Priority: Minor (was: Major) > Dispatcher.stopped should be enclosed by synchronized block. >

[jira] [Updated] (SPARK-15883) Fix broken links on MLLIB documentations

[ https://issues.apache.org/jira/browse/SPARK-15883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-15883: -- Description: This issue fixes all broken links on Spark 2.0 preview MLLib documents. Also,

[jira] [Created] (SPARK-15883) Fix broken links on MLLIB documentations

Dongjoon Hyun created SPARK-15883: - Summary: Fix broken links on MLLIB documentations Key: SPARK-15883 URL: https://issues.apache.org/jira/browse/SPARK-15883 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-15883) Fix broken links on MLLIB documentations

[ https://issues.apache.org/jira/browse/SPARK-15883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-15883: -- Description: This issue fixes all broken links on Spark 2.0 preview MLLib documents. Also,

[jira] [Commented] (SPARK-15922) BlockMatrix to IndexedRowMatrix throws an error

[ https://issues.apache.org/jira/browse/SPARK-15922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15327884#comment-15327884 ] Dongjoon Hyun commented on SPARK-15922: --- Hi, [~chaz2505]. This is due to `toIndexedRowMatrix` bug.

[jira] [Commented] (SPARK-15908) Add varargs-type dropDuplicates() function in SparkR

[ https://issues.apache.org/jira/browse/SPARK-15908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15328949#comment-15328949 ] Dongjoon Hyun commented on SPARK-15908: --- Hi, [~sunrui]. I did SPARK-15807. If you didn't start yet,

[jira] [Comment Edited] (SPARK-15908) Add varargs-type dropDuplicates() function in SparkR

[ https://issues.apache.org/jira/browse/SPARK-15908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15331439#comment-15331439 ] Dongjoon Hyun edited comment on SPARK-15908 at 6/15/16 10:16 AM: - I'll

[jira] [Commented] (SPARK-15908) Add varargs-type dropDuplicates() function in SparkR

[ https://issues.apache.org/jira/browse/SPARK-15908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15331439#comment-15331439 ] Dongjoon Hyun commented on SPARK-15908: --- I'll working on this issue~. > Add varargs-type

[jira] [Commented] (SPARK-15922) BlockMatrix to IndexedRowMatrix throws an error

[ https://issues.apache.org/jira/browse/SPARK-15922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15331294#comment-15331294 ] Dongjoon Hyun commented on SPARK-15922: --- Hi, [~mengxr]. Could you review the PR on this bug? >

[jira] [Commented] (SPARK-14692) Error While Setting the path for R front end

[ https://issues.apache.org/jira/browse/SPARK-14692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15331613#comment-15331613 ] Dongjoon Hyun commented on SPARK-14692: --- Hi, [~nmolkeri]. It seems that you just needed

[jira] [Commented] (SPARK-15918) unionAll returns wrong result when two dataframes has schema in different order

[ https://issues.apache.org/jira/browse/SPARK-15918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15328405#comment-15328405 ] Dongjoon Hyun commented on SPARK-15918: --- Hi, [~Prabhu Joseph]. Instead of changing one of the

[jira] [Created] (SPARK-15773) Avoid creating local variable `sc` in examples

Dongjoon Hyun created SPARK-15773: - Summary: Avoid creating local variable `sc` in examples Key: SPARK-15773 URL: https://issues.apache.org/jira/browse/SPARK-15773 Project: Spark Issue Type:

[jira] [Updated] (SPARK-15773) Avoid creating local variable `sc` in examples if possible

[ https://issues.apache.org/jira/browse/SPARK-15773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-15773: -- Summary: Avoid creating local variable `sc` in examples if possible (was: Avoid creating

[jira] [Created] (SPARK-15807) Support varargs for distinct/dropDuplicates in Dataset/DataFrame

Dongjoon Hyun created SPARK-15807: - Summary: Support varargs for distinct/dropDuplicates in Dataset/DataFrame Key: SPARK-15807 URL: https://issues.apache.org/jira/browse/SPARK-15807 Project: Spark

[jira] [Created] (SPARK-15660) RDD and Dataset should show the consistent value for variance/stdev.

Dongjoon Hyun created SPARK-15660: - Summary: RDD and Dataset should show the consistent value for variance/stdev. Key: SPARK-15660 URL: https://issues.apache.org/jira/browse/SPARK-15660 Project:

[jira] [Updated] (SPARK-15660) RDD and Dataset should show the consistent value for variance/stdev.

[ https://issues.apache.org/jira/browse/SPARK-15660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-15660: -- Description: In Spark-11490, `variance/stdev` are redefined as the **sample**

[jira] [Updated] (SPARK-15076) Add ReorderAssociativeOperator optimizer

[ https://issues.apache.org/jira/browse/SPARK-15076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-15076: -- Summary: Add ReorderAssociativeOperator optimizer (was: Improve ConstantFolding optimizer to

[jira] [Updated] (SPARK-15076) Add ReorderAssociativeOperator optimizer

[ https://issues.apache.org/jira/browse/SPARK-15076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-15076: -- Description: This issue add a new optimizer `ConstantFolding` by taking advantage of

[jira] [Updated] (SPARK-15076) Add ReorderAssociativeOperator optimizer

[ https://issues.apache.org/jira/browse/SPARK-15076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-15076: -- Description: This issue add a new optimizer `ReorderAssociativeOperator` by taking advantage

[jira] [Commented] (SPARK-15612) Raise exception if decimal `scale` >= `precision`

[ https://issues.apache.org/jira/browse/SPARK-15612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303949#comment-15303949 ] Dongjoon Hyun commented on SPARK-15612: --- It was my mistake. > Raise exception if decimal `scale`

[jira] [Updated] (SPARK-15612) Raise exception if decimal `scale` >= `precision`

[ https://issues.apache.org/jira/browse/SPARK-15612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-15612: -- Summary: Raise exception if decimal `scale` >= `precision` (was: Raise exception if decimal

[jira] [Updated] (SPARK-15612) Raise exception if decimal `scale` equals to `precision`

[ https://issues.apache.org/jira/browse/SPARK-15612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-15612: -- Summary: Raise exception if decimal `scale` equals to `precision` (was: Decimal `scale` must

[jira] [Commented] (SPARK-15579) SparkUI: Storage page is empty even if things are cached

[ https://issues.apache.org/jira/browse/SPARK-15579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303786#comment-15303786 ] Dongjoon Hyun commented on SPARK-15579: --- Also, in Executors page, the memory usage shows only the

[jira] [Closed] (SPARK-15612) Raise exception if decimal `scale` >= `precision`

[ https://issues.apache.org/jira/browse/SPARK-15612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-15612. - Resolution: Invalid > Raise exception if decimal `scale` >= `precision` >

[jira] [Created] (SPARK-15612) Decimal `scale` must be less than `precision`

Dongjoon Hyun created SPARK-15612: - Summary: Decimal `scale` must be less than `precision` Key: SPARK-15612 URL: https://issues.apache.org/jira/browse/SPARK-15612 Project: Spark Issue Type:

[jira] [Commented] (SPARK-15579) SparkUI: Storage page is empty even if things are cached

[ https://issues.apache.org/jira/browse/SPARK-15579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303784#comment-15303784 ] Dongjoon Hyun commented on SPARK-15579: --- Hi, [~andrewor14]. The dangling RDD seems to be removed.

[jira] [Commented] (SPARK-15618) Use SparkSession.builder.sparkContext(...) in tests where possible

[ https://issues.apache.org/jira/browse/SPARK-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304509#comment-15304509 ] Dongjoon Hyun commented on SPARK-15618: --- Thank you! Right. That's better. > Use

[jira] [Commented] (SPARK-15618) Use SparkSession.builder.sparkContext(...) in tests where possible

[ https://issues.apache.org/jira/browse/SPARK-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304486#comment-15304486 ] Dongjoon Hyun commented on SPARK-15618: --- Thank you for creating JIRA for this. I'll start now. :)

[jira] [Commented] (SPARK-15618) Use SparkSession.builder.sparkContext(...) in tests where possible

[ https://issues.apache.org/jira/browse/SPARK-15618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304498#comment-15304498 ] Dongjoon Hyun commented on SPARK-15618: --- Is it okay if I remove `private[sql]` from that function?

[jira] [Commented] (SPARK-15584) Abstract duplicate code: "spark.sql.sources." properties

[ https://issues.apache.org/jira/browse/SPARK-15584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303276#comment-15303276 ] Dongjoon Hyun commented on SPARK-15584: --- Oh, sure! Thank you! > Abstract duplicate code:

[jira] [Created] (SPARK-15603) Replace SQLContext with SparkSession in ML/MLLib

Dongjoon Hyun created SPARK-15603: - Summary: Replace SQLContext with SparkSession in ML/MLLib Key: SPARK-15603 URL: https://issues.apache.org/jira/browse/SPARK-15603 Project: Spark Issue

[jira] [Created] (SPARK-15709) Prevent `freqItems` from raising `UnsupportedOperationException: empty.min`

Dongjoon Hyun created SPARK-15709: - Summary: Prevent `freqItems` from raising `UnsupportedOperationException: empty.min` Key: SPARK-15709 URL: https://issues.apache.org/jira/browse/SPARK-15709

[jira] [Commented] (SPARK-15709) Prevent `freqItems` from raising `UnsupportedOperationException: empty.min`

[ https://issues.apache.org/jira/browse/SPARK-15709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15310873#comment-15310873 ] Dongjoon Hyun commented on SPARK-15709: --- Thank you, [~srowen]! > Prevent `freqItems` from raising

[jira] [Created] (SPARK-15696) Improve `crosstab` to have a consistent column order

Dongjoon Hyun created SPARK-15696: - Summary: Improve `crosstab` to have a consistent column order Key: SPARK-15696 URL: https://issues.apache.org/jira/browse/SPARK-15696 Project: Spark

[jira] [Commented] (SPARK-15956) When unwrapping ORC avoid pattern matching at runtime

[ https://issues.apache.org/jira/browse/SPARK-15956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15344887#comment-15344887 ] Dongjoon Hyun commented on SPARK-15956: --- Congratulation, [~chobrian]! Now, I know your new email

[jira] [Created] (SPARK-16005) Add `randomSplit` to SparkR

Dongjoon Hyun created SPARK-16005: - Summary: Add `randomSplit` to SparkR Key: SPARK-16005 URL: https://issues.apache.org/jira/browse/SPARK-16005 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-14995) Add "since" tag in Roxygen documentation for SparkR API methods

[ https://issues.apache.org/jira/browse/SPARK-14995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15335053#comment-15335053 ] Dongjoon Hyun commented on SPARK-14995: --- Hi, All. If it's okay, I'll make a PR for this tonight.

[jira] [Updated] (SPARK-15660) Update RDD `variance/stdev` description and add popVariance/popStdev

[ https://issues.apache.org/jira/browse/SPARK-15660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-15660: -- Priority: Minor (was: Major) Description: In Spark-11490, `variance/stdev` are

[jira] [Created] (SPARK-16052) Add CollapseRepartitionBy optimizer

Dongjoon Hyun created SPARK-16052: - Summary: Add CollapseRepartitionBy optimizer Key: SPARK-16052 URL: https://issues.apache.org/jira/browse/SPARK-16052 Project: Spark Issue Type:

[jira] [Created] (SPARK-16053) Add `spark_partition_id` in SparkR

Dongjoon Hyun created SPARK-16053: - Summary: Add `spark_partition_id` in SparkR Key: SPARK-16053 URL: https://issues.apache.org/jira/browse/SPARK-16053 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-16051) Add `read.orc/write.orc` to SparkR

Dongjoon Hyun created SPARK-16051: - Summary: Add `read.orc/write.orc` to SparkR Key: SPARK-16051 URL: https://issues.apache.org/jira/browse/SPARK-16051 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-16059) Add `monotonically_increasing_id` function in SparkR

Dongjoon Hyun created SPARK-16059: - Summary: Add `monotonically_increasing_id` function in SparkR Key: SPARK-16059 URL: https://issues.apache.org/jira/browse/SPARK-16059 Project: Spark Issue

[jira] [Created] (SPARK-16165) Fix the update logic for InMemoryTableScanExec.readBatches accumulator

Dongjoon Hyun created SPARK-16165: - Summary: Fix the update logic for InMemoryTableScanExec.readBatches accumulator Key: SPARK-16165 URL: https://issues.apache.org/jira/browse/SPARK-16165 Project:

[jira] [Commented] (SPARK-16164) Filter pushdown should keep the ordering in the logical plan

[ https://issues.apache.org/jira/browse/SPARK-16164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345945#comment-15345945 ] Dongjoon Hyun commented on SPARK-16164: --- Hi, [~mengxr]. The root cause seems to be

[jira] [Commented] (SPARK-16164) Filter pushdown should keep the ordering in the logical plan

[ https://issues.apache.org/jira/browse/SPARK-16164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345977#comment-15345977 ] Dongjoon Hyun commented on SPARK-16164: --- It's my pleasure. :) > Filter pushdown should keep the

[jira] [Created] (SPARK-15996) Fix R dataframe example by removing deprecated functions

Dongjoon Hyun created SPARK-15996: - Summary: Fix R dataframe example by removing deprecated functions Key: SPARK-15996 URL: https://issues.apache.org/jira/browse/SPARK-15996 Project: Spark

[jira] [Updated] (SPARK-15996) Fix R examples by removing deprecated functions

[ https://issues.apache.org/jira/browse/SPARK-15996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-15996: -- Description: Currently, R examples(dataframe.R and data-manipulation.R) fail like the

[jira] [Updated] (SPARK-16186) Support partition batch pruning with `IN` predicate in InMemoryTableScanExec

[ https://issues.apache.org/jira/browse/SPARK-16186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-16186: -- Description: One of the most frequent usage patterns for Spark SQL is using **cached

[jira] [Created] (SPARK-16174) Add RemoveLiteralRepetitionFromIn optimizer

Dongjoon Hyun created SPARK-16174: - Summary: Add RemoveLiteralRepetitionFromIn optimizer Key: SPARK-16174 URL: https://issues.apache.org/jira/browse/SPARK-16174 Project: Spark Issue Type:

[jira] [Created] (SPARK-16186) Support partition batch pruning with `IN` predicate in InMemoryTableScanExec

Dongjoon Hyun created SPARK-16186: - Summary: Support partition batch pruning with `IN` predicate in InMemoryTableScanExec Key: SPARK-16186 URL: https://issues.apache.org/jira/browse/SPARK-16186

[jira] [Updated] (SPARK-16186) Support partition batch pruning with `IN` predicate in InMemoryTableScanExec

[ https://issues.apache.org/jira/browse/SPARK-16186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-16186: -- Description: One of the most frequent usage patterns for Spark SQL is using **cached

[jira] [Commented] (SPARK-16006) Attemping to write empty DataFrame with no fields throw non-intuitive exception

[ https://issues.apache.org/jira/browse/SPARK-16006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15338083#comment-15338083 ] Dongjoon Hyun commented on SPARK-16006: --- Hi, [~tdas]. The PR is updated, could you review again? >

[jira] [Commented] (SPARK-16006) Attemping to write empty DataFrame with no fields throw non-intuitive exception

[ https://issues.apache.org/jira/browse/SPARK-16006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15335324#comment-15335324 ] Dongjoon Hyun commented on SPARK-16006: --- I will fix this tonight~ Thank you for reporting this,

[jira] [Commented] (SPARK-6814) Support sorting for any data type in SparkR

[ https://issues.apache.org/jira/browse/SPARK-6814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15338147#comment-15338147 ] Dongjoon Hyun commented on SPARK-6814: -- Hi, [~shivaram]. Since SparkR RDD is hiding from users now,

[jira] [Updated] (SPARK-16174) Improve OptimizeIn optimizer to remove deterministic repetitions

[ https://issues.apache.org/jira/browse/SPARK-16174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-16174: -- Description: This issue improves `OptimizeIn` optimizer to remove the deterministic

[jira] [Commented] (SPARK-16183) Large Spark SQL commands cause StackOverflowError in parser when using sqlContext.sql

[ https://issues.apache.org/jira/browse/SPARK-16183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347874#comment-15347874 ] Dongjoon Hyun commented on SPARK-16183: --- Hi, [~UZiVcbfPXaNrMtT]. Could you provide some sample

[jira] [Closed] (SPARK-16208) Add `CollapseEmptyPlan` optimizer

[ https://issues.apache.org/jira/browse/SPARK-16208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-16208. - Resolution: Incomplete > Add `CollapseEmptyPlan` optimizer > - >

[jira] [Commented] (SPARK-16183) Large Spark SQL commands cause StackOverflowError in parser when using sqlContext.sql

[ https://issues.apache.org/jira/browse/SPARK-16183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15349758#comment-15349758 ] Dongjoon Hyun commented on SPARK-16183: --- Oh, I see what you mean. Thank you. > Large Spark SQL

[jira] [Commented] (SPARK-16208) Add `CollapseEmptyPlan` optimizer

[ https://issues.apache.org/jira/browse/SPARK-16208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15349745#comment-15349745 ] Dongjoon Hyun commented on SPARK-16208: --- I will revisit this issue later. > Add

[jira] [Updated] (SPARK-16052) Improve `CollapseRepartition` optimizer for Repartition/RepartitionBy

[ https://issues.apache.org/jira/browse/SPARK-16052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-16052: -- Description: This issue improves `CollapseRepartition` to optimize the adjacent combinations

[jira] [Commented] (SPARK-16228) "Percentile" needs explicit cast to double

[ https://issues.apache.org/jira/browse/SPARK-16228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15351708#comment-15351708 ] Dongjoon Hyun commented on SPARK-16228: --- Hi, [~epahomov] and [~srowen]. The root cause is that

[jira] [Commented] (SPARK-10591) False negative in QueryTest.checkAnswer

[ https://issues.apache.org/jira/browse/SPARK-10591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15350065#comment-15350065 ] Dongjoon Hyun commented on SPARK-10591: --- Hi, [~lian cheng]. When I check this today, it is handled

[jira] [Commented] (SPARK-16111) Hide SparkOrcNewRecordReader in API docs

[ https://issues.apache.org/jira/browse/SPARK-16111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15350092#comment-15350092 ] Dongjoon Hyun commented on SPARK-16111: --- Hi, [~mengxr]. Could you review this PR? > Hide

[jira] [Commented] (SPARK-16173) Can't join describe() of DataFrame in Scala 2.10

[ https://issues.apache.org/jira/browse/SPARK-16173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15348685#comment-15348685 ] Dongjoon Hyun commented on SPARK-16173: --- Hi, [~davies] and [~bomeng]. If you don't mind, I'll make

[jira] [Commented] (SPARK-16173) Can't join describe() of DataFrame in Scala 2.10

[ https://issues.apache.org/jira/browse/SPARK-16173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15348688#comment-15348688 ] Dongjoon Hyun commented on SPARK-16173: --- Of course, with Scala 2.10. > Can't join describe() of

[jira] [Commented] (SPARK-16211) DataFrame filter is buggy when used with "and"

[ https://issues.apache.org/jira/browse/SPARK-16211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15350026#comment-15350026 ] Dongjoon Hyun commented on SPARK-16211: --- Hi, [~renatbek], [~srowen], [~hvanhovell]. It seems to be

[jira] [Commented] (SPARK-16172) SQL Context's

[ https://issues.apache.org/jira/browse/SPARK-16172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15350039#comment-15350039 ] Dongjoon Hyun commented on SPARK-16172: --- Otherwise, you can ask this for latest Spark versions. (If

[jira] [Commented] (SPARK-16210) DataFrame.drop(colName) fails if another column has a period in its name

[ https://issues.apache.org/jira/browse/SPARK-16210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15350034#comment-15350034 ] Dongjoon Hyun commented on SPARK-16210: --- I also tested this. Unfortunately Spark 1.6.2 (RC) still

[jira] [Commented] (SPARK-16172) SQL Context's

[ https://issues.apache.org/jira/browse/SPARK-16172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15350037#comment-15350037 ] Dongjoon Hyun commented on SPARK-16172: --- Oh, it's an issue about 1.2.X. Interesting. By the way, I

[jira] [Reopened] (SPARK-16208) Add `CollapseEmptyPlan` optimizer

[ https://issues.apache.org/jira/browse/SPARK-16208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-16208: --- I made a new PR. > Add `CollapseEmptyPlan` optimizer > - > >

[jira] [Commented] (SPARK-16208) Add `CollapseEmptyPlan` optimizer

[ https://issues.apache.org/jira/browse/SPARK-16208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15349983#comment-15349983 ] Dongjoon Hyun commented on SPARK-16208: --- New PR is in the process of review. > Add

[jira] [Updated] (SPARK-16186) Support partition batch pruning with `IN` predicate in InMemoryTableScanExec

[ https://issues.apache.org/jira/browse/SPARK-16186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-16186: -- Description: One of the most frequent usage patterns for Spark SQL is using **cached

[jira] [Commented] (SPARK-16183) Large Spark SQL commands cause StackOverflowError in parser when using sqlContext.sql

[ https://issues.apache.org/jira/browse/SPARK-16183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15349078#comment-15349078 ] Dongjoon Hyun commented on SPARK-16183: --- Hi, [~hvanhovell]. Does Spark have SQL Query Parsing Size

[jira] [Updated] (SPARK-16208) Add `CollapseEmptyPlan` optimizer

[ https://issues.apache.org/jira/browse/SPARK-16208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-16208: -- Description: This PR adds a new logical optimizer, `CollapseEmptyPlan`, to collapse a logical

[jira] [Commented] (SPARK-16211) DataFrame filter is buggy when used with "and"

[ https://issues.apache.org/jira/browse/SPARK-16211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15350294#comment-15350294 ] Dongjoon Hyun commented on SPARK-16211: --- Great! :) > DataFrame filter is buggy when used with

[jira] [Created] (SPARK-16208) Add `CollapseEmptyPlan` optimizer

Dongjoon Hyun created SPARK-16208: - Summary: Add `CollapseEmptyPlan` optimizer Key: SPARK-16208 URL: https://issues.apache.org/jira/browse/SPARK-16208 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-16221) Redirect Parquet JUL logger via SLF4J for WRITE operations

Dongjoon Hyun created SPARK-16221: - Summary: Redirect Parquet JUL logger via SLF4J for WRITE operations Key: SPARK-16221 URL: https://issues.apache.org/jira/browse/SPARK-16221 Project: Spark

[jira] [Commented] (SPARK-16289) Implement posexplode table generating function

[ https://issues.apache.org/jira/browse/SPARK-16289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15354797#comment-15354797 ] Dongjoon Hyun commented on SPARK-16289: --- I'll work on this issue. > Implement posexplode table

[jira] [Created] (SPARK-13583) Enforce `UnusedImports` Java checkstyle rule

Dongjoon Hyun created SPARK-13583: - Summary: Enforce `UnusedImports` Java checkstyle rule Key: SPARK-13583 URL: https://issues.apache.org/jira/browse/SPARK-13583 Project: Spark Issue Type:

[jira] [Updated] (SPARK-13583) Support `UnusedImports` Java checkstyle rule

[ https://issues.apache.org/jira/browse/SPARK-13583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-13583: -- Description: After SPARK-6990, `dev/lint-java` keeps Java code healthy and helps PR review by

[jira] [Commented] (SPARK-13583) Support `UnusedImports` Java checkstyle rule

[ https://issues.apache.org/jira/browse/SPARK-13583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15173040#comment-15173040 ] Dongjoon Hyun commented on SPARK-13583: --- I changed the content of this issue since `lint-java` is

[jira] [Commented] (SPARK-11381) Replace example code in mllib-linear-methods.md using include_example

[ https://issues.apache.org/jira/browse/SPARK-11381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158132#comment-15158132 ] Dongjoon Hyun commented on SPARK-11381: --- Hi, @yinxusen . I'm interested this. May I assign it to

[jira] [Comment Edited] (SPARK-11381) Replace example code in mllib-linear-methods.md using include_example

[ https://issues.apache.org/jira/browse/SPARK-11381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158132#comment-15158132 ] Dongjoon Hyun edited comment on SPARK-11381 at 2/23/16 1:55 AM: Hi,

[jira] [Commented] (SPARK-11381) Replace example code in mllib-linear-methods.md using include_example

[ https://issues.apache.org/jira/browse/SPARK-11381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158174#comment-15158174 ] Dongjoon Hyun commented on SPARK-11381: --- Thank you! > Replace example code in

[jira] [Commented] (SPARK-11381) Replace example code in mllib-linear-methods.md using include_example

[ https://issues.apache.org/jira/browse/SPARK-11381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158176#comment-15158176 ] Dongjoon Hyun commented on SPARK-11381: --- Oh, I have not permission here. Sorry, I was confused,

[jira] [Comment Edited] (SPARK-11381) Replace example code in mllib-linear-methods.md using include_example

[ https://issues.apache.org/jira/browse/SPARK-11381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158176#comment-15158176 ] Dongjoon Hyun edited comment on SPARK-11381 at 2/23/16 2:38 AM: Oh, I

[jira] [Commented] (SPARK-11381) Replace example code in mllib-linear-methods.md using include_example

[ https://issues.apache.org/jira/browse/SPARK-11381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166269#comment-15166269 ] Dongjoon Hyun commented on SPARK-11381: --- Thank you for assigning me, [~mengxr]! > Replace example

[jira] [Commented] (SPARK-11381) Replace example code in mllib-linear-methods.md using include_example

[ https://issues.apache.org/jira/browse/SPARK-11381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158309#comment-15158309 ] Dongjoon Hyun commented on SPARK-11381: --- Could anyone fix the content of this issue? It seems that

[jira] [Commented] (SPARK-11381) Replace example code in mllib-linear-methods.md using include_example

[ https://issues.apache.org/jira/browse/SPARK-11381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158350#comment-15158350 ] Dongjoon Hyun commented on SPARK-11381: --- Oh, fast! Thank you. > Replace example code in

[jira] [Updated] (SPARK-13583) Support `UnusedImports` Java checkstyle rule

[ https://issues.apache.org/jira/browse/SPARK-13583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-13583: -- Priority: Minor (was: Trivial) Description: After SPARK-6990, `dev/lint-java` keeps

[jira] [Commented] (SPARK-9289) OrcPartitionDiscoverySuite is slow to run

[ https://issues.apache.org/jira/browse/SPARK-9289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188710#comment-15188710 ] Dongjoon Hyun commented on SPARK-9289: -- Oh, it wasn't fast enough. I see. Thank you any way. >

[jira] [Commented] (SPARK-12653) Re-enable test "SPARK-8489: MissingRequirementError during reflection"

[ https://issues.apache.org/jira/browse/SPARK-12653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188897#comment-15188897 ] Dongjoon Hyun commented on SPARK-12653: --- Hi, [~rxin]. As you guessed, I can re-enable the test by

[jira] [Commented] (SPARK-3854) Scala style: require spaces before `{`

[ https://issues.apache.org/jira/browse/SPARK-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15189886#comment-15189886 ] Dongjoon Hyun commented on SPARK-3854: -- Hi, all. It seems to be a long lasting issue. :) In this

[jira] [Created] (SPARK-13834) Update sbt for 2.x

Dongjoon Hyun created SPARK-13834: - Summary: Update sbt for 2.x Key: SPARK-13834 URL: https://issues.apache.org/jira/browse/SPARK-13834 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-13834) Update sbt and sbt plugins for 2.x.

[ https://issues.apache.org/jira/browse/SPARK-13834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-13834: -- Description: For 2.0.0, we had better make sbt and sbt plugins up-to-date. This PR checks the

  1   2   3   4   5   6   7   8   9   10   >