[jira] [Commented] (SPARK-4587) Model export/import

[ https://issues.apache.org/jira/browse/SPARK-4587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381544#comment-14381544 ] zhangyouhua commented on SPARK-4587: “Sorry, this file is invalid so it cannot be

[jira] [Created] (SPARK-6549) Spark console logger logs to stderr by default

Pavel Sakun created SPARK-6549: -- Summary: Spark console logger logs to stderr by default Key: SPARK-6549 URL: https://issues.apache.org/jira/browse/SPARK-6549 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-6550) Add PreAnalyzer to keep logical plan consistent across DataFrame

[ https://issues.apache.org/jira/browse/SPARK-6550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381571#comment-14381571 ] Apache Spark commented on SPARK-6550: - User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-6550) Add PreAnalyzer to keep logical plan consistent across DataFrame

[ https://issues.apache.org/jira/browse/SPARK-6550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6550: --- Assignee: Apache Spark Add PreAnalyzer to keep logical plan consistent across DataFrame

[jira] [Assigned] (SPARK-6550) Add PreAnalyzer to keep logical plan consistent across DataFrame

[ https://issues.apache.org/jira/browse/SPARK-6550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6550: --- Assignee: (was: Apache Spark) Add PreAnalyzer to keep logical plan consistent across

[jira] [Assigned] (SPARK-6549) Spark console logger logs to stderr by default

[ https://issues.apache.org/jira/browse/SPARK-6549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6549: --- Assignee: Apache Spark Spark console logger logs to stderr by default

[jira] [Commented] (SPARK-6549) Spark console logger logs to stderr by default

[ https://issues.apache.org/jira/browse/SPARK-6549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381570#comment-14381570 ] Apache Spark commented on SPARK-6549: - User 'pavel-sakun' has created a pull request

[jira] [Commented] (SPARK-6549) Spark console logger logs to stderr by default

[ https://issues.apache.org/jira/browse/SPARK-6549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381568#comment-14381568 ] Pavel Sakun commented on SPARK-6549: Pull request:

[jira] [Assigned] (SPARK-6549) Spark console logger logs to stderr by default

[ https://issues.apache.org/jira/browse/SPARK-6549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6549: --- Assignee: (was: Apache Spark) Spark console logger logs to stderr by default

[jira] [Assigned] (SPARK-6471) Metastore schema should only be a subset of parquet schema to support dropping of columns using replace columns

[ https://issues.apache.org/jira/browse/SPARK-6471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6471: --- Assignee: Apache Spark Metastore schema should only be a subset of parquet schema to

[jira] [Assigned] (SPARK-6471) Metastore schema should only be a subset of parquet schema to support dropping of columns using replace columns

[ https://issues.apache.org/jira/browse/SPARK-6471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6471: --- Assignee: (was: Apache Spark) Metastore schema should only be a subset of parquet

[jira] [Created] (SPARK-6552) expose start-slave.sh to user and update outdated doc

Tao Wang created SPARK-6552: --- Summary: expose start-slave.sh to user and update outdated doc Key: SPARK-6552 URL: https://issues.apache.org/jira/browse/SPARK-6552 Project: Spark Issue Type:

[jira] [Updated] (SPARK-6546) Build failure caused by PR #5029 together with #4289

[ https://issues.apache.org/jira/browse/SPARK-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6546: -- Component/s: (was: Build) SQL Description: PR

[jira] [Assigned] (SPARK-6553) Support for functools.partial as UserDefinedFunction

[ https://issues.apache.org/jira/browse/SPARK-6553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6553: --- Assignee: Apache Spark Support for functools.partial as UserDefinedFunction

[jira] [Updated] (SPARK-6550) Add PreAnalyzer to keep logical plan consistent across DataFrame

[ https://issues.apache.org/jira/browse/SPARK-6550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-6550: --- Description: h2. Problems In some cases, the expressions in a logical plan will be modified

[jira] [Updated] (SPARK-6546) Using the wrong code that will make spark compile failed!!

[ https://issues.apache.org/jira/browse/SPARK-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6546: -- Assignee: DoingDone9 Using the wrong code that will make spark compile failed!!

[jira] [Commented] (SPARK-6480) histogram() bucket function is wrong in some simple edge cases

[ https://issues.apache.org/jira/browse/SPARK-6480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381588#comment-14381588 ] Frank Rosner commented on SPARK-6480: - [~srowen] will do today! histogram() bucket

[jira] [Created] (SPARK-6551) Incorrect aggregate results if op(...) mutates first argument

Jarno Seppanen created SPARK-6551: - Summary: Incorrect aggregate results if op(...) mutates first argument Key: SPARK-6551 URL: https://issues.apache.org/jira/browse/SPARK-6551 Project: Spark

[jira] [Updated] (SPARK-6551) Incorrect aggregate results if seqOp(...) mutates its first argument

[ https://issues.apache.org/jira/browse/SPARK-6551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarno Seppanen updated SPARK-6551: -- Description: Python RDD.aggregate method doesn't match its documentation w.r.t. seqOp mutating

[jira] [Updated] (SPARK-6552) expose start-slave.sh to user and update outdated doc

[ https://issues.apache.org/jira/browse/SPARK-6552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-6552: Component/s: Documentation expose start-slave.sh to user and update outdated doc

[jira] [Created] (SPARK-6550) Add PreAnalyzer to keep logical plan consistent across DataFrame

Liang-Chi Hsieh created SPARK-6550: -- Summary: Add PreAnalyzer to keep logical plan consistent across DataFrame Key: SPARK-6550 URL: https://issues.apache.org/jira/browse/SPARK-6550 Project: Spark

[jira] [Resolved] (SPARK-6546) Using the wrong code that will make spark compile failed!!

[ https://issues.apache.org/jira/browse/SPARK-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-6546. --- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5198

[jira] [Updated] (SPARK-6546) Using the wrong code that will make spark compile failed!!

[ https://issues.apache.org/jira/browse/SPARK-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6546: -- Affects Version/s: 1.4.0 Using the wrong code that will make spark compile failed!!

[jira] [Commented] (SPARK-6552) expose start-slave.sh to user and update outdated doc

[ https://issues.apache.org/jira/browse/SPARK-6552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381604#comment-14381604 ] Apache Spark commented on SPARK-6552: - User 'WangTaoTheTonic' has created a pull

[jira] [Commented] (SPARK-6546) Build failure caused by PR #5029 together with #4289

[ https://issues.apache.org/jira/browse/SPARK-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381606#comment-14381606 ] Cheng Lian commented on SPARK-6546: --- Updated ticket title and description to refect the

[jira] [Assigned] (SPARK-6552) expose start-slave.sh to user and update outdated doc

[ https://issues.apache.org/jira/browse/SPARK-6552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6552: --- Assignee: (was: Apache Spark) expose start-slave.sh to user and update outdated doc

[jira] [Assigned] (SPARK-6552) expose start-slave.sh to user and update outdated doc

[ https://issues.apache.org/jira/browse/SPARK-6552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6552: --- Assignee: Apache Spark expose start-slave.sh to user and update outdated doc

[jira] [Created] (SPARK-6553) Support for functools.partial as UserDefinedFunction

Kalle Jepsen created SPARK-6553: --- Summary: Support for functools.partial as UserDefinedFunction Key: SPARK-6553 URL: https://issues.apache.org/jira/browse/SPARK-6553 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-6553) Support for functools.partial as UserDefinedFunction

[ https://issues.apache.org/jira/browse/SPARK-6553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6553: --- Assignee: (was: Apache Spark) Support for functools.partial as UserDefinedFunction

[jira] [Commented] (SPARK-6553) Support for functools.partial as UserDefinedFunction

[ https://issues.apache.org/jira/browse/SPARK-6553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381616#comment-14381616 ] Apache Spark commented on SPARK-6553: - User 'ksonj' has created a pull request for

[jira] [Commented] (SPARK-6435) spark-shell --jars option does not add all jars to classpath

[ https://issues.apache.org/jira/browse/SPARK-6435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381641#comment-14381641 ] Masayoshi TSUZUKI commented on SPARK-6435: -- I think {{%~2==}} way is better for

[jira] [Commented] (SPARK-2213) Sort Merge Join

[ https://issues.apache.org/jira/browse/SPARK-2213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381650#comment-14381650 ] Apache Spark commented on SPARK-2213: - User 'adrian-wang' has created a pull request

[jira] [Commented] (SPARK-4830) Spark Streaming Java Application : java.lang.ClassNotFoundException

[ https://issues.apache.org/jira/browse/SPARK-4830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381663#comment-14381663 ] sam commented on SPARK-4830: Could also be related to

[jira] [Created] (SPARK-6555) Override equals and hashCode in MetastoreRelation

Cheng Lian created SPARK-6555: - Summary: Override equals and hashCode in MetastoreRelation Key: SPARK-6555 URL: https://issues.apache.org/jira/browse/SPARK-6555 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-6554) Cannot use partition columns in where clause

[ https://issues.apache.org/jira/browse/SPARK-6554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381720#comment-14381720 ] Jon Chase commented on SPARK-6554: -- Here's a test case to reproduce the issue: {code}

[jira] [Assigned] (SPARK-6544) Problem with Avro and Kryo Serialization

[ https://issues.apache.org/jira/browse/SPARK-6544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6544: --- Assignee: Apache Spark Problem with Avro and Kryo Serialization

[jira] [Assigned] (SPARK-6544) Problem with Avro and Kryo Serialization

[ https://issues.apache.org/jira/browse/SPARK-6544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6544: --- Assignee: (was: Apache Spark) Problem with Avro and Kryo Serialization

[jira] [Updated] (SPARK-6554) Cannot use partition columns in where clause

[ https://issues.apache.org/jira/browse/SPARK-6554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6554: -- Target Version/s: 1.3.1, 1.4.0 Cannot use partition columns in where clause

[jira] [Assigned] (SPARK-6554) Cannot use partition columns in where clause

[ https://issues.apache.org/jira/browse/SPARK-6554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian reassigned SPARK-6554: - Assignee: Cheng Lian Cannot use partition columns in where clause

[jira] [Commented] (SPARK-6481) Set In Progress when a PR is opened for an issue

[ https://issues.apache.org/jira/browse/SPARK-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381703#comment-14381703 ] Cheng Lian commented on SPARK-6481: --- Maybe unrelated to this issue, but I saw a lot of

[jira] [Updated] (SPARK-6556) Fix wrong parsing logic of executorTimeoutMs and checkTimeoutIntervalMs in HeartbeatReceiver

[ https://issues.apache.org/jira/browse/SPARK-6556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-6556: Description: The current reading logic of executorTimeoutMs is: {code} private val

[jira] [Created] (SPARK-6556) Fix wrong parsing logic of executorTimeoutMs and checkTimeoutIntervalMs in HeartbeatReceiver

Shixiong Zhu created SPARK-6556: --- Summary: Fix wrong parsing logic of executorTimeoutMs and checkTimeoutIntervalMs in HeartbeatReceiver Key: SPARK-6556 URL: https://issues.apache.org/jira/browse/SPARK-6556

[jira] [Assigned] (SPARK-6556) Fix wrong parsing logic of executorTimeoutMs and checkTimeoutIntervalMs in HeartbeatReceiver

[ https://issues.apache.org/jira/browse/SPARK-6556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6556: --- Assignee: Apache Spark Fix wrong parsing logic of executorTimeoutMs and

[jira] [Assigned] (SPARK-6556) Fix wrong parsing logic of executorTimeoutMs and checkTimeoutIntervalMs in HeartbeatReceiver

[ https://issues.apache.org/jira/browse/SPARK-6556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6556: --- Assignee: (was: Apache Spark) Fix wrong parsing logic of executorTimeoutMs and

[jira] [Commented] (SPARK-6556) Fix wrong parsing logic of executorTimeoutMs and checkTimeoutIntervalMs in HeartbeatReceiver

[ https://issues.apache.org/jira/browse/SPARK-6556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381769#comment-14381769 ] Apache Spark commented on SPARK-6556: - User 'zsxwing' has created a pull request for

[jira] [Created] (SPARK-6554) Cannot use partition columns in where clause

Jon Chase created SPARK-6554: Summary: Cannot use partition columns in where clause Key: SPARK-6554 URL: https://issues.apache.org/jira/browse/SPARK-6554 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-6465) GenericRowWithSchema: KryoException: Class cannot be created (missing no-arg constructor):

[ https://issues.apache.org/jira/browse/SPARK-6465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-6465. --- Resolution: Fixed Fix Version/s: 1.4.0 1.3.1 Issue resolved by pull request

[jira] [Updated] (SPARK-6549) Spark console logger logs to stderr by default

[ https://issues.apache.org/jira/browse/SPARK-6549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pavel Sakun updated SPARK-6549: --- Description: Spark's console logger is configured to log message with INFO level to stderr by

[jira] [Commented] (SPARK-6481) Set In Progress when a PR is opened for an issue

[ https://issues.apache.org/jira/browse/SPARK-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381771#comment-14381771 ] Sean Owen commented on SPARK-6481: -- [~nchammas] Agree, I really like this, though it's

[jira] [Updated] (SPARK-6554) Cannot use partition columns in where clause

[ https://issues.apache.org/jira/browse/SPARK-6554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6554: -- Description: I'm having trouble referencing partition columns in my queries with Parquet. In the

[jira] [Commented] (SPARK-6554) Cannot use partition columns in where clause when Parquet filter push-down is enabled

[ https://issues.apache.org/jira/browse/SPARK-6554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381850#comment-14381850 ] Cheng Lian commented on SPARK-6554: --- Marked this as critical rather than blocker mostly

[jira] [Comment Edited] (SPARK-6506) python support yarn cluster mode requires SPARK_HOME to be set

[ https://issues.apache.org/jira/browse/SPARK-6506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381844#comment-14381844 ] Lianhui Wang edited comment on SPARK-6506 at 3/26/15 1:18 PM: --

[jira] [Commented] (SPARK-6554) Cannot use partition columns in where clause when Parquet filter push-down is enabled

[ https://issues.apache.org/jira/browse/SPARK-6554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381862#comment-14381862 ] Cheng Lian commented on SPARK-6554: --- Parquet filter push-down isn't enabled by default

[jira] [Commented] (SPARK-6506) python support yarn cluster mode requires SPARK_HOME to be set

[ https://issues.apache.org/jira/browse/SPARK-6506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381860#comment-14381860 ] Thomas Graves commented on SPARK-6506: -- If you are running on yarn you just have to

[jira] [Updated] (SPARK-6554) Cannot use partition columns in where clause when Parquet filter push-down is enabled

[ https://issues.apache.org/jira/browse/SPARK-6554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6554: -- Issue Type: Sub-task (was: Bug) Parent: SPARK-5463 Cannot use partition columns in where

[jira] [Updated] (SPARK-5463) Fix Parquet filter push-down

[ https://issues.apache.org/jira/browse/SPARK-5463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5463: -- Affects Version/s: 1.3.0 Fix Parquet filter push-down

[jira] [Resolved] (SPARK-6491) Spark will put the current working dir to the CLASSPATH

[ https://issues.apache.org/jira/browse/SPARK-6491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6491. -- Resolution: Fixed Fix Version/s: 1.3.1 Assignee: Liangliang Gu Resolved by

[jira] [Commented] (SPARK-6435) spark-shell --jars option does not add all jars to classpath

[ https://issues.apache.org/jira/browse/SPARK-6435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381797#comment-14381797 ] Sean Owen commented on SPARK-6435: -- Yes this is a moot point in 1.4 and after, but I'd

[jira] [Commented] (SPARK-6481) Set In Progress when a PR is opened for an issue

[ https://issues.apache.org/jira/browse/SPARK-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381811#comment-14381811 ] Cheng Lian commented on SPARK-6481: --- Aha, so I'm not the only one! Although I just

[jira] [Resolved] (SPARK-6468) Fix the race condition of subDirs in DiskBlockManager

[ https://issues.apache.org/jira/browse/SPARK-6468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6468. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5136

[jira] [Commented] (SPARK-6554) Cannot use partition columns in where clause when Parquet filter push-down is enabled

[ https://issues.apache.org/jira/browse/SPARK-6554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381831#comment-14381831 ] Jon Chase commented on SPARK-6554: -- spark.sql.parquet.filterPushdown was the problem.

[jira] [Commented] (SPARK-6508) error handling issue running python in yarn cluster mode

[ https://issues.apache.org/jira/browse/SPARK-6508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381838#comment-14381838 ] Thomas Graves commented on SPARK-6508: -- [~TomStewart] are you running on yarn? If so

[jira] [Assigned] (SPARK-6538) Add missing nullable Metastore fields when merging a Parquet schema

[ https://issues.apache.org/jira/browse/SPARK-6538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6538: --- Assignee: (was: Apache Spark) Add missing nullable Metastore fields when merging a

[jira] [Updated] (SPARK-6554) Cannot use partition columns in where clause when Parquet filter push-down is enabled

[ https://issues.apache.org/jira/browse/SPARK-6554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6554: -- Summary: Cannot use partition columns in where clause when Parquet filter push-down is enabled (was:

[jira] [Commented] (SPARK-6551) Incorrect aggregate results if seqOp(...) mutates its first argument

[ https://issues.apache.org/jira/browse/SPARK-6551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381807#comment-14381807 ] Sean Owen commented on SPARK-6551: -- FWIW an equivalent example works as expected in

[jira] [Updated] (SPARK-6468) Fix the race condition of subDirs in DiskBlockManager

[ https://issues.apache.org/jira/browse/SPARK-6468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6468: - Assignee: Shixiong Zhu Fix the race condition of subDirs in DiskBlockManager

[jira] [Assigned] (SPARK-6480) histogram() bucket function is wrong in some simple edge cases

[ https://issues.apache.org/jira/browse/SPARK-6480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6480: --- Assignee: Apache Spark (was: Sean Owen) histogram() bucket function is wrong in some

[jira] [Assigned] (SPARK-6480) histogram() bucket function is wrong in some simple edge cases

[ https://issues.apache.org/jira/browse/SPARK-6480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6480: --- Assignee: Sean Owen (was: Apache Spark) histogram() bucket function is wrong in some

[jira] [Commented] (SPARK-6471) Metastore schema should only be a subset of parquet schema to support dropping of columns using replace columns

[ https://issues.apache.org/jira/browse/SPARK-6471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381846#comment-14381846 ] Cheng Lian commented on SPARK-6471: --- Bumped to blocker level since this is actually a

[jira] [Updated] (SPARK-6471) Metastore schema should only be a subset of parquet schema to support dropping of columns using replace columns

[ https://issues.apache.org/jira/browse/SPARK-6471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6471: -- Priority: Blocker (was: Major) Target Version/s: 1.3.1, 1.4.0 Metastore schema should

[jira] [Commented] (SPARK-6554) Cannot use partition columns in where clause

[ https://issues.apache.org/jira/browse/SPARK-6554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381788#comment-14381788 ] Cheng Lian commented on SPARK-6554: --- Hi [~jonchase], did you happen to turn on Parquet

[jira] [Updated] (SPARK-6554) Cannot use partition columns in where clause

[ https://issues.apache.org/jira/browse/SPARK-6554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6554: -- Priority: Critical (was: Major) Cannot use partition columns in where clause

[jira] [Commented] (SPARK-6554) Cannot use partition columns in where clause when Parquet filter push-down is enabled

[ https://issues.apache.org/jira/browse/SPARK-6554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381814#comment-14381814 ] Apache Spark commented on SPARK-6554: - User 'liancheng' has created a pull request for

[jira] [Assigned] (SPARK-6554) Cannot use partition columns in where clause when Parquet filter push-down is enabled

[ https://issues.apache.org/jira/browse/SPARK-6554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6554: --- Assignee: Cheng Lian (was: Apache Spark) Cannot use partition columns in where clause when

[jira] [Assigned] (SPARK-6554) Cannot use partition columns in where clause when Parquet filter push-down is enabled

[ https://issues.apache.org/jira/browse/SPARK-6554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6554: --- Assignee: Apache Spark (was: Cheng Lian) Cannot use partition columns in where clause when

[jira] [Resolved] (SPARK-6515) Use while(true) in OpenHashSet.getPos

[ https://issues.apache.org/jira/browse/SPARK-6515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6515. -- Resolution: Fixed Fix Version/s: 1.4.0 (Looks like this was merged in

[jira] [Resolved] (SPARK-6471) Metastore schema should only be a subset of parquet schema to support dropping of columns using replace columns

[ https://issues.apache.org/jira/browse/SPARK-6471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-6471. --- Resolution: Fixed Fix Version/s: 1.3.1 Issue resolved by pull request 5141

[jira] [Updated] (SPARK-6471) Metastore schema should only be a subset of parquet schema to support dropping of columns using replace columns

[ https://issues.apache.org/jira/browse/SPARK-6471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6471: -- Assignee: Yash Datta Metastore schema should only be a subset of parquet schema to support dropping

[jira] [Commented] (SPARK-6506) python support yarn cluster mode requires SPARK_HOME to be set

[ https://issues.apache.org/jira/browse/SPARK-6506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381844#comment-14381844 ] Lianhui Wang commented on SPARK-6506: - hi [~tgraves] I use 1.3.0 to run. if i donot

[jira] [Comment Edited] (SPARK-6506) python support yarn cluster mode requires SPARK_HOME to be set

[ https://issues.apache.org/jira/browse/SPARK-6506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14381844#comment-14381844 ] Lianhui Wang edited comment on SPARK-6506 at 3/26/15 1:17 PM: --

[jira] [Resolved] (SPARK-6510) Add Graph#minus method to act as Set#difference

[ https://issues.apache.org/jira/browse/SPARK-6510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave resolved SPARK-6510. --- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5175

[jira] [Commented] (SPARK-4550) In sort-based shuffle, store map outputs in serialized form

[ https://issues.apache.org/jira/browse/SPARK-4550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383280#comment-14383280 ] Sandy Ryza commented on SPARK-4550: --- Java serialization appears to write out the full

[jira] [Created] (SPARK-6559) specify port of python gateway server and let it retry if failed

Tao Wang created SPARK-6559: --- Summary: specify port of python gateway server and let it retry if failed Key: SPARK-6559 URL: https://issues.apache.org/jira/browse/SPARK-6559 Project: Spark Issue

[jira] [Created] (SPARK-6560) PairRDDFunctions suppresses exceptions in writeFile

Stephen Haberman created SPARK-6560: --- Summary: PairRDDFunctions suppresses exceptions in writeFile Key: SPARK-6560 URL: https://issues.apache.org/jira/browse/SPARK-6560 Project: Spark

[jira] [Commented] (SPARK-6559) specify port of python gateway server and let it retry if failed

[ https://issues.apache.org/jira/browse/SPARK-6559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383329#comment-14383329 ] Davies Liu commented on SPARK-6559: --- [~WangTaoTheTonic] The port is only open for python

[jira] [Assigned] (SPARK-4233) Simplify the Aggregation Function implementation

[ https://issues.apache.org/jira/browse/SPARK-4233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4233: --- Assignee: (was: Apache Spark) Simplify the Aggregation Function implementation

[jira] [Assigned] (SPARK-4233) Simplify the Aggregation Function implementation

[ https://issues.apache.org/jira/browse/SPARK-4233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4233: --- Assignee: Apache Spark Simplify the Aggregation Function implementation

[jira] [Commented] (SPARK-4550) In sort-based shuffle, store map outputs in serialized form

[ https://issues.apache.org/jira/browse/SPARK-4550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383260#comment-14383260 ] Reynold Xin commented on SPARK-4550: [~sandyryza] can you investigate what's happening

[jira] [Assigned] (SPARK-6559) specify port of python gateway server and let it retry if failed

[ https://issues.apache.org/jira/browse/SPARK-6559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6559: --- Assignee: Apache Spark specify port of python gateway server and let it retry if failed

[jira] [Assigned] (SPARK-6559) specify port of python gateway server and let it retry if failed

[ https://issues.apache.org/jira/browse/SPARK-6559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6559: --- Assignee: (was: Apache Spark) specify port of python gateway server and let it retry if

[jira] [Commented] (SPARK-6559) specify port of python gateway server and let it retry if failed

[ https://issues.apache.org/jira/browse/SPARK-6559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383284#comment-14383284 ] Apache Spark commented on SPARK-6559: - User 'WangTaoTheTonic' has created a pull

[jira] [Assigned] (SPARK-6341) Upgrade breeze from 0.11.1 to 0.11.2 or later

[ https://issues.apache.org/jira/browse/SPARK-6341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6341: --- Assignee: (was: Apache Spark) Upgrade breeze from 0.11.1 to 0.11.2 or later

[jira] [Commented] (SPARK-6341) Upgrade breeze from 0.11.1 to 0.11.2 or later

[ https://issues.apache.org/jira/browse/SPARK-6341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383311#comment-14383311 ] Apache Spark commented on SPARK-6341: - User 'yu-iskw' has created a pull request for

[jira] [Commented] (SPARK-6560) PairRDDFunctions suppresses exceptions in writeFile

[ https://issues.apache.org/jira/browse/SPARK-6560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383313#comment-14383313 ] Apache Spark commented on SPARK-6560: - User 'stephenh' has created a pull request for

[jira] [Assigned] (SPARK-6560) PairRDDFunctions suppresses exceptions in writeFile

[ https://issues.apache.org/jira/browse/SPARK-6560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6560: --- Assignee: (was: Apache Spark) PairRDDFunctions suppresses exceptions in writeFile

[jira] [Assigned] (SPARK-6560) PairRDDFunctions suppresses exceptions in writeFile

[ https://issues.apache.org/jira/browse/SPARK-6560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6560: --- Assignee: Apache Spark PairRDDFunctions suppresses exceptions in writeFile

[jira] [Resolved] (SPARK-6405) Spark Kryo buffer should be forced to be max. 2GB

[ https://issues.apache.org/jira/browse/SPARK-6405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-6405. Resolution: Fixed Assignee: Matthew Cheah Spark Kryo buffer should be forced to be

[jira] [Updated] (SPARK-6510) Add Graph#minus method to act as Set#difference

[ https://issues.apache.org/jira/browse/SPARK-6510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave updated SPARK-6510: -- Assignee: Brennon York Add Graph#minus method to act as Set#difference

[jira] [Commented] (SPARK-6341) Upgrade breeze from 0.11.1 to 0.11.2 or later

[ https://issues.apache.org/jira/browse/SPARK-6341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14383268#comment-14383268 ] Yu Ishikawa commented on SPARK-6341: Thanks to David Hall, we are able to upgrade the

[jira] [Assigned] (SPARK-6341) Upgrade breeze from 0.11.1 to 0.11.2 or later

[ https://issues.apache.org/jira/browse/SPARK-6341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6341: --- Assignee: Apache Spark Upgrade breeze from 0.11.1 to 0.11.2 or later

  1   2   3   >