[jira] [Created] (SPARK-16003) SerializationDebugger run into infinite loop

Davies Liu created SPARK-16003: -- Summary: SerializationDebugger run into infinite loop Key: SPARK-16003 URL: https://issues.apache.org/jira/browse/SPARK-16003 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-15966) Fix markdown for Spark Monitoring

[ https://issues.apache.org/jira/browse/SPARK-15966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15966: Assignee: Apache Spark > Fix markdown for Spark Monitoring >

[jira] [Assigned] (SPARK-15966) Fix markdown for Spark Monitoring

[ https://issues.apache.org/jira/browse/SPARK-15966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15966: Assignee: (was: Apache Spark) > Fix markdown for Spark Monitoring >

[jira] [Commented] (SPARK-15966) Fix markdown for Spark Monitoring

[ https://issues.apache.org/jira/browse/SPARK-15966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334820#comment-15334820 ] Apache Spark commented on SPARK-15966: -- User 'dhruve' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16002) Sleep when no new data arrives to avoid 100% CPU usage

[ https://issues.apache.org/jira/browse/SPARK-16002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16002: Assignee: Apache Spark (was: Shixiong Zhu) > Sleep when no new data arrives to avoid

[jira] [Assigned] (SPARK-16002) Sleep when no new data arrives to avoid 100% CPU usage

[ https://issues.apache.org/jira/browse/SPARK-16002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16002: Assignee: Shixiong Zhu (was: Apache Spark) > Sleep when no new data arrives to avoid

[jira] [Commented] (SPARK-16002) Sleep when no new data arrives to avoid 100% CPU usage

[ https://issues.apache.org/jira/browse/SPARK-16002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334802#comment-15334802 ] Apache Spark commented on SPARK-16002: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Updated] (SPARK-15966) Fix markdown for Spark Monitoring

[ https://issues.apache.org/jira/browse/SPARK-15966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dhruve Ashar updated SPARK-15966: - Description: The markdown for Spark monitoring needs to be fixed.

[jira] [Created] (SPARK-16002) Sleep when no new data arrives to avoid 100% CPU usage

Shixiong Zhu created SPARK-16002: Summary: Sleep when no new data arrives to avoid 100% CPU usage Key: SPARK-16002 URL: https://issues.apache.org/jira/browse/SPARK-16002 Project: Spark Issue

[jira] [Commented] (SPARK-16000) Make model loading backward compatible with saved models using old vector columns

[ https://issues.apache.org/jira/browse/SPARK-16000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334763#comment-15334763 ] Yanbo Liang commented on SPARK-16000: - We should only add for models which support save/load in Spark

[jira] [Commented] (SPARK-15501) ML 2.0 QA: Scala APIs audit for recommendation

[ https://issues.apache.org/jira/browse/SPARK-15501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334754#comment-15334754 ] Joseph K. Bradley commented on SPARK-15501: --- [~mlnick] Is this audit done, or are there checks

[jira] [Commented] (SPARK-15786) joinWith bytecode generation calling ByteBuffer.wrap with InternalRow

[ https://issues.apache.org/jira/browse/SPARK-15786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334743#comment-15334743 ] Sean Zhong commented on SPARK-15786: [~yhuai] Sure, we definitely can improve it. > joinWith

[jira] [Resolved] (SPARK-15749) Make the error message more meaningful

[ https://issues.apache.org/jira/browse/SPARK-15749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15749. --- Resolution: Fixed Assignee: Huaxin Gao Fix Version/s: 2.0.0 Target

[jira] [Commented] (SPARK-15643) ML 2.0 QA: migration guide update

[ https://issues.apache.org/jira/browse/SPARK-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334735#comment-15334735 ] Yanbo Liang commented on SPARK-15643: - Sure > ML 2.0 QA: migration guide update >

[jira] [Resolved] (SPARK-15868) Executors table in Executors tab should sort Executor IDs in numerical order (not alphabetical order)

[ https://issues.apache.org/jira/browse/SPARK-15868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15868. --- Resolution: Fixed Assignee: Alex Bozarth Fix Version/s: 2.0.0 Target

[jira] [Updated] (SPARK-15947) Make pipeline components backward compatible with old vector columns in Scala/Java

[ https://issues.apache.org/jira/browse/SPARK-15947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-15947: -- Summary: Make pipeline components backward compatible with old vector columns in Scala/Java

[jira] [Closed] (SPARK-15948) Make pipeline components backward compatible with old vector columns in Python

[ https://issues.apache.org/jira/browse/SPARK-15948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng closed SPARK-15948. - Resolution: Won't Fix > Make pipeline components backward compatible with old vector columns in

[jira] [Resolved] (SPARK-15947) Make pipeline components backward compatible with old vector columns in Scala/Java

[ https://issues.apache.org/jira/browse/SPARK-15947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-15947. --- Resolution: Won't Fix > Make pipeline components backward compatible with old vector columns

[jira] [Commented] (SPARK-15948) Make pipeline components backward compatible with old vector columns in Python

[ https://issues.apache.org/jira/browse/SPARK-15948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334732#comment-15334732 ] Xiangrui Meng commented on SPARK-15948: --- Marked this as "Won't Do". See SPARK-15947 for reasons. >

[jira] [Updated] (SPARK-15643) ML 2.0 QA: migration guide update

[ https://issues.apache.org/jira/browse/SPARK-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-15643: -- Assignee: Yanbo Liang > ML 2.0 QA: migration guide update > -

[jira] [Commented] (SPARK-15643) ML 2.0 QA: migration guide update

[ https://issues.apache.org/jira/browse/SPARK-15643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334729#comment-15334729 ] Xiangrui Meng commented on SPARK-15643: --- [~yanboliang] Please include a paragraph to help users

[jira] [Comment Edited] (SPARK-15947) Make pipeline components backward compatible with old vector columns

[ https://issues.apache.org/jira/browse/SPARK-15947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334725#comment-15334725 ] Xiangrui Meng edited comment on SPARK-15947 at 6/16/16 9:30 PM: Had an

[jira] [Commented] (SPARK-15947) Make pipeline components backward compatible with old vector columns

[ https://issues.apache.org/jira/browse/SPARK-15947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334725#comment-15334725 ] Xiangrui Meng commented on SPARK-15947: --- Had an offline discussion with [~josephkb]. There would be

[jira] [Updated] (SPARK-15343) NoClassDefFoundError when initializing Spark with YARN

[ https://issues.apache.org/jira/browse/SPARK-15343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-15343: Attachment: (was: jersey-client-2.22.2.jar) > NoClassDefFoundError when initializing Spark

[jira] [Created] (SPARK-16001) request that spark history server write a log entry whenever it (1) tries cleaning old event logs and (2) has found and deleted old event logs

Thanh created SPARK-16001: - Summary: request that spark history server write a log entry whenever it (1) tries cleaning old event logs and (2) has found and deleted old event logs Key: SPARK-16001 URL:

[jira] [Commented] (SPARK-15767) Decision Tree Regression wrapper in SparkR

[ https://issues.apache.org/jira/browse/SPARK-15767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334721#comment-15334721 ] Joseph K. Bradley commented on SPARK-15767: --- [~vectorijk] Notes from sync: Can you please write

[jira] [Updated] (SPARK-15343) NoClassDefFoundError when initializing Spark with YARN

[ https://issues.apache.org/jira/browse/SPARK-15343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-15343: Attachment: jersey-client-2.22.2.jar > NoClassDefFoundError when initializing Spark with YARN >

[jira] [Commented] (SPARK-15343) NoClassDefFoundError when initializing Spark with YARN

[ https://issues.apache.org/jira/browse/SPARK-15343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334719#comment-15334719 ] Saisai Shao commented on SPARK-15343: - The class ClientConfig is still existed but the package name

[jira] [Resolved] (SPARK-15998) Verification of SQLConf HIVE_METASTORE_PARTITION_PRUNING

[ https://issues.apache.org/jira/browse/SPARK-15998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15998. --- Resolution: Fixed Fix Version/s: 2.0.0 > Verification of SQLConf

[jira] [Updated] (SPARK-15998) Verification of SQLConf HIVE_METASTORE_PARTITION_PRUNING

[ https://issues.apache.org/jira/browse/SPARK-15998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15998: -- Assignee: Xiao Li > Verification of SQLConf HIVE_METASTORE_PARTITION_PRUNING >

[jira] [Commented] (SPARK-15343) NoClassDefFoundError when initializing Spark with YARN

[ https://issues.apache.org/jira/browse/SPARK-15343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334712#comment-15334712 ] Marcelo Vanzin commented on SPARK-15343: Fair point. But I think the right thing then is to just

[jira] [Resolved] (SPARK-15975) Improper Popen.wait() return code handling in dev/run-tests

[ https://issues.apache.org/jira/browse/SPARK-15975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15975. --- Resolution: Fixed Fix Version/s: 2.0.0 1.6.2 1.5.3 >

[jira] [Resolved] (SPARK-15978) Some improvement of "Show Tables"

[ https://issues.apache.org/jira/browse/SPARK-15978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15978. --- Resolution: Fixed Assignee: Bo Meng (was: Apache Spark) Fix Version/s:

[jira] [Comment Edited] (SPARK-15343) NoClassDefFoundError when initializing Spark with YARN

[ https://issues.apache.org/jira/browse/SPARK-15343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334683#comment-15334683 ] Saisai Shao edited comment on SPARK-15343 at 6/16/16 9:06 PM: -- [~vanzin]

[jira] [Commented] (SPARK-15343) NoClassDefFoundError when initializing Spark with YARN

[ https://issues.apache.org/jira/browse/SPARK-15343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334683#comment-15334683 ] Saisai Shao commented on SPARK-15343: - [~vanzin] [~srowen], I don't think it is a vendor specific

[jira] [Resolved] (SPARK-15796) Reduce spark.memory.fraction default to avoid overrunning old gen in JVM default config

[ https://issues.apache.org/jira/browse/SPARK-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-15796. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13618

[jira] [Assigned] (SPARK-15796) Reduce spark.memory.fraction default to avoid overrunning old gen in JVM default config

[ https://issues.apache.org/jira/browse/SPARK-15796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-15796: - Assignee: Sean Owen > Reduce spark.memory.fraction default to avoid overrunning old gen in JVM

[jira] [Updated] (SPARK-15947) Make pipeline components backward compatible with old vector columns

[ https://issues.apache.org/jira/browse/SPARK-15947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-15947: -- Description: After SPARK-15945, we should make ALL pipeline components accept old vector

[jira] [Updated] (SPARK-16000) Make model loading backward compatible with saved models using old vector columns

[ https://issues.apache.org/jira/browse/SPARK-16000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16000: -- Description: To help users migrate from Spark 1.6. to 2.0, we should make model loading

[jira] [Resolved] (SPARK-15922) BlockMatrix to IndexedRowMatrix throws an error

[ https://issues.apache.org/jira/browse/SPARK-15922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-15922. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13643

[jira] [Updated] (SPARK-15922) BlockMatrix to IndexedRowMatrix throws an error

[ https://issues.apache.org/jira/browse/SPARK-15922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15922: -- Assignee: Dongjoon Hyun > BlockMatrix to IndexedRowMatrix throws an error >

[jira] [Updated] (SPARK-16000) Make model loading backward compatible with saved models using old vector columns

[ https://issues.apache.org/jira/browse/SPARK-16000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16000: -- Summary: Make model loading backward compatible with saved models using old vector columns

[jira] [Updated] (SPARK-15947) Make pipeline components backward compatible with old vector columns

[ https://issues.apache.org/jira/browse/SPARK-15947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-15947: -- Description: After SPARK-15945, we should make ALL pipeline components accept old vector

[jira] [Updated] (SPARK-15947) Make pipeline components backward compatible with old vector columns

[ https://issues.apache.org/jira/browse/SPARK-15947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-15947: -- Summary: Make pipeline components backward compatible with old vector columns (was: Make

[jira] [Created] (SPARK-16000) Make model loading backward compatible with saved models using old vector columns

Xiangrui Meng created SPARK-16000: - Summary: Make model loading backward compatible with saved models using old vector columns Key: SPARK-16000 URL: https://issues.apache.org/jira/browse/SPARK-16000

[jira] [Updated] (SPARK-16000) Make model loading backward compatible with saved models using old vector columns in Scala/Java

[ https://issues.apache.org/jira/browse/SPARK-16000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16000: -- Summary: Make model loading backward compatible with saved models using old vector columns in

[jira] [Resolved] (SPARK-15731) orc writer directory permissions

[ https://issues.apache.org/jira/browse/SPARK-15731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-15731. --- Resolution: Cannot Reproduce > orc writer directory permissions > >

[jira] [Commented] (SPARK-14048) Aggregation operations on structs fail when the structs have fields with special characters

[ https://issues.apache.org/jira/browse/SPARK-14048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334657#comment-15334657 ] Sean Zhong commented on SPARK-14048: [~simeons] I can now reproduce this on Databricks community

[jira] [Resolved] (SPARK-15977) TRUNCATE TABLE does not work with Datasource tables outside of Hive

[ https://issues.apache.org/jira/browse/SPARK-15977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-15977. --- Resolution: Resolved > TRUNCATE TABLE does not work with Datasource tables outside

[jira] [Commented] (SPARK-14048) Aggregation operations on structs fail when the structs have fields with special characters

[ https://issues.apache.org/jira/browse/SPARK-14048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334644#comment-15334644 ] Sean Zhong commented on SPARK-14048: [~simeons] Can you share a complete notebook which we can run

[jira] [Commented] (SPARK-15069) GSoC 2016: Exposing more R and Python APIs for MLlib

[ https://issues.apache.org/jira/browse/SPARK-15069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334622#comment-15334622 ] Joseph K. Bradley commented on SPARK-15069: --- h4. 6/16/2016 - Week 4 To-do items * Continuation

[jira] [Resolved] (SPARK-15981) Fix bug in python DataStreamReader

[ https://issues.apache.org/jira/browse/SPARK-15981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-15981. -- Resolution: Fixed Fix Version/s: 2.0.0 > Fix bug in python DataStreamReader >

[jira] [Resolved] (SPARK-15999) Wrong/Missing information for Spark UI/REST port

[ https://issues.apache.org/jira/browse/SPARK-15999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-15999. --- Resolution: Not A Problem You're referring to an old version -- normally we try to report JIRAs vs

[jira] [Created] (SPARK-15999) Wrong/Missing information for Spark UI/REST port

Faisal created SPARK-15999: -- Summary: Wrong/Missing information for Spark UI/REST port Key: SPARK-15999 URL: https://issues.apache.org/jira/browse/SPARK-15999 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-12114) ColumnPruning rule fails in case of "Project <- Filter <- Join"

[ https://issues.apache.org/jira/browse/SPARK-12114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12114: -- Assignee: Min Qiu > ColumnPruning rule fails in case of "Project <- Filter <- Join" >

[jira] [Updated] (SPARK-9689) Cache doesn't refresh for HadoopFsRelation based table

[ https://issues.apache.org/jira/browse/SPARK-9689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9689: - Assignee: Cheng Hao > Cache doesn't refresh for HadoopFsRelation based table >

[jira] [Resolved] (SPARK-11882) Allow for running Spark applications against a custom coarse grained scheduler

[ https://issues.apache.org/jira/browse/SPARK-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11882. --- Resolution: Duplicate Fix Version/s: (was: 2.0.0) > Allow for running Spark applications

[jira] [Reopened] (SPARK-11882) Allow for running Spark applications against a custom coarse grained scheduler

[ https://issues.apache.org/jira/browse/SPARK-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-11882: --- Just resolving as duplicate then > Allow for running Spark applications against a custom coarse grained

[jira] [Reopened] (SPARK-12248) Make Spark Coarse Mesos Scheduler obey limits on memory/cpu ratios

[ https://issues.apache.org/jira/browse/SPARK-12248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-12248: --- > Make Spark Coarse Mesos Scheduler obey limits on memory/cpu ratios >

[jira] [Updated] (SPARK-15996) Fix R examples by removing deprecated functions

[ https://issues.apache.org/jira/browse/SPARK-15996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15996: -- Assignee: Dongjoon Hyun > Fix R examples by removing deprecated functions >

[jira] [Resolved] (SPARK-12248) Make Spark Coarse Mesos Scheduler obey limits on memory/cpu ratios

[ https://issues.apache.org/jira/browse/SPARK-12248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12248. --- Resolution: Not A Problem > Make Spark Coarse Mesos Scheduler obey limits on memory/cpu ratios >

[jira] [Updated] (SPARK-15934) Return binary mode in ThriftServer

[ https://issues.apache.org/jira/browse/SPARK-15934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15934: -- Assignee: Egor Pakhomov > Return binary mode in ThriftServer > -- > >

[jira] [Resolved] (SPARK-10757) Java friendly constructor for distributed matrices

[ https://issues.apache.org/jira/browse/SPARK-10757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10757. --- Resolution: Won't Fix > Java friendly constructor for distributed matrices >

[jira] [Commented] (SPARK-15467) Getting stack overflow when attempting to query a wide Dataset (>200 fields)

[ https://issues.apache.org/jira/browse/SPARK-15467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334541#comment-15334541 ] Herman van Hovell commented on SPARK-15467: --- [~kiszk] Shouldn't this be opened against the new

[jira] [Resolved] (SPARK-15996) Fix R examples by removing deprecated functions

[ https://issues.apache.org/jira/browse/SPARK-15996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-15996. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Commented] (SPARK-15811) Python UDFs do not work in Spark 2.0-preview built with scala 2.10

[ https://issues.apache.org/jira/browse/SPARK-15811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334474#comment-15334474 ] Apache Spark commented on SPARK-15811: -- User 'davies' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15811) Python UDFs do not work in Spark 2.0-preview built with scala 2.10

[ https://issues.apache.org/jira/browse/SPARK-15811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15811: Assignee: Davies Liu (was: Apache Spark) > Python UDFs do not work in Spark 2.0-preview

[jira] [Assigned] (SPARK-15811) Python UDFs do not work in Spark 2.0-preview built with scala 2.10

[ https://issues.apache.org/jira/browse/SPARK-15811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15811: Assignee: Apache Spark (was: Davies Liu) > Python UDFs do not work in Spark 2.0-preview

[jira] [Comment Edited] (SPARK-14048) Aggregation operations on structs fail when the structs have fields with special characters

[ https://issues.apache.org/jira/browse/SPARK-14048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334456#comment-15334456 ] Simeon Simeonov edited comment on SPARK-14048 at 6/16/16 7:02 PM: --

[jira] [Commented] (SPARK-14048) Aggregation operations on structs fail when the structs have fields with special characters

[ https://issues.apache.org/jira/browse/SPARK-14048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334456#comment-15334456 ] Simeon Simeonov commented on SPARK-14048: - [~clockfly] The code executes with no error on the

[jira] [Commented] (SPARK-15467) Getting stack overflow when attempting to query a wide Dataset (>200 fields)

[ https://issues.apache.org/jira/browse/SPARK-15467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334443#comment-15334443 ] Kazuaki Ishizaki commented on SPARK-15467: -- We are waiting for author's review at

[jira] [Updated] (SPARK-15811) Python UDFs do not work in Spark 2.0-preview built with scala 2.10

[ https://issues.apache.org/jira/browse/SPARK-15811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-15811: --- Description: I've built spark-2.0-preview (8f5a04b) with scala-2.10 using the following {code}

[jira] [Assigned] (SPARK-15998) Verification of SQLConf HIVE_METASTORE_PARTITION_PRUNING

[ https://issues.apache.org/jira/browse/SPARK-15998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15998: Assignee: Apache Spark > Verification of SQLConf HIVE_METASTORE_PARTITION_PRUNING >

[jira] [Commented] (SPARK-15998) Verification of SQLConf HIVE_METASTORE_PARTITION_PRUNING

[ https://issues.apache.org/jira/browse/SPARK-15998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334418#comment-15334418 ] Apache Spark commented on SPARK-15998: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15998) Verification of SQLConf HIVE_METASTORE_PARTITION_PRUNING

[ https://issues.apache.org/jira/browse/SPARK-15998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15998: Assignee: (was: Apache Spark) > Verification of SQLConf

[jira] [Created] (SPARK-15998) Verification of SQLConf HIVE_METASTORE_PARTITION_PRUNING

Xiao Li created SPARK-15998: --- Summary: Verification of SQLConf HIVE_METASTORE_PARTITION_PRUNING Key: SPARK-15998 URL: https://issues.apache.org/jira/browse/SPARK-15998 Project: Spark Issue Type:

[jira] [Created] (SPARK-15997) Audit ml.feature Update documentation for ml feature transformers

Gayathri Murali created SPARK-15997: --- Summary: Audit ml.feature Update documentation for ml feature transformers Key: SPARK-15997 URL: https://issues.apache.org/jira/browse/SPARK-15997 Project:

[jira] [Updated] (SPARK-15996) Fix R examples by removing deprecated functions

[ https://issues.apache.org/jira/browse/SPARK-15996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-15996: -- Description: Currently, R examples(dataframe.R and data-manipulation.R) fail like the

[jira] [Updated] (SPARK-15981) Fix bug in python DataStreamReader

[ https://issues.apache.org/jira/browse/SPARK-15981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-15981: -- Description: Bug in Python DataStreamReader API made it unusable. Because a single path was

[jira] [Closed] (SPARK-12248) Make Spark Coarse Mesos Scheduler obey limits on memory/cpu ratios

[ https://issues.apache.org/jira/browse/SPARK-12248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Allen closed SPARK-12248. - Resolution: Fixed Fix Version/s: 2.0.0 > Make Spark Coarse Mesos Scheduler obey limits on

[jira] [Commented] (SPARK-12248) Make Spark Coarse Mesos Scheduler obey limits on memory/cpu ratios

[ https://issues.apache.org/jira/browse/SPARK-12248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334376#comment-15334376 ] Charles Allen commented on SPARK-12248: --- The limit of one task per slave seems to have been

[jira] [Updated] (SPARK-15992) Code cleanup mesos coarse backend offer evaluation workflow

[ https://issues.apache.org/jira/browse/SPARK-15992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Allen updated SPARK-15992: -- Attachment: (was: 0001-Refactor-MesosCoarseGrainedSchedulerBackend-offer-co.patch) > Code

[jira] [Updated] (SPARK-15994) Allow enabling Mesos fetch cache in coarse executor backend

[ https://issues.apache.org/jira/browse/SPARK-15994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Allen updated SPARK-15994: -- Attachment: (was: 0001-Add-ability-to-enable-mesos-fetch-cache.patch) > Allow enabling

[jira] [Assigned] (SPARK-15992) Code cleanup mesos coarse backend offer evaluation workflow

[ https://issues.apache.org/jira/browse/SPARK-15992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15992: Assignee: Apache Spark > Code cleanup mesos coarse backend offer evaluation workflow >

[jira] [Assigned] (SPARK-15992) Code cleanup mesos coarse backend offer evaluation workflow

[ https://issues.apache.org/jira/browse/SPARK-15992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15992: Assignee: (was: Apache Spark) > Code cleanup mesos coarse backend offer evaluation

[jira] [Commented] (SPARK-15992) Code cleanup mesos coarse backend offer evaluation workflow

[ https://issues.apache.org/jira/browse/SPARK-15992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334364#comment-15334364 ] Apache Spark commented on SPARK-15992: -- User 'drcrallen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15996) Fix R dataframe example by removing deprecated functions

[ https://issues.apache.org/jira/browse/SPARK-15996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15996: Assignee: (was: Apache Spark) > Fix R dataframe example by removing deprecated

[jira] [Assigned] (SPARK-15996) Fix R dataframe example by removing deprecated functions

[ https://issues.apache.org/jira/browse/SPARK-15996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15996: Assignee: Apache Spark > Fix R dataframe example by removing deprecated functions >

[jira] [Commented] (SPARK-15996) Fix R dataframe example by removing deprecated functions

[ https://issues.apache.org/jira/browse/SPARK-15996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334362#comment-15334362 ] Apache Spark commented on SPARK-15996: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-15994) Allow enabling Mesos fetch cache in coarse executor backend

[ https://issues.apache.org/jira/browse/SPARK-15994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15994: Assignee: Apache Spark > Allow enabling Mesos fetch cache in coarse executor backend >

[jira] [Commented] (SPARK-15994) Allow enabling Mesos fetch cache in coarse executor backend

[ https://issues.apache.org/jira/browse/SPARK-15994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334356#comment-15334356 ] Apache Spark commented on SPARK-15994: -- User 'drcrallen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15994) Allow enabling Mesos fetch cache in coarse executor backend

[ https://issues.apache.org/jira/browse/SPARK-15994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15994: Assignee: (was: Apache Spark) > Allow enabling Mesos fetch cache in coarse executor

[jira] [Updated] (SPARK-15608) Add document for ML IsotonicRegression

[ https://issues.apache.org/jira/browse/SPARK-15608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-15608: -- Issue Type: Documentation (was: Sub-task) Parent: (was: SPARK-15099) >

[jira] [Updated] (SPARK-15099) Audit: ml.regression

[ https://issues.apache.org/jira/browse/SPARK-15099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-15099: -- Assignee: Yanbo Liang > Audit: ml.regression > > >

[jira] [Resolved] (SPARK-15099) Audit: ml.regression

[ https://issues.apache.org/jira/browse/SPARK-15099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-15099. --- Resolution: Done Marking as done since this JIRA is just for the audit. Thanks

[jira] [Created] (SPARK-15996) Fix R dataframe example by removing deprecated functions

Dongjoon Hyun created SPARK-15996: - Summary: Fix R dataframe example by removing deprecated functions Key: SPARK-15996 URL: https://issues.apache.org/jira/browse/SPARK-15996 Project: Spark

[jira] [Commented] (SPARK-15100) Audit: ml.feature

[ https://issues.apache.org/jira/browse/SPARK-15100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334346#comment-15334346 ] Joseph K. Bradley commented on SPARK-15100: --- [~yuhaoyan] Is it correct that you finished the

[jira] [Commented] (SPARK-15786) joinWith bytecode generation calling ByteBuffer.wrap with InternalRow

[ https://issues.apache.org/jira/browse/SPARK-15786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334331#comment-15334331 ] Yin Huai commented on SPARK-15786: -- Is there any chance that we can let users know what is wrong

[jira] [Commented] (SPARK-15990) Support rolling log aggregation for Spark running on YARN

[ https://issues.apache.org/jira/browse/SPARK-15990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334320#comment-15334320 ] Apache Spark commented on SPARK-15990: -- User 'jerryshao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15990) Support rolling log aggregation for Spark running on YARN

[ https://issues.apache.org/jira/browse/SPARK-15990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15990: Assignee: (was: Apache Spark) > Support rolling log aggregation for Spark running on

<    1   2   3   4   >