[jira] [Commented] (SPARK-15801) spark-submit --num-executors switch also works without YARN

2016-06-09 Thread Jonathan Taws (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15322322#comment-15322322 ] Jonathan Taws commented on SPARK-15801: --- I don't think it is a problem, but it migh

[jira] [Issue Comment Deleted] (SPARK-15823) Add @property for 'accuracy' in MulticlassMetrics

2016-06-09 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-15823: - Comment: was deleted (was: {MulticlassMetrics.confusionMatrix} may need {@property} too, but I am

[jira] [Comment Edited] (SPARK-15823) Add @property for 'accuracy' in MulticlassMetrics

2016-06-09 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15322308#comment-15322308 ] zhengruifeng edited comment on SPARK-15823 at 6/9/16 10:20 AM:

[jira] [Commented] (SPARK-15823) Add @property for 'accuracy' in MulticlassMetrics

2016-06-09 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15322309#comment-15322309 ] zhengruifeng commented on SPARK-15823: -- {MulticlassMetrics.confusionMatrix} may need

[jira] [Commented] (SPARK-15823) Add @property for 'accuracy' in MulticlassMetrics

2016-06-09 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15322308#comment-15322308 ] zhengruifeng commented on SPARK-15823: -- {MulticlassMetrics.confusionMatrix} may need

[jira] [Updated] (SPARK-15831) Kryo 2.21 TreeMap serialization bug causes random job failures with RDDs of HBase puts

2016-06-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15831: -- Affects Version/s: 1.5.2 1.6.1 Target Version/s: (was: 1.5.0) > Kryo 2.21

[jira] [Updated] (SPARK-15823) Add @property for 'accuracy' in MulticlassMetrics

2016-06-09 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng updated SPARK-15823: - Summary: Add @property for 'accuracy' in MulticlassMetrics (was: Add @property for 'property' in

[jira] [Resolved] (SPARK-15801) spark-submit --num-executors switch also works without YARN

2016-06-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-15801. --- Resolution: Not A Problem This much seems to be not a problem. > spark-submit --num-executors switch

[jira] [Resolved] (SPARK-15716) Memory usage of driver keeps growing up in Spark Streaming

2016-06-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-15716. --- Resolution: Not A Problem > Memory usage of driver keeps growing up in Spark Streaming >

[jira] [Resolved] (SPARK-15802) SparkSQL connection fail using shell command "bin/beeline -u "jdbc:hive2://*.*.*.*:10000/default""

2016-06-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-15802. --- Resolution: Not A Problem It looks like you show the answer in your question, not sure what you're l

[jira] [Updated] (SPARK-15781) Reduce spark.memory.fraction default to avoid overrunning old gen in JVM default config

2016-06-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15781: -- Summary: Reduce spark.memory.fraction default to avoid overrunning old gen in JVM default config (was:

[jira] [Resolved] (SPARK-15818) Upgrade to Hadoop 2.7.2

2016-06-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-15818. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13556 [https://github.co

[jira] [Updated] (SPARK-15818) Upgrade to Hadoop 2.7.2

2016-06-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15818: -- Assignee: Adam Roberts > Upgrade to Hadoop 2.7.2 > --- > > Key: SPA

[jira] [Updated] (SPARK-15697) [SPARK REPL] unblock some of the useful repl commands.

2016-06-09 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-15697: Description: "implicits", "javap", "power", "type", "kind" commands in repl are blocked. H

[jira] [Updated] (SPARK-15697) [SPARK REPL] unblock some of the useful repl commands.

2016-06-09 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-15697: Description: "implicits", "javap", "power", "type", "kind" commands in repl are blocked. H

[jira] [Updated] (SPARK-15697) [SPARK REPL] unblock some of the useful repl commands.

2016-06-09 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-15697: Description: "implicits", "javap", "power", "type", "kind" commands in repl are blocked. H

[jira] [Assigned] (SPARK-15841) [SPARK REPL] REPLSuite has incorrect env set for a couple of tests.

2016-06-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15841: Assignee: (was: Apache Spark) > [SPARK REPL] REPLSuite has incorrect env set for a cou

[jira] [Commented] (SPARK-15841) [SPARK REPL] REPLSuite has incorrect env set for a couple of tests.

2016-06-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15322199#comment-15322199 ] Apache Spark commented on SPARK-15841: -- User 'ScrapCodes' has created a pull request

[jira] [Assigned] (SPARK-15841) [SPARK REPL] REPLSuite has incorrect env set for a couple of tests.

2016-06-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15841: Assignee: Apache Spark > [SPARK REPL] REPLSuite has incorrect env set for a couple of test

[jira] [Resolved] (SPARK-15836) Spark 2.0/master maven snapshots are broken

2016-06-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-15836. --- Resolution: Duplicate Target Version/s: (was: 2.0.0) > Spark 2.0/master maven snapshots a

[jira] [Updated] (SPARK-15841) [SPARK REPL] REPLSuite has incorrect env set for a couple of tests.

2016-06-09 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-15841: Summary: [SPARK REPL] REPLSuite has incorrect env set for a couple of tests. (was: [SPARK

[jira] [Commented] (SPARK-15837) PySpark ML Word2Vec should support maxSentenceLength

2016-06-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15322195#comment-15322195 ] Sean Owen commented on SPARK-15837: --- Yeah, ideally we would have suggested and done thi

[jira] [Created] (SPARK-15841) [SPARK REPL] REPLSuite has in correct env set for a couple of tests.

2016-06-09 Thread Prashant Sharma (JIRA)
Prashant Sharma created SPARK-15841: --- Summary: [SPARK REPL] REPLSuite has in correct env set for a couple of tests. Key: SPARK-15841 URL: https://issues.apache.org/jira/browse/SPARK-15841 Project: S

[jira] [Updated] (SPARK-15841) [SPARK REPL] REPLSuite has in correct env set for a couple of tests.

2016-06-09 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-15841: Component/s: Spark Shell > [SPARK REPL] REPLSuite has in correct env set for a couple of te

[jira] [Commented] (SPARK-11765) Avoid assign UI port between browser unsafe ports (or just 4045: lockd)

2016-06-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15322180#comment-15322180 ] Sean Owen commented on SPARK-11765: --- That's how it works now. > Avoid assign UI port b

[jira] [Commented] (SPARK-15840) New csv reader does not "determine the input schema"

2016-06-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15322147#comment-15322147 ] Hyukjin Kwon commented on SPARK-15840: -- For custom dateFormat, here there are, http

[jira] [Updated] (SPARK-15840) New csv reader does not "determine the input schema"

2016-06-09 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-15840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ernst Sjöstrand updated SPARK-15840: Description: When testing the new csv reader I found that it would not determine the input

[jira] [Updated] (SPARK-15840) New csv reader does not "determine the input schema"

2016-06-09 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-15840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ernst Sjöstrand updated SPARK-15840: Description: When testing the new csv reader I found that it would not determine the input

[jira] [Commented] (SPARK-15840) New csv reader does not "determine the input schema"

2016-06-09 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-15840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15322143#comment-15322143 ] Ernst Sjöstrand commented on SPARK-15840: - I have only tested this for Python, no

[jira] [Comment Edited] (SPARK-15840) New csv reader does not "determine the input schema"

2016-06-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15322140#comment-15322140 ] Hyukjin Kwon edited comment on SPARK-15840 at 6/9/16 8:24 AM: -

[jira] [Commented] (SPARK-15840) New csv reader does not "determine the input schema"

2016-06-09 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-15840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15322142#comment-15322142 ] Ernst Sjöstrand commented on SPARK-15840: - Also, the documentation implies that a

[jira] [Commented] (SPARK-15840) New csv reader does not "determine the input schema"

2016-06-09 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15322140#comment-15322140 ] Hyukjin Kwon commented on SPARK-15840: -- There is {{inferSchema}} option but it seems

[jira] [Commented] (SPARK-15840) New csv reader does not "determine the input schema"

2016-06-09 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-15840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15322137#comment-15322137 ] Ernst Sjöstrand commented on SPARK-15840: - Perhaps related to SPARK-13667 ? > Ne

[jira] [Commented] (SPARK-15840) New csv reader does not "determine the input schema"

2016-06-09 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-15840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15322127#comment-15322127 ] Ernst Sjöstrand commented on SPARK-15840: - The old databricks csv had an option c

[jira] [Created] (SPARK-15840) New csv reader does not "determine the input schema"

2016-06-09 Thread JIRA
Ernst Sjöstrand created SPARK-15840: --- Summary: New csv reader does not "determine the input schema" Key: SPARK-15840 URL: https://issues.apache.org/jira/browse/SPARK-15840 Project: Spark Is

[jira] [Resolved] (SPARK-12712) test-dependencies.sh script fails when run against empty .m2 cache

2016-06-09 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-12712. Resolution: Fixed Fix Version/s: 1.6.2 2.0.0 Issue resolved by pull reque

[jira] [Commented] (SPARK-15839) Maven doc JAR generation fails when JAVA_7_HOME is set

2016-06-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15322103#comment-15322103 ] Apache Spark commented on SPARK-15839: -- User 'JoshRosen' has created a pull request

[jira] [Created] (SPARK-15839) Maven doc JAR generation fails when JAVA_7_HOME is set

2016-06-09 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-15839: -- Summary: Maven doc JAR generation fails when JAVA_7_HOME is set Key: SPARK-15839 URL: https://issues.apache.org/jira/browse/SPARK-15839 Project: Spark Issue Type

[jira] [Commented] (SPARK-15086) Update Java API once the Scala one is finalized

2016-06-09 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15322082#comment-15322082 ] Weichen Xu commented on SPARK-15086: OK. [~srowen] What do you think about it? > Upd

[jira] [Commented] (SPARK-15086) Update Java API once the Scala one is finalized

2016-06-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15322075#comment-15322075 ] Reynold Xin commented on SPARK-15086: - I was suggesting renaming both, so the two wou

[jira] [Commented] (SPARK-15086) Update Java API once the Scala one is finalized

2016-06-09 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15322074#comment-15322074 ] Weichen Xu commented on SPARK-15086: If do so, only rename the java API in this type

<    1   2   3