[jira] [Commented] (SPARK-4049) Storage web UI "fraction cached" shows as > 100%

2015-12-14 Thread Warren Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15057500#comment-15057500 ] Warren Wang commented on SPARK-4049: Actually the fraction cached will not expand when

[jira] [Closed] (SPARK-9687) System.exit() still disrupt applications embedding Spark

2015-12-14 Thread Alberto (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alberto closed SPARK-9687. -- > System.exit() still disrupt applications embedding Spark > ---

[jira] [Created] (SPARK-12333) Support shuffle spill encryption in Spark

2015-12-14 Thread Ferdinand Xu (JIRA)
Ferdinand Xu created SPARK-12333: Summary: Support shuffle spill encryption in Spark Key: SPARK-12333 URL: https://issues.apache.org/jira/browse/SPARK-12333 Project: Spark Issue Type: New Fea

[jira] [Commented] (SPARK-4049) Storage web UI "fraction cached" shows as > 100%

2015-12-14 Thread jeffonia Tung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15057400#comment-15057400 ] jeffonia Tung commented on SPARK-4049: -- I got the same phase, the fraction cached goe

[jira] [Comment Edited] (SPARK-11255) R Test build should run on R 3.1.1

2015-12-14 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15057374#comment-15057374 ] Sun Rui edited comment on SPARK-11255 at 12/15/15 5:31 AM: --- see

[jira] [Commented] (SPARK-11255) R Test build should run on R 3.1.1

2015-12-14 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15057374#comment-15057374 ] Sun Rui commented on SPARK-11255: - seems 'plyr' package has to be rebuilt under R 3.1.1

[jira] [Commented] (SPARK-11255) R Test build should run on R 3.1.1

2015-12-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15057368#comment-15057368 ] Felix Cheung commented on SPARK-11255: -- Is this test error caused by this? https://

[jira] [Commented] (SPARK-12327) lint-r checks fail with commented code

2015-12-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15057364#comment-15057364 ] Felix Cheung commented on SPARK-12327: -- In fact [~yu_ishikawa] did open a PR for a s

[jira] [Updated] (SPARK-8402) Add DP means clustering to MLlib

2015-12-14 Thread Meethu Mathew (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Meethu Mathew updated SPARK-8402: - Summary: Add DP means clustering to MLlib (was: DP means clustering ) > Add DP means clustering t

[jira] [Updated] (SPARK-12330) Mesos coarse executor does not cleanup blockmgr properly on termination if data is stored on disk

2015-12-14 Thread Charles Allen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Allen updated SPARK-12330: -- Description: A simple line count example can be launched as similar to {code} SPARK_HOME=/mnt

[jira] [Resolved] (SPARK-12288) Support UnsafeRow in Coalesce/Except/Intersect

2015-12-14 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12288. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10285 [https://github.

[jira] [Assigned] (SPARK-12332) Typo in ResetSystemProperties.scala's comments

2015-12-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12332: Assignee: Apache Spark > Typo in ResetSystemProperties.scala's comments >

[jira] [Assigned] (SPARK-12332) Typo in ResetSystemProperties.scala's comments

2015-12-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12332: Assignee: (was: Apache Spark) > Typo in ResetSystemProperties.scala's comments > -

[jira] [Updated] (SPARK-12332) Typo in ResetSystemProperties.scala's comments

2015-12-14 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-12332: Component/s: Tests > Typo in ResetSystemProperties.scala's comments > -

[jira] [Created] (SPARK-12332) Typo in ResetSystemProperties.scala's comments

2015-12-14 Thread holdenk (JIRA)
holdenk created SPARK-12332: --- Summary: Typo in ResetSystemProperties.scala's comments Key: SPARK-12332 URL: https://issues.apache.org/jira/browse/SPARK-12332 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-12331) R^2 for regression through the origin

2015-12-14 Thread Imran Younus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Younus updated SPARK-12331: - Description: The value of R^2 (coefficient of determination) obtained from LinearRegressionModel

[jira] [Created] (SPARK-12331) R^2 for regression through the origin

2015-12-14 Thread Imran Younus (JIRA)
Imran Younus created SPARK-12331: Summary: R^2 for regression through the origin Key: SPARK-12331 URL: https://issues.apache.org/jira/browse/SPARK-12331 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-12329) spark-sql prints out SET commands to stdout instead of stderr

2015-12-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12329: Assignee: Apache Spark > spark-sql prints out SET commands to stdout instead of stderr > -

[jira] [Assigned] (SPARK-12329) spark-sql prints out SET commands to stdout instead of stderr

2015-12-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12329: Assignee: (was: Apache Spark) > spark-sql prints out SET commands to stdout instead of

[jira] [Created] (SPARK-12330) Mesos coarse executor does not cleanup blockmgr properly on termination if data is stored on disk

2015-12-14 Thread Charles Allen (JIRA)
Charles Allen created SPARK-12330: - Summary: Mesos coarse executor does not cleanup blockmgr properly on termination if data is stored on disk Key: SPARK-12330 URL: https://issues.apache.org/jira/browse/SPARK-1233

[jira] [Commented] (SPARK-11460) Locality waits should be based on task set creation time, not last launch time

2015-12-14 Thread Kay Ousterhout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15057203#comment-15057203 ] Kay Ousterhout commented on SPARK-11460: For the specific issue mentioned in the

[jira] [Assigned] (SPARK-12329) spark-sql prints out SET commands to stdout instead of stderr

2015-12-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12329: Assignee: (was: Apache Spark) > spark-sql prints out SET commands to stdout instead of

[jira] [Assigned] (SPARK-12329) spark-sql prints out SET commands to stdout instead of stderr

2015-12-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12329: Assignee: Apache Spark > spark-sql prints out SET commands to stdout instead of stderr > -

[jira] [Commented] (SPARK-12307) ParquetFormat options should be exposed through the DataFrameReader/Writer options API

2015-12-14 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15057141#comment-15057141 ] holdenk commented on SPARK-12307: - I hear you, I agree we probably don't want to wholesal

[jira] [Assigned] (SPARK-12329) spark-sql prints out SET commands to stdout instead of stderr

2015-12-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12329: Assignee: (was: Apache Spark) > spark-sql prints out SET commands to stdout instead of

[jira] [Assigned] (SPARK-12329) spark-sql prints out SET commands to stdout instead of stderr

2015-12-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12329: Assignee: Apache Spark > spark-sql prints out SET commands to stdout instead of stderr > -

[jira] [Commented] (SPARK-12219) Spark 1.5.2 code does not build on Scala 2.11.7 with SBT assembly

2015-12-14 Thread Rodrigo Boavida (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15057133#comment-15057133 ] Rodrigo Boavida commented on SPARK-12219: - [~srowen] Just built and ran successfu

[jira] [Assigned] (SPARK-12329) spark-sql prints out SET commands to stdout instead of stderr

2015-12-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12329: Assignee: Apache Spark > spark-sql prints out SET commands to stdout instead of stderr > -

[jira] [Assigned] (SPARK-12329) spark-sql prints out SET commands to stdout instead of stderr

2015-12-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12329: Assignee: (was: Apache Spark) > spark-sql prints out SET commands to stdout instead of

[jira] [Created] (SPARK-12329) spark-sql prints out SET commands to stdout instead of stderr

2015-12-14 Thread Ashwin Shankar (JIRA)
Ashwin Shankar created SPARK-12329: -- Summary: spark-sql prints out SET commands to stdout instead of stderr Key: SPARK-12329 URL: https://issues.apache.org/jira/browse/SPARK-12329 Project: Spark

[jira] [Assigned] (SPARK-11097) Add connection established callback to lower level RPC layer so we don't need to check for new connections in NettyRpcHandler.receive

2015-12-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11097: Assignee: Apache Spark > Add connection established callback to lower level RPC layer so w

[jira] [Resolved] (SPARK-12274) WrapOption should not have type constraint for child

2015-12-14 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12274. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10263 [htt

[jira] [Assigned] (SPARK-11097) Add connection established callback to lower level RPC layer so we don't need to check for new connections in NettyRpcHandler.receive

2015-12-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11097: Assignee: (was: Apache Spark) > Add connection established callback to lower level RPC

[jira] [Assigned] (SPARK-11097) Add connection established callback to lower level RPC layer so we don't need to check for new connections in NettyRpcHandler.receive

2015-12-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11097: Assignee: Apache Spark > Add connection established callback to lower level RPC layer so w

[jira] [Resolved] (SPARK-12328) Add connectionEstablished callback to RpcHandler to monitor the new connections

2015-12-14 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-12328. -- Resolution: Duplicate > Add connectionEstablished callback to RpcHandler to monitor the new >

[jira] [Commented] (SPARK-12328) Add connectionEstablished callback to RpcHandler to monitor the new connections

2015-12-14 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15057080#comment-15057080 ] Shixiong Zhu commented on SPARK-12328: -- Oh. Right. Forgot it. > Add connectionEstab

[jira] [Commented] (SPARK-12328) Add connectionEstablished callback to RpcHandler to monitor the new connections

2015-12-14 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15057072#comment-15057072 ] Marcelo Vanzin commented on SPARK-12328: SPARK-11097? > Add connectionEstablishe

[jira] [Comment Edited] (SPARK-12307) ParquetFormat options should be exposed through the DataFrameReader/Writer options API

2015-12-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15057067#comment-15057067 ] Hyukjin Kwon edited comment on SPARK-12307 at 12/15/15 12:40 AM: --

[jira] [Commented] (SPARK-12307) ParquetFormat options should be exposed through the DataFrameReader/Writer options API

2015-12-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15057067#comment-15057067 ] Hyukjin Kwon commented on SPARK-12307: -- Just my personal though. I felt in the same

[jira] [Created] (SPARK-12328) Add connectionEstablished callback to RpcHandler to monitor the new connections

2015-12-14 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-12328: Summary: Add connectionEstablished callback to RpcHandler to monitor the new connections Key: SPARK-12328 URL: https://issues.apache.org/jira/browse/SPARK-12328 Proje

[jira] [Commented] (SPARK-12231) Failed to generate predicate Error when using dropna

2015-12-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15057049#comment-15057049 ] Apache Spark commented on SPARK-12231: -- User 'kevinyu98' has created a pull request

[jira] [Commented] (SPARK-12327) lint-r checks fail with commented code

2015-12-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15057033#comment-15057033 ] Shivaram Venkataraman commented on SPARK-12327: --- Yeah [~felixcheung] I thin

[jira] [Commented] (SPARK-12327) lint-r checks fail with commented code

2015-12-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15057030#comment-15057030 ] Shivaram Venkataraman commented on SPARK-12327: --- This test is currently dis

[jira] [Assigned] (SPARK-12327) lint-r checks fail with commented code

2015-12-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman reassigned SPARK-12327: - Assignee: (was: Apache Spark) > lint-r checks fail with commented co

[jira] [Closed] (SPARK-12275) No plan for BroadcastHint in some condition

2015-12-14 Thread yucai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai closed SPARK-12275. - I verified the PR has fixed this issue. > No plan for BroadcastHint in some condition >

[jira] [Comment Edited] (SPARK-12327) lint-r checks fail with commented code

2015-12-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15056995#comment-15056995 ] Felix Cheung edited comment on SPARK-12327 at 12/14/15 11:51 PM: --

[jira] [Assigned] (SPARK-12327) lint-r checks fail with commented code

2015-12-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12327: Assignee: Apache Spark > lint-r checks fail with commented code >

[jira] [Commented] (SPARK-12327) lint-r checks fail with commented code

2015-12-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15056995#comment-15056995 ] Felix Cheung commented on SPARK-12327: -- "# void -> NULL" is another example - they a

[jira] [Commented] (SPARK-12327) lint-r checks fail with commented code

2015-12-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15056994#comment-15056994 ] Felix Cheung commented on SPARK-12327: -- yea, I think these are overactive checks in

[jira] [Commented] (SPARK-12327) lint-r checks fail with commented code

2015-12-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15056969#comment-15056969 ] Shivaram Venkataraman commented on SPARK-12327: --- cc [~felixcheung] This is

[jira] [Updated] (SPARK-12232) Create new R API for read.table to avoid conflict

2015-12-14 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-12232: - Summary: Create new R API for read.table to avoid conflict (was: Consider exporting read.table i

[jira] [Created] (SPARK-12327) lint-r checks fail with commented code

2015-12-14 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-12327: - Summary: lint-r checks fail with commented code Key: SPARK-12327 URL: https://issues.apache.org/jira/browse/SPARK-12327 Project: Spark Issu

[jira] [Commented] (SPARK-12317) Support configurate value with unit(e.g. kb/mb/gb) in SQL

2015-12-14 Thread kevin yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15056948#comment-15056948 ] kevin yu commented on SPARK-12317: -- I talked with Bo, I will work on this PR. Thanks. K

[jira] [Updated] (SPARK-12325) Inappropriate error messages in DataFrame StatFunctions

2015-12-14 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Narine Kokhlikyan updated SPARK-12325: -- Affects Version/s: 1.5.2 > Inappropriate error messages in DataFrame StatFunctions > -

[jira] [Commented] (SPARK-12270) JDBC Where clause comparison doesn't work for DB2 char(n)

2015-12-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15056870#comment-15056870 ] Apache Spark commented on SPARK-12270: -- User 'huaxingao' has created a pull request

[jira] [Assigned] (SPARK-12302) Example for servlet filter used by spark.ui.filters

2015-12-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12302: Assignee: (was: Apache Spark) > Example for servlet filter used by spark.ui.filters >

[jira] [Assigned] (SPARK-12302) Example for servlet filter used by spark.ui.filters

2015-12-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12302: Assignee: Apache Spark > Example for servlet filter used by spark.ui.filters > ---

[jira] [Commented] (SPARK-12231) Failed to generate predicate Error when using dropna

2015-12-14 Thread kevin yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15056805#comment-15056805 ] kevin yu commented on SPARK-12231: -- Hello Michael: I try to submit my fix for this PR, s

[jira] [Updated] (SPARK-12325) Inappropriate error messages in DataFrame StatFunctions

2015-12-14 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Narine Kokhlikyan updated SPARK-12325: -- Description: Hi there, I have mentioned this issue earlier in one of my pull requests

[jira] [Updated] (SPARK-12062) Master rebuilding historical SparkUI should be asynchronous

2015-12-14 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-12062: -- Target Version/s: 1.6.1, 2.0.0 > Master rebuilding historical SparkUI should be asynchronous >

[jira] [Reopened] (SPARK-12062) Master rebuilding historical SparkUI should be asynchronous

2015-12-14 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-12062: --- > Master rebuilding historical SparkUI should be asynchronous > -

[jira] [Assigned] (SPARK-12296) Feature parity for pyspark.mllib StandardScalerModel

2015-12-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12296: Assignee: Apache Spark > Feature parity for pyspark.mllib StandardScalerModel > --

[jira] [Assigned] (SPARK-12296) Feature parity for pyspark.mllib StandardScalerModel

2015-12-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12296: Assignee: (was: Apache Spark) > Feature parity for pyspark.mllib StandardScalerModel >

[jira] [Assigned] (SPARK-12271) Improve error message for Dataset.as[] when the schema is incompatible.

2015-12-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12271: Assignee: Apache Spark > Improve error message for Dataset.as[] when the schema is incompa

[jira] [Assigned] (SPARK-12296) Feature parity for pyspark.mllib StandardScalerModel

2015-12-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12296: Assignee: (was: Apache Spark) > Feature parity for pyspark.mllib StandardScalerModel >

[jira] [Assigned] (SPARK-12296) Feature parity for pyspark.mllib StandardScalerModel

2015-12-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12296: Assignee: Apache Spark > Feature parity for pyspark.mllib StandardScalerModel > --

[jira] [Commented] (SPARK-12296) Feature parity for pyspark.mllib StandardScalerModel

2015-12-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15056723#comment-15056723 ] Apache Spark commented on SPARK-12296: -- User 'holdenk' has created a pull request fo

[jira] [Resolved] (SPARK-12275) No plan for BroadcastHint in some condition

2015-12-14 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-12275. --- Resolution: Fixed Fix Version/s: 1.5.3 Target Version/s: 1.5.3, 1.6.1, 2.0.0 (was: 1

[jira] [Commented] (SPARK-12326) Move GBT implementation from spark.mllib to spark.ml

2015-12-14 Thread Seth Hendrickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15056715#comment-15056715 ] Seth Hendrickson commented on SPARK-12326: -- [~josephkb] Could you review the pla

[jira] [Created] (SPARK-12326) Move GBT implementation from spark.mllib to spark.ml

2015-12-14 Thread Seth Hendrickson (JIRA)
Seth Hendrickson created SPARK-12326: Summary: Move GBT implementation from spark.mllib to spark.ml Key: SPARK-12326 URL: https://issues.apache.org/jira/browse/SPARK-12326 Project: Spark

[jira] [Assigned] (SPARK-12324) The documentation sidebar does not collapse properly

2015-12-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12324: Assignee: Apache Spark > The documentation sidebar does not collapse properly > --

[jira] [Commented] (SPARK-12324) The documentation sidebar does not collapse properly

2015-12-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15056703#comment-15056703 ] Apache Spark commented on SPARK-12324: -- User 'thunterdb' has created a pull request

[jira] [Updated] (SPARK-12325) Inappropriate error messages in DataFrame StatFunctions

2015-12-14 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Narine Kokhlikyan updated SPARK-12325: -- Description: Hi there, I have mentioned this issue earlier in one of my pull requests

[jira] [Created] (SPARK-12325) Inappropriate error messages in DataFrame StatFunctions

2015-12-14 Thread Narine Kokhlikyan (JIRA)
Narine Kokhlikyan created SPARK-12325: - Summary: Inappropriate error messages in DataFrame StatFunctions Key: SPARK-12325 URL: https://issues.apache.org/jira/browse/SPARK-12325 Project: Spark

[jira] [Updated] (SPARK-12324) The documentation sidebar does not collapse properly

2015-12-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12324: -- Priority: Minor (was: Major) Component/s: (was: MLlib) > The documentation sidebar does not

[jira] [Commented] (SPARK-12324) The documentation sidebar does not collapse properly

2015-12-14 Thread Timothy Hunter (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15056677#comment-15056677 ] Timothy Hunter commented on SPARK-12324: I am creating a PR with a fix. cc [~jos

[jira] [Commented] (SPARK-4816) Maven profile netlib-lgpl does not work

2015-12-14 Thread RJ Nowling (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15056675#comment-15056675 ] RJ Nowling commented on SPARK-4816: --- Agreed. Thanks! > Maven profile netlib-lgpl does

[jira] [Updated] (SPARK-12324) The documentation sidebar does not collapse properly

2015-12-14 Thread Timothy Hunter (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timothy Hunter updated SPARK-12324: --- Attachment: Screen Shot 2015-12-14 at 12.29.57 PM.png > The documentation sidebar does not co

[jira] [Created] (SPARK-12324) The documentation sidebar does not collapse properly

2015-12-14 Thread Timothy Hunter (JIRA)
Timothy Hunter created SPARK-12324: -- Summary: The documentation sidebar does not collapse properly Key: SPARK-12324 URL: https://issues.apache.org/jira/browse/SPARK-12324 Project: Spark Issu

[jira] [Resolved] (SPARK-4816) Maven profile netlib-lgpl does not work

2015-12-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4816. -- Resolution: Fixed Assignee: Sean Owen Fix Version/s: 1.4.2 I see, so it's re-fixed for o

[jira] [Commented] (SPARK-4816) Maven profile netlib-lgpl does not work

2015-12-14 Thread RJ Nowling (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15056630#comment-15056630 ] RJ Nowling commented on SPARK-4816: --- Tried with Maven 3.3.9. I see no issues with the n

[jira] [Commented] (SPARK-12296) Feature parity for pyspark.mllib StandardScalerModel

2015-12-14 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15056576#comment-15056576 ] holdenk commented on SPARK-12296: - I can take this one :) > Feature parity for pyspark.m

[jira] [Assigned] (SPARK-12271) Improve error message for Dataset.as[] when the schema is incompatible.

2015-12-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12271: Assignee: Apache Spark > Improve error message for Dataset.as[] when the schema is incompa

[jira] [Assigned] (SPARK-12271) Improve error message for Dataset.as[] when the schema is incompatible.

2015-12-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12271: Assignee: (was: Apache Spark) > Improve error message for Dataset.as[] when the schema

[jira] [Resolved] (SPARK-11255) R Test build should run on R 3.1.1

2015-12-14 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp resolved SPARK-11255. - Resolution: Fixed this is done > R Test build should run on R 3.1.1 > --

[jira] [Closed] (SPARK-11255) R Test build should run on R 3.1.1

2015-12-14 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp closed SPARK-11255. --- > R Test build should run on R 3.1.1 > -- > > Key: SPARK-

[jira] [Commented] (SPARK-12317) Support configurate value with unit(e.g. kb/mb/gb) in SQL

2015-12-14 Thread Bo Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15056471#comment-15056471 ] Bo Meng commented on SPARK-12317: - Good point. We can follow JVM convention for memory co

[jira] [Commented] (SPARK-11255) R Test build should run on R 3.1.1

2015-12-14 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15056461#comment-15056461 ] shane knapp commented on SPARK-11255: - this is happening now. i forgot about it last

[jira] [Resolved] (SPARK-12282) Document spark.jars

2015-12-14 Thread Justin Bailey (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Justin Bailey resolved SPARK-12282. --- Resolution: Not A Problem > Document spark.jars > --- > > Key

[jira] [Commented] (SPARK-12317) Support configurate value with unit(e.g. kb/mb/gb) in SQL

2015-12-14 Thread Bo Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15056446#comment-15056446 ] Bo Meng commented on SPARK-12317: - If we wanna go that route, my suggestion is to support

[jira] [Commented] (SPARK-12317) Support configurate value with unit(e.g. kb/mb/gb) in SQL

2015-12-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15056448#comment-15056448 ] Sean Owen commented on SPARK-12317: --- I like the idea though am so used to the JVM's ver

[jira] [Closed] (SPARK-12282) Document spark.jars

2015-12-14 Thread Justin Bailey (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Justin Bailey closed SPARK-12282. - > Document spark.jars > --- > > Key: SPARK-12282 > UR

[jira] [Commented] (SPARK-12304) Make Spark Streaming web UI display more friendly Receiver graphs

2015-12-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15056422#comment-15056422 ] Apache Spark commented on SPARK-12304: -- User 'proflin' has created a pull request fo

[jira] [Commented] (SPARK-4816) Maven profile netlib-lgpl does not work

2015-12-14 Thread RJ Nowling (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15056414#comment-15056414 ] RJ Nowling commented on SPARK-4816: --- Happy to try Maven 3.3.x and report back. Would ce

[jira] [Commented] (SPARK-5506) java.lang.ClassCastException using lambda expressions in combination of spark and Servlet

2015-12-14 Thread Pavan Achanta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15056413#comment-15056413 ] Pavan Achanta commented on SPARK-5506: -- I get the same exception while running a job

[jira] [Commented] (SPARK-4816) Maven profile netlib-lgpl does not work

2015-12-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15056409#comment-15056409 ] Sean Owen commented on SPARK-4816: -- I'm on Maven 3.3.x. I wonder if that could be a diffe

[jira] [Resolved] (SPARK-12016) word2vec load model can't use findSynonyms to get words

2015-12-14 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12016. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10100 [https://github.

[jira] [Commented] (SPARK-4816) Maven profile netlib-lgpl does not work

2015-12-14 Thread RJ Nowling (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15056375#comment-15056375 ] RJ Nowling commented on SPARK-4816: --- Also, what version of Maven are you running? > Mav

[jira] [Commented] (SPARK-4816) Maven profile netlib-lgpl does not work

2015-12-14 Thread RJ Nowling (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15056368#comment-15056368 ] RJ Nowling commented on SPARK-4816: --- I want to push for two things (a) some sort of docu

[jira] [Assigned] (SPARK-12323) Don't assign default value for non-nullable columns of a Dataset

2015-12-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12323: Assignee: Apache Spark (was: Cheng Lian) > Don't assign default value for non-nullable co

  1   2   >