[jira] [Reopened] (SPARK-6145) ORDER BY fails to resolve nested fields

[ https://issues.apache.org/jira/browse/SPARK-6145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust reopened SPARK-6145: - Assignee: Michael Armbrust > ORDER BY fails to resolve nested fields > -

[jira] [Created] (SPARK-6315) SparkSQL 1.3.0 (RC3) fails to read parquet file generated by 1.1.1

Michael Armbrust created SPARK-6315: --- Summary: SparkSQL 1.3.0 (RC3) fails to read parquet file generated by 1.1.1 Key: SPARK-6315 URL: https://issues.apache.org/jira/browse/SPARK-6315 Project: Spark

[jira] [Commented] (SPARK-6279) Miss expressions flag "s" at logging string

[ https://issues.apache.org/jira/browse/SPARK-6279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14360013#comment-14360013 ] zzc commented on SPARK-6279: [~srowen], I am new to Spark and JIRA, Sorry for this > Miss exp

[jira] [Commented] (SPARK-6275) Miss toDF() function in docs/sql-programming-guide.md

[ https://issues.apache.org/jira/browse/SPARK-6275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14360012#comment-14360012 ] zzc commented on SPARK-6275: [~srowen], I am new to Spark and JIRA, Sorry for this > Miss toD

[jira] [Created] (SPARK-6314) Failed to load application log data from FileStatus

zzc created SPARK-6314: -- Summary: Failed to load application log data from FileStatus Key: SPARK-6314 URL: https://issues.apache.org/jira/browse/SPARK-6314 Project: Spark Issue Type: Bug Compo

[jira] [Updated] (SPARK-6313) Fetch File Lock file creation doesnt work when Spark working dir is on a NFS mount

[ https://issues.apache.org/jira/browse/SPARK-6313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6313: --- Priority: Critical (was: Major) > Fetch File Lock file creation doesnt work when Spark workin

[jira] [Comment Edited] (SPARK-6313) Fetch File Lock file creation doesnt work when Spark working dir is on a NFS mount

[ https://issues.apache.org/jira/browse/SPARK-6313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14359972#comment-14359972 ] Nathan McCarthy edited comment on SPARK-6313 at 3/13/15 5:38 AM: ---

[jira] [Updated] (SPARK-6313) Fetch File Lock file creation doesnt work when Spark working dir is on a NFS mount

[ https://issues.apache.org/jira/browse/SPARK-6313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan McCarthy updated SPARK-6313: --- Affects Version/s: 1.2.0 1.2.1 > Fetch File Lock file creation doesnt w

[jira] [Commented] (SPARK-6313) Fetch File Lock file creation doesnt work when Spark working dir is on a NFS mount

[ https://issues.apache.org/jira/browse/SPARK-6313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14359972#comment-14359972 ] Nathan McCarthy commented on SPARK-6313: Since the `val lockFileName = s"${url.has

[jira] [Commented] (SPARK-6313) Fetch File Lock file creation doesnt work when Spark working dir is on a NFS mount

[ https://issues.apache.org/jira/browse/SPARK-6313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14359964#comment-14359964 ] Nathan McCarthy commented on SPARK-6313: Suggestion along the lines of; https://g

[jira] [Comment Edited] (SPARK-6222) [STREAMING] All data may not be recovered from WAL when driver is killed

[ https://issues.apache.org/jira/browse/SPARK-6222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14359950#comment-14359950 ] Tathagata Das edited comment on SPARK-6222 at 3/13/15 5:09 AM: -

[jira] [Commented] (SPARK-6222) [STREAMING] All data may not be recovered from WAL when driver is killed

[ https://issues.apache.org/jira/browse/SPARK-6222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14359950#comment-14359950 ] Tathagata Das commented on SPARK-6222: -- I proposed another way to fix this here https

[jira] [Commented] (SPARK-6222) [STREAMING] All data may not be recovered from WAL when driver is killed

[ https://issues.apache.org/jira/browse/SPARK-6222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14359948#comment-14359948 ] Apache Spark commented on SPARK-6222: - User 'tdas' has created a pull request for this

[jira] [Commented] (SPARK-5376) [Mesos] MesosExecutor should have correct resources

[ https://issues.apache.org/jira/browse/SPARK-5376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14359943#comment-14359943 ] Lukasz Jastrzebski commented on SPARK-5376: --- One comment, however if you run mul

[jira] [Created] (SPARK-6313) Fetch File Lock file creation doesnt work when Spark working dir is on a NFS mount

Nathan McCarthy created SPARK-6313: -- Summary: Fetch File Lock file creation doesnt work when Spark working dir is on a NFS mount Key: SPARK-6313 URL: https://issues.apache.org/jira/browse/SPARK-6313

[jira] [Resolved] (SPARK-6311) ChiSqTest should check for too few counts

[ https://issues.apache.org/jira/browse/SPARK-6311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-6311. Resolution: Duplicate > ChiSqTest should check for too few counts >

[jira] [Resolved] (SPARK-6310) ChiSqTest should check for too few counts

[ https://issues.apache.org/jira/browse/SPARK-6310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-6310. Resolution: Duplicate > ChiSqTest should check for too few counts >

[jira] [Commented] (SPARK-3066) Support recommendAll in matrix factorization model

[ https://issues.apache.org/jira/browse/SPARK-3066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14359892#comment-14359892 ] Debasish Das commented on SPARK-3066: - We use the non-level 3 BLAS code in our interna

[jira] [Commented] (SPARK-6299) ClassNotFoundException when running groupByKey with class defined in REPL.

[ https://issues.apache.org/jira/browse/SPARK-6299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14359789#comment-14359789 ] Kevin (Sangwoo) Kim commented on SPARK-6299: Hi Sean, Surely it should work,

[jira] [Created] (SPARK-6312) ChiSqTest should check for too few counts

Joseph K. Bradley created SPARK-6312: Summary: ChiSqTest should check for too few counts Key: SPARK-6312 URL: https://issues.apache.org/jira/browse/SPARK-6312 Project: Spark Issue Type: I

[jira] [Created] (SPARK-6311) ChiSqTest should check for too few counts

Joseph K. Bradley created SPARK-6311: Summary: ChiSqTest should check for too few counts Key: SPARK-6311 URL: https://issues.apache.org/jira/browse/SPARK-6311 Project: Spark Issue Type: I

[jira] [Created] (SPARK-6310) ChiSqTest should check for too few counts

Joseph K. Bradley created SPARK-6310: Summary: ChiSqTest should check for too few counts Key: SPARK-6310 URL: https://issues.apache.org/jira/browse/SPARK-6310 Project: Spark Issue Type: I

[jira] [Created] (SPARK-6308) VectorUDT is displayed as `vecto` in dtypes

Xiangrui Meng created SPARK-6308: Summary: VectorUDT is displayed as `vecto` in dtypes Key: SPARK-6308 URL: https://issues.apache.org/jira/browse/SPARK-6308 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-6309) Add MatrixUDT to support dense/sparse matrices in DataFrames

Xiangrui Meng created SPARK-6309: Summary: Add MatrixUDT to support dense/sparse matrices in DataFrames Key: SPARK-6309 URL: https://issues.apache.org/jira/browse/SPARK-6309 Project: Spark I

[jira] [Commented] (SPARK-6210) Generated column name should not include id of column in it.

[ https://issues.apache.org/jira/browse/SPARK-6210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14359705#comment-14359705 ] Apache Spark commented on SPARK-6210: - User 'davies' has created a pull request for th

[jira] [Assigned] (SPARK-6210) Generated column name should not include id of column in it.

[ https://issues.apache.org/jira/browse/SPARK-6210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-6210: - Assignee: Davies Liu (was: Michael Armbrust) > Generated column name should not include id of co

[jira] [Commented] (SPARK-2426) Quadratic Minimization for MLlib ALS

[ https://issues.apache.org/jira/browse/SPARK-2426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14359695#comment-14359695 ] Apache Spark commented on SPARK-2426: - User 'debasish83' has created a pull request fo

[jira] [Commented] (SPARK-5189) Reorganize EC2 scripts so that nodes can be provisioned independent of Spark master

[ https://issues.apache.org/jira/browse/SPARK-5189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14359665#comment-14359665 ] Nicholas Chammas commented on SPARK-5189: - For the record, this is the script I us

[jira] [Updated] (SPARK-5189) Reorganize EC2 scripts so that nodes can be provisioned independent of Spark master

[ https://issues.apache.org/jira/browse/SPARK-5189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5189: Description: As of 1.2.0, we launch Spark clusters on EC2 by setting up the master first, t

[jira] [Resolved] (SPARK-4588) Add API for feature attributes

[ https://issues.apache.org/jira/browse/SPARK-4588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-4588. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 4925 [https://githu

[jira] [Commented] (SPARK-5389) spark-shell.cmd does not run from DOS Windows 7

[ https://issues.apache.org/jira/browse/SPARK-5389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14359614#comment-14359614 ] Yana Kadiyska commented on SPARK-5389: -- C:\Users\ykadiysk\Downloads\spark-1.2.0-bin-c

[jira] [Resolved] (SPARK-6294) PySpark task may hang while call take() on in Java/Scala

[ https://issues.apache.org/jira/browse/SPARK-6294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-6294. -- Resolution: Fixed Fix Version/s: (was: 1.3.1) (was: 1.4.0)

[jira] [Resolved] (SPARK-6268) KMeans parameter getter methods

[ https://issues.apache.org/jira/browse/SPARK-6268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-6268. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 4974 [https://githu

[jira] [Commented] (SPARK-6190) create LargeByteBuffer abstraction for eliminating 2GB limit on blocks

[ https://issues.apache.org/jira/browse/SPARK-6190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14359524#comment-14359524 ] Reynold Xin commented on SPARK-6190: If I can guarantee at the block manager level, al

[jira] [Resolved] (SPARK-5622) Add connector/handler hive configuration settings to hive-thrift-server

[ https://issues.apache.org/jira/browse/SPARK-5622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5622. -- Resolution: Won't Fix This sounded more clearly like a WontFix from the PR. > Add connector/handler hiv

[jira] [Created] (SPARK-6307) Executers fetches the same rdd-block 100's or 1000's of times

Tobias Bertelsen created SPARK-6307: --- Summary: Executers fetches the same rdd-block 100's or 1000's of times Key: SPARK-6307 URL: https://issues.apache.org/jira/browse/SPARK-6307 Project: Spark

[jira] [Updated] (SPARK-5740) Change comment default value from empty string to "null" in DescribeCommand

[ https://issues.apache.org/jira/browse/SPARK-5740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5740: - Priority: Minor (was: Major) Target Version/s: (was: 1.4.0) Fix Version/s: (was:

[jira] [Commented] (SPARK-4927) Spark does not clean up properly during long jobs.

[ https://issues.apache.org/jira/browse/SPARK-4927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14359437#comment-14359437 ] Sean Owen commented on SPARK-4927: -- OK, behavior looks a little different on YARN. I find

[jira] [Commented] (SPARK-6282) Strange Python import error when using random() in a lambda function

[ https://issues.apache.org/jira/browse/SPARK-6282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14359404#comment-14359404 ] Nicholas Chammas commented on SPARK-6282: - Shouldn't be related to boto. "_winreg"

[jira] [Commented] (SPARK-1673) GLMNET implementation in Spark

[ https://issues.apache.org/jira/browse/SPARK-1673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14359366#comment-14359366 ] mike bowles commented on SPARK-1673: Here's a table of scaling results for our impleme

[jira] [Commented] (SPARK-6282) Strange Python import error when using random() in a lambda function

[ https://issues.apache.org/jira/browse/SPARK-6282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14359362#comment-14359362 ] Sean Owen commented on SPARK-6282: -- [~nchammas] or [~shivaram] might have a clue if it di

[jira] [Commented] (SPARK-6282) Strange Python import error when using random() in a lambda function

[ https://issues.apache.org/jira/browse/SPARK-6282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14359336#comment-14359336 ] Joseph K. Bradley commented on SPARK-6282: -- It looks like "winreg" is referenced

[jira] [Commented] (SPARK-4927) Spark does not clean up properly during long jobs.

[ https://issues.apache.org/jira/browse/SPARK-4927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14359294#comment-14359294 ] Ilya Ganelin commented on SPARK-4927: - Are you running over yarn? My theory is that th

[jira] [Commented] (SPARK-3424) KMeans Plus Plus is too slow

[ https://issues.apache.org/jira/browse/SPARK-3424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14359241#comment-14359241 ] Xiangrui Meng commented on SPARK-3424: -- Ah, sorry! I typed your email manually in the

[jira] [Updated] (SPARK-4001) Add FP-growth algorithm to Spark MLlib

[ https://issues.apache.org/jira/browse/SPARK-4001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4001: - Summary: Add FP-growth algorithm to Spark MLlib (was: Add Apriori algorithm to Spark MLlib) > Ad

[jira] [Commented] (SPARK-4927) Spark does not clean up properly during long jobs.

[ https://issues.apache.org/jira/browse/SPARK-4927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14359200#comment-14359200 ] Sean Owen commented on SPARK-4927: -- Yes that's what I'm running in spark-shell (plus impo

[jira] [Commented] (SPARK-5654) Integrate SparkR into Apache Spark

[ https://issues.apache.org/jira/browse/SPARK-5654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14359166#comment-14359166 ] Patrick Wendell commented on SPARK-5654: I see the decision here as somewhat ortho

[jira] [Comment Edited] (SPARK-4927) Spark does not clean up properly during long jobs.

[ https://issues.apache.org/jira/browse/SPARK-4927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14358958#comment-14358958 ] Ilya Ganelin edited comment on SPARK-4927 at 3/12/15 6:50 PM: --

[jira] [Commented] (SPARK-4012) Uncaught OOM in ContextCleaner

[ https://issues.apache.org/jira/browse/SPARK-4012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14359062#comment-14359062 ] Apache Spark commented on SPARK-4012: - User 'CodingCat' has created a pull request for

[jira] [Commented] (SPARK-1564) Add JavaScript into Javadoc to turn ::Experimental:: and such into badges

[ https://issues.apache.org/jira/browse/SPARK-1564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14359027#comment-14359027 ] Sean Owen commented on SPARK-1564: -- Yeah that's what I did, just made it not tied to the

[jira] [Commented] (SPARK-1564) Add JavaScript into Javadoc to turn ::Experimental:: and such into badges

[ https://issues.apache.org/jira/browse/SPARK-1564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14359017#comment-14359017 ] Matei Zaharia commented on SPARK-1564: -- This is still a valid issue AFAIK, isn't it?

[jira] [Commented] (SPARK-6294) PySpark task may hang while call take() on in Java/Scala

[ https://issues.apache.org/jira/browse/SPARK-6294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14359016#comment-14359016 ] Apache Spark commented on SPARK-6294: - User 'davies' has created a pull request for th

[jira] [Commented] (SPARK-5310) Update SQL programming guide for 1.3

[ https://issues.apache.org/jira/browse/SPARK-5310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14358981#comment-14358981 ] Apache Spark commented on SPARK-5310: - User 'liancheng' has created a pull request for

[jira] [Commented] (SPARK-6286) Handle TASK_ERROR in TaskState

[ https://issues.apache.org/jira/browse/SPARK-6286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14358964#comment-14358964 ] Apache Spark commented on SPARK-6286: - User 'dragos' has created a pull request for th

[jira] [Commented] (SPARK-4927) Spark does not clean up properly during long jobs.

[ https://issues.apache.org/jira/browse/SPARK-4927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14358958#comment-14358958 ] Ilya Ganelin commented on SPARK-4927: - Hi Sean - I have a code snippet that reproduced

[jira] [Commented] (SPARK-4927) Spark does not clean up properly during long jobs.

[ https://issues.apache.org/jira/browse/SPARK-4927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14358933#comment-14358933 ] Sean Owen commented on SPARK-4927: -- I'm interested in this one. When I run it though it h

[jira] [Commented] (SPARK-6286) Handle TASK_ERROR in TaskState

[ https://issues.apache.org/jira/browse/SPARK-6286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14358905#comment-14358905 ] Iulian Dragos commented on SPARK-6286: -- Sure, I'll issue a PR for handling {{TASK_ERR

[jira] [Commented] (SPARK-1546) Add AdaBoost algorithm to Spark MLlib

[ https://issues.apache.org/jira/browse/SPARK-1546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14358881#comment-14358881 ] Manish Amde commented on SPARK-1546: I haven't worked on it since we haven't heard a n

[jira] [Commented] (SPARK-6300) sc.addFile(path) does not support the relative path.

[ https://issues.apache.org/jira/browse/SPARK-6300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14358877#comment-14358877 ] Sean Owen commented on SPARK-6300: -- (Sandy notes it's a regression so yeah it's more impo

[jira] [Updated] (SPARK-6299) ClassNotFoundException when running groupByKey with class defined in REPL.

[ https://issues.apache.org/jira/browse/SPARK-6299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6299: - Component/s: Spark Shell > ClassNotFoundException when running groupByKey with class defined in REPL. > --

[jira] [Updated] (SPARK-6300) sc.addFile(path) does not support the relative path.

[ https://issues.apache.org/jira/browse/SPARK-6300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated SPARK-6300: -- Priority: Critical (was: Minor) Target Version/s: 1.3.1 > sc.addFile(path) does not support

[jira] [Updated] (SPARK-6273) Got error when one table's alias name is the same with other table's column name

[ https://issues.apache.org/jira/browse/SPARK-6273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6273: - Component/s: SQL Description: while one table's alias name is the same with other table's column name

[jira] [Commented] (SPARK-1548) Add Partial Random Forest algorithm to MLlib

[ https://issues.apache.org/jira/browse/SPARK-1548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14358871#comment-14358871 ] Manish Amde commented on SPARK-1548: We should also leave this ticket unassigned for s

[jira] [Updated] (SPARK-1548) Add Partial Random Forest algorithm to MLlib

[ https://issues.apache.org/jira/browse/SPARK-1548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1548: - Assignee: (was: Frank Dai) > Add Partial Random Forest algorithm to MLlib > --

[jira] [Commented] (SPARK-6306) Readme points to dead link

[ https://issues.apache.org/jira/browse/SPARK-6306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14358850#comment-14358850 ] Theodore Vasiloudis commented on SPARK-6306: I'll keep that in mind in the fut

[jira] [Updated] (SPARK-6300) sc.addFile(path) does not support the relative path.

[ https://issues.apache.org/jira/browse/SPARK-6300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6300: - Priority: Minor (was: Critical) Target Version/s: (was: 1.3.1) > sc.addFile(path) does not

[jira] [Commented] (SPARK-6299) ClassNotFoundException when running groupByKey with class defined in REPL.

[ https://issues.apache.org/jira/browse/SPARK-6299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14358816#comment-14358816 ] Sean Owen commented on SPARK-6299: -- Hm, is this supposed to work? the class is not define

[jira] [Commented] (SPARK-6301) Unable to load external jars while submitting Spark Job

[ https://issues.apache.org/jira/browse/SPARK-6301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14358815#comment-14358815 ] raju patel commented on SPARK-6301: --- I am trying to call Java functions which is basical

[jira] [Updated] (SPARK-6275) Miss toDF() function in docs/sql-programming-guide.md

[ https://issues.apache.org/jira/browse/SPARK-6275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6275: - Priority: Trivial (was: Minor) Assignee: zzc This is also too minor to bother with a JIRA. > Miss to

[jira] [Commented] (SPARK-6286) Handle TASK_ERROR in TaskState

[ https://issues.apache.org/jira/browse/SPARK-6286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14358799#comment-14358799 ] Sean Owen commented on SPARK-6286: -- [~dragos] I think it would be reasonable to handle th

[jira] [Updated] (SPARK-6301) Unable to load external jars while submitting Spark Job

[ https://issues.apache.org/jira/browse/SPARK-6301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6301: - Priority: Major (was: Blocker) Until it's clear what is being reported, this should not be marked "Blocke

[jira] [Resolved] (SPARK-6275) Miss toDF() function in docs/sql-programming-guide.md

[ https://issues.apache.org/jira/browse/SPARK-6275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6275. -- Resolution: Fixed Fix Version/s: 1.4.0 > Miss toDF() function in docs/sql-programming-guide.md >

[jira] [Commented] (SPARK-6306) Readme points to dead link

[ https://issues.apache.org/jira/browse/SPARK-6306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14358784#comment-14358784 ] Sean Owen commented on SPARK-6306: -- For a trivial change, a JIRA is just overhead. You do

[jira] [Resolved] (SPARK-6306) Readme points to dead link

[ https://issues.apache.org/jira/browse/SPARK-6306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6306. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 4999 [https://github.com/ap

[jira] [Commented] (SPARK-6306) Readme points to dead link

[ https://issues.apache.org/jira/browse/SPARK-6306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14358687#comment-14358687 ] Apache Spark commented on SPARK-6306: - User 'thvasilo' has created a pull request for

[jira] [Created] (SPARK-6306) Readme points to dead link

Theodore Vasiloudis created SPARK-6306: -- Summary: Readme points to dead link Key: SPARK-6306 URL: https://issues.apache.org/jira/browse/SPARK-6306 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-6305) Add support for log4j 2.x to Spark

[ https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14358625#comment-14358625 ] Apache Spark commented on SPARK-6305: - User 'liorchaga' has created a pull request for

[jira] [Created] (SPARK-6305) Add support for log4j 2.x to Spark

Tal Sliwowicz created SPARK-6305: Summary: Add support for log4j 2.x to Spark Key: SPARK-6305 URL: https://issues.apache.org/jira/browse/SPARK-6305 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-5692) Model import/export for Word2Vec

[ https://issues.apache.org/jira/browse/SPARK-5692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14358583#comment-14358583 ] Manoj Kumar commented on SPARK-5692: I'm not sure about Eclipse, but I work just on su

[jira] [Commented] (SPARK-5692) Model import/export for Word2Vec

[ https://issues.apache.org/jira/browse/SPARK-5692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14358573#comment-14358573 ] ANUPAM MEDIRATTA commented on SPARK-5692: - I tried working on it. I am new to spar

[jira] [Commented] (SPARK-6227) PCA and SVD for PySpark

[ https://issues.apache.org/jira/browse/SPARK-6227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14358529#comment-14358529 ] Meethu Mathew commented on SPARK-6227: -- [~mengxr] Please give your inputs on the sam

[jira] [Commented] (SPARK-6256) Python MLlib API missing items: Regression

[ https://issues.apache.org/jira/browse/SPARK-6256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14358521#comment-14358521 ] Apache Spark commented on SPARK-6256: - User 'yanboliang' has created a pull request fo

[jira] [Updated] (SPARK-6301) Unable to load external jars while submitting Spark Job

[ https://issues.apache.org/jira/browse/SPARK-6301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] raju patel updated SPARK-6301: -- Description: We are using Jnius to call Java functions from Python. But when we are trying to submit th

[jira] [Updated] (SPARK-6304) Checkpointing doesn't retain driver port

[ https://issues.apache.org/jira/browse/SPARK-6304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marius Soutier updated SPARK-6304: -- Description: In a check-pointed Streaming application running on a fixed driver port, the setti

[jira] [Created] (SPARK-6304) Checkpointing doesn't retain driver port

Marius Soutier created SPARK-6304: - Summary: Checkpointing doesn't retain driver port Key: SPARK-6304 URL: https://issues.apache.org/jira/browse/SPARK-6304 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-6282) Strange Python import error when using random() in a lambda function

[ https://issues.apache.org/jira/browse/SPARK-6282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14358504#comment-14358504 ] Pavel Laskov commented on SPARK-6282: - Hi Sven and Joseph, Thanks for a quick reply t

[jira] [Commented] (SPARK-6190) create LargeByteBuffer abstraction for eliminating 2GB limit on blocks

[ https://issues.apache.org/jira/browse/SPARK-6190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14357609#comment-14357609 ] Imran Rashid commented on SPARK-6190: - Hi [~rxin], I've been adding scatterered notes

[jira] [Commented] (SPARK-6189) Pandas to DataFrame conversion should check field names for periods

[ https://issues.apache.org/jira/browse/SPARK-6189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14357610#comment-14357610 ] mgdadv commented on SPARK-6189: --- While the dot is legal in R and SQL, I don't think there is

[jira] [Commented] (SPARK-6303) Average should be in canBeCodeGened list

[ https://issues.apache.org/jira/browse/SPARK-6303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14358399#comment-14358399 ] Apache Spark commented on SPARK-6303: - User 'viirya' has created a pull request for th

[jira] [Created] (SPARK-6303) Average should be in canBeCodeGened list

Liang-Chi Hsieh created SPARK-6303: -- Summary: Average should be in canBeCodeGened list Key: SPARK-6303 URL: https://issues.apache.org/jira/browse/SPARK-6303 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-6227) PCA and SVD for PySpark

[ https://issues.apache.org/jira/browse/SPARK-6227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-6227: - Issue Type: Sub-task (was: Improvement) Parent: SPARK-6100 > PCA and SVD for PySp

[jira] [Commented] (SPARK-6286) Handle TASK_ERROR in TaskState

[ https://issues.apache.org/jira/browse/SPARK-6286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14357310#comment-14357310 ] Iulian Dragos commented on SPARK-6286: -- Good point. It's been [introduced in 0.21.0|

[jira] [Commented] (SPARK-6198) Support "select current_database()"

[ https://issues.apache.org/jira/browse/SPARK-6198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14358361#comment-14358361 ] Apache Spark commented on SPARK-6198: - User 'DoingDone9' has created a pull request fo

[jira] [Commented] (SPARK-6285) Duplicated code leads to errors

[ https://issues.apache.org/jira/browse/SPARK-6285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14357255#comment-14357255 ] Sean Owen commented on SPARK-6285: -- I do not observe any compilation problem in Maven or

[jira] [Commented] (SPARK-6284) Support framework authentication and role in Mesos framework

[ https://issues.apache.org/jira/browse/SPARK-6284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14357180#comment-14357180 ] Timothy Chen commented on SPARK-6284: - https://github.com/apache/spark/pull/4960 > Su

[jira] [Commented] (SPARK-5987) Model import/export for GaussianMixtureModel

[ https://issues.apache.org/jira/browse/SPARK-5987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14357109#comment-14357109 ] Joseph K. Bradley commented on SPARK-5987: -- This isn't a bug in Spark SQL. The i

[jira] [Commented] (SPARK-6302) GeneratedAggregate uses wrong schema on updateProjection

[ https://issues.apache.org/jira/browse/SPARK-6302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14358333#comment-14358333 ] Apache Spark commented on SPARK-6302: - User 'viirya' has created a pull request for th

[jira] [Updated] (SPARK-6301) Unable to load external jars while submitting Spark Job

[ https://issues.apache.org/jira/browse/SPARK-6301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] raju patel updated SPARK-6301: -- Description: We are using Jnius to call Java functions from Python. But when we are trying to submit th

[jira] [Created] (SPARK-6302) GeneratedAggregate uses wrong schema on updateProjection

Liang-Chi Hsieh created SPARK-6302: -- Summary: GeneratedAggregate uses wrong schema on updateProjection Key: SPARK-6302 URL: https://issues.apache.org/jira/browse/SPARK-6302 Project: Spark Is

[jira] [Commented] (SPARK-5692) Model import/export for Word2Vec

[ https://issues.apache.org/jira/browse/SPARK-5692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14357069#comment-14357069 ] Manoj Kumar commented on SPARK-5692: okay, great > Model import/export for Word2Vec >

  1   2   >