[jira] [Commented] (SPARK-8409) In windows cant able to read .csv or .json files using read.df()

2015-06-17 Thread Arun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590119#comment-14590119 ] Arun commented on SPARK-8409: - Ok thanks a lot shriram In windows cant able to read .csv or

[jira] [Created] (SPARK-8412) java#KafkaUtils.createDirectStream Java(Pair)RDDs do not implement HasOffsetRanges

2015-06-17 Thread jweinste (JIRA)
jweinste created SPARK-8412: --- Summary: java#KafkaUtils.createDirectStream Java(Pair)RDDs do not implement HasOffsetRanges Key: SPARK-8412 URL: https://issues.apache.org/jira/browse/SPARK-8412 Project:

[jira] [Updated] (SPARK-8365) pyspark does not retain --packages or --jars passed on the command line as of 1.4.0

2015-06-17 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8365: - Priority: Blocker (was: Major) pyspark does not retain --packages or --jars passed on the command line

[jira] [Updated] (SPARK-8365) pyspark does not retain --packages or --jars passed on the command line as of 1.4.0

2015-06-17 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8365: - Target Version/s: 1.4.1, 1.5.0 pyspark does not retain --packages or --jars passed on the command line

[jira] [Commented] (SPARK-8365) pyspark does not retain --packages or --jars passed on the command line as of 1.4.0

2015-06-17 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590150#comment-14590150 ] Andrew Or commented on SPARK-8365: -- Bumping to blocker because this seems like a

[jira] [Closed] (SPARK-7913) Increase the maximum capacity of PartitionedPairBuffer, PartitionedSerializedPairBuffer and AppendOnlyMap

2015-06-17 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-7913. Resolution: Fixed Fix Version/s: 1.5.0 Assignee: Shixiong Zhu Target Version/s:

[jira] [Resolved] (SPARK-6782) add sbt-revolver plugin to sbt build

2015-06-17 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-6782. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 5426

[jira] [Commented] (SPARK-7888) Be able to disable intercept in Linear Regression in ML package

2015-06-17 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590585#comment-14590585 ] holdenk commented on SPARK-7888: So if we don't re-center but still scale all of the

[jira] [Updated] (SPARK-7913) Increase the maximum capacity of PartitionedPairBuffer, PartitionedSerializedPairBuffer and AppendOnlyMap

2015-06-17 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7913: - Affects Version/s: 1.2.0 Increase the maximum capacity of PartitionedPairBuffer,

[jira] [Updated] (SPARK-8095) Spark package dependencies not resolved when package is in local-ivy-cache

2015-06-17 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8095: - Fix Version/s: 1.5.0 1.4.1 Spark package dependencies not resolved when package is in

[jira] [Updated] (SPARK-6548) Adding stddev to DataFrame functions

2015-06-17 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6548: Shepherd: Michael Armbrust Adding stddev to DataFrame functions

[jira] [Updated] (SPARK-6785) DateUtils can not handle date before 1970/01/01 correctly

2015-06-17 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6785: Target Version/s: 1.5.0 Shepherd: Michael Armbrust DateUtils can not handle

[jira] [Updated] (SPARK-8409) In windows cant able to read .csv or .json files using read.df() in sparkR of spark 1.4 for eg.) df_1- read.df(sqlContext, E:/setup/spark-1.4.0-bin-hadoop2.6/spark-1.4

2015-06-17 Thread Arun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun updated SPARK-8409: Summary: In windows cant able to read .csv or .json files using read.df() in sparkR of spark 1.4 for eg.) df_1-

[jira] [Updated] (SPARK-8409) In windows cant able to read .csv or .json files using read.df() in sparkR of spark 1.4 for eg.) df_1- read.df(sqlContext, E:/setup/spark-1.4.0-bin-hadoop2.6/spark-1.4

2015-06-17 Thread Arun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun updated SPARK-8409: Description: Hi, In SparkR shell, I invoke: mydf-read.df(sqlContext, /home/esten/ami/usaf.json, source=json,

[jira] [Created] (SPARK-8409) i cant able to read .csv files using read.df() in sparkR of spark 1.4 for eg.) mydf-read.df(sqlContext, /home/esten/ami/usaf.json, source=json, header=false)

2015-06-17 Thread Arun (JIRA)
Arun created SPARK-8409: --- Summary: i cant able to read .csv files using read.df() in sparkR of spark 1.4 for eg.) mydf-read.df(sqlContext, /home/esten/ami/usaf.json, source=json, header=false) Key: SPARK-8409 URL:

[jira] [Updated] (SPARK-8409) In windows cant able to read .csv files using read.df() in sparkR of spark 1.4 for eg.) df_1- read.df(sqlContext, E:/setup/spark-1.4.0-bin-hadoop2.6/spark-1.4.0-bin-ha

2015-06-17 Thread Arun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun updated SPARK-8409: Summary: In windows cant able to read .csv files using read.df() in sparkR of spark 1.4 for eg.) df_1-

[jira] [Updated] (SPARK-8409) In windows cant able to read .csv or .json files using read.df() in sparkR of spark 1.4 for eg.) df_1- read.df(sqlContext, E:/setup/spark-1.4.0-bin-hadoop2.6/spark-1.4

2015-06-17 Thread Arun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun updated SPARK-8409: Description: Hi, In SparkR shell, I invoke: mydf-read.df(sqlContext, /home/esten/ami/usaf.json, source=json,

[jira] [Created] (SPARK-8402) DP means clustering

2015-06-17 Thread Meethu Mathew (JIRA)
Meethu Mathew created SPARK-8402: Summary: DP means clustering Key: SPARK-8402 URL: https://issues.apache.org/jira/browse/SPARK-8402 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-8402) DP means clustering

2015-06-17 Thread Meethu Mathew (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589392#comment-14589392 ] Meethu Mathew commented on SPARK-8402: -- Could anyone please assign this ticket to me

[jira] [Commented] (SPARK-7009) Build assembly JAR via ant to avoid zip64 problems

2015-06-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589408#comment-14589408 ] Sean Owen commented on SPARK-7009: -- 1.4 should be built with Java 6, so shouldn't exhibit

[jira] [Commented] (SPARK-8404) Use thread-safe collections to make KafkaStreamSuite tests more reliable

2015-06-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589439#comment-14589439 ] Apache Spark commented on SPARK-8404: - User 'zsxwing' has created a pull request for

[jira] [Assigned] (SPARK-8404) Use thread-safe collections to make KafkaStreamSuite tests more reliable

2015-06-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8404: --- Assignee: Apache Spark Use thread-safe collections to make KafkaStreamSuite tests more

[jira] [Created] (SPARK-8408) Python OR operator is not considered while creating a column of boolean type

2015-06-17 Thread JIRA
Felix Maximilian Möller created SPARK-8408: -- Summary: Python OR operator is not considered while creating a column of boolean type Key: SPARK-8408 URL: https://issues.apache.org/jira/browse/SPARK-8408

[jira] [Updated] (SPARK-8408) Python OR operator is not considered while creating a column of boolean type

2015-06-17 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-8408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Maximilian Möller updated SPARK-8408: --- Description: h3. Given {code} d = [{'name': 'Alice', 'age': 1},{'name':

[jira] [Commented] (SPARK-7009) Build assembly JAR via ant to avoid zip64 problems

2015-06-17 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589659#comment-14589659 ] Steve Loughran commented on SPARK-7009: --- The issue isn't that python can't read

[jira] [Commented] (SPARK-6653) New configuration property to specify port for sparkYarnAM actor system

2015-06-17 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589699#comment-14589699 ] Jeff Zhang commented on SPARK-6653: --- Although this is already committed, would it be

[jira] [Updated] (SPARK-8408) Python OR operator is not considered while creating a column of boolean type

2015-06-17 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-8408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Maximilian Möller updated SPARK-8408: --- Attachment: bug_report.ipynb.json IPython notebook with the code that

[jira] [Commented] (SPARK-7819) Isolated Hive Client Loader appears to cause Native Library libMapRClient.4.0.2-mapr.so already loaded in another classloader error

2015-06-17 Thread John Omernik (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589663#comment-14589663 ] John Omernik commented on SPARK-7819: - Yin - This occurred with my 1.4.0 release (not

[jira] [Updated] (SPARK-8403) Pruner partition won't effective when partition field and fieldSchema exist in sql predicate

2015-06-17 Thread Hong Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Shen updated SPARK-8403: - Description: When partition field and fieldSchema exist in sql predicates, pruner partition won't

[jira] [Commented] (SPARK-6882) Spark ThriftServer2 Kerberos failed encountering java.lang.IllegalArgumentException: Unknown auth type: null Allowed values are: [auth-int, auth-conf, auth]

2015-06-17 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589398#comment-14589398 ] Tao Wang commented on SPARK-6882: - Did you try to set hive.server2.thrift.sasl.qop to

[jira] [Commented] (SPARK-8407) complex type constructors: struct and named_struct

2015-06-17 Thread Yijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589473#comment-14589473 ] Yijie Shen commented on SPARK-8407: --- I will take this one. complex type constructors:

[jira] [Updated] (SPARK-8403) Pruner partition won't effective when partition field and fieldSchema exit in sql predicate

2015-06-17 Thread Hong Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Shen updated SPARK-8403: - Description: When partition field and fieldSchema exist in sql predicates, pruner partition won't

[jira] [Updated] (SPARK-8403) Pruner partition won't effective when partition field and fieldSchema exist in sql predicate

2015-06-17 Thread Hong Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Shen updated SPARK-8403: - Summary: Pruner partition won't effective when partition field and fieldSchema exist in sql predicate

[jira] [Updated] (SPARK-8403) Pruner partition won't effective when partition field and fieldSchema exit in sql predicate

2015-06-17 Thread Hong Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Shen updated SPARK-8403: - Summary: Pruner partition won't effective when partition field and fieldSchema exit in sql predicate

[jira] [Created] (SPARK-8403) Pruner partition won't effective when udf exit in sql predicates

2015-06-17 Thread Hong Shen (JIRA)
Hong Shen created SPARK-8403: Summary: Pruner partition won't effective when udf exit in sql predicates Key: SPARK-8403 URL: https://issues.apache.org/jira/browse/SPARK-8403 Project: Spark

[jira] [Updated] (SPARK-8403) Pruner partition won't effective when udf exit in sql predicates

2015-06-17 Thread Hong Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Shen updated SPARK-8403: - Description: When udf exit in sql predicates, pruner partition won't effective. Here is the sql, {code}

[jira] [Assigned] (SPARK-7088) [REGRESSION] Spark 1.3.1 breaks analysis of third-party logical plans

2015-06-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7088: --- Assignee: (was: Apache Spark) [REGRESSION] Spark 1.3.1 breaks analysis of third-party

[jira] [Assigned] (SPARK-7088) [REGRESSION] Spark 1.3.1 breaks analysis of third-party logical plans

2015-06-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7088: --- Assignee: Apache Spark [REGRESSION] Spark 1.3.1 breaks analysis of third-party logical

[jira] [Commented] (SPARK-7088) [REGRESSION] Spark 1.3.1 breaks analysis of third-party logical plans

2015-06-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589484#comment-14589484 ] Apache Spark commented on SPARK-7088: - User 'smola' has created a pull request for

[jira] [Commented] (SPARK-8393) JavaStreamingContext#awaitTermination() throws non-declared InterruptedException

2015-06-17 Thread Jaromir Vanek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589483#comment-14589483 ] Jaromir Vanek commented on SPARK-8393: -- {{awaitTerminationOrTimeout}} also throws

[jira] [Commented] (SPARK-8405) Show executor logs on Web UI when Yarn log aggregation is enabled

2015-06-17 Thread Carson Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589475#comment-14589475 ] Carson Wang commented on SPARK-8405: I had some in progress works and here is the

[jira] [Updated] (SPARK-8406) Race condition when writing Parquet files

2015-06-17 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-8406: -- Description: To support appending, the Parquet data source tries to find out the max ID of part-files

[jira] [Updated] (SPARK-8407) complex type constructors: struct and named_struct

2015-06-17 Thread Yijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yijie Shen updated SPARK-8407: -- Description: struct(val1, val2, val3, ...) Creates a struct with the given field values. Struct field

[jira] [Updated] (SPARK-8403) Pruner partition won't effective when udf exit in sql predicates

2015-06-17 Thread Hong Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Shen updated SPARK-8403: - Description: When udf exit in sql predicates, pruner partition won't effective. Here is the sql, {code}

[jira] [Commented] (SPARK-8204) conditional function: least

2015-06-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589416#comment-14589416 ] Apache Spark commented on SPARK-8204: - User 'adrian-wang' has created a pull request

[jira] [Created] (SPARK-8404) Use thread-safe collections to make KafkaStreamSuite tests more reliable

2015-06-17 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-8404: --- Summary: Use thread-safe collections to make KafkaStreamSuite tests more reliable Key: SPARK-8404 URL: https://issues.apache.org/jira/browse/SPARK-8404 Project: Spark

[jira] [Created] (SPARK-8407) complex type constructors: struct and named_struct

2015-06-17 Thread Yijie Shen (JIRA)
Yijie Shen created SPARK-8407: - Summary: complex type constructors: struct and named_struct Key: SPARK-8407 URL: https://issues.apache.org/jira/browse/SPARK-8407 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-8404) Use thread-safe collections to make KafkaStreamSuite tests more reliable

2015-06-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8404: --- Assignee: (was: Apache Spark) Use thread-safe collections to make KafkaStreamSuite

[jira] [Created] (SPARK-8405) Show executor logs on Web UI when Yarn log aggregation is enabled

2015-06-17 Thread Carson Wang (JIRA)
Carson Wang created SPARK-8405: -- Summary: Show executor logs on Web UI when Yarn log aggregation is enabled Key: SPARK-8405 URL: https://issues.apache.org/jira/browse/SPARK-8405 Project: Spark

[jira] [Updated] (SPARK-8405) Show executor logs on Web UI when Yarn log aggregation is enabled

2015-06-17 Thread Carson Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carson Wang updated SPARK-8405: --- Attachment: SparkLogError.png Show executor logs on Web UI when Yarn log aggregation is enabled

[jira] [Created] (SPARK-8406) Race condition when writing Parquet files

2015-06-17 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-8406: - Summary: Race condition when writing Parquet files Key: SPARK-8406 URL: https://issues.apache.org/jira/browse/SPARK-8406 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-8335) DecisionTreeModel.predict() return type not convenient!

2015-06-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8335: --- Assignee: (was: Apache Spark) DecisionTreeModel.predict() return type not convenient!

[jira] [Assigned] (SPARK-8335) DecisionTreeModel.predict() return type not convenient!

2015-06-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8335: --- Assignee: Apache Spark DecisionTreeModel.predict() return type not convenient!

[jira] [Commented] (SPARK-8395) spark-submit documentation is incorrect

2015-06-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589493#comment-14589493 ] Apache Spark commented on SPARK-8395: - User 'srowen' has created a pull request for

[jira] [Assigned] (SPARK-8395) spark-submit documentation is incorrect

2015-06-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8395: --- Assignee: (was: Apache Spark) spark-submit documentation is incorrect

[jira] [Assigned] (SPARK-8395) spark-submit documentation is incorrect

2015-06-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8395: --- Assignee: Apache Spark spark-submit documentation is incorrect

[jira] [Commented] (SPARK-7667) MLlib Python API consistency check

2015-06-17 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589587#comment-14589587 ] Yanbo Liang commented on SPARK-7667: [~josephkb] I have finished the check and list

[jira] [Commented] (SPARK-8320) Add example in streaming programming guide that shows union of multiple input streams

2015-06-17 Thread Nirman Narang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589612#comment-14589612 ] Nirman Narang commented on SPARK-8320: -- This seems interesting, would like to solve

[jira] [Assigned] (SPARK-8391) showDagViz throws OutOfMemoryError, cause the whole jobPage dies

2015-06-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8391: --- Assignee: Apache Spark showDagViz throws OutOfMemoryError, cause the whole jobPage dies

[jira] [Assigned] (SPARK-8391) showDagViz throws OutOfMemoryError, cause the whole jobPage dies

2015-06-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8391: --- Assignee: (was: Apache Spark) showDagViz throws OutOfMemoryError, cause the whole

[jira] [Commented] (SPARK-8391) showDagViz throws OutOfMemoryError, cause the whole jobPage dies

2015-06-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589614#comment-14589614 ] Apache Spark commented on SPARK-8391: - User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-7667) MLlib Python API consistency check

2015-06-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7667: --- Assignee: Apache Spark MLlib Python API consistency check

[jira] [Updated] (SPARK-7667) MLlib Python API consistency check

2015-06-17 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-7667: --- Description: Check and ensure the MLlib Python API(class/method/parameter) consistent with Scala.

[jira] [Commented] (SPARK-8335) DecisionTreeModel.predict() return type not convenient!

2015-06-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589492#comment-14589492 ] Apache Spark commented on SPARK-8335: - User 'srowen' has created a pull request for

[jira] [Commented] (SPARK-8406) Race condition when writing Parquet files

2015-06-17 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589592#comment-14589592 ] Cheng Lian commented on SPARK-8406: --- An example task completion and scheduling order

[jira] [Commented] (SPARK-8406) Race condition when writing Parquet files

2015-06-17 Thread Nathan McCarthy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589498#comment-14589498 ] Nathan McCarthy commented on SPARK-8406: This is hitting us hard. Let me know if

[jira] [Commented] (SPARK-8333) Spark failed to delete temp directory created by HiveContext

2015-06-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589596#comment-14589596 ] Apache Spark commented on SPARK-8333: - User 'navis' has created a pull request for

[jira] [Updated] (SPARK-8309) OpenHashMap doesn't work with more than 12M items

2015-06-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8309: - Priority: Critical (was: Major) Affects Version/s: 1.3.1 OpenHashMap doesn't work with

[jira] [Resolved] (SPARK-8309) OpenHashMap doesn't work with more than 12M items

2015-06-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8309. -- Resolution: Fixed Fix Version/s: 1.4.1 1.5.0 1.3.2 Issue

[jira] [Updated] (SPARK-8309) OpenHashMap doesn't work with more than 12M items

2015-06-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8309: - Assignee: Vyacheslav Baranov OpenHashMap doesn't work with more than 12M items

[jira] [Assigned] (SPARK-7667) MLlib Python API consistency check

2015-06-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7667: --- Assignee: (was: Apache Spark) MLlib Python API consistency check

[jira] [Commented] (SPARK-7667) MLlib Python API consistency check

2015-06-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589565#comment-14589565 ] Apache Spark commented on SPARK-7667: - User 'yanboliang' has created a pull request

[jira] [Commented] (SPARK-7688) PySpark + ipython throws port out of range exception

2015-06-17 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589747#comment-14589747 ] Manoj Kumar commented on SPARK-7688: I faced the same issue with a very old version of

[jira] [Created] (SPARK-8410) Hive VersionsSuite RuntimeException

2015-06-17 Thread Josiah Samuel Sathiadass (JIRA)
Josiah Samuel Sathiadass created SPARK-8410: --- Summary: Hive VersionsSuite RuntimeException Key: SPARK-8410 URL: https://issues.apache.org/jira/browse/SPARK-8410 Project: Spark

[jira] [Commented] (SPARK-1403) Spark on Mesos does not set Thread's context class loader

2015-06-17 Thread John Omernik (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589736#comment-14589736 ] John Omernik commented on SPARK-1403: - This is occurring still in 1.4.0 I've

[jira] [Resolved] (SPARK-8220) math function: positive

2015-06-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8220. Resolution: Fixed Fix Version/s: 1.5.0 math function: positive ---

[jira] [Commented] (SPARK-7334) Implement RandomProjection for Dimensionality Reduction

2015-06-17 Thread Sebastian Alfers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589388#comment-14589388 ] Sebastian Alfers commented on SPARK-7334: - I implemented RP as a transformer to be

[jira] [Updated] (SPARK-7667) MLlib Python API consistency check

2015-06-17 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-7667: --- Description: Check and ensure the MLlib Python API(class/method/parameter) consistent with Scala.

[jira] [Assigned] (SPARK-8204) conditional function: least

2015-06-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8204: --- Assignee: (was: Apache Spark) conditional function: least ---

[jira] [Assigned] (SPARK-8203) conditional functions: greatest

2015-06-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8203: --- Assignee: Apache Spark conditional functions: greatest ---

[jira] [Assigned] (SPARK-8203) conditional functions: greatest

2015-06-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8203: --- Assignee: (was: Apache Spark) conditional functions: greatest

[jira] [Commented] (SPARK-8203) conditional functions: greatest

2015-06-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589415#comment-14589415 ] Apache Spark commented on SPARK-8203: - User 'adrian-wang' has created a pull request

[jira] [Assigned] (SPARK-8204) conditional function: least

2015-06-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8204: --- Assignee: Apache Spark conditional function: least ---

[jira] [Updated] (SPARK-8332) NoSuchMethodError: com.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer

2015-06-17 Thread Olivier Girardot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olivier Girardot updated SPARK-8332: Priority: Critical (was: Major) NoSuchMethodError:

[jira] [Commented] (SPARK-8332) NoSuchMethodError: com.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer

2015-06-17 Thread Olivier Girardot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589903#comment-14589903 ] Olivier Girardot commented on SPARK-8332: - I have the same issue on a CDH5 cluster

[jira] [Comment Edited] (SPARK-8332) NoSuchMethodError: com.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer

2015-06-17 Thread Olivier Girardot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589903#comment-14589903 ] Olivier Girardot edited comment on SPARK-8332 at 6/17/15 3:12 PM:

[jira] [Updated] (SPARK-8409) In windows cant able to read .csv or .json files using read.df()

2015-06-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-8409: - Summary: In windows cant able to read .csv or .json files using read.df() (was:

[jira] [Commented] (SPARK-8409) In windows cant able to read .csv or .json files using read.df()

2015-06-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589906#comment-14589906 ] Shivaram Venkataraman commented on SPARK-8409: -- The error here is that the

[jira] [Created] (SPARK-8411) No space left on device

2015-06-17 Thread Mukund Sudarshan (JIRA)
Mukund Sudarshan created SPARK-8411: --- Summary: No space left on device Key: SPARK-8411 URL: https://issues.apache.org/jira/browse/SPARK-8411 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-7009) Build assembly JAR via ant to avoid zip64 problems

2015-06-17 Thread Harry Brundage (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589913#comment-14589913 ] Harry Brundage edited comment on SPARK-7009 at 6/17/15 3:22 PM:

[jira] [Resolved] (SPARK-6698) RandomForest.scala (et al) hardcodes usage of StorageLevel.MEMORY_AND_DISK

2015-06-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6698. -- Resolution: Won't Fix Closing per PR RandomForest.scala (et al) hardcodes usage of

[jira] [Updated] (SPARK-7009) Build assembly JAR via ant to avoid zip64 problems

2015-06-17 Thread Harry Brundage (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harry Brundage updated SPARK-7009: -- Attachment: check_spark_python.sh Script for checking to see if a spark release artifact jar

[jira] [Commented] (SPARK-8368) ClassNotFoundException in closure for map

2015-06-17 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590072#comment-14590072 ] Yin Huai commented on SPARK-8368: - Can you add {{--verbose}} and post the extra

[jira] [Issue Comment Deleted] (SPARK-8320) Add example in streaming programming guide that shows union of multiple input streams

2015-06-17 Thread Neelesh Srinivas Salian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neelesh Srinivas Salian updated SPARK-8320: --- Comment: was deleted (was: Added python example:

[jira] [Commented] (SPARK-8320) Add example in streaming programming guide that shows union of multiple input streams

2015-06-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590076#comment-14590076 ] Apache Spark commented on SPARK-8320: - User 'nssalian' has created a pull request for

[jira] [Issue Comment Deleted] (SPARK-8320) Add example in streaming programming guide that shows union of multiple input streams

2015-06-17 Thread Neelesh Srinivas Salian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neelesh Srinivas Salian updated SPARK-8320: --- Comment: was deleted (was: Deleted that PR. Added

[jira] [Commented] (SPARK-8409) In windows cant able to read .csv or .json files using read.df()

2015-06-17 Thread Arun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590100#comment-14590100 ] Arun commented on SPARK-8409: - Thanks sivram, I have doubts to get clarified. 1.) how can we

[jira] [Commented] (SPARK-8409) In windows cant able to read .csv or .json files using read.df()

2015-06-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590116#comment-14590116 ] Shivaram Venkataraman commented on SPARK-8409: -- [~b.arunguna...@gmail.com]

[jira] [Resolved] (SPARK-8409) In windows cant able to read .csv or .json files using read.df()

2015-06-17 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-8409. -- Resolution: Not A Problem In windows cant able to read .csv or .json files

[jira] [Commented] (SPARK-7009) Build assembly JAR via ant to avoid zip64 problems

2015-06-17 Thread Harry Brundage (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589913#comment-14589913 ] Harry Brundage commented on SPARK-7009: --- [~sowen] I wrote a script to test that we

<    1   2   3   4   >