[jira] [Commented] (SPARK-13108) Encoding not working with non-ascii compatible encodings (UTF-16/32 etc.)

[ https://issues.apache.org/jira/browse/SPARK-13108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127651#comment-15127651 ] Hyukjin Kwon commented on SPARK-13108: -- Oh sorry I re-read and it looks funny. I meant I will submit

[jira] [Commented] (SPARK-13108) Encoding not working with non-ascii compatible encodings (UTF-16/32 etc.)

[ https://issues.apache.org/jira/browse/SPARK-13108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127657#comment-15127657 ] Hyukjin Kwon commented on SPARK-13108: -- Sure. It needs to re-write Hadoop's LineRecordReader,

[jira] [Comment Edited] (SPARK-13108) Encoding not working with non-ascii compatible encodings (UTF-16/32 etc.)

[ https://issues.apache.org/jira/browse/SPARK-13108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127656#comment-15127656 ] Hyukjin Kwon edited comment on SPARK-13108 at 2/2/16 4:56 AM: -- Sure. It

[jira] [Comment Edited] (SPARK-13108) Encoding not working with non-ascii compatible encodings (UTF-16/32 etc.)

[ https://issues.apache.org/jira/browse/SPARK-13108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127656#comment-15127656 ] Hyukjin Kwon edited comment on SPARK-13108 at 2/2/16 4:55 AM: -- Sure. It

[jira] [Created] (SPARK-13130) Make whole stage codegen variable names slightly easier to read

Reynold Xin created SPARK-13130: --- Summary: Make whole stage codegen variable names slightly easier to read Key: SPARK-13130 URL: https://issues.apache.org/jira/browse/SPARK-13130 Project: Spark

[jira] [Updated] (SPARK-13130) Make whole stage codegen variable names slightly easier to read

[ https://issues.apache.org/jira/browse/SPARK-13130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13130: Component/s: SQL > Make whole stage codegen variable names slightly easier to read >

[jira] [Assigned] (SPARK-13130) Make whole stage codegen variable names slightly easier to read

[ https://issues.apache.org/jira/browse/SPARK-13130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reassigned SPARK-13130: --- Assignee: Reynold Xin > Make whole stage codegen variable names slightly easier to read >

[jira] [Commented] (SPARK-13129) Spark SQL can't query hive table, which is create by Hive HCatalog Streaming API

[ https://issues.apache.org/jira/browse/SPARK-13129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127742#comment-15127742 ] Tao Li commented on SPARK-13129: [~srowen] OK, I will give some background. There are two ways to load

[jira] [Commented] (SPARK-13114) java.lang.NegativeArraySizeException in CSV

[ https://issues.apache.org/jira/browse/SPARK-13114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127757#comment-15127757 ] Reynold Xin commented on SPARK-13114: - Please do. > java.lang.NegativeArraySizeException in CSV >

[jira] [Assigned] (SPARK-13108) Encoding not working with non-ascii compatible encodings (UTF-16/32 etc.)

[ https://issues.apache.org/jira/browse/SPARK-13108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13108: Assignee: Apache Spark > Encoding not working with non-ascii compatible encodings

[jira] [Issue Comment Deleted] (SPARK-13108) Encoding not working with non-ascii compatible encodings (UTF-16/32 etc.)

[ https://issues.apache.org/jira/browse/SPARK-13108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-13108: - Comment: was deleted (was: Sure. It needs to re-write Hadoop's LineRecordReader, LineReader and

[jira] [Created] (SPARK-13129) Spark SQL can't query hive table, which is create by Hive HCatalog Streaming API

Tao Li created SPARK-13129: -- Summary: Spark SQL can't query hive table, which is create by Hive HCatalog Streaming API Key: SPARK-13129 URL: https://issues.apache.org/jira/browse/SPARK-13129 Project: Spark

[jira] [Updated] (SPARK-13123) Add wholestage codegen for sort

[ https://issues.apache.org/jira/browse/SPARK-13123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13123: Assignee: Nong Li > Add wholestage codegen for sort > --- > >

[jira] [Commented] (SPARK-13129) Spark SQL can't query hive table, which is create by Hive HCatalog Streaming API

[ https://issues.apache.org/jira/browse/SPARK-13129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127682#comment-15127682 ] Tao Li commented on SPARK-13129: [~srowen] [~davies] > Spark SQL can't query hive table, which is create

[jira] [Commented] (SPARK-13129) Spark SQL can't query hive table, which is create by Hive HCatalog Streaming API

[ https://issues.apache.org/jira/browse/SPARK-13129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127692#comment-15127692 ] Tao Li commented on SPARK-13129: To open hive streaming data ingest feature, I change metastore

[jira] [Commented] (SPARK-13131) Use best time in benchmark

[ https://issues.apache.org/jira/browse/SPARK-13131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127709#comment-15127709 ] Apache Spark commented on SPARK-13131: -- User 'davies' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13131) Use best time in benchmark

[ https://issues.apache.org/jira/browse/SPARK-13131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13131: Assignee: (was: Apache Spark) > Use best time in benchmark >

[jira] [Commented] (SPARK-13129) Spark SQL can't query hive table, which is create by Hive HCatalog Streaming API

[ https://issues.apache.org/jira/browse/SPARK-13129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127730#comment-15127730 ] Sean Owen commented on SPARK-13129: --- I'm not a reviewer for SQL or Hive. However this does not look

[jira] [Commented] (SPARK-3611) Show number of cores for each executor in application web UI

[ https://issues.apache.org/jira/browse/SPARK-3611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127542#comment-15127542 ] Alex Bozarth commented on SPARK-3611: - I have a fix for this I was about to submit when I discovered

[jira] [Created] (SPARK-13125) makes the ratio of kafka topic partition to KafkaRDD partition configurable.

zhengcanbin created SPARK-13125: --- Summary: makes the ratio of kafka topic partition to KafkaRDD partition configurable. Key: SPARK-13125 URL: https://issues.apache.org/jira/browse/SPARK-13125 Project:

[jira] [Commented] (SPARK-13115) RandomForest is stuck at computing same stage over and over

[ https://issues.apache.org/jira/browse/SPARK-13115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127615#comment-15127615 ] Rahul Tanwani commented on SPARK-13115: --- Computing the same stage over and over again is different

[jira] [Updated] (SPARK-13125) makes the ratio of kafka topic partition to KafkaRDD partition configurable.

[ https://issues.apache.org/jira/browse/SPARK-13125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengcanbin updated SPARK-13125: Affects Version/s: (was: 2.0.0) 1.6.1 Environment: (was:

[jira] [Created] (SPARK-13127) Upgrade Parquet to 1.9 (Fixes parquet sorting)

Justin Pihony created SPARK-13127: - Summary: Upgrade Parquet to 1.9 (Fixes parquet sorting) Key: SPARK-13127 URL: https://issues.apache.org/jira/browse/SPARK-13127 Project: Spark Issue Type:

[jira] [Updated] (SPARK-13126) History Server page always has horizontal scrollbar

[ https://issues.apache.org/jira/browse/SPARK-13126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alex Bozarth updated SPARK-13126: - Attachment: page_width.png [~zhuoliu] Did you see this when creating the page? The screenshots

[jira] [Comment Edited] (SPARK-13129) Spark SQL can't query hive table, which is create by Hive HCatalog Streaming API

[ https://issues.apache.org/jira/browse/SPARK-13129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127742#comment-15127742 ] Tao Li edited comment on SPARK-13129 at 2/2/16 6:17 AM: [~srowen] OK, I will give

[jira] [Commented] (SPARK-4388) Add tooltips to explain maxMemory / usedMemory columns in executor UI

[ https://issues.apache.org/jira/browse/SPARK-4388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127609#comment-15127609 ] Alex Bozarth commented on SPARK-4388: - Fixed by SPARK-5768 > Add tooltips to explain maxMemory /

[jira] [Closed] (SPARK-4388) Add tooltips to explain maxMemory / usedMemory columns in executor UI

[ https://issues.apache.org/jira/browse/SPARK-4388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alex Bozarth closed SPARK-4388. --- Resolution: Duplicate > Add tooltips to explain maxMemory / usedMemory columns in executor UI >

[jira] [Updated] (SPARK-13125) makes the ratio of KafkaRDD partition to kafka topic partition configurable.

[ https://issues.apache.org/jira/browse/SPARK-13125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengcanbin updated SPARK-13125: Summary: makes the ratio of KafkaRDD partition to kafka topic partition configurable. (was:

[jira] [Updated] (SPARK-13108) Encoding not working with non-ascii compatible encodings (UTF-16/32 etc.)

[ https://issues.apache.org/jira/browse/SPARK-13108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-13108: - Description: This library uses Hadoop's

[jira] [Commented] (SPARK-13108) Encoding not working with non-ascii compatible encodings (UTF-16/32 etc.)

[ https://issues.apache.org/jira/browse/SPARK-13108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127630#comment-15127630 ] Apache Spark commented on SPARK-13108: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-13108) Encoding not working with non-ascii compatible encodings (UTF-16/32 etc.)

[ https://issues.apache.org/jira/browse/SPARK-13108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13108: Assignee: (was: Apache Spark) > Encoding not working with non-ascii compatible

[jira] [Commented] (SPARK-13108) Encoding not working with non-ascii compatible encodings (UTF-16/32 etc.)

[ https://issues.apache.org/jira/browse/SPARK-13108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127648#comment-15127648 ] Reynold Xin commented on SPARK-13108: - [~hyukjin.kwon] are you replying to yourself? > Encoding not

[jira] [Commented] (SPARK-13108) Encoding not working with non-ascii compatible encodings (UTF-16/32 etc.)

[ https://issues.apache.org/jira/browse/SPARK-13108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127649#comment-15127649 ] Reynold Xin commented on SPARK-13108: - BTW I think we should consider doing a rewrite so it supports

[jira] [Commented] (SPARK-13108) Encoding not working with non-ascii compatible encodings (UTF-16/32 etc.)

[ https://issues.apache.org/jira/browse/SPARK-13108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127656#comment-15127656 ] Hyukjin Kwon commented on SPARK-13108: -- Sure. It needs to re-write Hadoop's LineRecordReader,

[jira] [Created] (SPARK-13128) API for building arrays / lists encoders

Michael Armbrust created SPARK-13128: Summary: API for building arrays / lists encoders Key: SPARK-13128 URL: https://issues.apache.org/jira/browse/SPARK-13128 Project: Spark Issue Type:

[jira] [Commented] (SPARK-13130) Make whole stage codegen variable names slightly easier to read

[ https://issues.apache.org/jira/browse/SPARK-13130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127696#comment-15127696 ] Apache Spark commented on SPARK-13130: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13130) Make whole stage codegen variable names slightly easier to read

[ https://issues.apache.org/jira/browse/SPARK-13130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13130: Assignee: Apache Spark (was: Reynold Xin) > Make whole stage codegen variable names

[jira] [Assigned] (SPARK-13130) Make whole stage codegen variable names slightly easier to read

[ https://issues.apache.org/jira/browse/SPARK-13130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13130: Assignee: Reynold Xin (was: Apache Spark) > Make whole stage codegen variable names

[jira] [Created] (SPARK-13131) Use best time in benchmark

Davies Liu created SPARK-13131: -- Summary: Use best time in benchmark Key: SPARK-13131 URL: https://issues.apache.org/jira/browse/SPARK-13131 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-13131) Use best time in benchmark

[ https://issues.apache.org/jira/browse/SPARK-13131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13131: Assignee: Apache Spark > Use best time in benchmark > -- > >

[jira] [Created] (SPARK-13132) LogisticRegression spends 35% of its time fetching the standardization parameter

Gary King created SPARK-13132: - Summary: LogisticRegression spends 35% of its time fetching the standardization parameter Key: SPARK-13132 URL: https://issues.apache.org/jira/browse/SPARK-13132 Project:

[jira] [Commented] (SPARK-13009) spark-streaming-twitter_2.10 does not make it possible to access the raw twitter json

[ https://issues.apache.org/jira/browse/SPARK-13009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127718#comment-15127718 ] Mario Briggs commented on SPARK-13009: -- IMHO even if the StatusJSONImpl was not final, still should

[jira] [Commented] (SPARK-13114) java.lang.NegativeArraySizeException in CSV

[ https://issues.apache.org/jira/browse/SPARK-13114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127756#comment-15127756 ] Hyukjin Kwon commented on SPARK-13114: -- Are you working on this? Could I quickly submit a PR for

[jira] [Assigned] (SPARK-13089) spark.ml Naive Bayes user guide

[ https://issues.apache.org/jira/browse/SPARK-13089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13089: Assignee: (was: Apache Spark) > spark.ml Naive Bayes user guide >

[jira] [Assigned] (SPARK-13089) spark.ml Naive Bayes user guide

[ https://issues.apache.org/jira/browse/SPARK-13089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13089: Assignee: Apache Spark > spark.ml Naive Bayes user guide >

[jira] [Commented] (SPARK-13089) spark.ml Naive Bayes user guide

[ https://issues.apache.org/jira/browse/SPARK-13089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127588#comment-15127588 ] Apache Spark commented on SPARK-13089: -- User 'hhbyyh' has created a pull request for this issue:

[jira] [Updated] (SPARK-13125) makes the ratio of KafkaRDD partition to kafka topic partition configurable.

[ https://issues.apache.org/jira/browse/SPARK-13125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengcanbin updated SPARK-13125: Description: Now each given Kafka topic/partition corresponds to an RDD partition, in some case

[jira] [Commented] (SPARK-12984) Not able to read CSV file using Spark 1.4.0

[ https://issues.apache.org/jira/browse/SPARK-12984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127698#comment-15127698 ] Sun Rui commented on SPARK-12984: - [~jaimurugesh], do you think if

[jira] [Created] (SPARK-13115) RandomForest is stuck at computing same stage over and over

Rahul Tanwani created SPARK-13115: - Summary: RandomForest is stuck at computing same stage over and over Key: SPARK-13115 URL: https://issues.apache.org/jira/browse/SPARK-13115 Project: Spark

[jira] [Commented] (SPARK-12715) Improve test coverage

[ https://issues.apache.org/jira/browse/SPARK-12715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126766#comment-15126766 ] Davies Liu commented on SPARK-12715: I think Hive should have lots of test cases for parser, it will

[jira] [Updated] (SPARK-13115) RandomForest is stuck at computing same stage over and over

[ https://issues.apache.org/jira/browse/SPARK-13115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rahul Tanwani updated SPARK-13115: -- Attachment: Stages.png > RandomForest is stuck at computing same stage over and over >

[jira] [Resolved] (SPARK-13110) How to configure the access of the Spark History Web UI with Kerberos authentication?

[ https://issues.apache.org/jira/browse/SPARK-13110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-13110. Resolution: Unresolved Hi Pierre, We don't use the bug tracker for questions. Please use

[jira] [Updated] (SPARK-13115) RandomForest is stuck at computing same stage over and over

[ https://issues.apache.org/jira/browse/SPARK-13115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rahul Tanwani updated SPARK-13115: -- Attachment: Stage details.png > RandomForest is stuck at computing same stage over and over >

[jira] [Updated] (SPARK-13115) RandomForest is stuck at computing same stage over and over

[ https://issues.apache.org/jira/browse/SPARK-13115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rahul Tanwani updated SPARK-13115: -- Attachment: Task details.png > RandomForest is stuck at computing same stage over and over >

[jira] [Created] (SPARK-13113) Remove unnecessary bit operation when decoding page number

Liang-Chi Hsieh created SPARK-13113: --- Summary: Remove unnecessary bit operation when decoding page number Key: SPARK-13113 URL: https://issues.apache.org/jira/browse/SPARK-13113 Project: Spark

[jira] [Commented] (SPARK-13106) KafkaUtils.createDirectStream method with messageHandler and topics

[ https://issues.apache.org/jira/browse/SPARK-13106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126369#comment-15126369 ] Cody Koeninger commented on SPARK-13106: My original intention was for the kafka offset api

[jira] [Assigned] (SPARK-13113) Remove unnecessary bit operation when decoding page number

[ https://issues.apache.org/jira/browse/SPARK-13113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13113: Assignee: Apache Spark > Remove unnecessary bit operation when decoding page number >

[jira] [Commented] (SPARK-13113) Remove unnecessary bit operation when decoding page number

[ https://issues.apache.org/jira/browse/SPARK-13113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126368#comment-15126368 ] Apache Spark commented on SPARK-13113: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13113) Remove unnecessary bit operation when decoding page number

[ https://issues.apache.org/jira/browse/SPARK-13113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13113: Assignee: (was: Apache Spark) > Remove unnecessary bit operation when decoding page

[jira] [Commented] (SPARK-13089) spark.ml Naive Bayes user guide

[ https://issues.apache.org/jira/browse/SPARK-13089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126618#comment-15126618 ] Vinayak Agrawal commented on SPARK-13089: - Yuhao, I can help you with this and review your work.

[jira] [Commented] (SPARK-13101) Dataset complex types mapping to DataFrame (element nullability) mismatch

[ https://issues.apache.org/jira/browse/SPARK-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126678#comment-15126678 ] Michael Armbrust commented on SPARK-13101: -- /cc [~lian cheng] [~cloud_fan] > Dataset complex

[jira] [Updated] (SPARK-13114) java.lang.NegativeArraySizeException in CSV

[ https://issues.apache.org/jira/browse/SPARK-13114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-13114: --- Priority: Critical (was: Major) > java.lang.NegativeArraySizeException in CSV >

[jira] [Commented] (SPARK-6319) Should throw analysis exception when using binary type in groupby/join

[ https://issues.apache.org/jira/browse/SPARK-6319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15126668#comment-15126668 ] Cheng Lian commented on SPARK-6319: --- One possible but not necessarily the best workaround is to have a

[jira] [Updated] (SPARK-13101) Dataset complex types mapping to DataFrame (element nullability) mismatch

[ https://issues.apache.org/jira/browse/SPARK-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13101: --- Description: There seems to be a regression between 1.6.0 and 1.6.1 (snapshot build). By default a

<    1   2   3