[jira] [Commented] (SPARK-17400) MinMaxScaler.transform() outputs DenseVector by default, which causes poor performance

2016-09-09 Thread Frank Dai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478819#comment-15478819 ] Frank Dai commented on SPARK-17400: --- [~mlnick] After reading the doc of MaxAbsScaler, I think

[jira] [Closed] (SPARK-17400) MinMaxScaler.transform() outputs DenseVector by default, which causes poor performance

2016-09-09 Thread Frank Dai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frank Dai closed SPARK-17400. - Resolution: Not A Problem > MinMaxScaler.transform() outputs DenseVector by default, which causes poor

[jira] [Commented] (SPARK-17400) MinMaxScaler.transform() outputs DenseVector by default, which causes poor performance

2016-09-05 Thread Frank Dai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15465845#comment-15465845 ] Frank Dai commented on SPARK-17400: --- Currently I'm haunted by this issue in production, I have 6

[jira] [Comment Edited] (SPARK-17400) MinMaxScaler.transform() outputs DenseVector by default, which causes poor performance

2016-09-05 Thread Frank Dai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15465845#comment-15465845 ] Frank Dai edited comment on SPARK-17400 at 9/5/16 9:52 PM: --- Currently I'm

[jira] [Updated] (SPARK-17400) MinMaxScaler.transform() outputs DenseVector by default, which causes poor performance

2016-09-05 Thread Frank Dai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frank Dai updated SPARK-17400: -- Description: MinMaxScaler.transform() outputs DenseVector by default, which will cause poor

[jira] [Updated] (SPARK-17400) MinMaxScaler.transform() outputs DenseVector by default, which causes poor performance

2016-09-05 Thread Frank Dai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frank Dai updated SPARK-17400: -- Description: MinMaxScaler.transform() outputs DenseVector by default, which will cause poor

[jira] [Created] (SPARK-17400) MinMaxScaler.transform() outputs DenseVector by default, which causes poor performance

2016-09-05 Thread Frank Dai (JIRA)
Frank Dai created SPARK-17400: - Summary: MinMaxScaler.transform() outputs DenseVector by default, which causes poor performance Key: SPARK-17400 URL: https://issues.apache.org/jira/browse/SPARK-17400

[jira] [Updated] (SPARK-11544) sqlContext doesn't use PathFilter

2015-11-05 Thread Frank Dai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Frank Dai updated SPARK-11544: -- Description: When sqlContext reads JSON files, it doesn't use {{PathFilter}} in the underlying

[jira] [Created] (SPARK-11544) sqlContext doesn't use PathFilter

2015-11-05 Thread Frank Dai (JIRA)
Frank Dai created SPARK-11544: - Summary: sqlContext doesn't use PathFilter Key: SPARK-11544 URL: https://issues.apache.org/jira/browse/SPARK-11544 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-1391) BlockManager cannot transfer blocks larger than 2G in size

2014-06-26 Thread Frank Dai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14044427#comment-14044427 ] Frank Dai commented on SPARK-1391: -- [~coderplay] Have you solved this issue yet ? Or do