[jira] [Commented] (SPARK-20082) Incremental update of LDA model, by adding initialModel as start point

2017-05-23 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16022379#comment-16022379 ] yuhao yang commented on SPARK-20082: refer to https://issues.apache.org/jira/browse/S

[jira] [Commented] (SPARK-20767) The training continuation for saved LDA model

2017-05-23 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16022375#comment-16022375 ] yuhao yang commented on SPARK-20767: Note there's already an issue about setInitialMo

[jira] [Resolved] (SPARK-20850) Improve division and multiplication mixing process the data

2017-05-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20850. --- Resolution: Not A Problem > Improve division and multiplication mixing process the data > ---

[jira] [Reopened] (SPARK-20850) Improve division and multiplication mixing process the data

2017-05-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-20850: --- > Improve division and multiplication mixing process the data > -

[jira] [Commented] (SPARK-20864) I tried to run spark mllib PIC algorithm, but got error

2017-05-23 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16022345#comment-16022345 ] yuhao yang commented on SPARK-20864: [~yuanjie] Could you please provide more code to

[jira] [Updated] (SPARK-20864) I tried to run spark mllib PIC algorithm, but got error

2017-05-23 Thread yuanjie (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuanjie updated SPARK-20864: Description: I use a very simple data: 1 2 3 2 1 3 3 1 3 4 5 2 4 6 2 5 6 2 but when running I got: Exceptio

[jira] [Created] (SPARK-20864) I tried to run spark mllib PIC algorithm, but got error

2017-05-23 Thread yuanjie (JIRA)
yuanjie created SPARK-20864: --- Summary: I tried to run spark mllib PIC algorithm, but got error Key: SPARK-20864 URL: https://issues.apache.org/jira/browse/SPARK-20864 Project: Spark Issue Type: Que

[jira] [Resolved] (SPARK-20861) Pyspark CrossValidator & TrainValidationSplit should delegate parameter looping to estimators

2017-05-23 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-20861. --- Resolution: Fixed Fix Version/s: 2.3.0 2.2.1 Issue resolved

[jira] [Commented] (SPARK-20861) Pyspark CrossValidator & TrainValidationSplit should delegate parameter looping to estimators

2017-05-23 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16022267#comment-16022267 ] Joseph K. Bradley commented on SPARK-20861: --- I targeted this at 2.2.1 and 2.3.0

[jira] [Updated] (SPARK-20861) Pyspark CrossValidator & TrainValidationSplit should delegate parameter looping to estimators

2017-05-23 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-20861: -- Target Version/s: 2.2.1, 2.3.0 (was: 2.2.1) > Pyspark CrossValidator & TrainValidation

[jira] [Assigned] (SPARK-20861) Pyspark CrossValidator & TrainValidationSplit should delegate parameter looping to estimators

2017-05-23 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reassigned SPARK-20861: - Assignee: Bago Amirbekian > Pyspark CrossValidator & TrainValidationSplit should

[jira] [Resolved] (SPARK-20850) Improve division and multiplication mixing process the data

2017-05-23 Thread caoxuewen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] caoxuewen resolved SPARK-20850. --- Resolution: Fixed > Improve division and multiplication mixing process the data > ---

[jira] [Commented] (SPARK-19256) Hive bucketing support

2017-05-23 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16022246#comment-16022246 ] Wenchen Fan commented on SPARK-19256: - let's wait for https://github.com/apache/spark

[jira] [Reopened] (SPARK-19900) [Standalone] Master registers application again when driver relaunched

2017-05-23 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reopened SPARK-19900: - > [Standalone] Master registers application again when driver relaunched > --

[jira] [Assigned] (SPARK-20863) Add metrics/instrumentation to LiveListenerBus

2017-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20863: Assignee: Apache Spark (was: Josh Rosen) > Add metrics/instrumentation to LiveListenerBus

[jira] [Assigned] (SPARK-20863) Add metrics/instrumentation to LiveListenerBus

2017-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20863: Assignee: Josh Rosen (was: Apache Spark) > Add metrics/instrumentation to LiveListenerBus

[jira] [Commented] (SPARK-20863) Add metrics/instrumentation to LiveListenerBus

2017-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16022192#comment-16022192 ] Apache Spark commented on SPARK-20863: -- User 'JoshRosen' has created a pull request

[jira] [Commented] (SPARK-20665) Spark-sql, "Bround" and "Round" function return NULL

2017-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16022182#comment-16022182 ] Apache Spark commented on SPARK-20665: -- User '10110346' has created a pull request f

[jira] [Assigned] (SPARK-20862) LogisticRegressionModel throws TypeError

2017-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20862: Assignee: Apache Spark > LogisticRegressionModel throws TypeError > --

[jira] [Assigned] (SPARK-20862) LogisticRegressionModel throws TypeError

2017-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20862: Assignee: (was: Apache Spark) > LogisticRegressionModel throws TypeError > ---

[jira] [Commented] (SPARK-20862) LogisticRegressionModel throws TypeError

2017-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16022179#comment-16022179 ] Apache Spark commented on SPARK-20862: -- User 'MrBago' has created a pull request for

[jira] [Created] (SPARK-20863) Add metrics/instrumentation to LiveListenerBus

2017-05-23 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-20863: -- Summary: Add metrics/instrumentation to LiveListenerBus Key: SPARK-20863 URL: https://issues.apache.org/jira/browse/SPARK-20863 Project: Spark Issue Type: New Fe

[jira] [Created] (SPARK-20862) LogisticRegressionModel throws TypeError

2017-05-23 Thread Bago Amirbekian (JIRA)
Bago Amirbekian created SPARK-20862: --- Summary: LogisticRegressionModel throws TypeError Key: SPARK-20862 URL: https://issues.apache.org/jira/browse/SPARK-20862 Project: Spark Issue Type: Bu

[jira] [Assigned] (SPARK-20771) Usability issues with weekofyear()

2017-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20771: Assignee: (was: Apache Spark) > Usability issues with weekofyear() > -

[jira] [Assigned] (SPARK-20771) Usability issues with weekofyear()

2017-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20771: Assignee: Apache Spark > Usability issues with weekofyear() >

[jira] [Commented] (SPARK-20771) Usability issues with weekofyear()

2017-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16022145#comment-16022145 ] Apache Spark commented on SPARK-20771: -- User 'setjet' has created a pull request for

[jira] [Assigned] (SPARK-10643) Support remote application download in client mode spark submit

2017-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10643: Assignee: (was: Apache Spark) > Support remote application download in client mode spa

[jira] [Assigned] (SPARK-10643) Support remote application download in client mode spark submit

2017-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10643: Assignee: Apache Spark > Support remote application download in client mode spark submit >

[jira] [Commented] (SPARK-10643) Support remote application download in client mode spark submit

2017-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16022143#comment-16022143 ] Apache Spark commented on SPARK-10643: -- User 'loneknightpy' has created a pull reque

[jira] [Commented] (SPARK-20861) Pyspark CrossValidator & TrainValidationSplit should delegate parameter looping to estimators

2017-05-23 Thread Bago Amirbekian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16022137#comment-16022137 ] Bago Amirbekian commented on SPARK-20861: - [~josephkb] > Pyspark CrossValidator

[jira] [Assigned] (SPARK-20861) Pyspark CrossValidator & TrainValidationSplit should delegate parameter looping to estimators

2017-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20861: Assignee: Apache Spark > Pyspark CrossValidator & TrainValidationSplit should delegate par

[jira] [Issue Comment Deleted] (SPARK-20861) Pyspark CrossValidator & TrainValidationSplit should delegate parameter looping to estimators

2017-05-23 Thread Bago Amirbekian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bago Amirbekian updated SPARK-20861: Comment: was deleted (was: I've made a PR to address this issue: https://github.com/apache

[jira] [Assigned] (SPARK-20861) Pyspark CrossValidator & TrainValidationSplit should delegate parameter looping to estimators

2017-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20861: Assignee: (was: Apache Spark) > Pyspark CrossValidator & TrainValidationSplit should d

[jira] [Commented] (SPARK-20861) Pyspark CrossValidator & TrainValidationSplit should delegate parameter looping to estimators

2017-05-23 Thread Bago Amirbekian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16022134#comment-16022134 ] Bago Amirbekian commented on SPARK-20861: - I've made a PR to address this issue:

[jira] [Commented] (SPARK-20861) Pyspark CrossValidator & TrainValidationSplit should delegate parameter looping to estimators

2017-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16022131#comment-16022131 ] Apache Spark commented on SPARK-20861: -- User 'MrBago' has created a pull request for

[jira] [Created] (SPARK-20861) Pyspark CrossValidator & TrainValidationSplit should delegate parameter looping to estimators

2017-05-23 Thread Bago Amirbekian (JIRA)
Bago Amirbekian created SPARK-20861: --- Summary: Pyspark CrossValidator & TrainValidationSplit should delegate parameter looping to estimators Key: SPARK-20861 URL: https://issues.apache.org/jira/browse/SPARK-2086

[jira] [Resolved] (SPARK-20860) Make spark-submit download remote files to local in client mode

2017-05-23 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-20860. Resolution: Duplicate > Make spark-submit download remote files to local in client mode > -

[jira] [Assigned] (SPARK-20841) Support table column aliases in FROM clause

2017-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20841: Assignee: Apache Spark > Support table column aliases in FROM clause > ---

[jira] [Assigned] (SPARK-20841) Support table column aliases in FROM clause

2017-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20841: Assignee: (was: Apache Spark) > Support table column aliases in FROM clause >

[jira] [Commented] (SPARK-20841) Support table column aliases in FROM clause

2017-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16022122#comment-16022122 ] Apache Spark commented on SPARK-20841: -- User 'maropu' has created a pull request for

[jira] [Assigned] (SPARK-20860) Make spark-submit download remote files to local in client mode

2017-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20860: Assignee: (was: Apache Spark) > Make spark-submit download remote files to local in cl

[jira] [Assigned] (SPARK-20860) Make spark-submit download remote files to local in client mode

2017-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20860: Assignee: Apache Spark > Make spark-submit download remote files to local in client mode >

[jira] [Commented] (SPARK-20860) Make spark-submit download remote files to local in client mode

2017-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16022120#comment-16022120 ] Apache Spark commented on SPARK-20860: -- User 'loneknightpy' has created a pull reque

[jira] [Created] (SPARK-20860) Make spark-submit download remote files to local in client mode

2017-05-23 Thread Yu Peng (JIRA)
Yu Peng created SPARK-20860: --- Summary: Make spark-submit download remote files to local in client mode Key: SPARK-20860 URL: https://issues.apache.org/jira/browse/SPARK-20860 Project: Spark Issue

[jira] [Commented] (SPARK-18406) Race between end-of-task and completion iterator read lock release

2017-05-23 Thread Yongqin Xiao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16022077#comment-16022077 ] Yongqin Xiao commented on SPARK-18406: -- Thanks for the fix. What spark release will

[jira] [Assigned] (SPARK-18406) Race between end-of-task and completion iterator read lock release

2017-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18406: Assignee: (was: Apache Spark) > Race between end-of-task and completion iterator read

[jira] [Commented] (SPARK-18406) Race between end-of-task and completion iterator read lock release

2017-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16022067#comment-16022067 ] Apache Spark commented on SPARK-18406: -- User 'jiangxb1987' has created a pull reques

[jira] [Assigned] (SPARK-18406) Race between end-of-task and completion iterator read lock release

2017-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18406: Assignee: Apache Spark > Race between end-of-task and completion iterator read lock releas

[jira] [Comment Edited] (SPARK-20307) SparkR: pass on setHandleInvalid to spark.mllib functions that use StringIndexer

2017-05-23 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16022049#comment-16022049 ] Miao Wang edited comment on SPARK-20307 at 5/23/17 11:16 PM: -

[jira] [Commented] (SPARK-20307) SparkR: pass on setHandleInvalid to spark.mllib functions that use StringIndexer

2017-05-23 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16022049#comment-16022049 ] Miao Wang commented on SPARK-20307: --- [~felixcheung] I will wait for [~wayen.zh...@263.n

[jira] [Comment Edited] (SPARK-15703) Make ListenerBus event queue size configurable

2017-05-23 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16013208#comment-16013208 ] Ruslan Dautkhanov edited comment on SPARK-15703 at 5/23/17 10:53 PM: --

[jira] [Commented] (SPARK-20859) SQL Loader does not recognize multidimensional columns in postgresql (like integer[]][])

2017-05-23 Thread Pablo Alcaraz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16022011#comment-16022011 ] Pablo Alcaraz commented on SPARK-20859: --- The patch on SPARK-14536 only works for un

[jira] [Created] (SPARK-20859) SQL Loader does not recognize multidimensional columns in postgresql (like integer[]][])

2017-05-23 Thread Pablo Alcaraz (JIRA)
Pablo Alcaraz created SPARK-20859: - Summary: SQL Loader does not recognize multidimensional columns in postgresql (like integer[]][]) Key: SPARK-20859 URL: https://issues.apache.org/jira/browse/SPARK-20859

[jira] [Commented] (SPARK-20847) Error reading NULL int[] element from postgres -- null pointer exception.

2017-05-23 Thread Pablo Alcaraz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16022004#comment-16022004 ] Pablo Alcaraz commented on SPARK-20847: --- This is fixed by SPARK-14536 in Spark 2.1.

[jira] [Commented] (SPARK-14536) NPE in JDBCRDD when array column contains nulls (postgresql)

2017-05-23 Thread Pablo Alcaraz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16022002#comment-16022002 ] Pablo Alcaraz commented on SPARK-14536: --- The fix is not accepting columns like inte

[jira] [Created] (SPARK-20858) Document ListenerBus event queue size property

2017-05-23 Thread Bjorn Jonsson (JIRA)
Bjorn Jonsson created SPARK-20858: - Summary: Document ListenerBus event queue size property Key: SPARK-20858 URL: https://issues.apache.org/jira/browse/SPARK-20858 Project: Spark Issue Type:

[jira] [Commented] (SPARK-18016) Code Generation: Constant Pool Past Limit for Wide/Nested Dataset

2017-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16021814#comment-16021814 ] Apache Spark commented on SPARK-18016: -- User 'bdrillard' has created a pull request

[jira] [Commented] (SPARK-4899) Support Mesos features: roles and checkpoints

2017-05-23 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16021766#comment-16021766 ] Michael Gummelt commented on SPARK-4899: [~drcrallen] Can you link me to the conve

[jira] [Commented] (SPARK-4899) Support Mesos features: roles and checkpoints

2017-05-23 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16021750#comment-16021750 ] Michael Gummelt commented on SPARK-4899: These are two separate features, which ne

[jira] [Resolved] (SPARK-15648) add TeradataDialect

2017-05-23 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-15648. - Resolution: Fixed Assignee: Kirby Linvill Fix Version/s: 2.3.0 > add TeradataDialect > --

[jira] [Closed] (SPARK-20853) spark.ui.reverseProxy=true leads to hanging communication to master

2017-05-23 Thread Alex Bozarth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alex Bozarth closed SPARK-20853. Resolution: Not A Problem > spark.ui.reverseProxy=true leads to hanging communication to master > -

[jira] [Commented] (SPARK-20853) spark.ui.reverseProxy=true leads to hanging communication to master

2017-05-23 Thread Alex Bozarth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16021636#comment-16021636 ] Alex Bozarth commented on SPARK-20853: -- Closing this as it is a question for the use

[jira] [Commented] (SPARK-20799) Unable to infer schema for ORC on reading ORC from S3

2017-05-23 Thread Jork Zijlstra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16021450#comment-16021450 ] Jork Zijlstra commented on SPARK-20799: --- [~dongjoon] I don't know since we don't us

[jira] [Resolved] (SPARK-20857) Generic resolved hint node

2017-05-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-20857. - Resolution: Fixed Fix Version/s: 2.2.0 > Generic resolved hint node >

[jira] [Commented] (SPARK-4921) TaskSetManager mistakenly returns PROCESS_LOCAL for NO_PREF tasks

2017-05-23 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16021417#comment-16021417 ] Nan Zhu commented on SPARK-4921: I forgot most of details...but the final conclusion was t

[jira] [Commented] (SPARK-20841) Support table column aliases in FROM clause

2017-05-23 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16021413#comment-16021413 ] Takeshi Yamamuro commented on SPARK-20841: -- I'll work on this. I feel we could i

[jira] [Commented] (SPARK-4921) TaskSetManager mistakenly returns PROCESS_LOCAL for NO_PREF tasks

2017-05-23 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16021410#comment-16021410 ] Imran Rashid commented on SPARK-4921: - I want to point out that this also results in r

[jira] [Closed] (SPARK-16209) Convert Hive Tables to Data Source Tables for CREATE TABLE AS SELECT

2017-05-23 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-16209. - Resolution: Won't Fix Hi, [~smilegator]. According to the discussion on PR, I'm closing this issu

[jira] [Commented] (SPARK-20851) Drop spark table failed if a column name is a numeric string

2017-05-23 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16021348#comment-16021348 ] Takeshi Yamamuro commented on SPARK-20851: -- I think we could use numeric strings

[jira] [Commented] (SPARK-20799) Unable to infer schema for ORC on reading ORC from S3

2017-05-23 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16021340#comment-16021340 ] Dongjoon Hyun commented on SPARK-20799: --- Hi, [~jzijlstra]. What about Parquet? > U

[jira] [Commented] (SPARK-15343) NoClassDefFoundError when initializing Spark with YARN

2017-05-23 Thread Bing Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16021310#comment-16021310 ] Bing Li commented on SPARK-15343: - The property in Yarn should be yarn.timeline-service.e

[jira] [Commented] (SPARK-20848) Dangling threads when reading parquet files in local mode

2017-05-23 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16021237#comment-16021237 ] Liang-Chi Hsieh commented on SPARK-20848: - Ok. It seems better not to change the

[jira] [Assigned] (SPARK-20848) Dangling threads when reading parquet files in local mode

2017-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20848: Assignee: Apache Spark > Dangling threads when reading parquet files in local mode > -

[jira] [Assigned] (SPARK-20848) Dangling threads when reading parquet files in local mode

2017-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20848: Assignee: (was: Apache Spark) > Dangling threads when reading parquet files in local m

[jira] [Commented] (SPARK-20848) Dangling threads when reading parquet files in local mode

2017-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16021236#comment-16021236 ] Apache Spark commented on SPARK-20848: -- User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-20857) Generic resolved hint node

2017-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20857: Assignee: Reynold Xin (was: Apache Spark) > Generic resolved hint node >

[jira] [Assigned] (SPARK-20857) Generic resolved hint node

2017-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20857: Assignee: Apache Spark (was: Reynold Xin) > Generic resolved hint node >

[jira] [Commented] (SPARK-20857) Generic resolved hint node

2017-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16021200#comment-16021200 ] Apache Spark commented on SPARK-20857: -- User 'rxin' has created a pull request for t

[jira] [Commented] (SPARK-20178) Improve Scheduler fetch failures

2017-05-23 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16021199#comment-16021199 ] Thomas Graves commented on SPARK-20178: --- | My understanding of today's code is that

[jira] [Updated] (SPARK-20857) Turn BroadcastHint into a more generic hint node

2017-05-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-20857: Summary: Turn BroadcastHint into a more generic hint node (was: Make BroadcastHint a more Resolved

[jira] [Created] (SPARK-20857) Make BroadcastHint a more ResolvedHint node

2017-05-23 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-20857: --- Summary: Make BroadcastHint a more ResolvedHint node Key: SPARK-20857 URL: https://issues.apache.org/jira/browse/SPARK-20857 Project: Spark Issue Type: Improve

[jira] [Updated] (SPARK-20857) Generic resolved hint node

2017-05-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-20857: Summary: Generic resolved hint node (was: Turn BroadcastHint into a more generic hint node) > Gen

[jira] [Commented] (SPARK-20848) Dangling threads when reading parquet files in local mode

2017-05-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16021186#comment-16021186 ] Sean Owen commented on SPARK-20848: --- Yes, possibly. The main tradeoff is that concurren

[jira] [Commented] (SPARK-20848) Dangling threads when reading parquet files in local mode

2017-05-23 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16021166#comment-16021166 ] Liang-Chi Hsieh commented on SPARK-20848: - It seems to me that to share the task

[jira] [Updated] (SPARK-20443) The blockSize of MLLIB ALS should be setting by the User

2017-05-23 Thread Peng Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peng Meng updated SPARK-20443: -- Attachment: blockSize.jpg blockSize and the performance of ALS recommendForAll > The blockSize of MLLI

[jira] [Created] (SPARK-20856) support statement using nested joins

2017-05-23 Thread N Campbell (JIRA)
N Campbell created SPARK-20856: -- Summary: support statement using nested joins Key: SPARK-20856 URL: https://issues.apache.org/jira/browse/SPARK-20856 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-20855) Update the Spark kinesis docs to use the KinesisInputDStream builder instead of deprecated KinesisUtils

2017-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20855: Assignee: Apache Spark > Update the Spark kinesis docs to use the KinesisInputDStream buil

[jira] [Assigned] (SPARK-20855) Update the Spark kinesis docs to use the KinesisInputDStream builder instead of deprecated KinesisUtils

2017-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20855: Assignee: (was: Apache Spark) > Update the Spark kinesis docs to use the KinesisInputD

[jira] [Commented] (SPARK-20855) Update the Spark kinesis docs to use the KinesisInputDStream builder instead of deprecated KinesisUtils

2017-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16021095#comment-16021095 ] Apache Spark commented on SPARK-20855: -- User 'yssharma' has created a pull request f

[jira] [Commented] (SPARK-20681) DataFram.Drop doesn't take effective, neither does error

2017-05-23 Thread lyc (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16021093#comment-16021093 ] lyc commented on SPARK-20681: - As said in spark source code, `drop` can only be used to drop

[jira] [Created] (SPARK-20855) Update the Spark kinesis docs to use the KinesisInputDStream builder instead of deprecated KinesisUtils

2017-05-23 Thread Yash Sharma (JIRA)
Yash Sharma created SPARK-20855: --- Summary: Update the Spark kinesis docs to use the KinesisInputDStream builder instead of deprecated KinesisUtils Key: SPARK-20855 URL: https://issues.apache.org/jira/browse/SPARK-20

[jira] [Resolved] (SPARK-20838) Spark ML ngram feature extractor should support ngram range like scikit

2017-05-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20838. --- Resolution: Duplicate > Spark ML ngram feature extractor should support ngram range like scikit > ---

[jira] [Resolved] (SPARK-13819) using a regexp_replace in a group by clause raises a nullpointerexception

2017-05-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13819. --- Resolution: Duplicate > using a regexp_replace in a group by clause raises a nullpointerexception > -

[jira] [Commented] (SPARK-13819) using a regexp_replace in a group by clause raises a nullpointerexception

2017-05-23 Thread DazhuangSu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16021024#comment-16021024 ] DazhuangSu commented on SPARK-13819: This is a duplicate of https://issues.apache.org

[jira] [Created] (SPARK-20854) extend hint syntax to support any expression, not just identifiers or strings

2017-05-23 Thread Bogdan Raducanu (JIRA)
Bogdan Raducanu created SPARK-20854: --- Summary: extend hint syntax to support any expression, not just identifiers or strings Key: SPARK-20854 URL: https://issues.apache.org/jira/browse/SPARK-20854 P

[jira] [Closed] (SPARK-20852) NullPointerException on distinct (Dataset)

2017-05-23 Thread Paride Casulli (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paride Casulli closed SPARK-20852. -- Resolution: Duplicate duplicate issue of https://issues.apache.org/jira/browse/SPARK-18528 > N

[jira] [Commented] (SPARK-20852) NullPointerException on distinct (Dataset)

2017-05-23 Thread Paride Casulli (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16020994#comment-16020994 ] Paride Casulli commented on SPARK-20852: Thank you Sean, you're right, without li

[jira] [Commented] (SPARK-20713) Speculative task that got CommitDenied exception shows up as failed

2017-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16020984#comment-16020984 ] Apache Spark commented on SPARK-20713: -- User 'liyichao' has created a pull request f

[jira] [Assigned] (SPARK-20713) Speculative task that got CommitDenied exception shows up as failed

2017-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20713: Assignee: (was: Apache Spark) > Speculative task that got CommitDenied exception shows

[jira] [Assigned] (SPARK-20713) Speculative task that got CommitDenied exception shows up as failed

2017-05-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20713: Assignee: Apache Spark > Speculative task that got CommitDenied exception shows up as fail

  1   2   >