[jira] [Commented] (SPARK-35242) Support change catalog default database for spark

2022-01-04 Thread Shawn Guo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17468968#comment-17468968 ] Shawn Guo commented on SPARK-35242: --- any update?   > Support change catalog default database for

[jira] [Commented] (SPARK-12513) SocketReceiver hang in Netcat example

2015-12-23 Thread Shawn Guo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070548#comment-15070548 ] Shawn Guo commented on SPARK-12513: --- Close client side socket connection before restart socket

[jira] [Updated] (SPARK-12513) SocketReceiver hang in Netcat example

2015-12-23 Thread Shawn Guo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shawn Guo updated SPARK-12513: -- Component/s: Streaming > SocketReceiver hang in Netcat example > -

[jira] [Updated] (SPARK-12513) SocketReceiver hang in Netcat example

2015-12-23 Thread Shawn Guo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shawn Guo updated SPARK-12513: -- Description: I add a SocketReceiver test based on the NetworkWordCount. Using pipeline and tail the

[jira] [Updated] (SPARK-12513) SocketReceiver hang in Netcat example

2015-12-23 Thread Shawn Guo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shawn Guo updated SPARK-12513: -- Description: I add a SocketReceiver test based on the NetworkWordCount. Using pipeline and tail the

[jira] [Created] (SPARK-12513) SocketReceiver hang in Netcat example

2015-12-23 Thread Shawn Guo (JIRA)
Shawn Guo created SPARK-12513: - Summary: SocketReceiver hang in Netcat example Key: SPARK-12513 URL: https://issues.apache.org/jira/browse/SPARK-12513 Project: Spark Issue Type: Bug Affects

[jira] [Commented] (SPARK-7725) --py-files doesn't seem to work in YARN cluster mode

2015-05-29 Thread Shawn Guo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564415#comment-14564415 ] Shawn Guo commented on SPARK-7725: -- Could you paste the discussion url? I met same issue

[jira] [Updated] (SPARK-4533) SchemaRDD Api error: Can only subtract another SchemaRDD

2014-11-27 Thread Shawn Guo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shawn Guo updated SPARK-4533: - Summary: SchemaRDD Api error: Can only subtract another SchemaRDD (was: Can only subtract another

[jira] [Updated] (SPARK-4533) SchemaRDD API error: Can only subtract another SchemaRDD

2014-11-27 Thread Shawn Guo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shawn Guo updated SPARK-4533: - Summary: SchemaRDD API error: Can only subtract another SchemaRDD (was: SchemaRDD Api error: Can only

[jira] [Created] (SPARK-4533) Can only subtract another SchemaRDD

2014-11-21 Thread Shawn Guo (JIRA)
Shawn Guo created SPARK-4533: Summary: Can only subtract another SchemaRDD Key: SPARK-4533 URL: https://issues.apache.org/jira/browse/SPARK-4533 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-3581) RDD API(distinct/subtract) does not work for RDD of Dictionaries

2014-09-18 Thread Shawn Guo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shawn Guo updated SPARK-3581: - Affects Version/s: 1.0.0 1.0.2 RDD API(distinct/subtract) does not work for RDD

[jira] [Commented] (SPARK-3321) Defining a class within python main script

2014-09-18 Thread Shawn Guo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14138569#comment-14138569 ] Shawn Guo commented on SPARK-3321: -- No idea yet, I use --py-files Null.py instead. it

[jira] [Commented] (SPARK-3581) RDD API(distinct/subtract) does not work for RDD of Dictionaries

2014-09-18 Thread Shawn Guo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14139902#comment-14139902 ] Shawn Guo commented on SPARK-3581: -- Yes, please. Thanks for clarification. RDD

[jira] [Commented] (SPARK-3321) Defining a class within python main script

2014-09-18 Thread Shawn Guo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14139903#comment-14139903 ] Shawn Guo commented on SPARK-3321: -- Yes please, thanks for clarification. Defining a

[jira] [Created] (SPARK-3581) RDD API(distinct/subtract) does not work for RDD of Dictionaries

2014-09-17 Thread Shawn Guo (JIRA)
Shawn Guo created SPARK-3581: Summary: RDD API(distinct/subtract) does not work for RDD of Dictionaries Key: SPARK-3581 URL: https://issues.apache.org/jira/browse/SPARK-3581 Project: Spark

[jira] [Updated] (SPARK-3581) RDD API(distinct/subtract) does not work for RDD of Dictionaries

2014-09-17 Thread Shawn Guo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shawn Guo updated SPARK-3581: - Description: Construct a RDD of dictionaries(dictRDD), try to use the RDD API, RDD.distinct() or

[jira] [Updated] (SPARK-3581) RDD API(distinct/subtract) does not work for RDD of Dictionaries

2014-09-17 Thread Shawn Guo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shawn Guo updated SPARK-3581: - Description: Construct a RDD of dictionaries(dictRDD), try to use the RDD API, RDD.distinct() or

[jira] [Updated] (SPARK-3321) Defining a class within python main script

2014-09-07 Thread Shawn Guo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shawn Guo updated SPARK-3321: - Priority: Minor (was: Critical) Defining a class within python main script

[jira] [Updated] (SPARK-3321) Defining a class within python main script

2014-08-30 Thread Shawn Guo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shawn Guo updated SPARK-3321: - Priority: Critical (was: Blocker) Defining a class within python main script

[jira] [Created] (SPARK-3321) Defining a class within python main script

2014-08-29 Thread Shawn Guo (JIRA)
Shawn Guo created SPARK-3321: Summary: Defining a class within python main script Key: SPARK-3321 URL: https://issues.apache.org/jira/browse/SPARK-3321 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-3321) Defining a class within python main script

2014-08-29 Thread Shawn Guo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shawn Guo updated SPARK-3321: - Description: *leftOuterJoin(self, other, numPartitions=None)* Perform a left outer join of self and