[jira] [Closed] (SPARK-17411) Cannot set fromOffsets in createDirectStream function

[ https://issues.apache.org/jira/browse/SPARK-17411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Milanowski closed SPARK-17411. Resolution: Fixed Duplicate of https://issues.apache.org/jira/browse/SPARK-16950 > Cannot

[jira] [Commented] (SPARK-17411) Cannot set fromOffsets in createDirectStream function

[ https://issues.apache.org/jira/browse/SPARK-17411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15467469#comment-15467469 ] Piotr Milanowski commented on SPARK-17411: -- I'll just add that I am using Python 3.5 and

[jira] [Created] (SPARK-17411) Cannot set fromOffsets in createDirectStream function

Piotr Milanowski created SPARK-17411: Summary: Cannot set fromOffsets in createDirectStream function Key: SPARK-17411 URL: https://issues.apache.org/jira/browse/SPARK-17411 Project: Spark

[jira] [Commented] (SPARK-15920) Using map on DataFrame

[ https://issues.apache.org/jira/browse/SPARK-15920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15454634#comment-15454634 ] Piotr Milanowski commented on SPARK-15920: -- That is why I used PySpark in components. This

[jira] [Comment Edited] (SPARK-16224) Hive context created by HiveContext can't access Hive databases when used in a script launched be spark-submit

[ https://issues.apache.org/jira/browse/SPARK-16224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15356932#comment-15356932 ] Piotr Milanowski edited comment on SPARK-16224 at 6/30/16 11:32 AM:

[jira] [Closed] (SPARK-16224) Hive context created by HiveContext can't access Hive databases when used in a script launched be spark-submit

[ https://issues.apache.org/jira/browse/SPARK-16224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Milanowski closed SPARK-16224. Resolved by with https://github.com/apache/spark/pull/13931 > Hive context created by

[jira] [Commented] (SPARK-16224) Hive context created by HiveContext can't access Hive databases when used in a script launched be spark-submit

[ https://issues.apache.org/jira/browse/SPARK-16224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15352602#comment-15352602 ] Piotr Milanowski commented on SPARK-16224: -- Hi, Tested your changes. It seems to work, now both

[jira] [Commented] (SPARK-15345) SparkSession's conf doesn't take effect when there's already an existing SparkContext

[ https://issues.apache.org/jira/browse/SPARK-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15350526#comment-15350526 ] Piotr Milanowski commented on SPARK-15345: -- I created a separate issue for this:

[jira] [Comment Edited] (SPARK-15345) SparkSession's conf doesn't take effect when there's already an existing SparkContext

[ https://issues.apache.org/jira/browse/SPARK-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15350524#comment-15350524 ] Piotr Milanowski edited comment on SPARK-15345 at 6/27/16 7:37 AM: ---

[jira] [Commented] (SPARK-15345) SparkSession's conf doesn't take effect when there's already an existing SparkContext

[ https://issues.apache.org/jira/browse/SPARK-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15350524#comment-15350524 ] Piotr Milanowski commented on SPARK-15345: -- Yes, hive-site.xml exists and contains information

[jira] [Created] (SPARK-16224) Hive context created by HiveContext can't access Hive databases when used in a script launched be spark-submit

Piotr Milanowski created SPARK-16224: Summary: Hive context created by HiveContext can't access Hive databases when used in a script launched be spark-submit Key: SPARK-16224 URL:

[jira] [Commented] (SPARK-15345) SparkSession's conf doesn't take effect when there's already an existing SparkContext

[ https://issues.apache.org/jira/browse/SPARK-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15345999#comment-15345999 ] Piotr Milanowski commented on SPARK-15345: -- Please note, that the issue I raised in my last

[jira] [Commented] (SPARK-15345) SparkSession's conf doesn't take effect when there's already an existing SparkContext

[ https://issues.apache.org/jira/browse/SPARK-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15329023#comment-15329023 ] Piotr Milanowski commented on SPARK-15345: -- [~hvanhovell] Thanks, I corrected it. But this is

[jira] [Comment Edited] (SPARK-15345) SparkSession's conf doesn't take effect when there's already an existing SparkContext

[ https://issues.apache.org/jira/browse/SPARK-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15327152#comment-15327152 ] Piotr Milanowski edited comment on SPARK-15345 at 6/14/16 7:34 AM: ---

[jira] [Comment Edited] (SPARK-15345) SparkSession's conf doesn't take effect when there's already an existing SparkContext

[ https://issues.apache.org/jira/browse/SPARK-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15327152#comment-15327152 ] Piotr Milanowski edited comment on SPARK-15345 at 6/14/16 7:32 AM: ---

[jira] [Closed] (SPARK-15293) 'collect_list' function undefined

[ https://issues.apache.org/jira/browse/SPARK-15293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Milanowski closed SPARK-15293. Works fine, thanks. > 'collect_list' function undefined > - >

[jira] [Created] (SPARK-15920) Using map on DataFrame

Piotr Milanowski created SPARK-15920: Summary: Using map on DataFrame Key: SPARK-15920 URL: https://issues.apache.org/jira/browse/SPARK-15920 Project: Spark Issue Type: Bug

[jira] [Reopened] (SPARK-15345) SparkSession's conf doesn't take effect when there's already an existing SparkContext

[ https://issues.apache.org/jira/browse/SPARK-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Milanowski reopened SPARK-15345: -- Does not work as expected when using spark-submit; for example, this works fine and

[jira] [Closed] (SPARK-15345) SparkSession's conf doesn't take effect when there's already an existing SparkContext

[ https://issues.apache.org/jira/browse/SPARK-15345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Milanowski closed SPARK-15345. Databases can be accessed and created after proposed changes. > SparkSession's conf doesn't

[jira] [Closed] (SPARK-15445) Build fails for java 1.7 after adding java.math.BigInteger support [SPARK-11827][SQL]

[ https://issues.apache.org/jira/browse/SPARK-15445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Milanowski closed SPARK-15445. System builds with java 1.7 with no problems > Build fails for java 1.7 after adding

[jira] [Created] (SPARK-15445) Build fails for java 1.7 after adding java.math.BigInteger support [SPARK-11827][SQL]

Piotr Milanowski created SPARK-15445: Summary: Build fails for java 1.7 after adding java.math.BigInteger support [SPARK-11827][SQL] Key: SPARK-15445 URL: https://issues.apache.org/jira/browse/SPARK-15445

[jira] [Created] (SPARK-15345) Cannot connect to Hive databases

Piotr Milanowski created SPARK-15345: Summary: Cannot connect to Hive databases Key: SPARK-15345 URL: https://issues.apache.org/jira/browse/SPARK-15345 Project: Spark Issue Type: Bug

[jira] [Closed] (SPARK-15289) SQL test compilation error from merge conflict

[ https://issues.apache.org/jira/browse/SPARK-15289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Milanowski closed SPARK-15289. Issue has been fixed. Spark builds normally > SQL test compilation error from merge conflict

[jira] [Closed] (SPARK-15270) Creating HiveContext does not work

[ https://issues.apache.org/jira/browse/SPARK-15270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Milanowski closed SPARK-15270. Last chage seems to fix the problem. > Creating HiveContext does not work >

[jira] [Updated] (SPARK-15293) 'collect_list' function undefined

[ https://issues.apache.org/jira/browse/SPARK-15293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Milanowski updated SPARK-15293: - Description: When using pyspark.sql.functions.collect_list function in sql queries, an

[jira] [Updated] (SPARK-15293) 'collect_list' function undefined

[ https://issues.apache.org/jira/browse/SPARK-15293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Milanowski updated SPARK-15293: - Description: When using pyspark.sql.functions.collect_list function in sql queries, an

[jira] [Created] (SPARK-15293) 'collect_list' function undefined

Piotr Milanowski created SPARK-15293: Summary: 'collect_list' function undefined Key: SPARK-15293 URL: https://issues.apache.org/jira/browse/SPARK-15293 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-15289) spark fails build

Piotr Milanowski created SPARK-15289: Summary: spark fails build Key: SPARK-15289 URL: https://issues.apache.org/jira/browse/SPARK-15289 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-15270) Creating HiveContext does not work

Piotr Milanowski created SPARK-15270: Summary: Creating HiveContext does not work Key: SPARK-15270 URL: https://issues.apache.org/jira/browse/SPARK-15270 Project: Spark Issue Type: Bug