[jira] [Commented] (SPARK-19743) Exception when creating more than one implicit Encoder in REPL

2018-01-05 Thread Mark Petruska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16313018#comment-16313018 ] Mark Petruska commented on SPARK-19743: --- Could not reproduce the problem on the current master

[jira] [Commented] (SPARK-20706) Spark-shell not overriding method/variable definition

2017-12-04 Thread Mark Petruska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16276921#comment-16276921 ] Mark Petruska commented on SPARK-20706: --- This is a Scala repl bug, see:

[jira] [Commented] (SPARK-22267) Spark SQL incorrectly reads ORC file when column order is different

2017-12-01 Thread Mark Petruska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274588#comment-16274588 ] Mark Petruska commented on SPARK-22267: --- All evidence suggests that this is a hive bug. In

[jira] [Commented] (SPARK-22267) Spark SQL incorrectly reads ORC file when column order is different

2017-12-01 Thread Mark Petruska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16274447#comment-16274447 ] Mark Petruska commented on SPARK-22267: --- Hi [~dongjoon], sorry for the late reply. I do not have a

[jira] [Commented] (SPARK-22393) spark-shell can't find imported types in class constructors, extends clause

2017-11-29 Thread Mark Petruska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16270912#comment-16270912 ] Mark Petruska commented on SPARK-22393: --- [~srowen], [~rdub], I can now confirm that the original

[jira] [Commented] (SPARK-22393) spark-shell can't find imported types in class constructors, extends clause

2017-11-29 Thread Mark Petruska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16270605#comment-16270605 ] Mark Petruska commented on SPARK-22393: --- Based on the comments above and the comments in the Scala

[jira] [Commented] (SPARK-22393) spark-shell can't find imported types in class constructors, extends clause

2017-11-25 Thread Mark Petruska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16265666#comment-16265666 ] Mark Petruska commented on SPARK-22393: --- I believe the scala repl fix would also fix this. Forcing

[jira] [Commented] (SPARK-22393) spark-shell can't find imported types in class constructors, extends clause

2017-11-24 Thread Mark Petruska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16265445#comment-16265445 ] Mark Petruska commented on SPARK-22393: --- Created a PR to retrofit the fix to scala repl 2.11:

[jira] [Commented] (SPARK-22393) spark-shell can't find imported types in class constructors, extends clause

2017-11-24 Thread Mark Petruska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16265401#comment-16265401 ] Mark Petruska commented on SPARK-22393: --- The fix for this went into the 2.12 branch of scala:

[jira] [Commented] (SPARK-22393) spark-shell can't find imported types in class constructors, extends clause

2017-11-24 Thread Mark Petruska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16265398#comment-16265398 ] Mark Petruska commented on SPARK-22393: --- https://github.com/scala/bug/issues/9881 > spark-shell

[jira] [Commented] (SPARK-22393) spark-shell can't find imported types in class constructors, extends clause

2017-11-24 Thread Mark Petruska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16265394#comment-16265394 ] Mark Petruska commented on SPARK-22393: --- Proof for the above statement: Tracing the import handler

[jira] [Commented] (SPARK-22393) spark-shell can't find imported types in class constructors, extends clause

2017-11-24 Thread Mark Petruska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16265385#comment-16265385 ] Mark Petruska commented on SPARK-22393: --- After digging in deeper, I found that there is a high

[jira] [Commented] (SPARK-22393) spark-shell can't find imported types in class constructors, extends clause

2017-11-23 Thread Mark Petruska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16264102#comment-16264102 ] Mark Petruska commented on SPARK-22393: --- The problem is also reproducible with non-spark related

[jira] [Commented] (SPARK-22267) Spark SQL incorrectly reads ORC file when column order is different

2017-11-22 Thread Mark Petruska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262850#comment-16262850 ] Mark Petruska commented on SPARK-22267: --- Hi [~dongjoon], I see that both issues mentioned are in

[jira] [Commented] (SPARK-22572) spark-shell does not re-initialize on :replay

2017-11-21 Thread Mark Petruska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16260759#comment-16260759 ] Mark Petruska commented on SPARK-22572: --- [~srowen]: Can I ask you to look at

[jira] [Created] (SPARK-22572) spark-shell does not re-initialize on :replay

2017-11-21 Thread Mark Petruska (JIRA)
Mark Petruska created SPARK-22572: - Summary: spark-shell does not re-initialize on :replay Key: SPARK-22572 URL: https://issues.apache.org/jira/browse/SPARK-22572 Project: Spark Issue Type:

[jira] [Commented] (SPARK-22393) spark-shell can't find imported types in class constructors, extends clause

2017-11-19 Thread Mark Petruska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16258476#comment-16258476 ] Mark Petruska commented on SPARK-22393: --- Trace of the 2.11 version: {code} ... parse(" class

[jira] [Commented] (SPARK-22393) spark-shell can't find imported types in class constructors, extends clause

2017-11-19 Thread Mark Petruska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16258469#comment-16258469 ] Mark Petruska commented on SPARK-22393: --- The difference between scala repls 2.11 and 2.12 is seen

[jira] [Commented] (SPARK-22393) spark-shell can't find imported types in class constructors, extends clause

2017-11-19 Thread Mark Petruska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16258468#comment-16258468 ] Mark Petruska commented on SPARK-22393: --- With the 2.12 build: {code} import

[jira] [Commented] (SPARK-22393) spark-shell can't find imported types in class constructors, extends clause

2017-11-19 Thread Mark Petruska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16258441#comment-16258441 ] Mark Petruska commented on SPARK-22393: --- Tested with spark-shell build 2.11: {code} import

[jira] [Commented] (SPARK-22267) Spark SQL incorrectly reads ORC file when column order is different

2017-11-16 Thread Mark Petruska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255112#comment-16255112 ] Mark Petruska commented on SPARK-22267: --- Hi [~dongjoon], I can confirm that reading from an ORC

[jira] [Commented] (SPARK-22267) Spark SQL incorrectly reads ORC file when column order is different

2017-11-15 Thread Mark Petruska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16253281#comment-16253281 ] Mark Petruska commented on SPARK-22267: --- Investigated the issue; unfortunately did not find any