[jira] [Commented] (SPARK-1948) Scalac crashes when building Spark in IntelliJ IDEA
[
https://issues.apache.org/jira/browse/SPARK-1948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14012416#comment-14012416
]
Cheng Lian commented on SPARK-1948:
---
Yea, I've closed this issue. Also worked out the Maven way, was blocked by
wrong proxy settings which lead to dependency resolution failure. Thanks a lot
for the help!
> Scalac crashes when building Spark in IntelliJ IDEA
> ---
>
> Key: SPARK-1948
> URL: https://issues.apache.org/jira/browse/SPARK-1948
> Project: Spark
> Issue Type: Bug
> Components: Build
>Affects Versions: 1.0.0
>Reporter: Cheng Lian
>Priority: Minor
> Attachments: scalac-crash.log
>
>
> After [commit 0be8b45|https://github.com/apache/spark/commit/0be8b45], the
> master branch fails to compile within IntelliJ IDEA and causes {{scalac}} to
> crash. But building Spark with SBT is OK. This issue is not blocking, but
> it's annoying since it prevents developers from debugging Spark within IDEA.
> I can't figure out the exact reason, only nailed down to this commit with
> binary searching. Maybe I should fire a bug issue to IDEA instead?
> How to reproduce:
> # Checkout [commit 0be8b45|https://github.com/apache/spark/commit/0be8b45]
> # Run {{sbt/sbt clean gen-idea}} under Spark source directory
> # Open the project in IntelliJ IDEA
> # Build the project
> The {{scalac}} crash report is attached.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (SPARK-1948) Scalac crashes when building Spark in IntelliJ IDEA
[
https://issues.apache.org/jira/browse/SPARK-1948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14012369#comment-14012369
]
Sean Owen commented on SPARK-1948:
--
OK, maybe you can resolve this, if it's not a Spark issue?
Separately, if you have problems with the Maven build maybe I can help offline.
> Scalac crashes when building Spark in IntelliJ IDEA
> ---
>
> Key: SPARK-1948
> URL: https://issues.apache.org/jira/browse/SPARK-1948
> Project: Spark
> Issue Type: Bug
> Components: Build
>Affects Versions: 1.0.0
>Reporter: Cheng Lian
>Priority: Minor
> Attachments: scalac-crash.log
>
>
> After [commit 0be8b45|https://github.com/apache/spark/commit/0be8b45], the
> master branch fails to compile within IntelliJ IDEA and causes {{scalac}} to
> crash. But building Spark with SBT is OK. This issue is not blocking, but
> it's annoying since it prevents developers from debugging Spark within IDEA.
> I can't figure out the exact reason, only nailed down to this commit with
> binary searching. Maybe I should fire a bug issue to IDEA instead?
> How to reproduce:
> # Checkout [commit 0be8b45|https://github.com/apache/spark/commit/0be8b45]
> # Run {{sbt/sbt clean gen-idea}} under Spark source directory
> # Open the project in IntelliJ IDEA
> # Build the project
> The {{scalac}} crash report is attached.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (SPARK-1948) Scalac crashes when building Spark in IntelliJ IDEA
[
https://issues.apache.org/jira/browse/SPARK-1948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14012366#comment-14012366
]
Cheng Lian commented on SPARK-1948:
---
Hi [~sowen], thanks for the suggestion! I tried to switch to Maven, but it
wasn't that smooth as expected, so I took sometime to investigate this issue.
At last it seems to be a bug of the {{sbt-idea}} plugin.
The {{.idea/libraries/SBT__org_apache_mesos_0_18_1.xml}} file generated by
{{sbt gen-idea}} declares both {{mesos-0.18.1.jar}} and
{{mesos-0.18.1-shaded-protobuf.jar}} in the {{CLASSES}} elements:
{code}
{code}
On the other hand, running {{show core/dependencyClasspath}} in SBT only shows
the latter one, which means SBT only refers to the shaded one to build the
project.
Removing the non-shaded Mesos jar file from IDEA project settings leads
everything to peace:
# Run {{sbt/sbt gen-idea}}
# Open the project in IDEA
# Click the "File / Project Structure..." menu item
# Locate the "SBT: org.apache.mesos:mesos:0.18.1" dependency along the UI path
"Project Settings / Modules / core / Dependencies"
# Click the "Edit" button (with a pen icon)
# Remove the non-shaded jar file from "Classes"
Now build Spark within IDEA, everything should be fine.
> Scalac crashes when building Spark in IntelliJ IDEA
> ---
>
> Key: SPARK-1948
> URL: https://issues.apache.org/jira/browse/SPARK-1948
> Project: Spark
> Issue Type: Bug
> Components: Build
>Affects Versions: 1.0.0
>Reporter: Cheng Lian
>Priority: Minor
> Attachments: scalac-crash.log
>
>
> After [commit 0be8b45|https://github.com/apache/spark/commit/0be8b45], the
> master branch fails to compile within IntelliJ IDEA and causes {{scalac}} to
> crash. But building Spark with SBT is OK. This issue is not blocking, but
> it's annoying since it prevents developers from debugging Spark within IDEA.
> I can't figure out the exact reason, only nailed down to this commit with
> binary searching. Maybe I should fire a bug issue to IDEA instead?
> How to reproduce:
> # Checkout [commit 0be8b45|https://github.com/apache/spark/commit/0be8b45]
> # Run {{sbt/sbt clean gen-idea}} under Spark source directory
> # Open the project in IntelliJ IDEA
> # Build the project
> The {{scalac}} crash report is attached.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (SPARK-1948) Scalac crashes when building Spark in IntelliJ IDEA
[
https://issues.apache.org/jira/browse/SPARK-1948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14011134#comment-14011134
]
Sean Owen commented on SPARK-1948:
--
This is likely a scalac or IntelliJ problem, indeed. I always use the Maven
build directly with IntelliJ. Does that work for you?
> Scalac crashes when building Spark in IntelliJ IDEA
> ---
>
> Key: SPARK-1948
> URL: https://issues.apache.org/jira/browse/SPARK-1948
> Project: Spark
> Issue Type: Bug
> Components: Build
>Affects Versions: 1.0.0
>Reporter: Cheng Lian
>Priority: Minor
> Attachments: scalac-crash.log
>
>
> After [commit 0be8b45|https://github.com/apache/spark/commit/0be8b45], the
> master branch fails to compile within IntelliJ IDEA and causes {{scalac}} to
> crash. But building Spark with SBT is OK. This issue is not blocking, but
> it's annoying since it prevents developers from debugging Spark within IDEA.
> I can't figure out the exact reason, only nailed down to this commit with
> binary searching. Maybe I should fire a bug issue to IDEA instead?
> How to reproduce:
> # Checkout [commit 0be8b45|https://github.com/apache/spark/commit/0be8b45]
> # Run {{sbt/sbt clean gen-idea}} under Spark source directory
> # Open the project in IntelliJ IDEA
> # Build the project
> The {{scalac}} crash report is attached.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
