Re: Cannot find checkstyle.xml

2017-02-14 Thread Jakub Dubovsky 
Somebody is able to help with this? I am stuck on this in my attempt to
help solve issues:

SPARK-16599 <https://issues.apache.org/jira/browse/SPARK-16599>
sparkNB-807 <https://github.com/andypetrella/spark-notebook/issues/807>

Thanks

On Thu, Feb 9, 2017 at 10:18 AM, Jakub Dubovsky <
spark.dubovsky.ja...@gmail.com> wrote:

> Thanks Ted for trying. (see below for Ted's reply). Con somebody confirm
> that this is not an expected behaviour? Is there somebody else having same
> issue?
>
> Thanks!
>
>
> On Wed, Feb 8, 2017 at 11:42 PM, Ted Yu <yuzhih...@gmail.com> wrote:
>
>> Using your command, I got:
>>
>> Caused by: org.apache.maven.project.DependencyResolutionException: Could
>> not resolve dependencies for project 
>> org.apache.spark:spark-launcher_2.11:jar:2.1.0:
>> Could not find artifact org.apache.hadoop:hadoop-client:jar:2.6.0-cdh5.7.1
>> in central (https://repo1.maven.org/maven2)
>> at org.apache.maven.project.DefaultProjectDependenciesResolver.
>> resolve(DefaultProjectDependenciesResolver.java:211)
>> at org.apache.maven.lifecycle.internal.LifecycleDependencyResol
>> ver.getDependencies(LifecycleDependencyResolver.java:195)
>> ... 23 more
>>
>> So I switched to:
>>
>> ./build/mvn -Phadoop-2.7 -Phive -Phive-thriftserver -Pyarn -DskipTests -e
>> clean install
>>
>> With your change to pom.xml, I got the same error.
>>
>> Without change to pom.xml, the build continues.
>>
>> On Wed, Feb 8, 2017 at 8:19 AM, Jakub Dubovsky <
>> spark.dubovsky.ja...@gmail.com> wrote:
>>
>>> Sorry, correct links set in text below.
>>>
>>>
>>> Hello there,
>>>>
>>>> I am trying to build spark locally so I can test something to help
>>>> resolve this ticket <https://issues.apache.org/jira/browse/SPARK-16599>
>>>> .
>>>>
>>>> git checkout v2.1.0
>>>> ./build/mvn -Phadoop-2.6 -Phive -Phive-thriftserver -Pyarn
>>>> -Dhadoop.version=2.6.0-cdh5.7.1 -DskipTests -e clean install
>>>>
>>>> This starts the build successfully. Then I changed one source file and
>>>> a version in pom.xml (exact diff
>>>> <https://gist.github.com/james64/cc158bdb81bc1828937c757fde94ce82>).
>>>> After this change when I run the same build command as above I get failure:
>>>>
>>>> Could not find resource 'dev/checkstyle.xml'
>>>>
>>>> whole build log
>>>> <https://gist.github.com/james64/85b3bf4613e7105bebd687502258a518>
>>>>
>>>> How this one commit change can cause this error? checkstyle.xml is
>>>> still there. I run maven from project root in both cases. What should I
>>>> change to build this?
>>>>
>>>> Thanks for your help
>>>>
>>>> Jakub
>>>>
>>>>
>>>
>>
>

Re: Cannot find checkstyle.xml

2017-02-09 Thread Jakub Dubovsky 
Thanks Ted for trying. (see below for Ted's reply). Con somebody confirm
that this is not an expected behaviour? Is there somebody else having same
issue?

Thanks!

On Wed, Feb 8, 2017 at 11:42 PM, Ted Yu <yuzhih...@gmail.com> wrote:

> Using your command, I got:
>
> Caused by: org.apache.maven.project.DependencyResolutionException: Could
> not resolve dependencies for project 
> org.apache.spark:spark-launcher_2.11:jar:2.1.0:
> Could not find artifact org.apache.hadoop:hadoop-client:jar:2.6.0-cdh5.7.1
> in central (https://repo1.maven.org/maven2)
> at org.apache.maven.project.DefaultProjectDependenciesResolver.
> resolve(DefaultProjectDependenciesResolver.java:211)
> at org.apache.maven.lifecycle.internal.LifecycleDependencyResol
> ver.getDependencies(LifecycleDependencyResolver.java:195)
> ... 23 more
>
> So I switched to:
>
> ./build/mvn -Phadoop-2.7 -Phive -Phive-thriftserver -Pyarn -DskipTests -e
> clean install
>
> With your change to pom.xml, I got the same error.
>
> Without change to pom.xml, the build continues.
>
> On Wed, Feb 8, 2017 at 8:19 AM, Jakub Dubovsky <
> spark.dubovsky.ja...@gmail.com> wrote:
>
>> Sorry, correct links set in text below.
>>
>>
>> Hello there,
>>>
>>> I am trying to build spark locally so I can test something to help
>>> resolve this ticket <https://issues.apache.org/jira/browse/SPARK-16599>.
>>>
>>> git checkout v2.1.0
>>> ./build/mvn -Phadoop-2.6 -Phive -Phive-thriftserver -Pyarn
>>> -Dhadoop.version=2.6.0-cdh5.7.1 -DskipTests -e clean install
>>>
>>> This starts the build successfully. Then I changed one source file and a
>>> version in pom.xml (exact diff
>>> <https://gist.github.com/james64/cc158bdb81bc1828937c757fde94ce82>).
>>> After this change when I run the same build command as above I get failure:
>>>
>>> Could not find resource 'dev/checkstyle.xml'
>>>
>>> whole build log
>>> <https://gist.github.com/james64/85b3bf4613e7105bebd687502258a518>
>>>
>>> How this one commit change can cause this error? checkstyle.xml is still
>>> there. I run maven from project root in both cases. What should I change to
>>> build this?
>>>
>>> Thanks for your help
>>>
>>> Jakub
>>>
>>>
>>
>

Re: Cannot find checkstyle.xml

2017-02-08 Thread Jakub Dubovsky 
Sorry, correct links set in text below.


Hello there,

I am trying to build spark locally so I can test something to help resolve this
ticket .

git checkout v2.1.0
./build/mvn -Phadoop-2.6 -Phive -Phive-thriftserver -Pyarn
-Dhadoop.version=2.6.0-cdh5.7.1 -DskipTests -e clean install

This starts the build successfully. Then I changed one source file and a
version in pom.xml (exact diff
). After
this change when I run the same build command as above I get failure:

Could not find resource 'dev/checkstyle.xml'

whole build log


How this one commit change can cause this error? checkstyle.xml is still
there. I run maven from project root in both cases. What should I change to
build this?

Thanks for your help

Jakub

Re: Cannot find checkstyle.xml

2017-02-08 Thread Jakub Dubovsky 
Sorry, correct links set in text below.

Hello there,
>
> I am trying to build spark locally so I can test something to help resolve 
> this
> ticket .
>
> git checkout v2.1.0
> ./build/mvn -Phadoop-2.6 -Phive -Phive-thriftserver -Pyarn
> -Dhadoop.version=2.6.0-cdh5.7.1 -DskipTests -e clean install
>
> This starts the build successfully. Then I changed one source file and a
> version in pom.xml (exact diff
> ).
> After this change when I run the same build command as above I get failure:
>
> Could not find resource 'dev/checkstyle.xml'
>
> whole build log
> 
>
> How this one commit change can cause this error? checkstyle.xml is still
> there. I run maven from project root in both cases. What should I change to
> build this?
>
> Thanks for your help
>
> Jakub
>
>

Cannot find checkstyle.xml

2017-02-08 Thread Jakub Dubovsky 
Hello there,

I am trying to build spark locally so I can test something to help resolve this
ticket .

git checkout v2.1.0
./build/mvn -Phadoop-2.6 -Phive -Phive-thriftserver -Pyarn
-Dhadoop.version=2.6.0-cdh5.7.1 -DskipTests -e clean install

This starts the build successfully. Then I changed one source file and a
version in pom.xml (exact diff). After this change when I run the same
build command as above I get failure:

Could not find resource 'dev/checkstyle.xml'

whole build log ;>>

How this one commit change can cause this error? checkstyle.xml is still
there. I run maven from project root in both cases. What should I change to
build this?

Thanks for your help

Jakub

Spark development with IntelliJ

2015-01-08 Thread Jakub Dubovsky 
Hi devs,

  I'd like to ask if anybody has experience with using intellij 14 to step 
into spark code. Whatever I try I get compilation error:

Error:scalac: bad option: -P:/home/jakub/.m2/repository/org/scalamacros/
paradise_2.10.4/2.0.1/paradise_2.10.4-2.0.1.jar

  Project is set up by Patrick's instruction [1] and packaged by mvn -
DskipTests clean install. Compilation works fine. Then I just created 
breakpoint in test code and run debug with the error.

  Thanks for any hints

  Jakub

[1] https://cwiki.apache.org/confluence/display/SPARK/Useful+Developer+
Tools#UsefulDeveloperTools-BuildingSparkinIntelliJIDEA

How to become spark developer in jira?

2014-12-29 Thread Jakub Dubovsky 
Hi devs,

  I'd like to ask what are the procedures/conditions for being assigned a 
role of a developer on spark jira? My motivation is to be able to assign 
issues to myself. Only related resource I have found is jira permission 
scheme [1].

  regards
  Jakub

 [1] https://cwiki.apache.org/confluence/display/SPARK/Jira+Permissions+
Scheme

Re: How to become spark developer in jira?

2014-12-29 Thread Jakub Dubovsky 
Hi Matei,

  that makes sense. Thanks a lot!

  Jakub


-- Původní zpráva --
Od: Matei Zaharia matei.zaha...@gmail.com
Komu: Jakub Dubovsky spark.dubovsky.ja...@seznam.cz
Datum: 29. 12. 2014 19:31:57
Předmět: Re: How to become spark developer in jira?

Please ask someone else to assign them for now, and just comment on them 
that you're working on them. Over time if you contribute a bunch we'll add 
you to that list. The problem is that in the past, people would assign 
issues to themselves and never actually work on them, making it confusing 
for others.

Matei

 On Dec 29, 2014, at 7:59 AM, Jakub Dubovsky spark.dubovsky.jakub@seznam.
cz wrote:
 
 Hi devs,
 
 I'd like to ask what are the procedures/conditions for being assigned a 
 role of a developer on spark jira? My motivation is to be able to assign 
 issues to myself. Only related resource I have found is jira permission 
 scheme [1].
 
 regards
 Jakub
 
 [1] https://cwiki.apache.org/confluence/display/SPARK/Jira+Permissions+
 Scheme


-
To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
For additional commands, e-mail: dev-h...@spark.apache.org