Contributing to Spark in GSoC 2017

2016-11-09 Thread Krishna Kalyan
Hello, I am Krishna, currently a 2nd year Masters student in (MSc. in Data Mining) currently in Barcelona studying at Université Polytechnique de Catalogne. I know its a little early for GSoC, however I wanted to get a head start working with the spark community. Is there anyone who would be

Re: Running Unit Tests in pyspark failure

2016-11-03 Thread Krishna Kalyan
I could resolve this by passing the argument below ./python/run-tests --python-executables=python2.7 Thanks, Krishna On Thu, Nov 3, 2016 at 4:16 PM, Krishna Kalyan <krishnakaly...@gmail.com> wrote: > Hello, > I am trying to run unit tests on pyspark. > > When I try to run un

Running Unit Tests in pyspark failure

2016-11-03 Thread Krishna Kalyan
Hello, I am trying to run unit tests on pyspark. When I try to run unit test I am faced with errors. krishna@Krishna:~/Experiment/spark$ ./python/run-tests Running PySpark tests. Output is in /Users/krishna/Experiment/ spark/python/unit-tests.log Will test against the following Python

Contributing to PySpark

2016-10-18 Thread Krishna Kalyan
Hello, I am a masters student. Could someone please let me know how set up my dev working environment to contribute to pyspark. Questions I had were: a) Should I use Intellij Idea or PyCharm?. b) How do I test my changes?. Regards, Krishna