Re: testing frameworks

2019-02-03 Thread Hichame El Khalfi
Hi, You can use pysparkling => https://github.com/svenkreiss/pysparkling This lib is useful in case you have RDD. Hope this helps, Hichame From: mmistr...@gmail.com Sent: February 3, 2019 4:42 PM To: radams...@gmail.com Cc: la...@mapflat.com; bpru...@opentext.com; user@spark.apache.org Subject:

Re: testing frameworks

2019-02-03 Thread Marco Mistroni
Hi sorry to resurrect this thread Any spark libraries for testing code in pyspark? the github code above seems related to Scala following links in the original threads (and also LMGFY) i found out pytest-spark ยท PyPI w/kindest regards Marco On Tue,