New reply on DataCleaner's online discussion forum (https://datacleaner.org/forum):
Dennis replied to subject 'Runnin DataCleaner on Spark as a local file' ------------------- Oh! We don't officially support running it outside YARN, but nothing nothing should prevent you're running it directly through Spark, when you're using Spark-submit and friends. The YARN stuff is for when you're running the job through the DataCleaner command line or Desktop interface (last not available in community edition). But if you running it Spark standalone, I don't know how or even if S3 connections should work. I think it requires support from Hadoop. But then writing locally _should_ work. :( ------------------- View the topic online to reply - go to https://datacleaner.org/topic/1140/Runnin-DataCleaner-on-Spark-as-a-local-file -- You received this message because you are subscribed to the Google Groups "DataCleaner-notify" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at https://groups.google.com/group/datacleaner-notify. For more options, visit https://groups.google.com/d/optout.
