New reply on DataCleaner's online discussion forum (https://datacleaner.org/forum):
Henrique replied to subject 'Runnin DataCleaner on Spark as a local file' ------------------- I am not sure where is the config for this file (file:/Users/henriqueandrade/Documents/App/spark/DataCleaner/engine/env/spark/target)) since it does not exists on my machine. I changed the datacleaner.result.hdfs.path=file:///Users/henriqueandrade/Documents/App/spark/DataCleaner/engine/env/spark/target/results/myresult.analysis.result.dat and then I get two files on this directory but both are empty. drwxr-xr-x 4 henriqueandrade staff 136 Aug 31 09:24 . drwxr-xr-x 18 henriqueandrade staff 612 Aug 31 09:21 .. -rw-r--r-- 1 henriqueandrade staff 0 Aug 31 09:24 .myresult.analysis.result.dat.crc -rw-r--r-- 1 henriqueandrade staff 0 Aug 31 09:24 myresult.analysis.result.dat On the stack trace I get this message: 16/08/31 09:24:10 INFO Main: DataCleaner result: 16/08/31 09:24:10 INFO InjectionManagerImpl: Creating RowAnnotationFactory for job: null 16/08/31 09:24:10 INFO InjectionManagerImpl: Creating RowAnnotationFactory for job: null 16/08/31 09:24:10 INFO InjectionManagerImpl: Creating RowAnnotationFactory for job: null 16/08/31 09:24:10 INFO InjectionManagerImpl: Creating RowAnnotationFactory for job: null 16/08/31 09:24:10 INFO InjectionManagerImpl: Creating RowAnnotationFactory for job: null 16/08/31 09:24:10 INFO InjectionManagerImpl: Creating RowAnnotationFactory for job: null After I get the correct results: Value distribution for: country - Denmark: 4 - Netherlands: 3 16/08/31 09:24:10 INFO SparkAnalysisRunner: AnalyzerResult (0): Crosstab: company,Avg chars: 2.0 company,Avg white spaces: 0.0 company,Blank count: 0 company,Diacritic chars: 0 company,Digit chars: 0 company,Entirely lowercase count: 0 company,Entirely uppercase count: 7 company,Lowercase chars: 0 ------------------- View the topic online to reply - go to https://datacleaner.org/topic/1140/Runnin-DataCleaner-on-Spark-as-a-local-file -- You received this message because you are subscribed to the Google Groups "DataCleaner-notify" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at https://groups.google.com/group/datacleaner-notify. For more options, visit https://groups.google.com/d/optout.
