New discussion topic on DataCleaner's online discussion forum (https://datacleaner.org/forum):
Henrique posted the subject 'Runnin DataCleaner on Spark as a local file' ------------------- I am running a simple sample using local files. Everything runs fine but the result file is not been written. Anyone can help on this? Analysis Result: Value distribution for: country - Denmark: 4 - Netherlands: 3 16/08/30 10:28:55 INFO SparkAnalysisRunner: AnalyzerResult (0): Crosstab: company,Avg chars: 2.0 company,Avg white spaces: 0.0 company,Blank count: 0 company,Diacritic chars: 0 company,Digit chars: 0 company,Entirely lowercase count: 0 company,Entirely uppercase count: 7 company,Lowercase chars: 0 I get this after that: 16/08/30 10:28:55 INFO Main: DataCleaner result will be written to: HadoopResource[file:///Users/henriqueandrade/Documents/App/spark/DataCleaner/results/myresult.analysis.result.dat] 16/08/30 10:28:55 INFO InjectionManagerImpl: Creating RowAnnotationFactory for job: null 16/08/30 10:28:55 INFO InjectionManagerImpl: Creating RowAnnotationFactory for job: null 16/08/30 10:28:55 INFO InjectionManagerImpl: Creating RowAnnotationFactory for job: null 16/08/30 10:28:55 INFO InjectionManagerImpl: Creating RowAnnotationFactory for job: null 16/08/30 10:28:55 INFO InjectionManagerImpl: Creating RowAnnotationFactory for job: null 16/08/30 10:28:55 INFO InjectionManagerImpl: Creating RowAnnotationFactory for job: null 16/08/30 10:28:55 INFO SparkUI: Stopped Spark web UI at http://192.168.86.30:4040 16/08/30 10:28:55 INFO DAGScheduler: Stopping DAGScheduler 16/08/30 10:28:55 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped! 16/08/30 10:28:55 INFO MemoryStore: MemoryStore cleared 16/08/30 10:28:55 INFO BlockManager: BlockManager stopped 16/08/30 10:28:55 INFO BlockManagerMaster: BlockManagerMaster stopped 16/08/30 10:28:55 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped! 16/08/30 10:28:55 INFO SparkContext: Successfully stopped SparkContext 16/08/30 10:28:55 INFO ShutdownHookManager: Shutdown hook called 16/08/30 10:28:55 INFO ShutdownHookManager: Deleting directory /private/var/folders/hv/vp5_qcx52rl1h9m27p7xg5n00000gn/T/spark-a0ec277b-da69-452d-97f7-a6b529aba480 ------------------- View the topic online to reply - go to https://datacleaner.org/topic/1140/Runnin-DataCleaner-on-Spark-as-a-local-file -- You received this message because you are subscribed to the Google Groups "DataCleaner-notify" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at https://groups.google.com/group/datacleaner-notify. For more options, visit https://groups.google.com/d/optout.
