hi Group,
default value of hive.exec.max.created.files is 100,000.
I have huge table without partitions.
I want to remove duplicates by using "group by" and insert into a new
partitioned table with dynamic partition.exception: [Fatal Error] total number of created files now is 101859, which exceeds 100000 I want to increase this setting. Before increasing, how do i know if its safe to do so? I have a ~50 node cluster. -- Cheers, Kishore
