[GitHub] [carbondata] kongxianghe1234 commented on issue #4182: FusionInsightHD 6518 spark2.3.2 carbon-2.0.0 skewedJoin adaptive execution no use.
kongxianghe1234 commented on issue #4182: URL: https://github.com/apache/carbondata/issues/4182#issuecomment-885997419 also add "spark.shuffle.statistics.verbose=true",still no use for skewed join -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@carbondata.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] kongxianghe1234 opened a new issue #4182: FusionInsightHD 6518 spark2.3.2 carbon-2.0.0 skewedJoin adaptive execution no use.
kongxianghe1234 opened a new issue #4182: URL: https://github.com/apache/carbondata/issues/4182 spark.sql.adaptive.enabled=true spark.sql.adaptive.skewedJoin.enabled=true spark.sql.adaptive.skewedPartitionMaxSplits=5 spark.sql.adaptive.skewedPartitionRowCountThreshold=1000 spark.sql.adaptive.skewedPartitionSizeThreshold=67108864 spark.sql.adaptive.skewedPartitionFactor : 5 --- In Spark2x JDBC no use for it. t1 left join t2 on t1.id = t2.id column id has one key, for example -00-00 ,has 100,000 records t2 has same key in column id also has 100,000 records ,this will generate 10*10 = 10B records!! for only one reducer. carbon solution no use for it,please check it. -- call hw. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@carbondata.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] study-day removed a comment on issue #4173: DELETE FROM TABLE default.test_table WHERE SEGMENT.ID IN reported an error in benline
study-day removed a comment on issue #4173: URL: https://github.com/apache/carbondata/issues/4173#issuecomment-885533091 thanks . what does it mean about 'Compacted' 'Success', the Status has how many types ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@carbondata.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] study-day commented on issue #4173: DELETE FROM TABLE default.test_table WHERE SEGMENT.ID IN reported an error in benline
study-day commented on issue #4173: URL: https://github.com/apache/carbondata/issues/4173#issuecomment-885533091 thanks . what does it mean about 'Compacted' 'Success', the Status has how many types ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@carbondata.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [carbondata] study-day commented on issue #4173: DELETE FROM TABLE default.test_table WHERE SEGMENT.ID IN reported an error in benline
study-day commented on issue #4173: URL: https://github.com/apache/carbondata/issues/4173#issuecomment-885531971 thanks . what does it mean about 'Compacted' 'Success', the Status has how many types ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@carbondata.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
