Re: In reduce task,i have a join operation ,and i found "org.apache.hadoop.mapred.FileInputFormat: Total input paths to process : 1" cast much long

2017-10-19 Thread Gopal Vijayaraghavan
> . I didn't see data skew for that reducer. It has similar amount of > REDUCE_INPUT_RECORDS as other reducers. … > org.apache.hadoop.hive.ql.exec.CommonJoinOperator: table 0 has 8000 rows for > join key [4092813312923569] The ratio of REDUCE_INPUT_RECORDS and REDUCE_INPUT_GROUPS is what is

Re: In reduce task,i have a join operation ,and i found "org.apache.hadoop.mapred.FileInputFormat: Total input paths to process : 1" cast much long

2017-10-19 Thread Daniel Bruce
Hi Feng, I've seen exactly same problem with one of my queries. There is one reducer hanging forever. I didn't see data skew for that reducer. It has similar amount of REDUCE_INPUT_RECORDS as other reducers. But this number stopped changing any more and just hanging.. Does anybody else know

Re: Find a possible problem in wiki content

2017-10-19 Thread Andrew Sherman
Hi 孙志禹, I think the text is referring to the javadoc for the Matcher class in java . I added a lkink on https://cwiki.apache.org/confluence/display/Hive/LanguageManual+UDF which may have been the page you meant. -Andrew On

Find a possible problem in wiki content

2017-10-19 Thread 孙志禹
In the link https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Select where there is an explanation of the function regexp_extract (in the picture below), there is a reference to the html docs/api/java/util/regex/Matcher.html which can not be opened directly. It seems something

Re: can i have write privilege to Hive Wiki

2017-10-19 Thread Lefty Leverenz
Done. Welcome to the Hive wiki team, Slim! -- Lefty On Wed, Oct 18, 2017 at 11:04 AM, Slim Bouguerra wrote: > User name is bslim and address is bs...@apache.org > thanks > >