[jira] [Assigned] (HIVE-19078) Add separate option to display query explain on HS2
[ https://issues.apache.org/jira/browse/HIVE-19078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Madhudeep Petwal reassigned HIVE-19078: --- Assignee: Madhudeep Petwal > Add separate option to display query explain on HS2 > --- > > Key: HIVE-19078 > URL: https://issues.apache.org/jira/browse/HIVE-19078 > Project: Hive > Issue Type: Improvement >Reporter: Zoltan Haindrich >Assignee: Madhudeep Petwal >Priority: Major > > currently the same option (ConfVars.HIVE_LOG_EXPLAIN_OUTPUT) controls both > explain print to console; and display on hs2 ; seeing it also on the console > eats up scroll space very fast > https://github.com/apache/hive/blob/b750a16be5a8e378ac11a88ace244e826d23cfe5/ql/src/java/org/apache/hadoop/hive/ql/Driver.java#L684 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18373) Make it easier to search for column name in a table
[ https://issues.apache.org/jira/browse/HIVE-18373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409563#comment-16409563 ] Madhudeep Petwal commented on HIVE-18373: - Sure. Thanks. :) > Make it easier to search for column name in a table > --- > > Key: HIVE-18373 > URL: https://issues.apache.org/jira/browse/HIVE-18373 > Project: Hive > Issue Type: New Feature >Reporter: Siddhant Saraf >Assignee: Madhudeep Petwal >Priority: Minor > Fix For: 3.0.0 > > Attachments: HIVE-18373.1.patch, HIVE-18373.2.patch, > HIVE-18373.3.patch > > > Within a database, to filter for tables with the string 'abc' in its name, I > can use something like: > {code:java} > hive> use my_database; > hive> show tables '*abc*'; > {code} > It would be great if I can do something similar to search within the list of > columns in a table. > I have a table with around 3200 columns. Searching for the column of interest > is an onerous task after doing a {{describe}} on it. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18373) Make it easier to search for column name in a table
[ https://issues.apache.org/jira/browse/HIVE-18373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409451#comment-16409451 ] Madhudeep Petwal commented on HIVE-18373: - [~kgyrtkirk] Documented. Please review. > Make it easier to search for column name in a table > --- > > Key: HIVE-18373 > URL: https://issues.apache.org/jira/browse/HIVE-18373 > Project: Hive > Issue Type: New Feature >Reporter: Siddhant Saraf >Assignee: Madhudeep Petwal >Priority: Minor > Labels: TODOC3.0 > Fix For: 3.0.0 > > Attachments: HIVE-18373.1.patch, HIVE-18373.2.patch, > HIVE-18373.3.patch > > > Within a database, to filter for tables with the string 'abc' in its name, I > can use something like: > {code:java} > hive> use my_database; > hive> show tables '*abc*'; > {code} > It would be great if I can do something similar to search within the list of > columns in a table. > I have a table with around 3200 columns. Searching for the column of interest > is an onerous task after doing a {{describe}} on it. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18373) Make it easier to search for column name in a table
[ https://issues.apache.org/jira/browse/HIVE-18373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16375952#comment-16375952 ] Madhudeep Petwal commented on HIVE-18373: - Hi [~kgyrtkirk], Happy Sunday :) I am following this wiki [https://cwiki.apache.org/confluence/display/Hive/AboutThisWiki] I still haven't got permission to edit for documentation. Can you help ? Thanks > Make it easier to search for column name in a table > --- > > Key: HIVE-18373 > URL: https://issues.apache.org/jira/browse/HIVE-18373 > Project: Hive > Issue Type: New Feature >Reporter: Siddhant Saraf >Assignee: Madhudeep Petwal >Priority: Minor > Labels: TODOC3.0 > Fix For: 3.0.0 > > Attachments: HIVE-18373.1.patch, HIVE-18373.2.patch, > HIVE-18373.3.patch > > > Within a database, to filter for tables with the string 'abc' in its name, I > can use something like: > {code:java} > hive> use my_database; > hive> show tables '*abc*'; > {code} > It would be great if I can do something similar to search within the list of > columns in a table. > I have a table with around 3200 columns. Searching for the column of interest > is an onerous task after doing a {{describe}} on it. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (HIVE-18736) Create Table Like doc needs to be updated
[ https://issues.apache.org/jira/browse/HIVE-18736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Madhudeep Petwal reassigned HIVE-18736: --- Assignee: Nikhil Harsoor (was: Madhudeep Petwal) > Create Table Like doc needs to be updated > - > > Key: HIVE-18736 > URL: https://issues.apache.org/jira/browse/HIVE-18736 > Project: Hive > Issue Type: Bug > Components: Documentation >Reporter: Eugene Koifman >Assignee: Nikhil Harsoor >Priority: Major > > https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL#LanguageManualDDL-CreateTableLike > needs to be updated. > according to HiveParser.g the syntax is much richer that what is in the doc > {noformat} > -> ^(TOK_CREATETABLE $name $temp? $ext? ifNotExists? > ^(TOK_LIKETABLE $likeName?) > columnNameTypeOrConstraintList? > tableComment? > tablePartition? > tableBuckets? > tableSkewed? > tableRowFormat? > tableFileFormat? > tableLocation? > tablePropertiesPrefixed? > selectStatementWithCTE? > ) > {noformat} > I tried specifying TBLPROPERTIES on current master (Hive 3.0) and it works. > Updated doc accordingly but more verification/doc changes are needed. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (HIVE-18736) Create Table Like doc needs to be updated
[ https://issues.apache.org/jira/browse/HIVE-18736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Madhudeep Petwal reassigned HIVE-18736: --- Assignee: Madhudeep Petwal > Create Table Like doc needs to be updated > - > > Key: HIVE-18736 > URL: https://issues.apache.org/jira/browse/HIVE-18736 > Project: Hive > Issue Type: Bug > Components: Documentation >Reporter: Eugene Koifman >Assignee: Madhudeep Petwal >Priority: Major > > https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL#LanguageManualDDL-CreateTableLike > needs to be updated. > according to HiveParser.g the syntax is much richer that what is in the doc > {noformat} > -> ^(TOK_CREATETABLE $name $temp? $ext? ifNotExists? > ^(TOK_LIKETABLE $likeName?) > columnNameTypeOrConstraintList? > tableComment? > tablePartition? > tableBuckets? > tableSkewed? > tableRowFormat? > tableFileFormat? > tableLocation? > tablePropertiesPrefixed? > selectStatementWithCTE? > ) > {noformat} > I tried specifying TBLPROPERTIES on current master (Hive 3.0) and it works. > Updated doc accordingly but more verification/doc changes are needed. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18373) Make it easier to search for column name in a table
[ https://issues.apache.org/jira/browse/HIVE-18373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16367568#comment-16367568 ] Madhudeep Petwal commented on HIVE-18373: - Thanks [~kgyrtkirk]. :) > Make it easier to search for column name in a table > --- > > Key: HIVE-18373 > URL: https://issues.apache.org/jira/browse/HIVE-18373 > Project: Hive > Issue Type: New Feature >Reporter: Siddhant Saraf >Assignee: Madhudeep Petwal >Priority: Minor > Fix For: 3.0.0 > > Attachments: HIVE-18373.1.patch, HIVE-18373.2.patch, > HIVE-18373.3.patch > > > Within a database, to filter for tables with the string 'abc' in its name, I > can use something like: > {code:java} > hive> use my_database; > hive> show tables '*abc*'; > {code} > It would be great if I can do something similar to search within the list of > columns in a table. > I have a table with around 3200 columns. Searching for the column of interest > is an onerous task after doing a {{describe}} on it. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (HIVE-16496) Enhance asterisk expression (as in "select *") with EXCLUDE clause
[ https://issues.apache.org/jira/browse/HIVE-16496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Madhudeep Petwal reassigned HIVE-16496: --- Assignee: (was: Madhudeep Petwal) > Enhance asterisk expression (as in "select *") with EXCLUDE clause > -- > > Key: HIVE-16496 > URL: https://issues.apache.org/jira/browse/HIVE-16496 > Project: Hive > Issue Type: Wish > Components: Parser >Reporter: Dudu Markovitz >Priority: Major > > support the following syntax: > {code} > select * exclude (a,b,e) from t > {code} > which for a table t with columns a,b,c,d,e would be equal to: > {code} > select c,d from t > {code} > Please note that the EXCLUDE clause relates directly to its preceding > asterisk. > Here are some useful use cases: > h3. use-case 1: join > {code} > select t1.* exclude (x), t2.* from t1 join t2 on t1.x=t2.x; > {code} > This supplies a very clean way to select all columns without getting > "Ambiguous column reference" and without the need to specify all the columns > of at least one of the tables. > > Currently, without this enhancement, the query would look something like this: > {code} > select a,b,c,d,e,f,g,h,i,j,k,l,m,n,o,p,q,r,s,t,u,v,w,y,z,t2.* from t1 join t2 > on t1.x=t2.x; > {code} > Considering a table may hold hundreds or even thousands of column, this can > be come very ugly and error prone. > Often this require some scripting work. > h3. use-case 2: view > Creating views with all the tables columns except for some technical columns > > {code} > create myview as select * exclude (cre_ts,upd_ts) from t; > {code} > h3. use-case 3: row_number > Remove computational columns that are not needed in the final row-set, e.g. - > retrieve the last record for each customer > {code} > select * exclude (rn) > from (select t.* >,row_number() over (partition by customer_id order by ts desc) > as rn > fromt > ) t > > where rn = 1 > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-18373) Make it easier to search for column name in a table
[ https://issues.apache.org/jira/browse/HIVE-18373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Madhudeep Petwal updated HIVE-18373: Attachment: HIVE-18373.3.patch > Make it easier to search for column name in a table > --- > > Key: HIVE-18373 > URL: https://issues.apache.org/jira/browse/HIVE-18373 > Project: Hive > Issue Type: New Feature >Reporter: Siddhant Saraf >Assignee: Madhudeep Petwal >Priority: Minor > Attachments: HIVE-18373.1.patch, HIVE-18373.2.patch, > HIVE-18373.3.patch > > > Within a database, to filter for tables with the string 'abc' in its name, I > can use something like: > {code:java} > hive> use my_database; > hive> show tables '*abc*'; > {code} > It would be great if I can do something similar to search within the list of > columns in a table. > I have a table with around 3200 columns. Searching for the column of interest > is an onerous task after doing a {{describe}} on it. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18373) Make it easier to search for column name in a table
[ https://issues.apache.org/jira/browse/HIVE-18373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363877#comment-16363877 ] Madhudeep Petwal commented on HIVE-18373: - Deleted show_columns2.q [~kgyrtkirk] > Make it easier to search for column name in a table > --- > > Key: HIVE-18373 > URL: https://issues.apache.org/jira/browse/HIVE-18373 > Project: Hive > Issue Type: New Feature >Reporter: Siddhant Saraf >Assignee: Madhudeep Petwal >Priority: Minor > Attachments: HIVE-18373.1.patch, HIVE-18373.2.patch, > HIVE-18373.3.patch > > > Within a database, to filter for tables with the string 'abc' in its name, I > can use something like: > {code:java} > hive> use my_database; > hive> show tables '*abc*'; > {code} > It would be great if I can do something similar to search within the list of > columns in a table. > I have a table with around 3200 columns. Searching for the column of interest > is an onerous task after doing a {{describe}} on it. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18373) Make it easier to search for column name in a table
[ https://issues.apache.org/jira/browse/HIVE-18373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360568#comment-16360568 ] Madhudeep Petwal commented on HIVE-18373: - No I don't think so [~kgyrtkirk], the error is {code:java} Table not found shcol_test{code} in clientpositive/show_columns.q this table is getting created. Don't know why this table is not found, maybe it is related to some failures of test cases. > Make it easier to search for column name in a table > --- > > Key: HIVE-18373 > URL: https://issues.apache.org/jira/browse/HIVE-18373 > Project: Hive > Issue Type: New Feature >Reporter: Siddhant Saraf >Assignee: Madhudeep Petwal >Priority: Minor > Attachments: HIVE-18373.1.patch, HIVE-18373.2.patch > > > Within a database, to filter for tables with the string 'abc' in its name, I > can use something like: > {code:java} > hive> use my_database; > hive> show tables '*abc*'; > {code} > It would be great if I can do something similar to search within the list of > columns in a table. > I have a table with around 3200 columns. Searching for the column of interest > is an onerous task after doing a {{describe}} on it. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18373) Make it easier to search for column name in a table
[ https://issues.apache.org/jira/browse/HIVE-18373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16360313#comment-16360313 ] Madhudeep Petwal commented on HIVE-18373: - [~kgyrtkirk] Please review. > Make it easier to search for column name in a table > --- > > Key: HIVE-18373 > URL: https://issues.apache.org/jira/browse/HIVE-18373 > Project: Hive > Issue Type: New Feature >Reporter: Siddhant Saraf >Assignee: Madhudeep Petwal >Priority: Minor > Attachments: HIVE-18373.1.patch, HIVE-18373.2.patch > > > Within a database, to filter for tables with the string 'abc' in its name, I > can use something like: > {code:java} > hive> use my_database; > hive> show tables '*abc*'; > {code} > It would be great if I can do something similar to search within the list of > columns in a table. > I have a table with around 3200 columns. Searching for the column of interest > is an onerous task after doing a {{describe}} on it. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18676) Usability: Better warnings for Unicode single quotes
[ https://issues.apache.org/jira/browse/HIVE-18676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359249#comment-16359249 ] Madhudeep Petwal commented on HIVE-18676: - Hi [~gopalv] can you describe this in detail? Can you provide table used here and other details like hive version you used for bug reproduction ? > Usability: Better warnings for Unicode single quotes > > > Key: HIVE-18676 > URL: https://issues.apache.org/jira/browse/HIVE-18676 > Project: Hive > Issue Type: Improvement > Components: Parser >Reporter: Gopal V >Priority: Major > Labels: usability > > The warning for > {code} > select d_date as ‘date’ from date_dim; > {code} > is hard to locate than it should be. > {code} > Error: Error while compiling statement: FAILED: ParseException line 1:18 > cannot recognize input near 'as' 'date' 'from' in selection target > (state=42000,code=4) > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (HIVE-18676) Usability: Better warnings for Unicode single quotes
[ https://issues.apache.org/jira/browse/HIVE-18676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Madhudeep Petwal reassigned HIVE-18676: --- Assignee: Madhudeep Petwal > Usability: Better warnings for Unicode single quotes > > > Key: HIVE-18676 > URL: https://issues.apache.org/jira/browse/HIVE-18676 > Project: Hive > Issue Type: Improvement > Components: Parser >Reporter: Gopal V >Assignee: Madhudeep Petwal >Priority: Major > Labels: usability > > The warning for > {code} > select d_date as ‘date’ from date_dim; > {code} > is hard to locate than it should be. > {code} > Error: Error while compiling statement: FAILED: ParseException line 1:18 > cannot recognize input near 'as' 'date' 'from' in selection target > (state=42000,code=4) > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18373) Make it easier to search for column name in a table
[ https://issues.apache.org/jira/browse/HIVE-18373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16358314#comment-16358314 ] Madhudeep Petwal commented on HIVE-18373: - [~thejas] [~kgyrtkirk] I have added those test cases. Please review. > Make it easier to search for column name in a table > --- > > Key: HIVE-18373 > URL: https://issues.apache.org/jira/browse/HIVE-18373 > Project: Hive > Issue Type: New Feature >Reporter: Siddhant Saraf >Assignee: Madhudeep Petwal >Priority: Minor > Attachments: HIVE-18373.1.patch, HIVE-18373.2.patch > > > Within a database, to filter for tables with the string 'abc' in its name, I > can use something like: > {code:java} > hive> use my_database; > hive> show tables '*abc*'; > {code} > It would be great if I can do something similar to search within the list of > columns in a table. > I have a table with around 3200 columns. Searching for the column of interest > is an onerous task after doing a {{describe}} on it. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-18373) Make it easier to search for column name in a table
[ https://issues.apache.org/jira/browse/HIVE-18373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Madhudeep Petwal updated HIVE-18373: Attachment: HIVE-18373.2.patch > Make it easier to search for column name in a table > --- > > Key: HIVE-18373 > URL: https://issues.apache.org/jira/browse/HIVE-18373 > Project: Hive > Issue Type: New Feature >Reporter: Siddhant Saraf >Assignee: Madhudeep Petwal >Priority: Minor > Attachments: HIVE-18373.1.patch, HIVE-18373.2.patch > > > Within a database, to filter for tables with the string 'abc' in its name, I > can use something like: > {code:java} > hive> use my_database; > hive> show tables '*abc*'; > {code} > It would be great if I can do something similar to search within the list of > columns in a table. > I have a table with around 3200 columns. Searching for the column of interest > is an onerous task after doing a {{describe}} on it. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18373) Make it easier to search for column name in a table
[ https://issues.apache.org/jira/browse/HIVE-18373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16352452#comment-16352452 ] Madhudeep Petwal commented on HIVE-18373: - Patch submitted. Who will review this [~thejas] ? > Make it easier to search for column name in a table > --- > > Key: HIVE-18373 > URL: https://issues.apache.org/jira/browse/HIVE-18373 > Project: Hive > Issue Type: New Feature >Reporter: Siddhant Saraf >Assignee: Madhudeep Petwal >Priority: Minor > Attachments: HIVE-18373.1.patch > > > Within a database, to filter for tables with the string 'abc' in its name, I > can use something like: > {code:java} > hive> use my_database; > hive> show tables '*abc*'; > {code} > It would be great if I can do something similar to search within the list of > columns in a table. > I have a table with around 3200 columns. Searching for the column of interest > is an onerous task after doing a {{describe}} on it. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-18373) Make it easier to search for column name in a table
[ https://issues.apache.org/jira/browse/HIVE-18373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Madhudeep Petwal updated HIVE-18373: Status: Patch Available (was: Open) > Make it easier to search for column name in a table > --- > > Key: HIVE-18373 > URL: https://issues.apache.org/jira/browse/HIVE-18373 > Project: Hive > Issue Type: New Feature >Reporter: Siddhant Saraf >Assignee: Madhudeep Petwal >Priority: Minor > Attachments: HIVE-18373.1.patch > > > Within a database, to filter for tables with the string 'abc' in its name, I > can use something like: > {code:java} > hive> use my_database; > hive> show tables '*abc*'; > {code} > It would be great if I can do something similar to search within the list of > columns in a table. > I have a table with around 3200 columns. Searching for the column of interest > is an onerous task after doing a {{describe}} on it. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-18373) Make it easier to search for column name in a table
[ https://issues.apache.org/jira/browse/HIVE-18373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Madhudeep Petwal updated HIVE-18373: Attachment: HIVE-18373.1.patch > Make it easier to search for column name in a table > --- > > Key: HIVE-18373 > URL: https://issues.apache.org/jira/browse/HIVE-18373 > Project: Hive > Issue Type: New Feature >Reporter: Siddhant Saraf >Assignee: Madhudeep Petwal >Priority: Minor > Attachments: HIVE-18373.1.patch > > > Within a database, to filter for tables with the string 'abc' in its name, I > can use something like: > {code:java} > hive> use my_database; > hive> show tables '*abc*'; > {code} > It would be great if I can do something similar to search within the list of > columns in a table. > I have a table with around 3200 columns. Searching for the column of interest > is an onerous task after doing a {{describe}} on it. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Comment Edited] (HIVE-18373) Make it easier to search for column name in a table
[ https://issues.apache.org/jira/browse/HIVE-18373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16331785#comment-16331785 ] Madhudeep Petwal edited comment on HIVE-18373 at 1/22/18 6:11 AM: -- Ok I looked up Hive.g grammar file. It looks like hive supports both {code:java} hive> show tables '*abc*';{code} {code:java} hive> show tables like '*abc*';{code} as we can see grammar rule for show tables {code:java} KW_SHOW KW_TABLES ((KW_FROM|KW_IN) db_name=identifier)? (KW_LIKE showStmtIdentifier|showStmtIdentifier)? -> ^(TOK_SHOWTABLES (TOK_FROM $db_name)? showStmtIdentifier?){code} I will keep the syntax similar to show tables then. This is my proposed grammar rule for show columns. Please review [~thejas] {code:java} KW_SHOW KW_COLUMNS (KW_FROM|KW_IN) tableName ((KW_FROM|KW_IN) db_name=identifier)? (KW_LIKE showStmtIdentifier|showStmtIdentifier)? -> ^(TOK_SHOWCOLUMNS tableName (TOK_FROM $db_name)? showStmtIdentifier?){code} was (Author: minions): Ok I looked up Hive.g grammar file. It looks like hive supports both {code:java} hive> show tables '*abc*';{code} {code:java} hive> show tables like '*abc*';{code} as we can see grammar rule for show tables {code:java} KW_SHOW KW_TABLES ((KW_FROM|KW_IN) db_name=identifier)? (KW_LIKE showStmtIdentifier|showStmtIdentifier)? -> ^(TOK_SHOWTABLES (TOK_FROM $db_name)? showStmtIdentifier?){code} I will keep the syntax similar to show tables then. This is my proposed grammar rule for show columns. Please review [~thejas] {code:java} KW_SHOW KW_COLUMNS (KW_FROM|KW_IN) tableName ((KW_FROM|KW_IN) db_name=identifier)? (KW_LIKE showStmtIdentifier|showStmtIdentifier)? -> ^(TOK_SHOWCOLUMNS tableName $db_name? showStmtIdentifier?){code} > Make it easier to search for column name in a table > --- > > Key: HIVE-18373 > URL: https://issues.apache.org/jira/browse/HIVE-18373 > Project: Hive > Issue Type: New Feature >Reporter: Siddhant Saraf >Assignee: Madhudeep Petwal >Priority: Minor > > Within a database, to filter for tables with the string 'abc' in its name, I > can use something like: > {code:java} > hive> use my_database; > hive> show tables '*abc*'; > {code} > It would be great if I can do something similar to search within the list of > columns in a table. > I have a table with around 3200 columns. Searching for the column of interest > is an onerous task after doing a {{describe}} on it. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18373) Make it easier to search for column name in a table
[ https://issues.apache.org/jira/browse/HIVE-18373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16331785#comment-16331785 ] Madhudeep Petwal commented on HIVE-18373: - Ok I looked up Hive.g grammar file. It looks like hive supports both {code:java} hive> show tables '*abc*';{code} {code:java} hive> show tables like '*abc*';{code} as we can see grammar rule for show tables {code:java} KW_SHOW KW_TABLES ((KW_FROM|KW_IN) db_name=identifier)? (KW_LIKE showStmtIdentifier|showStmtIdentifier)? -> ^(TOK_SHOWTABLES (TOK_FROM $db_name)? showStmtIdentifier?){code} I will keep the syntax similar to show tables then. This is my proposed grammar rule for show columns. Please review [~thejas] {code:java} KW_SHOW KW_COLUMNS (KW_FROM|KW_IN) tableName ((KW_FROM|KW_IN) db_name=identifier)? (KW_LIKE showStmtIdentifier|showStmtIdentifier)? -> ^(TOK_SHOWCOLUMNS tableName $db_name? showStmtIdentifier?){code} > Make it easier to search for column name in a table > --- > > Key: HIVE-18373 > URL: https://issues.apache.org/jira/browse/HIVE-18373 > Project: Hive > Issue Type: New Feature >Reporter: Siddhant Saraf >Assignee: Madhudeep Petwal >Priority: Minor > > Within a database, to filter for tables with the string 'abc' in its name, I > can use something like: > {code:java} > hive> use my_database; > hive> show tables '*abc*'; > {code} > It would be great if I can do something similar to search within the list of > columns in a table. > I have a table with around 3200 columns. Searching for the column of interest > is an onerous task after doing a {{describe}} on it. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Comment Edited] (HIVE-18373) Make it easier to search for column name in a table
[ https://issues.apache.org/jira/browse/HIVE-18373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16330296#comment-16330296 ] Madhudeep Petwal edited comment on HIVE-18373 at 1/18/18 9:38 AM: -- I agree with [~siddhantsaraf] . As we have syntax for {code:java} hive> show tables '*abc*'; {code} On similar grounds we can have {code:java} hive> show columns '*abc*' in my_table; {code} This makes sense as syntax will be same throughout. we can't have mysql/otherDb syntax here but not in show tables, Mysql syntax for show tables {code:java} mysql> SHOW TABLES like '%search_term%'; {code} [~prasadns14] [~thejas] Please give your views on this. was (Author: minions): I agree with [~siddhantsaraf] . As we have syntax for hive> show tables '*abc*'; On similar grounds we can have hive> show columns '*abc*' in my_table; This makes sense as syntax will be same throughout. we can't have mysql/otherDb syntax here but not in show tables, Mysql syntax for show tables mysql> SHOW TABLES like '%search_term%'; [~prasadns14] [~thejas] Please give your views on this. > Make it easier to search for column name in a table > --- > > Key: HIVE-18373 > URL: https://issues.apache.org/jira/browse/HIVE-18373 > Project: Hive > Issue Type: New Feature >Reporter: Siddhant Saraf >Assignee: Madhudeep Petwal >Priority: Minor > > Within a database, to filter for tables with the string 'abc' in its name, I > can use something like: > {code:java} > hive> use my_database; > hive> show tables '*abc*'; > {code} > It would be great if I can do something similar to search within the list of > columns in a table. > I have a table with around 3200 columns. Searching for the column of interest > is an onerous task after doing a {{describe}} on it. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18373) Make it easier to search for column name in a table
[ https://issues.apache.org/jira/browse/HIVE-18373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16330296#comment-16330296 ] Madhudeep Petwal commented on HIVE-18373: - I agree with [~siddhantsaraf] . As we have syntax for hive> show tables '*abc*'; On similar grounds we can have hive> show columns '*abc*' in my_table; This makes sense as syntax will be same throughout. we can't have mysql/otherDb syntax here but not in show tables, Mysql syntax for show tables mysql> SHOW TABLES like '%search_term%'; [~prasadns14] [~thejas] Please give your views on this. > Make it easier to search for column name in a table > --- > > Key: HIVE-18373 > URL: https://issues.apache.org/jira/browse/HIVE-18373 > Project: Hive > Issue Type: New Feature >Reporter: Siddhant Saraf >Assignee: Madhudeep Petwal >Priority: Minor > > Within a database, to filter for tables with the string 'abc' in its name, I > can use something like: > {code:java} > hive> use my_database; > hive> show tables '*abc*'; > {code} > It would be great if I can do something similar to search within the list of > columns in a table. > I have a table with around 3200 columns. Searching for the column of interest > is an onerous task after doing a {{describe}} on it. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (HIVE-18373) Make it easier to search for column name in a table
[ https://issues.apache.org/jira/browse/HIVE-18373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16317732#comment-16317732 ] Madhudeep Petwal commented on HIVE-18373: - Oh. sorry for misreading the statement. Will get back onto this. > Make it easier to search for column name in a table > --- > > Key: HIVE-18373 > URL: https://issues.apache.org/jira/browse/HIVE-18373 > Project: Hive > Issue Type: New Feature >Reporter: Siddhant Saraf >Assignee: Madhudeep Petwal >Priority: Minor > > Within a database, to filter for tables with the string 'abc' in its name, I > can use something like: > {code:java} > hive> use my_database; > hive> show tables '*abc*'; > {code} > It would be great if I can do something similar to search within the list of > columns in a table. > I have a table with around 3200 columns. Searching for the column of interest > is an onerous task after doing a describe on it. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Comment Edited] (HIVE-18373) Make it easier to search for column name in a table
[ https://issues.apache.org/jira/browse/HIVE-18373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16315681#comment-16315681 ] Madhudeep Petwal edited comment on HIVE-18373 at 1/8/18 5:32 AM: - Yeah, I was thinking of first implementing for table names regex. show tables \*abc\*; show tables '*abc*'; show tables "*abc*"; show tables *ab*c; where * will not be any letter in table name. Please tell me your views on this. was (Author: minions): Yeah, I was thinking of first implementing for table names regex. show tables *abc*; show tables '*abc*'; show tables "*abc*"; show tables *ab*c; where * will not be any letter in table name. Please tell me your views on this. > Make it easier to search for column name in a table > --- > > Key: HIVE-18373 > URL: https://issues.apache.org/jira/browse/HIVE-18373 > Project: Hive > Issue Type: New Feature >Reporter: Siddhant Saraf >Assignee: Madhudeep Petwal >Priority: Minor > > Within a database, to filter for tables with the string 'abc' in its name, I > can use something like: > {code:java} > hive> use my_database; > hive> show tables '*abc*'; > {code} > It would be great if I can do something similar to search within the list of > columns in a table. > I have a table with around 3200 columns. Searching for the column of interest > is an onerous task after doing a describe on it. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Comment Edited] (HIVE-18373) Make it easier to search for column name in a table
[ https://issues.apache.org/jira/browse/HIVE-18373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16315681#comment-16315681 ] Madhudeep Petwal edited comment on HIVE-18373 at 1/8/18 5:32 AM: - Yeah, I was thinking of first implementing for table names regex. show tables \*abc\*; show tables '\*abc\*'; show tables "\*abc\*"; show tables *ab*c; where * will not be any letter in table name. Please tell me your views on this. was (Author: minions): Yeah, I was thinking of first implementing for table names regex. show tables \*abc\*; show tables '*abc*'; show tables "*abc*"; show tables *ab*c; where * will not be any letter in table name. Please tell me your views on this. > Make it easier to search for column name in a table > --- > > Key: HIVE-18373 > URL: https://issues.apache.org/jira/browse/HIVE-18373 > Project: Hive > Issue Type: New Feature >Reporter: Siddhant Saraf >Assignee: Madhudeep Petwal >Priority: Minor > > Within a database, to filter for tables with the string 'abc' in its name, I > can use something like: > {code:java} > hive> use my_database; > hive> show tables '*abc*'; > {code} > It would be great if I can do something similar to search within the list of > columns in a table. > I have a table with around 3200 columns. Searching for the column of interest > is an onerous task after doing a describe on it. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HIVE-18373) Make it easier to search for column name in a table
[ https://issues.apache.org/jira/browse/HIVE-18373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16315681#comment-16315681 ] Madhudeep Petwal commented on HIVE-18373: - Yeah, I was thinking of first implementing for table names regex. show tables *abc*; show tables '*abc*'; show tables "*abc*"; show tables *ab*c; where * will not be any letter in table name. Please tell me your views on this. > Make it easier to search for column name in a table > --- > > Key: HIVE-18373 > URL: https://issues.apache.org/jira/browse/HIVE-18373 > Project: Hive > Issue Type: New Feature >Reporter: Siddhant Saraf >Assignee: Madhudeep Petwal >Priority: Minor > > Within a database, to filter for tables with the string 'abc' in its name, I > can use something like: > {code:java} > hive> use my_database; > hive> show tables '*abc*'; > {code} > It would be great if I can do something similar to search within the list of > columns in a table. > I have a table with around 3200 columns. Searching for the column of interest > is an onerous task after doing a describe on it. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HIVE-18373) Make it easier to search for column name in a table
[ https://issues.apache.org/jira/browse/HIVE-18373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16311127#comment-16311127 ] Madhudeep Petwal commented on HIVE-18373: - This would be a nice feature. I would like to work on this. > Make it easier to search for column name in a table > --- > > Key: HIVE-18373 > URL: https://issues.apache.org/jira/browse/HIVE-18373 > Project: Hive > Issue Type: New Feature >Reporter: Siddhant Saraf >Assignee: Madhudeep Petwal >Priority: Minor > > Within a database, to filter for tables with the string 'abc' in its name, I > can use something like: > {code:java} > hive> use my_database; > hive> show tables '*abc*'; > {code} > It would be great if I can do something similar to search within the list of > columns in a table. > I have a table with around 3200 columns. Searching for the column of interest > is an onerous task after doing a describe on it. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (HIVE-18373) Make it easier to search for column name in a table
[ https://issues.apache.org/jira/browse/HIVE-18373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Madhudeep Petwal reassigned HIVE-18373: --- Assignee: Madhudeep Petwal > Make it easier to search for column name in a table > --- > > Key: HIVE-18373 > URL: https://issues.apache.org/jira/browse/HIVE-18373 > Project: Hive > Issue Type: New Feature >Reporter: Siddhant Saraf >Assignee: Madhudeep Petwal >Priority: Minor > > Within a database, to filter for tables with the string 'abc' in its name, I > can use something like: > {code:java} > hive> use my_database; > hive> show tables '*abc*'; > {code} > It would be great if I can do something similar to search within the list of > columns in a table. > I have a table with around 3200 columns. Searching for the column of interest > is an onerous task after doing a describe on it. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HIVE-11547) beeline does not continue running the script after an error occurs while "beeline --force=true" is already set.
[ https://issues.apache.org/jira/browse/HIVE-11547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16310780#comment-16310780 ] Madhudeep Petwal commented on HIVE-11547: - This issue is fixed. We can close this JIRA [~whuang] > beeline does not continue running the script after an error occurs while > "beeline --force=true" is already set. > --- > > Key: HIVE-11547 > URL: https://issues.apache.org/jira/browse/HIVE-11547 > Project: Hive > Issue Type: Bug > Components: Beeline >Affects Versions: 1.2.0 > Environment: HDP 2.3 on Virtual box >Reporter: Wei Huang > > If you execute beeline to run a SQL script file, using the following command > > beeline -f > the beeline exists after the first error. i.e. when a test query fails > beeline quits to the CLI. > The "beeline --force=true" seems to have a bug and it does not continue > running the script after an error occurs. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HIVE-18346) Beeline could not launch because of size of history
[ https://issues.apache.org/jira/browse/HIVE-18346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16310721#comment-16310721 ] Madhudeep Petwal commented on HIVE-18346: - Thats all right [~asherman] . It would be very helpful if you could point to other beginner bug. > Beeline could not launch because of size of history > --- > > Key: HIVE-18346 > URL: https://issues.apache.org/jira/browse/HIVE-18346 > Project: Hive > Issue Type: Bug > Components: Beeline >Affects Versions: 1.2.1 >Reporter: Jumping >Assignee: Madhudeep Petwal >Priority: Minor > > Beeline version 1.2.1 could not launch when the size of > ${user.home}/.beeline/history larger than 39MB. Which reports > "java.lang.outofmemoryerror" . -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HIVE-18346) Beeline could not launch because of size of history
[ https://issues.apache.org/jira/browse/HIVE-18346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16309474#comment-16309474 ] Madhudeep Petwal commented on HIVE-18346: - The max size for history is DEFAULT_MAX_SIZE = 500; and this function maybeResize() is keeping a check on history size It looks like you manually inserted some history records, in that case also beeline truncate history size to 3k -rw---. 1 user group 3.0K Jan 3 16:17 .beeline/history am I wrong ?? I am not able to reproduce this bug. I think it is handled [~asherman] > Beeline could not launch because of size of history > --- > > Key: HIVE-18346 > URL: https://issues.apache.org/jira/browse/HIVE-18346 > Project: Hive > Issue Type: Bug > Components: Beeline >Affects Versions: 1.2.1 >Reporter: Jumping >Assignee: Madhudeep Petwal >Priority: Minor > > Beeline version 1.2.1 could not launch when the size of > ${user.home}/.beeline/history larger than 39MB. Which reports > "java.lang.outofmemoryerror" . -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HIVE-18346) Beeline could not launch because of size of history
[ https://issues.apache.org/jira/browse/HIVE-18346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16307400#comment-16307400 ] Madhudeep Petwal commented on HIVE-18346: - What I mean was when you got this error, this was the only error or there was some more statements following it ? For example Exception in thread "main" java.lang.OutOfMemoryError: Java heap space Like this ? > Beeline could not launch because of size of history > --- > > Key: HIVE-18346 > URL: https://issues.apache.org/jira/browse/HIVE-18346 > Project: Hive > Issue Type: Bug > Components: Beeline >Affects Versions: 1.2.1 >Reporter: Jumping >Assignee: Madhudeep Petwal >Priority: Minor > > Beeline version 1.2.1 could not launch when the size of > ${user.home}/.beeline/history larger than 39MB. Which reports > "java.lang.outofmemoryerror" . -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HIVE-18346) Beeline could not launch because of size of history
[ https://issues.apache.org/jira/browse/HIVE-18346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16305993#comment-16305993 ] Madhudeep Petwal commented on HIVE-18346: - [~JQu] can you print the complete stack trace ? > Beeline could not launch because of size of history > --- > > Key: HIVE-18346 > URL: https://issues.apache.org/jira/browse/HIVE-18346 > Project: Hive > Issue Type: Bug > Components: Beeline >Affects Versions: 1.2.1 >Reporter: Jumping >Assignee: Madhudeep Petwal >Priority: Minor > > Beeline version 1.2.1 could not launch when the size of > ${user.home}/.beeline/history larger than 39MB. Which reports > "java.lang.outofmemoryerror" . -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (HIVE-18346) Beeline could not launch because of size of history
[ https://issues.apache.org/jira/browse/HIVE-18346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Madhudeep Petwal reassigned HIVE-18346: --- Assignee: Madhudeep Petwal (was: Andrew Sherman) > Beeline could not launch because of size of history > --- > > Key: HIVE-18346 > URL: https://issues.apache.org/jira/browse/HIVE-18346 > Project: Hive > Issue Type: Bug > Components: Beeline >Affects Versions: 1.2.1 >Reporter: JQu >Assignee: Madhudeep Petwal >Priority: Minor > > Beeline version 1.2.1 could not launch when the size of > ${user.home}/.beeline/history larger than 39MB. Which reports > "java.lang.outofmemoryerror" . -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HIVE-14615) Temp table leaves behind insert command
[ https://issues.apache.org/jira/browse/HIVE-14615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16305596#comment-16305596 ] Madhudeep Petwal commented on HIVE-14615: - Thanks [~asherman] . I will look into that. > Temp table leaves behind insert command > --- > > Key: HIVE-14615 > URL: https://issues.apache.org/jira/browse/HIVE-14615 > Project: Hive > Issue Type: Bug > Components: Query Processor >Reporter: Chaoyu Tang >Assignee: Andrew Sherman > > {code} > create table test (key int, value string); > insert into test values (1, 'val1'); > show tables; > test > values__tmp__table__1 > {code} > the temp table values__tmp__table__1 was resulted from insert into ...values > and exists until logout the session. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HIVE-14615) Temp table leaves behind insert command
[ https://issues.apache.org/jira/browse/HIVE-14615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16305043#comment-16305043 ] Madhudeep Petwal commented on HIVE-14615: - temp tables are created in genValuesTempTable() function, I was thinking of dropping the table using dropTableOrPartitions() func after query successfully inserts. Btw have not coded yet. > Temp table leaves behind insert command > --- > > Key: HIVE-14615 > URL: https://issues.apache.org/jira/browse/HIVE-14615 > Project: Hive > Issue Type: Bug > Components: Query Processor >Reporter: Chaoyu Tang >Assignee: Madhudeep Petwal > > {code} > create table test (key int, value string); > insert into test values (1, 'val1'); > show tables; > test > values__tmp__table__1 > {code} > the temp table values__tmp__table__1 was resulted from insert into ...values > and exists until logout the session. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (HIVE-14615) Temp table leaves behind insert command
[ https://issues.apache.org/jira/browse/HIVE-14615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Madhudeep Petwal reassigned HIVE-14615: --- Assignee: Madhudeep Petwal (was: Andrew Sherman) > Temp table leaves behind insert command > --- > > Key: HIVE-14615 > URL: https://issues.apache.org/jira/browse/HIVE-14615 > Project: Hive > Issue Type: Bug > Components: Query Processor >Reporter: Chaoyu Tang >Assignee: Madhudeep Petwal > > {code} > create table test (key int, value string); > insert into test values (1, 'val1'); > show tables; > test > values__tmp__table__1 > {code} > the temp table values__tmp__table__1 was resulted from insert into ...values > and exists until logout the session. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (HIVE-14615) Temp table leaves behind insert command
[ https://issues.apache.org/jira/browse/HIVE-14615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16303463#comment-16303463 ] Madhudeep Petwal commented on HIVE-14615: - Can I work on this issue ? > Temp table leaves behind insert command > --- > > Key: HIVE-14615 > URL: https://issues.apache.org/jira/browse/HIVE-14615 > Project: Hive > Issue Type: Bug > Components: Query Processor >Reporter: Chaoyu Tang >Assignee: Madhudeep Petwal > > {code} > create table test (key int, value string); > insert into test values (1, 'val1'); > show tables; > test > values__tmp__table__1 > {code} > the temp table values__tmp__table__1 was resulted from insert into ...values > and exists until logout the session. -- This message was sent by Atlassian JIRA (v6.4.14#64029)