[
https://issues.apache.org/jira/browse/HIVE-3227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13409159#comment-13409159
]
Navis commented on HIVE-3227:
-----------------------------
@Edward Capriolo
As you said, HIVE-3238(cool!) seemed to be much better and safer way for doing
the same.
Nonetheless, I insist there should be a alternative way which can populate
table/partition simply and quickly (only) for test use. Current full test
time(4h?) seemed to be too long and ever increasing.
> Implement data loading from user provided string directly for test
> ------------------------------------------------------------------
>
> Key: HIVE-3227
> URL: https://issues.apache.org/jira/browse/HIVE-3227
> Project: Hive
> Issue Type: Improvement
> Components: Query Processor, Testing Infrastructure
> Affects Versions: 0.10.0
> Reporter: Navis
> Assignee: Navis
> Priority: Trivial
>
> {code}
> load data instream 'key value\nkey2 value2' into table test;
> {code}
> This will make test easier and also can reduce test time. For example,
> {code}
> -- ppr_pushdown.q
> create table ppr_test (key string) partitioned by (ds string);
> alter table ppr_test add partition (ds = '1234');
> insert overwrite table ppr_test partition(ds = '1234') select * from (select
> '1234' from src limit 1 union all select 'abcd' from src limit 1) s;
> {code}
> last query is 4MR job. But can be replaced by
> {code}
> create table ppr_test (key string) partitioned by (ds string) ROW FORMAT
> delimited fields terminated by ' ';
> alter table ppr_test add partition (ds = '1234');
> load data local instream '1234\nabcd' overwrite into table ppr_test
> partition(ds = '1234');
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
