[jira] [Commented] (HIVE-11538) Add an option to skip init script while running tests

2017-06-06 Thread Zoltan Haindrich (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-11538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16039476#comment-16039476
 ] 

Zoltan Haindrich commented on HIVE-11538:
-

[~ashutoshc] [~wzheng] oh...it seems like this have been changed by that 
upgrade - because the initScript setting location is now inside the java code; 
the maven part defaults to setting it to an empty string (because it have to be 
passed over to surefire...) - for this reason the method which picks up the 
overriden value for  {{initScript}} threats the empty value as "not set" - 
since it is impossible to unset a property if its empty...

I always use some nonexistent initscript value ({{-DinitScript=asd.sql}}) to 
skip the initscript...now I know why - I wasn't aware that I've broken this...

I think the reason behind the need to skip the initscript is because the test 
data-dependencies are "hidden", and everything is pushed into 
q_test_init.sql...there are many datasets in there which are rarely used1 
test usually uses only 1 dataset...I've collected a few ideas which may help 
here: https://gist.github.com/kgyrtkirk/89931b7e420c4950b7b36cc8fc1cb6a2

> Add an option to skip init script while running tests
> -
>
> Key: HIVE-11538
> URL: https://issues.apache.org/jira/browse/HIVE-11538
> Project: Hive
>  Issue Type: Improvement
>  Components: Testing Infrastructure
>Reporter: Ashutosh Chauhan
>Assignee: Ashutosh Chauhan
> Fix For: 2.0.0
>
> Attachments: HIVE-11538.2.patch, HIVE-11538.3.patch, HIVE-11538.patch
>
>
> {{q_test_init.sql}} has grown over time. Now, it takes substantial amount of 
> time. When debugging a particular query which doesn't need such 
> initialization, this delay is annoyance.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (HIVE-11538) Add an option to skip init script while running tests

2017-06-02 Thread Ashutosh Chauhan (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-11538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035523#comment-16035523
 ] 

Ashutosh Chauhan commented on HIVE-11538:
-

It doesnt work for me anymore either. My suspicion is when [~kgyrtkirk] 
overhauled our test infra somewhere that time, it stopped working.

> Add an option to skip init script while running tests
> -
>
> Key: HIVE-11538
> URL: https://issues.apache.org/jira/browse/HIVE-11538
> Project: Hive
>  Issue Type: Improvement
>  Components: Testing Infrastructure
>Reporter: Ashutosh Chauhan
>Assignee: Ashutosh Chauhan
> Fix For: 2.0.0
>
> Attachments: HIVE-11538.2.patch, HIVE-11538.3.patch, HIVE-11538.patch
>
>
> {{q_test_init.sql}} has grown over time. Now, it takes substantial amount of 
> time. When debugging a particular query which doesn't need such 
> initialization, this delay is annoyance.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (HIVE-11538) Add an option to skip init script while running tests

2017-06-02 Thread Wei Zheng (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-11538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035482#comment-16035482
 ] 

Wei Zheng commented on HIVE-11538:
--

For some reason this doesn't work for me -- it still runs the init script. 
Here's the command that I used. Anything wrong?
{code}
mvn test -Dtest=TestCliDriver -Dqfile=mm_materializedview.q -DinitScript=
{code}

> Add an option to skip init script while running tests
> -
>
> Key: HIVE-11538
> URL: https://issues.apache.org/jira/browse/HIVE-11538
> Project: Hive
>  Issue Type: Improvement
>  Components: Testing Infrastructure
>Reporter: Ashutosh Chauhan
>Assignee: Ashutosh Chauhan
> Fix For: 2.0.0
>
> Attachments: HIVE-11538.2.patch, HIVE-11538.3.patch, HIVE-11538.patch
>
>
> {{q_test_init.sql}} has grown over time. Now, it takes substantial amount of 
> time. When debugging a particular query which doesn't need such 
> initialization, this delay is annoyance.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (HIVE-11538) Add an option to skip init script while running tests

2016-01-16 Thread Lefty Leverenz (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-11538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15103507#comment-15103507
 ] 

Lefty Leverenz commented on HIVE-11538:
---

Removing the TODOC2.0 label, on the assumption that the documentation is 
correct and does not need any explanation of a profile-not-found warning 
emitted for "-Phadoop-2" -- that could be added easily enough, but the 
information is available here via the JIRA link in the doc.

* [How do I modify the init script when testing? | 
https://cwiki.apache.org/confluence/display/Hive/HiveDeveloperFAQ#HiveDeveloperFAQ-HowdoImodifytheinitscriptwhentesting?]

Thanks [~sladymon], and thanks for the clarification [~sershe].

> Add an option to skip init script while running tests
> -
>
> Key: HIVE-11538
> URL: https://issues.apache.org/jira/browse/HIVE-11538
> Project: Hive
>  Issue Type: Improvement
>  Components: Testing Infrastructure
>Reporter: Ashutosh Chauhan
>Assignee: Ashutosh Chauhan
> Fix For: 2.0.0
>
> Attachments: HIVE-11538.2.patch, HIVE-11538.3.patch, HIVE-11538.patch
>
>
> {{q_test_init.sql}} has grown over time. Now, it takes substantial amount of 
> time. When debugging a particular query which doesn't need such 
> initialization, this delay is annoyance.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-11538) Add an option to skip init script while running tests

2016-01-06 Thread Lefty Leverenz (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-11538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15085312#comment-15085312
 ] 

Lefty Leverenz commented on HIVE-11538:
---

Pinging [~ashutoshc].

Is -Phadoop-2 still needed in mvn test commands for Hive 2.0.0 and later?

> Add an option to skip init script while running tests
> -
>
> Key: HIVE-11538
> URL: https://issues.apache.org/jira/browse/HIVE-11538
> Project: Hive
>  Issue Type: Improvement
>  Components: Testing Infrastructure
>Reporter: Ashutosh Chauhan
>Assignee: Ashutosh Chauhan
>  Labels: TODOC2.0
> Fix For: 2.0.0
>
> Attachments: HIVE-11538.2.patch, HIVE-11538.3.patch, HIVE-11538.patch
>
>
> {{q_test_init.sql}} has grown over time. Now, it takes substantial amount of 
> time. When debugging a particular query which doesn't need such 
> initialization, this delay is annoyance.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-11538) Add an option to skip init script while running tests

2016-01-06 Thread Sergey Shelukhin (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-11538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15086040#comment-15086040
 ] 

Sergey Shelukhin commented on HIVE-11538:
-

No, it should not be needed. However, it's harmless and just emits a warning 
that the profile is not found.

> Add an option to skip init script while running tests
> -
>
> Key: HIVE-11538
> URL: https://issues.apache.org/jira/browse/HIVE-11538
> Project: Hive
>  Issue Type: Improvement
>  Components: Testing Infrastructure
>Reporter: Ashutosh Chauhan
>Assignee: Ashutosh Chauhan
>  Labels: TODOC2.0
> Fix For: 2.0.0
>
> Attachments: HIVE-11538.2.patch, HIVE-11538.3.patch, HIVE-11538.patch
>
>
> {{q_test_init.sql}} has grown over time. Now, it takes substantial amount of 
> time. When debugging a particular query which doesn't need such 
> initialization, this delay is annoyance.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-11538) Add an option to skip init script while running tests

2015-12-10 Thread Lefty Leverenz (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-11538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051902#comment-15051902
 ] 

Lefty Leverenz commented on HIVE-11538:
---

[~ashutoshc] since this is only for Hive 2.0.0+, is -Phadoop-2 really necessary 
in the mvn commands?

{code}
mvn test -Dtest=TestCliDriver -Phadoop-2 -Dqfile=test_to_run.q  -DinitScript=
{code}

and

{code}
mvn test -Dtest=TestCliDriver -Phadoop-2 -Dtest.output.overwrite=true 
-Dqfile=test_to_run.q  -DinitScript=custom_script.sql
{code}

> Add an option to skip init script while running tests
> -
>
> Key: HIVE-11538
> URL: https://issues.apache.org/jira/browse/HIVE-11538
> Project: Hive
>  Issue Type: Improvement
>  Components: Testing Infrastructure
>Reporter: Ashutosh Chauhan
>Assignee: Ashutosh Chauhan
>  Labels: TODOC2.0
> Fix For: 2.0.0
>
> Attachments: HIVE-11538.2.patch, HIVE-11538.3.patch, HIVE-11538.patch
>
>
> {{q_test_init.sql}} has grown over time. Now, it takes substantial amount of 
> time. When debugging a particular query which doesn't need such 
> initialization, this delay is annoyance.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-11538) Add an option to skip init script while running tests

2015-12-10 Thread Shannon Ladymon (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-11538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051859#comment-15051859
 ] 

Shannon Ladymon commented on HIVE-11538:


[~ashutoshc], this is now added to the wikidoc in the HiveDeveloperFAQ:
* [HiveDeveloperFAQ - Testing | 
https://cwiki.apache.org/confluence/display/Hive/HiveDeveloperFAQ#HiveDeveloperFAQ-Testing]

> Add an option to skip init script while running tests
> -
>
> Key: HIVE-11538
> URL: https://issues.apache.org/jira/browse/HIVE-11538
> Project: Hive
>  Issue Type: Improvement
>  Components: Testing Infrastructure
>Reporter: Ashutosh Chauhan
>Assignee: Ashutosh Chauhan
>  Labels: TODOC2.0
> Fix For: 2.0.0
>
> Attachments: HIVE-11538.2.patch, HIVE-11538.3.patch, HIVE-11538.patch
>
>
> {{q_test_init.sql}} has grown over time. Now, it takes substantial amount of 
> time. When debugging a particular query which doesn't need such 
> initialization, this delay is annoyance.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-11538) Add an option to skip init script while running tests

2015-08-26 Thread Ashutosh Chauhan (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-11538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14715193#comment-14715193
 ] 

Ashutosh Chauhan commented on HIVE-11538:
-

[~leftylev] Yes. Please add to wikidoc.

 Add an option to skip init script while running tests
 -

 Key: HIVE-11538
 URL: https://issues.apache.org/jira/browse/HIVE-11538
 Project: Hive
  Issue Type: Improvement
  Components: Testing Infrastructure
Reporter: Ashutosh Chauhan
Assignee: Ashutosh Chauhan
 Fix For: 2.0.0

 Attachments: HIVE-11538.2.patch, HIVE-11538.3.patch, HIVE-11538.patch


 {{q_test_init.sql}} has grown over time. Now, it takes substantial amount of 
 time. When debugging a particular query which doesn't need such 
 initialization, this delay is annoyance.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-11538) Add an option to skip init script while running tests

2015-08-25 Thread Takanobu Asanuma (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-11538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14712378#comment-14712378
 ] 

Takanobu Asanuma commented on HIVE-11538:
-

Actually the problem was solved. When importing the maven project in IntelliJ, 
I was asked to Select profile and chose both hadoop-2 and hadoop-1. This 
caused the problem. Then I chose only hadoop-2, it was solved. I'm sorry to 
have caused trouble. Tahnks anyway.

 Add an option to skip init script while running tests
 -

 Key: HIVE-11538
 URL: https://issues.apache.org/jira/browse/HIVE-11538
 Project: Hive
  Issue Type: Improvement
  Components: Testing Infrastructure
Reporter: Ashutosh Chauhan
Assignee: Ashutosh Chauhan
 Fix For: 2.0.0

 Attachments: HIVE-11538.2.patch, HIVE-11538.3.patch, HIVE-11538.patch


 {{q_test_init.sql}} has grown over time. Now, it takes substantial amount of 
 time. When debugging a particular query which doesn't need such 
 initialization, this delay is annoyance.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-11538) Add an option to skip init script while running tests

2015-08-25 Thread Lefty Leverenz (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-11538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14712384#comment-14712384
 ] 

Lefty Leverenz commented on HIVE-11538:
---

Ping [~ashutoshc]:  does this need wikidoc?

 Add an option to skip init script while running tests
 -

 Key: HIVE-11538
 URL: https://issues.apache.org/jira/browse/HIVE-11538
 Project: Hive
  Issue Type: Improvement
  Components: Testing Infrastructure
Reporter: Ashutosh Chauhan
Assignee: Ashutosh Chauhan
 Fix For: 2.0.0

 Attachments: HIVE-11538.2.patch, HIVE-11538.3.patch, HIVE-11538.patch


 {{q_test_init.sql}} has grown over time. Now, it takes substantial amount of 
 time. When debugging a particular query which doesn't need such 
 initialization, this delay is annoyance.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-11538) Add an option to skip init script while running tests

2015-08-25 Thread Takanobu Asanuma (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-11538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14710690#comment-14710690
 ] 

Takanobu Asanuma commented on HIVE-11538:
-

Hi, [~ashutoshc].
I'm using IntelliJ and it can't resolve {{FileStatus#isDirectory}} in 
{{QTestUtil}}. I built the project with {{mvn clean install -DskipTests 
-Phadoop-2}}. The build was passed and hadoop-core-1.2.1 which has 
{{FileStatus}} was imported. But {{FileStatus}} doesn't have the method in 
version 1.2.1. Could you please check this problem?

 Add an option to skip init script while running tests
 -

 Key: HIVE-11538
 URL: https://issues.apache.org/jira/browse/HIVE-11538
 Project: Hive
  Issue Type: Improvement
  Components: Testing Infrastructure
Reporter: Ashutosh Chauhan
Assignee: Ashutosh Chauhan
 Fix For: 2.0.0

 Attachments: HIVE-11538.2.patch, HIVE-11538.3.patch, HIVE-11538.patch


 {{q_test_init.sql}} has grown over time. Now, it takes substantial amount of 
 time. When debugging a particular query which doesn't need such 
 initialization, this delay is annoyance.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-11538) Add an option to skip init script while running tests

2015-08-13 Thread Ashutosh Chauhan (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-11538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14695537#comment-14695537
 ] 

Ashutosh Chauhan commented on HIVE-11538:
-

Can we do that up in a follow-up? I am afraid I won't have more time for this 
and patch in current form still provides lot of value (atleast to me : ))

 Add an option to skip init script while running tests
 -

 Key: HIVE-11538
 URL: https://issues.apache.org/jira/browse/HIVE-11538
 Project: Hive
  Issue Type: Improvement
  Components: Testing Infrastructure
Reporter: Ashutosh Chauhan
Assignee: Ashutosh Chauhan
 Attachments: HIVE-11538.patch


 {{q_test_init.sql}} has grown over time. Now, it takes substantial amount of 
 time. When debugging a particular query which doesn't need such 
 initialization, this delay is annoyance.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-11538) Add an option to skip init script while running tests

2015-08-13 Thread Hive QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-11538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14696022#comment-14696022
 ] 

Hive QA commented on HIVE-11538:




{color:red}Overall{color}: -1 at least one tests failed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12750328/HIVE-11538.2.patch

{color:red}ERROR:{color} -1 due to 4 failed/errored test(s), 9357 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestEncryptedHDFSCliDriver.testCliDriver_encryption_drop_table
org.apache.hadoop.hive.cli.TestEncryptedHDFSCliDriver.testCliDriver_encryption_insert_partition_dynamic
org.apache.hadoop.hive.cli.TestEncryptedHDFSCliDriver.testCliDriver_encryption_join_unencrypted_tbl
org.apache.hadoop.hive.cli.TestEncryptedHDFSCliDriver.testCliDriver_encryption_move_tbl
{noformat}

Test results: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4954/testReport
Console output: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4954/console
Test logs: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-4954/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 4 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12750328 - PreCommit-HIVE-TRUNK-Build

 Add an option to skip init script while running tests
 -

 Key: HIVE-11538
 URL: https://issues.apache.org/jira/browse/HIVE-11538
 Project: Hive
  Issue Type: Improvement
  Components: Testing Infrastructure
Reporter: Ashutosh Chauhan
Assignee: Ashutosh Chauhan
 Attachments: HIVE-11538.2.patch, HIVE-11538.patch


 {{q_test_init.sql}} has grown over time. Now, it takes substantial amount of 
 time. When debugging a particular query which doesn't need such 
 initialization, this delay is annoyance.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-11538) Add an option to skip init script while running tests

2015-08-13 Thread Sergey Shelukhin (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-11538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14695819#comment-14695819
 ] 

Sergey Shelukhin commented on HIVE-11538:
-

sounds good, +1


 Add an option to skip init script while running tests
 -

 Key: HIVE-11538
 URL: https://issues.apache.org/jira/browse/HIVE-11538
 Project: Hive
  Issue Type: Improvement
  Components: Testing Infrastructure
Reporter: Ashutosh Chauhan
Assignee: Ashutosh Chauhan
 Attachments: HIVE-11538.2.patch, HIVE-11538.patch


 {{q_test_init.sql}} has grown over time. Now, it takes substantial amount of 
 time. When debugging a particular query which doesn't need such 
 initialization, this delay is annoyance.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-11538) Add an option to skip init script while running tests

2015-08-13 Thread Lefty Leverenz (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-11538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14696521#comment-14696521
 ] 

Lefty Leverenz commented on HIVE-11538:
---

Should this be documented in the wiki?  (See Ashutosh's first two comments.)  
If so, where?

* [Testing Docs | https://cwiki.apache.org/confluence/display/Hive/TestingDocs]

 Add an option to skip init script while running tests
 -

 Key: HIVE-11538
 URL: https://issues.apache.org/jira/browse/HIVE-11538
 Project: Hive
  Issue Type: Improvement
  Components: Testing Infrastructure
Reporter: Ashutosh Chauhan
Assignee: Ashutosh Chauhan
 Fix For: 2.0.0

 Attachments: HIVE-11538.2.patch, HIVE-11538.3.patch, HIVE-11538.patch


 {{q_test_init.sql}} has grown over time. Now, it takes substantial amount of 
 time. When debugging a particular query which doesn't need such 
 initialization, this delay is annoyance.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-11538) Add an option to skip init script while running tests

2015-08-12 Thread Ashutosh Chauhan (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-11538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694125#comment-14694125
 ] 

Ashutosh Chauhan commented on HIVE-11538:
-

Refer to my prev comment.

 Add an option to skip init script while running tests
 -

 Key: HIVE-11538
 URL: https://issues.apache.org/jira/browse/HIVE-11538
 Project: Hive
  Issue Type: Improvement
  Components: Testing Infrastructure
Reporter: Ashutosh Chauhan
Assignee: Ashutosh Chauhan
 Attachments: HIVE-11538.patch


 {{q_test_init.sql}} has grown over time. Now, it takes substantial amount of 
 time. When debugging a particular query which doesn't need such 
 initialization, this delay is annoyance.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-11538) Add an option to skip init script while running tests

2015-08-12 Thread Sergey Shelukhin (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-11538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694124#comment-14694124
 ] 

Sergey Shelukhin commented on HIVE-11538:
-

Hmm.. wouldn't the queries fail w/o init script if they rely on any tables like 
src, cbo_blah, etc.?
You would almost always need to supply one.
Should the init script be split as part of this change, with the main script 
calling a number of smaller init sub-scripts that initialize one table or small 
subset?
That way these small scripts could be used for this parameter when debugging.

 Add an option to skip init script while running tests
 -

 Key: HIVE-11538
 URL: https://issues.apache.org/jira/browse/HIVE-11538
 Project: Hive
  Issue Type: Improvement
  Components: Testing Infrastructure
Reporter: Ashutosh Chauhan
Assignee: Ashutosh Chauhan
 Attachments: HIVE-11538.patch


 {{q_test_init.sql}} has grown over time. Now, it takes substantial amount of 
 time. When debugging a particular query which doesn't need such 
 initialization, this delay is annoyance.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-11538) Add an option to skip init script while running tests

2015-08-12 Thread Ashutosh Chauhan (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-11538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694117#comment-14694117
 ] 

Ashutosh Chauhan commented on HIVE-11538:
-

It also let you supply custom init script. e.g., pcr.q only refers to src  
srcpart tables. So,
{code}
$ cat ../../data/scripts/src_srcpart.sql 
CREATE TABLE src (key STRING COMMENT 'default', value STRING COMMENT 'default') 
STORED AS TEXTFILE;
LOAD DATA LOCAL INPATH ${hiveconf:test.data.dir}/kv1.txt INTO TABLE src;

CREATE TABLE srcpart (key STRING COMMENT 'default', value STRING COMMENT 
'default')
PARTITIONED BY (ds STRING, hr STRING)
STORED AS TEXTFILE;

LOAD DATA LOCAL INPATH ${hiveconf:test.data.dir}/kv1.txt
OVERWRITE INTO TABLE srcpart PARTITION (ds=2008-04-08, hr=11);

LOAD DATA LOCAL INPATH ${hiveconf:test.data.dir}/kv1.txt
OVERWRITE INTO TABLE srcpart PARTITION (ds=2008-04-08, hr=12);

LOAD DATA LOCAL INPATH ${hiveconf:test.data.dir}/kv1.txt
OVERWRITE INTO TABLE srcpart PARTITION (ds=2008-04-09, hr=11);

LOAD DATA LOCAL INPATH ${hiveconf:test.data.dir}/kv1.txt
OVERWRITE INTO TABLE srcpart PARTITION (ds=2008-04-09, hr=12);

$mvn test -Dtest=TestCliDriver -Phadoop-2 -Dtest.output.overwrite=true 
-Dqfile=pcr.q  -DinitScript=src_srcpart.sql
{code}

 Add an option to skip init script while running tests
 -

 Key: HIVE-11538
 URL: https://issues.apache.org/jira/browse/HIVE-11538
 Project: Hive
  Issue Type: Improvement
  Components: Testing Infrastructure
Reporter: Ashutosh Chauhan
Assignee: Ashutosh Chauhan
 Attachments: HIVE-11538.patch


 {{q_test_init.sql}} has grown over time. Now, it takes substantial amount of 
 time. When debugging a particular query which doesn't need such 
 initialization, this delay is annoyance.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-11538) Add an option to skip init script while running tests

2015-08-12 Thread Hive QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-11538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694456#comment-14694456
 ] 

Hive QA commented on HIVE-11538:




{color:red}Overall{color}: -1 at least one tests failed

Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12750155/HIVE-11538.patch

{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 9348 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.ql.TestMTQueries.testMTQueries1
{noformat}

Test results: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4940/testReport
Console output: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4940/console
Test logs: 
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-4940/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12750155 - PreCommit-HIVE-TRUNK-Build

 Add an option to skip init script while running tests
 -

 Key: HIVE-11538
 URL: https://issues.apache.org/jira/browse/HIVE-11538
 Project: Hive
  Issue Type: Improvement
  Components: Testing Infrastructure
Reporter: Ashutosh Chauhan
Assignee: Ashutosh Chauhan
 Attachments: HIVE-11538.patch


 {{q_test_init.sql}} has grown over time. Now, it takes substantial amount of 
 time. When debugging a particular query which doesn't need such 
 initialization, this delay is annoyance.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (HIVE-11538) Add an option to skip init script while running tests

2015-08-12 Thread Sergey Shelukhin (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-11538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694138#comment-14694138
 ] 

Sergey Shelukhin commented on HIVE-11538:
-

What I am saying is, these scripts should be included in the patch (and used 
from main script) :)

 Add an option to skip init script while running tests
 -

 Key: HIVE-11538
 URL: https://issues.apache.org/jira/browse/HIVE-11538
 Project: Hive
  Issue Type: Improvement
  Components: Testing Infrastructure
Reporter: Ashutosh Chauhan
Assignee: Ashutosh Chauhan
 Attachments: HIVE-11538.patch


 {{q_test_init.sql}} has grown over time. Now, it takes substantial amount of 
 time. When debugging a particular query which doesn't need such 
 initialization, this delay is annoyance.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)