[jira] [Updated] (IMPALA-6923) Update scripts in $IMPALA_HOME/tests/benchmark

2018-08-01 Thread nithya (JIRA)


 [ 
https://issues.apache.org/jira/browse/IMPALA-6923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

nithya updated IMPALA-6923:
---
Description: 
Update scripts in $IMPALA_HOME/tests/benchmark to address two items,

Item-1:

Out of these 3 scripts in the benchmark folder, only 
report_benchmark_results.py is currently being used upstream to generate a 
report comparing performance benchmark numbers between two given runs of the 
performance tests. The other two scripts have some code that inserts some 
metrics from a given performance test run to a database on a specified impala 
instance. But these scripts depend on some internal resources to generate a 
meaningful interpretation of these metrics and these resources are not 
available to external apache community. Hence removing these scripts. While 
removing these scripts report_benchmark_results.py needs to be cleaned up to 
remove any code pointing to these scripts.

 

Item-2:

Add some checks for metadata queries which don't have summaries and for command 
line option hive_results to report_benchmark_results.py script

 

  was:
 

Update scripts in 

Out of these 3 scripts, only report_benchmark_results.py is currently being 
used upstream to generate a report comparing performance benchmark numbers 
between two given runs of the performance tests. The other two scripts have 
some code that inserts some metrics from a given performance test run to a 
database on a specified impala instance. But these scripts depend on some 
internal resources to generate a meaningful interpretation of these metrics and 
these resources are not available to external apache community. Hence removing 
these scripts. While removing these scripts report_benchmark_results.py needs 
to be cleaned up to remove any code pointing to these scripts.

 

 


> Update scripts in $IMPALA_HOME/tests/benchmark
> --
>
> Key: IMPALA-6923
> URL: https://issues.apache.org/jira/browse/IMPALA-6923
> Project: IMPALA
>  Issue Type: Task
>Reporter: nithya
>Priority: Major
>
> Update scripts in $IMPALA_HOME/tests/benchmark to address two items,
> Item-1:
> Out of these 3 scripts in the benchmark folder, only 
> report_benchmark_results.py is currently being used upstream to generate a 
> report comparing performance benchmark numbers between two given runs of the 
> performance tests. The other two scripts have some code that inserts some 
> metrics from a given performance test run to a database on a specified impala 
> instance. But these scripts depend on some internal resources to generate a 
> meaningful interpretation of these metrics and these resources are not 
> available to external apache community. Hence removing these scripts. While 
> removing these scripts report_benchmark_results.py needs to be cleaned up to 
> remove any code pointing to these scripts.
>  
> Item-2:
> Add some checks for metadata queries which don't have summaries and for 
> command line option hive_results to report_benchmark_results.py script
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org



[jira] [Updated] (IMPALA-6923) Update scripts in $IMPALA_HOME/tests/benchmark

2018-08-01 Thread nithya (JIRA)


 [ 
https://issues.apache.org/jira/browse/IMPALA-6923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

nithya updated IMPALA-6923:
---
Description: 
 

Update scripts in 

Out of these 3 scripts, only report_benchmark_results.py is currently being 
used upstream to generate a report comparing performance benchmark numbers 
between two given runs of the performance tests. The other two scripts have 
some code that inserts some metrics from a given performance test run to a 
database on a specified impala instance. But these scripts depend on some 
internal resources to generate a meaningful interpretation of these metrics and 
these resources are not available to external apache community. Hence removing 
these scripts. While removing these scripts report_benchmark_results.py needs 
to be cleaned up to remove any code pointing to these scripts.

 

 

  was:
$IMPALA_HOME/tests/benchmark folder has scripts that can be used collect useful 
information about test execution.

 


> Update scripts in $IMPALA_HOME/tests/benchmark
> --
>
> Key: IMPALA-6923
> URL: https://issues.apache.org/jira/browse/IMPALA-6923
> Project: IMPALA
>  Issue Type: Task
>Reporter: nithya
>Priority: Major
>
>  
> Update scripts in 
> Out of these 3 scripts, only report_benchmark_results.py is currently being 
> used upstream to generate a report comparing performance benchmark numbers 
> between two given runs of the performance tests. The other two scripts have 
> some code that inserts some metrics from a given performance test run to a 
> database on a specified impala instance. But these scripts depend on some 
> internal resources to generate a meaningful interpretation of these metrics 
> and these resources are not available to external apache community. Hence 
> removing these scripts. While removing these scripts 
> report_benchmark_results.py needs to be cleaned up to remove any code 
> pointing to these scripts.
>  
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org



[jira] [Updated] (IMPALA-6923) Update scripts in $IMPALA_HOME/tests/benchmark

2018-08-01 Thread nithya (JIRA)


 [ 
https://issues.apache.org/jira/browse/IMPALA-6923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

nithya updated IMPALA-6923:
---
Description: 
$IMPALA_HOME/tests/benchmark folder has scripts that can be used collect useful 
information about test execution.

 

  was:
$IMPALA_HOME/tests/benchmark folder has scripts that can be used collect useful 
information about test execution.

Updating these scripts to capture
 * Test Run time execution information
 * Workload data
 * Add options to mark test run as official and to not save profiles.


> Update scripts in $IMPALA_HOME/tests/benchmark
> --
>
> Key: IMPALA-6923
> URL: https://issues.apache.org/jira/browse/IMPALA-6923
> Project: IMPALA
>  Issue Type: Task
>Reporter: nithya
>Priority: Major
>
> $IMPALA_HOME/tests/benchmark folder has scripts that can be used collect 
> useful information about test execution.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org