[
https://issues.apache.org/jira/browse/HCATALOG-340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Crawford resolved HCATALOG-340.
--------------------------------------
Resolution: Won't Fix
Closing because a lot of this slowness comes from PIG-2702. Tests will get
faster once our pig dependency has updated to 0.11.0.
> Speed up top 5 slowest HCatalog tests
> -------------------------------------
>
> Key: HCATALOG-340
> URL: https://issues.apache.org/jira/browse/HCATALOG-340
> Project: HCatalog
> Issue Type: Improvement
> Reporter: Travis Crawford
> Assignee: Travis Crawford
>
> Tests will always take longer than you want, but it looks like there may be
> some low-hanging fruit here. Speeding up the top 5 slowest tests will make
> developers happy.
> Top 5 slowest tests:
> # org.apache.hcatalog.pig.TestHCatLoaderComplexSchema - Time elapsed: 133.348
> sec
> # org.apache.hcatalog.pig.TestHCatStorer - Time elapsed: 113.594 sec
> # org.apache.hcatalog.mapreduce.TestHCatPartitioned - Time elapsed: 74.08 sec
> # org.apache.hcatalog.mapreduce.TestHCatDynamicPartitioned - Time elapsed:
> 58.456 sec
> # org.apache.hcatalog.mapreduce.TestSequenceFileReadWrite - Time elapsed:
> 57.884 sec
> All tests:
> {code}
> test:
> [mkdir] Created dir: /Users/travis/apache/hcatalog/build/test/logs
> [mkdir] Created dir: /tmp/hcat_junit_warehouse
> [junit] WARNING: multiple versions of ant detected in path for junit
> [junit]
> jar:file:/usr/share/ant/lib/ant.jar!/org/apache/tools/ant/Project.class
> [junit] and
> jar:file:/Users/travis/apache/hcatalog/hive/external/build/ivy/lib/default/ant-1.6.5.jar!/org/apache/tools/ant/Project.class
> [junit] Running org.apache.hcatalog.cli.TestPermsGrp
> [junit] 2012-03-22 18:31:23.664 java[17443:7807] Unable to load realm
> info from SCDynamicStore
> [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 46.237 sec
> [junit] Running org.apache.hcatalog.cli.TestSemanticAnalysis
> [junit] 2012-03-22 18:31:40.512 java[17450:1a03] Unable to load realm
> info from SCDynamicStore
> [junit] Tests run: 22, Failures: 0, Errors: 0, Time elapsed: 14.713 sec
> [junit] Running org.apache.hcatalog.cli.TestUseDatabase
> [junit] 2012-03-22 18:31:51.128 java[17551:1a03] Unable to load realm
> info from SCDynamicStore
> [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 7.139 sec
> [junit] Running org.apache.hcatalog.common.TestHCatUtil
> [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.12 sec
> [junit] Running org.apache.hcatalog.data.TestDefaultHCatRecord
> [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.055 sec
> [junit] Running org.apache.hcatalog.data.TestHCatRecordSerDe
> [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.282 sec
> [junit] Running org.apache.hcatalog.data.TestJsonSerDe
> [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.303 sec
> [junit] Running org.apache.hcatalog.data.TestLazyHCatRecord
> [junit] Tests run: 11, Failures: 0, Errors: 0, Time elapsed: 0.185 sec
> [junit] Running org.apache.hcatalog.data.TestReaderWriter
> [junit] 2012-03-22 18:32:12.175 java[17560:1a03] Unable to load realm
> info from SCDynamicStore
> [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 5.503 sec
> [junit] Running org.apache.hcatalog.data.schema.TestHCatSchema
> [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.01 sec
> [junit] Running org.apache.hcatalog.data.schema.TestHCatSchemaUtils
> [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.04 sec
> [junit] Running org.apache.hcatalog.listener.TestMsgBusConnection
> [junit] 2012-03-22 18:32:22.170 java[17566:1a03] Unable to load realm
> info from SCDynamicStore
> [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 9.143 sec
> [junit] Running org.apache.hcatalog.listener.TestNotificationListener
> [junit] 2012-03-22 18:32:34.745 java[17595:1a03] Unable to load realm
> info from SCDynamicStore
> [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 9.709 sec
> [junit] Running org.apache.hcatalog.mapreduce.TestHCatDynamicPartitioned
> [junit] 2012-03-22 18:32:58.464 java[17677:1a03] Unable to load realm
> info from SCDynamicStore
> [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 58.456 sec
> [junit] Running org.apache.hcatalog.mapreduce.TestHCatHiveCompatibility
> [junit] 2012-03-22 18:33:55.079 java[17797:1a03] Unable to load realm
> info from SCDynamicStore
> [junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 39.607 sec
> [junit] Running org.apache.hcatalog.mapreduce.TestHCatNonPartitioned
> [junit] 2012-03-22 18:34:34.502 java[17826:1a03] Unable to load realm
> info from SCDynamicStore
> [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 15.44 sec
> [junit] Running org.apache.hcatalog.mapreduce.TestHCatOutputFormat
> [junit] 2012-03-22 18:34:51.599 java[17928:1a03] Unable to load realm
> info from SCDynamicStore
> [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 5.613 sec
> [junit] Running org.apache.hcatalog.mapreduce.TestHCatPartitioned
> [junit] 2012-03-22 18:35:00.190 java[17932:1a03] Unable to load realm
> info from SCDynamicStore
> [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 74.08 sec
> [junit] Running org.apache.hcatalog.mapreduce.TestSequenceFileReadWrite
> [junit] 2012-03-22 18:36:13.185 java[18058:1a03] Unable to load realm
> info from SCDynamicStore
> [junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 57.884 sec
> [junit] Running org.apache.hcatalog.pig.TestHCatLoader
> [junit] 2012-03-22 18:37:13.759 java[18188:1a03] Unable to load realm
> info from SCDynamicStore
> [junit] Tests run: 6, Failures: 0, Errors: 0, Time elapsed: 54.616 sec
> [junit] 2012-03-22 18:38:09.457 java[18319:1a03] Unable to load realm
> info from SCDynamicStore
> [junit] Running org.apache.hcatalog.pig.TestHCatLoaderComplexSchema
> [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 133.348 sec
> [junit] Running org.apache.hcatalog.pig.TestHCatStorer
> [junit] 2012-03-22 18:40:33.173 java[18497:1a03] Unable to load realm
> info from SCDynamicStore
> [junit] Tests run: 14, Failures: 0, Errors: 0, Time elapsed: 113.594 sec
> [junit] Running org.apache.hcatalog.pig.TestHCatStorerMulti
> [junit] 2012-03-22 18:42:28.182 java[18640:1a03] Unable to load realm
> info from SCDynamicStore
> [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 27.781 sec
> [junit] Running org.apache.hcatalog.rcfile.TestRCFileInputStorageDriver
> [junit] 2012-03-22 18:42:56.939 java[18704:1a03] Unable to load realm
> info from SCDynamicStore
> [junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.571 sec
> [junit] 2012-03-22 18:42:59.001 java[18705:1a03] Unable to load realm
> info from SCDynamicStore
> [junit] Running org.apache.hcatalog.rcfile.TestRCFileMapReduceInputFormat
> [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.228 sec
> [junit] Running org.apache.hcatalog.rcfile.TestRCFileOutputStorageDriver
> [junit] 2012-03-22 18:43:01.237 java[18706:1a03] Unable to load realm
> info from SCDynamicStore
> [junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 0.434 sec
> [junit] Running org.apache.hcatalog.security.TestHdfsAuthorizationProvider
> [junit] 2012-03-22 18:43:03.343 java[18707:1a03] Unable to load realm
> info from SCDynamicStore
> [junit] Tests run: 34, Failures: 0, Errors: 0, Time elapsed: 17.207 sec
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
