----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/67023/ -----------------------------------------------------------
(Updated May 11, 2018, 11:38 p.m.) Review request for hive and Sahil Takiar. Repository: hive-git Description ------- TestErasureCodingHDFSCliDriver uses a test-only CommandProcessor "ErasureProcessor" which allows .q files to contain Erasure Coding commands similar to those provided by the hdfs ec command https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/HDFSErasureCoding.html. The Erasure Coding functionality is exposed through a new shim "HdfsFileErasureCodingPolicy". At this stage there are two .q files: erasure_commnds.q (a simple test to show ERASURE commands can run on local fs via TestCliDriver or on hdfs via TestErasureCodingHDFSCliDriver), and erasure_simple.q (which does some trivial queries to demonstrate basic functionality). More tests will come in future commits. Diffs (updated) ----- itests/qtest/src/test/java/org/apache/hadoop/hive/cli/TestErasureCodingHDFSCliDriver.java PRE-CREATION itests/src/test/resources/testconfiguration.properties cf6d19a5937c3f4a82e4ffe09201af8a79da2e3d itests/util/src/main/java/org/apache/hadoop/hive/cli/control/CliConfigs.java 6628336807b06cab49063673be0d8e9c5b5a7101 itests/util/src/main/java/org/apache/hadoop/hive/ql/QTestUtil.java 750fc69c5f210ca8f7bfe81b82ee9e3001fc07ba ql/src/java/org/apache/hadoop/hive/ql/processors/CommandProcessorFactory.java 3d47991b603c94c8da2106e67192c8513ef783a7 ql/src/java/org/apache/hadoop/hive/ql/processors/ErasureProcessor.java PRE-CREATION ql/src/java/org/apache/hadoop/hive/ql/processors/HiveCommand.java 56c7516ecfaf2421b0f3d3a188d05f38715b25b2 ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java 9f65a771f95a7c0bd3fdb4e56e47c0fc70235850 ql/src/test/org/apache/hadoop/hive/ql/processors/TestCommandProcessorFactory.java de43c2866f64e2ed5c74eab450de28f1a79248dc ql/src/test/queries/clientpositive/erasure_commands.q PRE-CREATION ql/src/test/queries/clientpositive/erasure_simple.q PRE-CREATION ql/src/test/results/clientpositive/erasure_commands.q.out PRE-CREATION ql/src/test/results/clientpositive/erasurecoding/erasure_commands.q.out PRE-CREATION ql/src/test/results/clientpositive/erasurecoding/erasure_simple.q.out PRE-CREATION shims/0.23/src/main/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java ec06a88dc21346473bec6589c703167d50e3b367 shims/common/src/main/java/org/apache/hadoop/hive/shims/HadoopShims.java b89081761780bf1f305d0196bb94bb0b54f7184f testutils/ptest2/conf/deployed/master-mr2.properties 7edc307f85744d60d322ad8087164625677fc230 Diff: https://reviews.apache.org/r/67023/diff/2/ Changes: https://reviews.apache.org/r/67023/diff/1-2/ Testing ------- Thanks, Andrew Sherman
