[
https://issues.apache.org/jira/browse/HIVE-19598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16494004#comment-16494004
]
Eugene Koifman commented on HIVE-19598:
---------------------------------------
[~ashutoshc],
I don't think it's pulling in these dependencies. Here is what I see after
{{mvn package -Pdist -DskipTests}}. Is there anything else I should check?
{noformat}
HW13943:hive ekoifman$ ls
packaging/target/apache-hive-4.0.0-SNAPSHOT-bin/apache-hive-4.0.0-SNAPSHOT-bin/lib/
HikariCP-2.6.1.jar
hbase-protocol-2.0.0-alpha4.jar jersey-guava-2.25.1.jar
ST4-4.0.4.jar
hbase-protocol-shaded-2.0.0-alpha4.jar
jersey-media-jaxb-2.25.1.jar
accumulo-core-1.7.3.jar
hbase-replication-2.0.0-alpha4.jar jersey-server-2.25.1.jar
accumulo-fate-1.7.3.jar
hbase-server-2.0.0-alpha4.jar jettison-1.1.jar
accumulo-start-1.7.3.jar
hbase-shaded-miscellaneous-1.0.1.jar
jetty-annotations-9.3.20.v20170531.jar
accumulo-trace-1.7.3.jar
hbase-shaded-netty-1.0.1.jar
jetty-client-9.3.20.v20170531.jar
aircompressor-0.10.jar
hbase-shaded-protobuf-1.0.1.jar
jetty-http-9.3.20.v20170531.jar
ant-1.6.5.jar
hive-accumulo-handler-4.0.0-SNAPSHOT.jar
jetty-io-9.3.20.v20170531.jar
ant-1.9.1.jar
hive-beeline-4.0.0-SNAPSHOT.jar
jetty-jaas-9.3.20.v20170531.jar
ant-launcher-1.9.1.jar
hive-classification-4.0.0-SNAPSHOT.jar
jetty-jndi-9.3.20.v20170531.jar
antlr-runtime-3.5.2.jar
hive-cli-4.0.0-SNAPSHOT.jar
jetty-plus-9.3.20.v20170531.jar
antlr4-runtime-4.5.jar
hive-common-4.0.0-SNAPSHOT.jar
jetty-rewrite-9.3.20.v20170531.jar
aopalliance-repackaged-2.5.0-b32.jar
hive-contrib-4.0.0-SNAPSHOT.jar
jetty-runner-9.3.20.v20170531.jar
apache-curator-2.12.0.pom
hive-druid-handler-4.0.0-SNAPSHOT.jar jetty-schemas-3.1.jar
apache-jsp-9.3.20.v20170531.jar
hive-exec-4.0.0-SNAPSHOT.jar
jetty-security-9.3.20.v20170531.jar
apache-jstl-9.3.20.v20170531.jar
hive-hbase-handler-4.0.0-SNAPSHOT.jar
jetty-server-9.3.20.v20170531.jar
arrow-format-0.8.0.jar
hive-hcatalog-core-4.0.0-SNAPSHOT.jar
jetty-servlet-9.3.20.v20170531.jar
arrow-memory-0.8.0.jar
hive-hcatalog-server-extensions-4.0.0-SNAPSHOT.jar
jetty-util-9.3.20.v20170531.jar
arrow-vector-0.8.0.jar
hive-hplsql-4.0.0-SNAPSHOT.jar
jetty-webapp-9.3.20.v20170531.jar
asm-5.0.1.jar
hive-jdbc-4.0.0-SNAPSHOT.jar
jetty-xml-9.3.20.v20170531.jar
asm-commons-5.0.1.jar
hive-jdbc-handler-4.0.0-SNAPSHOT.jar jline-2.12.jar
asm-tree-5.0.1.jar
hive-kryo-registrator-4.0.0-SNAPSHOT.jar joda-time-2.9.9.jar
audience-annotations-0.5.0.jar
hive-llap-client-4.0.0-SNAPSHOT.jar joni-2.1.11.jar
avatica-1.11.0.jar
hive-llap-common-4.0.0-SNAPSHOT-tests.jar jpam-1.1.jar
avro-1.7.7.jar
hive-llap-common-4.0.0-SNAPSHOT.jar json-1.8.jar
bonecp-0.8.0.RELEASE.jar
hive-llap-ext-client-4.0.0-SNAPSHOT.jar jsp-api-2.0.jar
calcite-core-1.16.0.jar
hive-llap-server-4.0.0-SNAPSHOT.jar jsr305-3.0.0.jar
calcite-druid-1.16.0.jar
hive-llap-tez-4.0.0-SNAPSHOT.jar jta-1.1.jar
calcite-linq4j-1.16.0.jar
hive-metastore-4.0.0-SNAPSHOT.jar libfb303-0.9.3.jar
commons-cli-1.2.jar
hive-serde-4.0.0-SNAPSHOT.jar libthrift-0.9.3.jar
commons-codec-1.7.jar
hive-service-4.0.0-SNAPSHOT.jar log4j-1.2-api-2.10.0.jar
commons-collections4-4.1.jar
hive-service-rpc-4.0.0-SNAPSHOT.jar log4j-api-2.10.0.jar
commons-compiler-2.7.6.jar
hive-shims-0.23-4.0.0-SNAPSHOT.jar log4j-core-2.10.0.jar
commons-compress-1.9.jar
hive-shims-4.0.0-SNAPSHOT.jar
log4j-slf4j-impl-2.10.0.jar
commons-crypto-1.0.0.jar
hive-shims-common-4.0.0-SNAPSHOT.jar log4j-web-2.10.0.jar
commons-dbcp-1.4.jar
hive-shims-scheduler-4.0.0-SNAPSHOT.jar memory-0.9.0.jar
commons-el-1.0.jar
hive-standalone-metastore-4.0.0-SNAPSHOT.jar metrics-core-3.1.0.jar
commons-io-2.4.jar
hive-storage-api-2.7.0-SNAPSHOT.jar metrics-json-3.1.0.jar
commons-lang-2.6.jar
hive-streaming-4.0.0-SNAPSHOT.jar metrics-jvm-3.1.0.jar
commons-lang3-3.2.jar
hive-testutils-4.0.0-SNAPSHOT.jar
mysql-metadata-storage-0.12.0.jar
commons-logging-1.0.4.jar
hive-upgrade-acid-4.0.0-SNAPSHOT.jar netty-3.10.5.Final.jar
commons-math-2.1.jar
hive-vector-code-gen-4.0.0-SNAPSHOT.jar
netty-all-4.1.17.Final.jar
commons-math3-3.6.1.jar hk2-api-2.5.0-b32.jar
netty-buffer-4.1.17.Final.jar
commons-pool-1.5.4.jar
hk2-locator-2.5.0-b32.jar
netty-common-4.1.17.Final.jar
commons-vfs2-2.1.jar hk2-utils-2.5.0-b32.jar
opencsv-2.3.jar
curator-client-2.12.0.jar hppc-0.7.2.jar
orc-core-1.5.0.jar
curator-framework-2.12.0.jar
htrace-core-3.2.0-incubating.jar orc-shims-1.5.0.jar
curator-recipes-2.12.0.jar httpclient-4.5.2.jar
org.abego.treelayout.core-1.0.1.jar
datanucleus-api-jdo-4.2.4.jar httpcore-4.4.4.jar
osgi-resource-locator-1.0.1.jar
datanucleus-core-4.1.17.jar ivy-2.4.0.jar
paranamer-2.3.jar
datanucleus-rdbms-4.1.19.jar
jackson-annotations-2.9.4.jar
parquet-hadoop-bundle-1.10.0.jar
derby-10.14.1.0.jar jackson-core-2.9.4.jar
php/
disruptor-3.3.6.jar
jackson-core-asl-1.9.13.jar
postgresql-9.4.1208.jre7.jar
dropwizard-metrics-hadoop-metrics2-reporter-0.1.2.jar
jackson-databind-2.9.4.jar
postgresql-metadata-storage-0.12.0.jar
druid-hdfs-storage-0.12.0.jar
jackson-dataformat-smile-2.9.4.jar protobuf-java-2.5.0.jar
ecj-4.4.2.jar
jackson-mapper-asl-1.9.13.jar py/
esri-geometry-api-2.0.0.jar jamon-runtime-2.3.1.jar
servlet-api-2.4.jar
findbugs-annotations-1.3.9-1.jar janino-2.7.6.jar
sketches-core-0.9.0.jar
flatbuffers-1.2.0-3f79e055.jar
jasper-compiler-5.5.23.jar snappy-java-1.1.4.jar
groovy-all-2.4.11.jar
jasper-runtime-5.5.23.jar sqlline-1.3.0.jar
gson-2.2.4.jar javassist-3.20.0-GA.jar
stax-api-1.0.1.jar
guava-19.0.jar
javax.annotation-api-1.2.jar super-csv-2.2.0.jar
hbase-client-2.0.0-alpha4.jar
javax.inject-2.5.0-b32.jar
taglibs-standard-impl-1.2.5.jar
hbase-common-2.0.0-alpha4-tests.jar javax.jdo-3.2.0-m3.jar
taglibs-standard-spec-1.2.5.jar
hbase-common-2.0.0-alpha4.jar
javax.servlet-api-3.1.0.jar tempus-fugit-1.1.jar
hbase-hadoop-compat-2.0.0-alpha4.jar
javax.servlet.jsp-api-2.3.1.jar transaction-api-1.1.jar
hbase-hadoop2-compat-2.0.0-alpha4-tests.jar
javax.ws.rs-api-2.0.1.jar
validation-api-1.1.0.Final.jar
hbase-hadoop2-compat-2.0.0-alpha4.jar javolution-5.5.1.jar
velocity-1.5.jar
hbase-http-2.0.0-alpha4.jar jcodings-1.0.18.jar
websocket-api-9.3.20.v20170531.jar
hbase-mapreduce-2.0.0-alpha4.jar jcommander-1.32.jar
websocket-client-9.3.20.v20170531.jar
hbase-metrics-2.0.0-alpha4.jar jdo-api-3.0.1.jar
websocket-common-9.3.20.v20170531.jar
hbase-metrics-api-2.0.0-alpha4.jar jersey-client-2.25.1.jar
websocket-server-9.3.20.v20170531.jar
hbase-prefix-tree-2.0.0-alpha4.jar jersey-common-2.25.1.jar
websocket-servlet-9.3.20.v20170531.jar
hbase-procedure-2.0.0-alpha4.jar
jersey-container-servlet-core-2.25.1.jar zookeeper-3.4.6.jar
HW13943:hive ekoifman$
{noformat}
> Acid V1 to V2 upgrade
> ---------------------
>
> Key: HIVE-19598
> URL: https://issues.apache.org/jira/browse/HIVE-19598
> Project: Hive
> Issue Type: Bug
> Components: Transactions
> Affects Versions: 3.0.0
> Reporter: Eugene Koifman
> Assignee: Eugene Koifman
> Priority: Critical
> Attachments: HIVE-19598.02.patch, HIVE-19598.05.patch
>
>
> The on-disk layout for full acid (transactional) tables has changed 3.0.
> Any transactional table that has any update/delete events in any deltas that
> have not been Major compacted, must go through a Major compaction before
> upgrading to 3.0. No more update/delete/merge should be run after/during
> major compaction.
> Not doing so will result in data corruption/loss.
>
> Need to create a utility tool to help with this process. HIVE-19233 started
> this but it needs more work.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
