soumilshah1995 commented on issue #351:
URL:
https://github.com/apache/incubator-xtable/issues/351#issuecomment-1973494877
Here is Error after adding --enable-sync \
```
24/03/01 11:28:00 INFO HoodieActiveTimeline: Loaded instants upto :
Option{val=[20240301112751750__deltacommit__COMPLETED__20240301112759850]}
24/03/01 11:28:00 INFO AbstractTableFileSystemView: Took 0 ms to read 0
instants, 0 replaced file groups
24/03/01 11:28:00 INFO ClusteringUtils: Found 0 files in pending clustering
operations
24/03/01 11:28:00 INFO StreamSync: Commit 20240301112751750 successful!
24/03/01 11:28:00 WARN StreamSync: SyncTool class
io.onetable.hudi.sync.OneTableSyncTool failed with exception
org.apache.hudi.exception.HoodieMetaSyncException: Could not sync using the
meta sync class io.onetable.hudi.sync.OneTableSyncTool
at
org.apache.hudi.sync.common.util.SyncUtilHelpers.runHoodieMetaSync(SyncUtilHelpers.java:81)
at
org.apache.hudi.utilities.streamer.StreamSync.runMetaSync(StreamSync.java:938)
at
org.apache.hudi.utilities.streamer.StreamSync.writeToSink(StreamSync.java:851)
at
org.apache.hudi.utilities.streamer.StreamSync.syncOnce(StreamSync.java:446)
at
org.apache.hudi.utilities.streamer.HoodieStreamer$StreamSyncService.ingestOnce(HoodieStreamer.java:840)
at
org.apache.hudi.utilities.ingestion.HoodieIngestionService.startIngestion(HoodieIngestionService.java:72)
at org.apache.hudi.common.util.Option.ifPresent(Option.java:97)
at
org.apache.hudi.utilities.streamer.HoodieStreamer.sync(HoodieStreamer.java:205)
at
org.apache.hudi.utilities.streamer.HoodieStreamer.main(HoodieStreamer.java:584)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at
org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at
org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:1020)
at
org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:192)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:215)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:91)
at
org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1111)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1120)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Caused by: java.lang.NoClassDefFoundError:
io/onetable/client/SourceClientProvider
at java.base/java.lang.Class.forName0(Native Method)
at java.base/java.lang.Class.forName(Class.java:315)
at
org.apache.hudi.common.util.ReflectionUtils.getClass(ReflectionUtils.java:55)
at
org.apache.hudi.common.util.ReflectionUtils.hasConstructor(ReflectionUtils.java:111)
at
org.apache.hudi.common.util.ReflectionUtils.hasConstructor(ReflectionUtils.java:93)
at
org.apache.hudi.sync.common.util.SyncUtilHelpers.instantiateMetaSyncTool(SyncUtilHelpers.java:106)
at
org.apache.hudi.sync.common.util.SyncUtilHelpers.runHoodieMetaSync(SyncUtilHelpers.java:78)
... 20 more
Caused by: java.lang.ClassNotFoundException:
io.onetable.client.SourceClientProvider
at java.base/java.net.URLClassLoader.findClass(URLClassLoader.java:476)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:594)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:527)
... 27 more
24/03/01 11:28:00 INFO StreamSync: Shutting down embedded timeline server
24/03/01 11:28:00 INFO EmbeddedTimelineService: Closing Timeline server
24/03/01 11:28:00 INFO TimelineService: Closing Timeline Service
24/03/01 11:28:00 INFO Javalin: Stopping Javalin ...
24/03/01 11:28:00 INFO Javalin: Javalin has stopped
24/03/01 11:28:00 INFO TimelineService: Closed Timeline Service
24/03/01 11:28:00 INFO EmbeddedTimelineService: Closed Timeline server
24/03/01 11:28:00 INFO SparkContext: SparkContext is stopping with exitCode
0.
24/03/01 11:28:00 INFO SparkUI: Stopped Spark web UI at
http://soumils-mbp:8090
24/03/01 11:28:00 INFO MapOutputTrackerMasterEndpoint:
MapOutputTrackerMasterEndpoint stopped!
24/03/01 11:28:00 INFO MemoryStore: MemoryStore cleared
24/03/01 11:28:00 INFO BlockManager: BlockManager stopped
24/03/01 11:28:00 INFO BlockManagerMaster: BlockManagerMaster stopped
24/03/01 11:28:00 INFO
OutputCommitCoordinator$OutputCommitCoordinatorEndpoint:
OutputCommitCoordinator stopped!
24/03/01 11:28:00 INFO SparkContext: Successfully stopped SparkContext
Exception in thread "main"
org.apache.hudi.exception.HoodieMetaSyncException: Could not sync using the
meta sync class io.onetable.hudi.sync.OneTableSyncTool
at
org.apache.hudi.sync.common.util.SyncUtilHelpers.runHoodieMetaSync(SyncUtilHelpers.java:81)
at
org.apache.hudi.utilities.streamer.StreamSync.runMetaSync(StreamSync.java:938)
at
org.apache.hudi.utilities.streamer.StreamSync.writeToSink(StreamSync.java:851)
at
org.apache.hudi.utilities.streamer.StreamSync.syncOnce(StreamSync.java:446)
at
org.apache.hudi.utilities.streamer.HoodieStreamer$StreamSyncService.ingestOnce(HoodieStreamer.java:840)
at
org.apache.hudi.utilities.ingestion.HoodieIngestionService.startIngestion(HoodieIngestionService.java:72)
at org.apache.hudi.common.util.Option.ifPresent(Option.java:97)
at
org.apache.hudi.utilities.streamer.HoodieStreamer.sync(HoodieStreamer.java:205)
at
org.apache.hudi.utilities.streamer.HoodieStreamer.main(HoodieStreamer.java:584)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at
org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at
org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:1020)
at
org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:192)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:215)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:91)
at
org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1111)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1120)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Caused by: java.lang.NoClassDefFoundError:
io/onetable/client/SourceClientProvider
at java.base/java.lang.Class.forName0(Native Method)
at java.base/java.lang.Class.forName(Class.java:315)
at
org.apache.hudi.common.util.ReflectionUtils.getClass(ReflectionUtils.java:55)
at
org.apache.hudi.common.util.ReflectionUtils.hasConstructor(ReflectionUtils.java:111)
at
org.apache.hudi.common.util.ReflectionUtils.hasConstructor(ReflectionUtils.java:93)
at
org.apache.hudi.sync.common.util.SyncUtilHelpers.instantiateMetaSyncTool(SyncUtilHelpers.java:106)
at
org.apache.hudi.sync.common.util.SyncUtilHelpers.runHoodieMetaSync(SyncUtilHelpers.java:78)
... 20 more
Caused by: java.lang.ClassNotFoundException:
io.onetable.client.SourceClientProvider
at java.base/java.net.URLClassLoader.findClass(URLClassLoader.java:476)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:594)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:527)
... 27 more
24/03/01 11:28:00 INFO ShutdownHookManager: Shutdown hook called
24/03/01 11:28:00 INFO ShutdownHookManager: Deleting directory
/private/var/folders/qq/s_1bjv516pn_mck29cwdwxnm0000gp/T/spark-ec817afa-a4ff-45ed-986f-d1bda7d2e071
24/03/01 11:28:00 INFO ShutdownHookManager: Deleting directory
/private/var/folders/qq/s_1bjv516pn_mck29cwdwxnm0000gp/T/spark-a3c51739-dd7b-43d4-9699-cb8eb7786835
soumilshah@Soumils-MBP DeltaStreamer %
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@xtable.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
