BalaMahesh opened a new issue, #5494:
URL: https://github.com/apache/hudi/issues/5494

   **_Tips before filing an issue_**
   
   - Have you gone through our [FAQs](https://hudi.apache.org/learn/faq/)?
   
   - Join the mailing list to engage in conversations and get faster support at 
[email protected].
   
   - If you have triaged this as a bug, then file an 
[issue](https://issues.apache.org/jira/projects/HUDI/issues) directly.
   
   **Describe the problem you faced**
   
   A clear and concise description of the problem.
   
   **To Reproduce**
   
   Steps to reproduce the behavior:
   
   1.  git pull origin release-0.11.0
   2. mvn clean install -DskipTests -Dspark3.2 -Dscala-2.12
   3. ./spark-submit  --jars 
packaging/hudi-spark-bundle/target/hudi-spark3.2-bundle_2.12-0.11.0.jar  
--class org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer 
hudi/packaging/hudi-utilities-slim-bundle/target/hudi-utilities-slim-bundle_2.12-0.11.0.jar
 --props file://hudi/properties/kafka.properties --schemaprovider-class 
org.apache.hudi.utilities.schema.FilebasedSchemaProvider --source-class 
org.apache.hudi.utilities.sources.JsonKafkaSource --target-base-path gs://xxx/ 
--target-table hudi.xxx --op INSERT --table-type COPY_ON_WRITE 
--source-ordering-field time --continuous  --transformer-class 
org.apache.hudi.utilities.transform.AddDateHourColumnTransformer --source-limit 
150
   
   **Expected behavior**
   
   Delta streamer to start and run and consume and write data. 
   
   **Environment Description**
   
   * Hudi version : 0.11.0
   
   * Spark version : 3.2.1
   
   * Hive version : 
   
   * Hadoop version : 3.3
   
   * Storage (HDFS/S3/GCS..) : gcs
    
   * Running on Docker? (yes/no) : no
   
   
   **Additional context**
   
   Built the hudi project using maven and trying to run the jar. 
     val DROP_PARTITION_COLUMNS: ConfigProperty[Boolean] = 
HoodieTableConfig.DROP_PARTITION_COLUMNS in DataSourceOptions.scala file is 
failing to resolve the static field in HoodieTableConfig.java 
   
   
   **Stacktrace**
   
   ```Exception in thread "main" java.lang.NoSuchFieldError: 
DROP_PARTITION_COLUMNS
        at 
org.apache.hudi.DataSourceWriteOptions$.<init>(DataSourceOptions.scala:488)
        at 
org.apache.hudi.DataSourceWriteOptions$.<clinit>(DataSourceOptions.scala)
        at 
org.apache.hudi.DataSourceWriteOptions.RECONCILE_SCHEMA(DataSourceOptions.scala)
        at 
org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer.combineProperties(HoodieDeltaStreamer.java:160)
        at 
org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer.<init>(HoodieDeltaStreamer.java:130)
        at 
org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer.<init>(HoodieDeltaStreamer.java:115)
        at 
org.apache.hudi.utilities.deltastreamer.HoodieDeltaStreamer.main(HoodieDeltaStreamer.java:549)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
        at 
org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:955)
        at 
org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:180)
        at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:203)
        at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:90)
        at 
org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1043)
        at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1052)
        at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
   22/05/04 10:21:34 INFO ShutdownHookManager: Shutdown hook called```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to