[ 
https://issues.apache.org/jira/browse/HUDI-4568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Raymond Xu updated HUDI-4568:
-----------------------------
    Sprint: 2022/08/08

> Cloudwatch reporter not being created with hudi-spark-bundle and 
> hudi-aws-bundle in classpath
> ---------------------------------------------------------------------------------------------
>
>                 Key: HUDI-4568
>                 URL: https://issues.apache.org/jira/browse/HUDI-4568
>             Project: Apache Hudi
>          Issue Type: Bug
>            Reporter: Sagar Sumit
>            Assignee: Sagar Sumit
>            Priority: Blocker
>             Fix For: 0.12.0
>
>
> spark-shell --jars 
> hudi-spark3-bundle_2.12-0.13.0-SNAPSHOT.jar,hudi-aws-bundle-0.13.0-SNAPSHOT.jar
>  --conf "spark.serializer=org.apache.spark.serializer.KryoSerializer"   
> --conf 
> "spark.sql.catalog.spark_catalog=org.apache.spark.sql.hudi.catalog.HoodieCatalog"
>  --conf 
> "spark.sql.extensions=org.apache.spark.sql.hudi.HoodieSparkSessionExtension"
> /** 
> * DO 
> df.write.format("hudi").options(**common_opts).option("hoodie.metrics.on", 
> "true").option("hoodie.metrics.reporter.type", "CLOUDWATCH").save()
> **/
> java.lang.NoSuchMethodError: 
> org.apache.hudi.aws.cloudwatch.CloudWatchReporter.forRegistry(Lorg/apache/hudi/com/codahale/metrics/MetricRegistry;)Lorg/apache/hudi/aws/cloudwatch/CloudWatchReporter$Builder;
>   at 
> org.apache.hudi.metrics.cloudwatch.CloudWatchMetricsReporter.createCloudWatchReporter(CloudWatchMetricsReporter.java:57)
>   at 
> org.apache.hudi.metrics.cloudwatch.CloudWatchMetricsReporter.<init>(CloudWatchMetricsReporter.java:47)
>   at 
> org.apache.hudi.metrics.MetricsReporterFactory.createReporter(MetricsReporterFactory.java:82)
>   at org.apache.hudi.metrics.Metrics.<init>(Metrics.java:50)
>   at org.apache.hudi.metrics.Metrics.init(Metrics.java:96)
>   at org.apache.hudi.metrics.HoodieMetrics.<init>(HoodieMetrics.java:61)
>   at 
> org.apache.hudi.client.BaseHoodieWriteClient.<init>(BaseHoodieWriteClient.java:178)
>   at 
> org.apache.hudi.client.SparkRDDWriteClient.<init>(SparkRDDWriteClient.java:95)
>   at 
> org.apache.hudi.client.SparkRDDWriteClient.<init>(SparkRDDWriteClient.java:79)
>   at 
> org.apache.hudi.DataSourceUtils.createHoodieClient(DataSourceUtils.java:193)
>   at 
> org.apache.hudi.HoodieSparkSqlWriter$.$anonfun$write$13(HoodieSparkSqlWriter.scala:311)
>   at scala.Option.getOrElse(Option.scala:189)
>   at 
> org.apache.hudi.HoodieSparkSqlWriter$.write(HoodieSparkSqlWriter.scala:310)
>   at org.apache.hudi.DefaultSource.createRelation(DefaultSource.scala:183)



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to