kamir commented on PR #403:
URL: https://github.com/apache/incubator-wayang/pull/403#issuecomment-1934418606
Yes, very good.
Thanks for that pointer. I added the mapping, updated my credentials, and
voila ....
We get a new error related to the **"Load Estimation procedure"**:
[INFO] --- exec:3.0.0:java (default-cli) @ wayang-test-01 ---
>>> Apache Wayang Test #01
We use a Kafka topic and a 'Java Context'.
*** Use default topic name: banking-tx-small-csv
### 7 ...
>>> Create consumer from DEFAULT PROPERTIES.
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/Users/mkaempf/.m2/repository/org/slf4j/slf4j-log4j12/1.7.10/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/Users/mkaempf/.m2/repository/org/slf4j/slf4j-simple/1.7.13/slf4j-simple-1.7.13.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
log4j:WARN No appenders could be found for logger
(org.apache.kafka.clients.consumer.ConsumerConfig).
log4j:WARN Please initialize the log4j system properly.
log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for
more info.
>>> KafkaTopicSource isInitialized=true
### 8 ...
[WARNING]
org.apache.wayang.core.api.exception.WayangException: Job execution failed.
at org.apache.wayang.core.api.Job.doExecute (Job.java:330)
at org.apache.wayang.core.util.OneTimeExecutable.tryExecute
(OneTimeExecutable.java:41)
at org.apache.wayang.core.util.OneTimeExecutable.execute
(OneTimeExecutable.java:54)
at org.apache.wayang.core.api.Job.execute (Job.java:244)
at org.apache.wayang.core.api.WayangContext.execute
(WayangContext.java:120)
at org.apache.wayang.core.api.WayangContext.execute
(WayangContext.java:108)
at org.apache.wayang.api.PlanBuilder.buildAndExecute
(PlanBuilder.scala:105)
at org.apache.wayang.api.DataQuanta.collect (DataQuanta.scala:758)
at org.apache.wayang.api.DataQuantaBuilder.collect
(DataQuantaBuilder.scala:369)
at org.apache.wayang.api.DataQuantaBuilder.collect$
(DataQuantaBuilder.scala:367)
at org.apache.wayang.api.BasicDataQuantaBuilder.collect
(DataQuantaBuilder.scala:463)
at KafkaTopicWordCount.main (KafkaTopicWordCount.java:78)
at org.codehaus.mojo.exec.ExecJavaMojo$1.run (ExecJavaMojo.java:254)
at java.lang.Thread.run (Thread.java:829)
Caused by: java.lang.NullPointerException
at org.apache.wayang.core.platform.AtomicExecution.estimateLoad
(AtomicExecution.java:59)
at
org.apache.wayang.core.platform.AtomicExecutionGroup.lambda$estimateLoad$0
(AtomicExecutionGroup.java:90)
at java.util.stream.ReferencePipeline$3$1.accept
(ReferencePipeline.java:195)
at java.util.LinkedList$LLSpliterator.forEachRemaining
(LinkedList.java:1239)
at java.util.stream.AbstractPipeline.copyInto (AbstractPipeline.java:484)
at java.util.stream.AbstractPipeline.wrapAndCopyInto
(AbstractPipeline.java:474)
at java.util.stream.ReduceOps$ReduceOp.evaluateSequential
(ReduceOps.java:913)
at java.util.stream.AbstractPipeline.evaluate (AbstractPipeline.java:234)
at java.util.stream.ReferencePipeline.reduce (ReferencePipeline.java:558)
at org.apache.wayang.core.platform.AtomicExecutionGroup.estimateLoad
(AtomicExecutionGroup.java:91)
at
org.apache.wayang.core.platform.AtomicExecutionGroup.estimateExecutionTime
(AtomicExecutionGroup.java:108)
at
org.apache.wayang.core.platform.AtomicExecutionGroup.estimateExecutionTime
(AtomicExecutionGroup.java:117)
at
org.apache.wayang.core.platform.PartialExecution.lambda$getOverallTimeEstimate$3
(PartialExecution.java:173)
at java.util.stream.ReferencePipeline$3$1.accept
(ReferencePipeline.java:195)
at java.util.ArrayList$ArrayListSpliterator.forEachRemaining
(ArrayList.java:1655)
at java.util.stream.AbstractPipeline.copyInto (AbstractPipeline.java:484)
at java.util.stream.AbstractPipeline.wrapAndCopyInto
(AbstractPipeline.java:474)
at java.util.stream.ReduceOps$ReduceOp.evaluateSequential
(ReduceOps.java:913)
at java.util.stream.AbstractPipeline.evaluate (AbstractPipeline.java:234)
at java.util.stream.ReferencePipeline.reduce (ReferencePipeline.java:553)
at
org.apache.wayang.core.platform.PartialExecution.getOverallTimeEstimate
(PartialExecution.java:174)
at org.apache.wayang.core.profiling.PartialExecutionMeasurement.<init>
(PartialExecutionMeasurement.java:62)
at org.apache.wayang.core.api.Job.logExecution (Job.java:705)
at org.apache.wayang.core.api.Job.doExecute (Job.java:325)
at org.apache.wayang.core.util.OneTimeExecutable.tryExecute
(OneTimeExecutable.java:41)
at org.apache.wayang.core.util.OneTimeExecutable.execute
(OneTimeExecutable.java:54)
at org.apache.wayang.core.api.Job.execute (Job.java:244)
at org.apache.wayang.core.api.WayangContext.execute
(WayangContext.java:120)
at org.apache.wayang.core.api.WayangContext.execute
(WayangContext.java:108)
at org.apache.wayang.api.PlanBuilder.buildAndExecute
(PlanBuilder.scala:105)
at org.apache.wayang.api.DataQuanta.collect (DataQuanta.scala:758)
at org.apache.wayang.api.DataQuantaBuilder.collect
(DataQuantaBuilder.scala:369)
at org.apache.wayang.api.DataQuantaBuilder.collect$
(DataQuantaBuilder.scala:367)
at org.apache.wayang.api.BasicDataQuantaBuilder.collect
(DataQuantaBuilder.scala:463)
at KafkaTopicWordCount.main (KafkaTopicWordCount.java:78)
at org.codehaus.mojo.exec.ExecJavaMojo$1.run (ExecJavaMojo.java:254)
at java.lang.Thread.run (Thread.java:829)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
