Hi, I am trying to run a simple samza job which reads a topic from Kafka
running on my local machine and prints out messages.
I am getting no tasks found. I was able to find the topic, messages from
Kafka console.
I am attaching the log file for your reference.
Any help would be appreciated?
--
Thanks,
Venkat Nannapaneni | Sr. Big Data Engineer | MetiStream, Inc. |
586.383.1459 (m) | www.metistream.com
15/06/04 11:05:49 INFO yarn.SamzaAppMaster$: got container id:
container_1433427301512_0013_02_000001
15/06/04 11:05:49 INFO yarn.SamzaAppMaster$: got app attempt id:
appattempt_1433427301512_0013_000002
15/06/04 11:05:49 INFO yarn.SamzaAppMaster$: got node manager host: kireetis-mbp
15/06/04 11:05:49 INFO yarn.SamzaAppMaster$: got node manager port: 49455
15/06/04 11:05:49 INFO yarn.SamzaAppMaster$: got node manager http port: 8042
15/06/04 11:05:49 INFO yarn.SamzaAppMaster$: got config:
{metrics.reporter.jmx.class=org.apache.samza.metrics.reporter.JmxReporterFactory,
job.factory.class=org.apache.samza.job.yarn.YarnJobFactory,
serializers.registry.metrics.class=org.apache.samza.serializers.MetricsSnapshotSerdeFactory,
metrics.reporter.snapshot.class=org.apache.samza.metrics.reporter.MetricsSnapshotReporterFactory,
task.checkpoint.replication.factor=1, job.name=hl7-ingestion,
task.input=kafka.testTopic,
task.checkpoint.factory=org.apache.samza.checkpoint.kafka.KafkaCheckpointManagerFactory,
systems.kafka.consumer.zookeeper.connect=localhost:2181/,
systems.kafka.consumer.auto.offset.reset=smallest,
systems.kafka.samza.msg.serde=json,
serializers.registry.json.class=org.apache.samza.serializers.JsonSerdeFactory,
metrics.reporters=snapshot,jmx, task.checkpoint.system=kafka,
systems.kafka.producer.bootstrap.servers=localhost:9092,
task.class=com.evariant.hdh.samza.task.hl7StreamTask,
yarn.package.path=file:///Users/kireeti/git/hl7-ingestion-samza/build/distributions/hl7-ingestion-samza-1.0-dist.tar.gz,
metrics.reporter.snapshot.stream=kafka.metrics,
systems.kafka.samza.factory=org.apache.samza.system.kafka.KafkaSystemFactory}
15/06/04 11:05:49 INFO yarn.ClientHelper: trying to connect to RM 0.0.0.0:8032
15/06/04 11:05:49 INFO client.RMProxy: Connecting to ResourceManager at
/0.0.0.0:8032
15/06/04 11:05:50 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
15/06/04 11:05:50 INFO metrics.JmxServer: According to
InetAddress.getLocalHost.getHostName we are Kireetis-MBP
15/06/04 11:05:50 INFO metrics.JmxServer: Started JmxServer registry port=50714
server port=50715
url=service:jmx:rmi://localhost:50715/jndi/rmi://localhost:50714/jmxrmi
15/06/04 11:05:50 INFO metrics.JmxServer: If you are tunneling, you might want
to try JmxServer registry port=50714 server port=50715
url=service:jmx:rmi://Kireetis-MBP:50715/jndi/rmi://Kireetis-MBP:50714/jmxrmi
15/06/04 11:05:50 INFO reporter.MetricsSnapshotReporterFactory: Creating new
metrics snapshot reporter.
15/06/04 11:05:50 WARN reporter.MetricsSnapshotReporterFactory: Unable to find
implementation version in jar's meta info. Defaulting to 0.0.1.
15/06/04 11:05:50 INFO reporter.MetricsSnapshotReporterFactory: Got system
stream SystemStream [system=kafka, stream=metrics].
15/06/04 11:05:50 INFO reporter.MetricsSnapshotReporterFactory: Got system
factory org.apache.samza.system.kafka.KafkaSystemFactory@52105584.
15/06/04 11:05:50 INFO reporter.MetricsSnapshotReporterFactory: Got producer
org.apache.samza.system.kafka.KafkaSystemProducer@7b08c2a1.
15/06/04 11:05:50 INFO reporter.MetricsSnapshotReporterFactory: Got serde
org.apache.samza.serializers.JsonSerde@2e412d4.
15/06/04 11:05:50 INFO reporter.MetricsSnapshotReporter: got metrics snapshot
reporter properties [job name: hl7-ingestion, job id: 1, containerName:
ApplicationMaster, version: 0.0.1, samzaVersion: 0.9.0, host: Kireetis-MBP]
15/06/04 11:05:50 INFO reporter.MetricsSnapshotReporter: Registering
MetricsSnapshotReporterFactory with producer.
15/06/04 11:05:50 INFO reporter.MetricsSnapshotReporter: Registering
ApplicationMaster with producer.
15/06/04 11:05:50 INFO reporter.JmxReporterFactory: Creating JMX reporter with
name jmx.
15/06/04 11:05:50 INFO yarn.SamzaAppMasterTaskManager: No yarn.container.count
specified. Defaulting to one container.
15/06/04 11:05:50 INFO utils.VerifiableProperties: Verifying properties
15/06/04 11:05:50 INFO utils.VerifiableProperties: Property auto.offset.reset
is overridden to smallest
15/06/04 11:05:50 INFO utils.VerifiableProperties: Property client.id is
overridden to samza_checkpoint_manager-hl7_ingestion-1-1433433950538-1
15/06/04 11:05:50 INFO utils.VerifiableProperties: Property group.id is
overridden to
undefined-samza-consumer-group-2c4453d9-82c8-44e3-8228-471555c1848b
15/06/04 11:05:50 INFO utils.VerifiableProperties: Property zookeeper.connect
is overridden to localhost:2181/
15/06/04 11:05:50 INFO kafka.KafkaCheckpointManager: Creating
KafkaCheckpointManager with:
clientId=samza_checkpoint_manager-hl7_ingestion-1-1433433950538-1,
checkpointTopic=__samza_checkpoint_ver_1_for_hl7-ingestion_1, systemName=kafka
15/06/04 11:05:50 INFO utils.VerifiableProperties: Verifying properties
15/06/04 11:05:50 INFO utils.VerifiableProperties: Property auto.offset.reset
is overridden to smallest
15/06/04 11:05:50 INFO utils.VerifiableProperties: Property client.id is
overridden to samza_admin-hl7_ingestion-1-1433433950590-2
15/06/04 11:05:50 INFO utils.VerifiableProperties: Property group.id is
overridden to
undefined-samza-consumer-group-32ac2f97-82a5-488e-96de-fba7c1dc29d2
15/06/04 11:05:50 INFO utils.VerifiableProperties: Property zookeeper.connect
is overridden to localhost:2181/
15/06/04 11:05:50 INFO kafka.KafkaCheckpointManager: Attempting to create
checkpoint topic __samza_checkpoint_ver_1_for_hl7-ingestion_1.
15/06/04 11:05:50 INFO zkclient.ZkEventThread: Starting ZkClient event thread.
15/06/04 11:05:50 INFO zookeeper.ZooKeeper: Client
environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT
15/06/04 11:05:50 INFO zookeeper.ZooKeeper: Client
environment:host.name=kireetis-mbp
15/06/04 11:05:50 INFO zookeeper.ZooKeeper: Client
environment:java.version=1.7.0_71
15/06/04 11:05:50 INFO zookeeper.ZooKeeper: Client
environment:java.vendor=Oracle Corporation
15/06/04 11:05:50 INFO zookeeper.ZooKeeper: Client
environment:java.home=/Library/Java/JavaVirtualMachines/jdk1.7.0_71.jdk/Contents/Home/jre
15/06/04 11:05:50 INFO zookeeper.ZooKeeper: Client
environment:java.class.path=/usr/local/hadoop-2.6.0/etc/hadoop:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/activation-1.1.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/akka-actor_2.10-2.1.2.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/aopalliance-1.0.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/asm-3.1.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/avro-1.7.4.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/cglib-2.2.1-v20090111.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/commons-beanutils-1.7.0.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/commons-beanutils-core-1.8.0.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/commons-cli-1.2.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/commons-codec-1.6.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/commons-collections-3.2.1.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/commons-compress-1.4.1.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/commons-configuration-1.6.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/commons-daemon-1.0.13.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/commons-digester-1.8.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/commons-el-1.0.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/commons-httpclient-3.1.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/commons-io-2.4.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/commons-lang-2.6.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/commons-logging-1.1.3.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/commons-math3-3.1.1.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/commons-net-3.1.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/config-1.0.0.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/grizzled-slf4j_2.10-1.0.1.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/guava-12.0.1.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/guice-3.0.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/guice-servlet-3.0.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/hadoop-annotations-2.4.0.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/hadoop-auth-2.4.0.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/hadoop-common-2.4.0.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/hadoop-hdfs-2.6.0.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/hadoop-yarn-api-2.4.0.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/hadoop-yarn-client-2.4.0.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/hadoop-yarn-common-2.4.0.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/hl7-ingestion-samza-1.0.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/htrace-core-3.0.4.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/httpclient-4.2.5.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/httpcore-4.2.4.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/irclib-1.10.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/jackson-core-asl-1.9.13.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/jackson-jaxrs-1.8.5.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/jackson-mapper-asl-1.9.13.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/jackson-xc-1.8.3.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/jasper-compiler-5.5.23.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/jasper-runtime-5.5.23.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/java-xmlbuilder-0.4.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/javax.inject-1.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/javax.servlet-3.0.0.v201112011016.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/jaxb-api-2.2.2.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/jaxb-impl-2.2.3-1.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/jersey-client-1.9.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/jersey-core-1.9.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/jersey-guice-1.9.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/jersey-json-1.9.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/jersey-server-1.9.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/jets3t-0.9.0.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/jettison-1.1.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/jetty-6.1.26.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/jetty-continuation-8.1.8.v20121106.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/jetty-http-8.1.8.v20121106.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/jetty-io-8.1.8.v20121106.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/jetty-security-8.1.8.v20121106.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/jetty-server-8.1.8.v20121106.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/jetty-servlet-8.1.8.v20121106.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/jetty-util-6.1.26.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/jetty-util-8.1.8.v20121106.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/jetty-webapp-8.1.8.v20121106.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/jetty-xml-8.1.8.v20121106.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/jline-0.9.94.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/joda-convert-1.2.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/joda-time-2.2.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/jopt-simple-3.2.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/jsch-0.1.42.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/jsp-api-2.1.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/jsr305-1.3.9.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/junit-3.8.1.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/juniversalchardet-1.0.3.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/kafka-clients-0.8.2.1.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/kafka_2.10-0.8.2.1.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/log4j-1.2.17.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/lz4-1.2.0.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/metrics-core-2.2.0.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/mime-util-2.1.3.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/netty-3.7.0.Final.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/paranamer-2.3.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/protobuf-java-2.5.0.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/rl_2.10-0.4.4.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/rocksdbjni-3.5.1.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/samza-api-0.9.0.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/samza-core_2.10-0.9.0.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/samza-kafka_2.10-0.9.0.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/samza-kv-rocksdb_2.10-0.9.0.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/samza-kv_2.10-0.9.0.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/samza-log4j-0.9.0.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/samza-shell-0.9.0.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/samza-yarn_2.10-0.9.0.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/scala-compiler-2.10.4.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/scala-library-2.10.4.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/scala-reflect-2.10.4.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/scalate-core_2.10-1.6.1.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/scalate-util_2.10-1.6.1.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/scalatra-common_2.10-2.2.1.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/scalatra-scalate_2.10-2.2.1.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/scalatra_2.10-2.2.1.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/servlet-api-2.5.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/slf4j-api-1.7.7.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/slf4j-log4j12-1.7.7.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/snappy-java-1.1.1.6.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/stax-api-1.0-2.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/xercesImpl-2.9.1.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/xml-apis-1.3.04.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/xmlenc-0.52.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/xz-1.0.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/zkclient-0.3.jar:/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/lib/zookeeper-3.4.6.jar
15/06/04 11:05:50 INFO zookeeper.ZooKeeper: Client
environment:java.library.path=/home//Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java:.
15/06/04 11:05:50 INFO zookeeper.ZooKeeper: Client
environment:java.io.tmpdir=/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001/__package/tmp
15/06/04 11:05:50 INFO zookeeper.ZooKeeper: Client
environment:java.compiler=<NA>
15/06/04 11:05:50 INFO zookeeper.ZooKeeper: Client environment:os.name=Mac OS X
15/06/04 11:05:50 INFO zookeeper.ZooKeeper: Client environment:os.arch=x86_64
15/06/04 11:05:50 INFO zookeeper.ZooKeeper: Client
environment:os.version=10.10.3
15/06/04 11:05:50 INFO zookeeper.ZooKeeper: Client environment:user.name=kireeti
15/06/04 11:05:50 INFO zookeeper.ZooKeeper: Client
environment:user.home=/Users/kireeti
15/06/04 11:05:50 INFO zookeeper.ZooKeeper: Client
environment:user.dir=/usr/local/hadoopTmpDir/nm-local-dir/usercache/kireeti/appcache/application_1433427301512_0013/container_1433427301512_0013_02_000001
15/06/04 11:05:50 INFO zookeeper.ZooKeeper: Initiating client connection,
connectString=localhost:2181/ sessionTimeout=6000
watcher=org.I0Itec.zkclient.ZkClient@6e0fb722
15/06/04 11:05:50 INFO zookeeper.ClientCnxn: Opening socket connection to
server localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using
SASL (unknown error)
15/06/04 11:05:50 INFO zookeeper.ClientCnxn: Socket connection established to
localhost/0:0:0:0:0:0:0:1:2181, initiating session
15/06/04 11:05:50 INFO zookeeper.ClientCnxn: Session establishment complete on
server localhost/0:0:0:0:0:0:0:1:2181, sessionid = 0x14dbeedeea10043,
negotiated timeout = 6000
15/06/04 11:05:50 INFO zkclient.ZkClient: zookeeper state changed
(SyncConnected)
15/06/04 11:05:50 INFO zkclient.ZkEventThread: Terminate ZkClient event thread.
15/06/04 11:05:50 INFO zookeeper.ZooKeeper: Session: 0x14dbeedeea10043 closed
15/06/04 11:05:50 INFO zookeeper.ClientCnxn: EventThread shut down
15/06/04 11:05:50 INFO kafka.KafkaCheckpointManager: Checkpoint topic
__samza_checkpoint_ver_1_for_hl7-ingestion_1 already exists.
15/06/04 11:05:50 INFO kafka.KafkaCheckpointManager: Validating checkpoint
topic __samza_checkpoint_ver_1_for_hl7-ingestion_1.
15/06/04 11:05:50 INFO utils.VerifiableProperties: Verifying properties
15/06/04 11:05:50 INFO utils.VerifiableProperties: Property client.id is
overridden to samza_checkpoint_manager-hl7_ingestion-1-1433433950538-1
15/06/04 11:05:50 INFO utils.VerifiableProperties: Property
metadata.broker.list is overridden to localhost:9092
15/06/04 11:05:50 INFO utils.VerifiableProperties: Property request.timeout.ms
is overridden to 30000
15/06/04 11:05:50 INFO client.ClientUtils$: Fetching metadata from broker
id:0,host:localhost,port:9092 with correlation id 0 for 1 topic(s)
Set(__samza_checkpoint_ver_1_for_hl7-ingestion_1)
15/06/04 11:05:50 INFO producer.SyncProducer: Connected to localhost:9092 for
producing
15/06/04 11:05:50 INFO producer.SyncProducer: Disconnecting from localhost:9092
15/06/04 11:05:50 INFO kafka.KafkaCheckpointManager: Successfully validated
checkpoint topic __samza_checkpoint_ver_1_for_hl7-ingestion_1.
15/06/04 11:05:50 INFO kafka.KafkaCheckpointManager: Connecting to leader
kireetis-mbp:9092 for topic __samza_checkpoint_ver_1_for_hl7-ingestion_1 and to
fetch all checkpoint messages.
15/06/04 11:05:50 INFO kafka.KafkaCheckpointManager: Got offset 0 for topic
__samza_checkpoint_ver_1_for_hl7-ingestion_1 and partition 0. Attempting to
fetch messages for changelog partition mapping.
15/06/04 11:05:50 INFO kafka.KafkaCheckpointManager: Get latest offset 1 for
topic __samza_checkpoint_ver_1_for_hl7-ingestion_1 and partition 0.
15/06/04 11:05:50 INFO coordinator.JobCoordinator$:
SystemStreamPartitionGrouper
org.apache.samza.container.grouper.stream.GroupByPartition@1c14b23f has grouped
the SystemStreamPartitions into the following taskNames:
15/06/04 11:05:50 INFO coordinator.JobCoordinator$: Saving task-to-changelog
partition mapping: Map()
15/06/04 11:05:50 INFO producer.ProducerConfig: ProducerConfig values:
value.serializer = class
org.apache.kafka.common.serialization.ByteArraySerializer
key.serializer = class
org.apache.kafka.common.serialization.ByteArraySerializer
block.on.buffer.full = true
retry.backoff.ms = 100
buffer.memory = 33554432
batch.size = 16384
metrics.sample.window.ms = 30000
metadata.max.age.ms = 300000
receive.buffer.bytes = 32768
timeout.ms = 30000
max.in.flight.requests.per.connection = 1
bootstrap.servers = [localhost:9092]
metric.reporters = []
client.id = samza_checkpoint_manager-hl7_ingestion-1-1433433950538-1
compression.type = none
retries = 2147483647
max.request.size = 1048576
send.buffer.bytes = 131072
acks = all
reconnect.backoff.ms = 10
linger.ms = 0
metrics.num.samples = 2
metadata.fetch.timeout.ms = 60000
Exception in thread "main" java.lang.IllegalArgumentException: requirement
failed: No tasks found. Likely due to no input partitions. Can't run a job with
no tasks.
at scala.Predef$.require(Predef.scala:233)
at
org.apache.samza.container.grouper.task.GroupByContainerCount.group(GroupByContainerCount.scala:40)
at
org.apache.samza.coordinator.JobCoordinator$.buildJobModel(JobCoordinator.scala:181)
at
org.apache.samza.coordinator.JobCoordinator$.apply(JobCoordinator.scala:55)
at
org.apache.samza.job.yarn.SamzaAppMasterTaskManager.<init>(SamzaAppMasterTaskManager.scala:72)
at
org.apache.samza.job.yarn.SamzaAppMaster$.main(SamzaAppMaster.scala:93)
at org.apache.samza.job.yarn.SamzaAppMaster.main(SamzaAppMaster.scala)
