Hola gente, estoy usando streamparse y me encontre con este problema cuando
hago el submit del codigo.

Estoy usando:
Mac OS for development.
streamparse: 2.1.3
En el server:
Storm: 0.10.0

En del deploy:

$ sparse submit  -e prod --name ptp

Uber-JAR created:
/Users/nicasio/primary/dataproccess/storm-py/pmy/_build/storm-pmy-0.0.1-SNAPSHOT-standalone.jar
Deploying "ptp" topology...
ssh tunnel to Nimbus 192.168.10.90:6627 established.
Routing Python logging to /home/nlino/logs/streamparse.
Running lein command to submit topology to nimbus:
lein run -m streamparse.commands.submit_topology/-main
topologies/ptp.clj --option 'topology.workers=2' --option
'topology.acker.executors=2' --option
'topology.python.path="/data/virtualenvs/ptp/bin/python"' --option
'streamparse.log.path="/home/nlino/logs/streamparse"' --option
'streamparse.log.max_bytes=1000000' --option
'streamparse.log.backup_count=10' --option
'streamparse.log.level="debug"'
{:option {streamparse.log.level debug, streamparse.log.backup_count
10, streamparse.log.max_bytes 1000000, streamparse.log.path
/home/nlino/logs/streamparse, topology.python.path
/data/virtualenvs/ptp/bin
/python, topology.acker.executors 2, topology.workers 2}, :debug
false, :port 6627, :host localhost, :help false}
Caught exception: org.apache.thrift7.protocol.TProtocolException:
Required field 'nimbus_uptime_secs' is unset!
Struct:ClusterSummary(supervisors:[SupervisorSummary(host:superhost,
uptime_secs:78109, num_w
orkers:2, num_used_workers:0,
supervisor_id:d00c750d-294f-462b-a057-cc9c59efc6f4)],
nimbus_uptime_secs:0, topologies:[])

java.lang.RuntimeException:
org.apache.thrift7.protocol.TProtocolException: Required field
'nimbus_uptime_secs' is unset!
Struct:ClusterSummary(supervisors:[SupervisorSummary(host:superhost,
uptime_secs:78
109, num_workers:2, num_used_workers:0,
supervisor_id:d00c750d-294f-462b-a057-cc9c59efc6f4)],
nimbus_uptime_secs:0, topologies:[])
 at backtype.storm.StormSubmitter.topologyNameExists (StormSubmitter.java:211)
    backtype.storm.StormSubmitter.submitTopology (StormSubmitter.java:117)
    backtype.storm.StormSubmitter.submitTopology (StormSubmitter.java:70)
    streamparse.commands.submit_topology$submit_topology_BANG_.invoke
(submit_topology.clj:23)
    streamparse.commands.submit_topology$_main.doInvoke (submit_topology.clj:86)
    clojure.lang.RestFn.invoke (RestFn.java:1789)
    clojure.lang.Var.invoke (Var.java:483)
    user$eval5.invoke (form-init7674699633928198013.clj:1)
    clojure.lang.Compiler.eval (Compiler.java:6619)
    clojure.lang.Compiler.eval (Compiler.java:6609)
    clojure.lang.CException in thread "main" ompiler.load (Compiler.java:7064)
    clojure.lang.Compiler.loadFile (Compiler.java:7020)
    clojure.main$load_script.invoke (main.clj:294)
    clojure.main$init_opt.invoke (main.clj:299)
    clojure.main$initialize.invoke (main.clj:327)
    clojure.main$null_opt.invoke (main.clj:362)
    clojure.main$main.doInvoke (main.clj:440)
    clojure.lang.RestFn.invoke (RestFn.java:421)
    clojure.lang.Var.invoke (Var.java:419)
    clojure.lang.AFn.applyToHelper (AFn.java:163)
    clojure.lang.Var.applyTo (Var.java:532)
    clojure.main.main (main.java:37)
java.lang.NullPointerException
        at 
streamparse.commands.submit_topology$submit_topology_BANG_.invoke(submit_topology.clj:28)
        at 
streamparse.commands.submit_topology$_main.doInvoke(submit_topology.clj:86)
        at clojure.lang.RestFn.invoke(RestFn.java:1789)

config.json

{
    "library": "",
    "topology_specs": "topologies/",
    "virtualenv_specs": "virtualenvs/",
    "envs": {
        "prod": {
            "user": "nlino",
            "nimbus": "192.168.10.90:6627",
            "workers": [
              "192.168.10.90"
            ],
            "log": {
                "path": "/home/nlino/logs/streamparse",
                "max_bytes": 1000000,
                "backup_count": 10,
                "level": "debug"
            },
            "virtualenv_root": "/data/virtualenvs"
        }
    }
}

project.clj

(defproject storm-pmy "0.0.1-SNAPSHOT"
  :source-paths ["topologies"]
  :resource-paths ["_resources"]
  :target-path "_build"
  :min-lein-version "2.0.0"
  :jvm-opts ["-client"]
  :dependencies  [[org.apache.storm/storm-core "0.9.5"]
                  [com.parsely/streamparse "0.0.4-SNAPSHOT"]
                  ]
  :jar-exclusions     [#"log4j\.properties" #"backtype" #"trident"
#"META-INF" #"meta-inf" #"\.yaml"]
  :uberjar-exclusions [#"log4j\.properties" #"backtype" #"trident"
#"META-INF" #"meta-inf" #"\.yaml"]
  )


Alguien tiene alguna idea??

Gracias!
_______________________________________________
Python-es mailing list
Python-es@python.org
https://mail.python.org/mailman/listinfo/python-es
FAQ: http://python-es-faq.wikidot.com/

Responder a