Hey all, For now questions about streamparse (Python + Storm) integration are better asked on our Github Issues tracker <https://github.com/Parsely/streamparse/issues>.
Running streamparse with Storm versions beyond 0.9.x requires using our developer release <https://github.com/Parsely/streamparse/releases/tag/v3.0.0.dev3>, which we are still in the stages of finalizing into a 3.0 general release with support for Storm 0.10 and 1.x. This is also the release that bundles a pure Python topology DSL instead of the Clojure-based DSL we relied upon in older versions. -Andrew (one of the streamparse authors) On Wed, Jul 13, 2016 at 3:32 AM, Spico Florin <[email protected]> wrote: > Hi! > For me it seems that you have to pass the classpath or to build a fat > jar. Please have a look at this post: > > http://stackoverflow.com/questions/32976198/deploy-storm-topology-remotely-using-storm-jar-command-on-windows > Florin > > On Wed, Jul 13, 2016 at 8:09 AM, ram kumar <[email protected]> > wrote: > >> I also tried setting option for nimbus_uptime_secs >> >> COMMAND: >> sparse submit -o "nimbus_uptime_secs=5" >> >> Still facing the same issue. >> >> On Tue, Jul 12, 2016 at 3:57 PM, ram kumar <[email protected]> >> wrote: >> >>> Hi all, >>> >>> I am trying to run storm topology in production mode, >>> >>> project.clj >>> (defproject meta "0.0.1-SNAPSHOT" >>> :source-paths ["topologies"] >>> :resource-paths ["_resources"] >>> :target-path "_build" >>> :min-lein-version "2.0.0" >>> :jvm-opts ["-client"] >>> :dependencies [[org.apache.storm/storm-core "0.10.0"] >>> [com.parsely/streamparse "0.0.4-SNAPSHOT"] >>> ] >>> :jar-exclusions [#"log4j\.properties" #"backtype" #"trident" >>> #"META-INF" #"meta-inf" #"\.yaml"] >>> :uberjar-exclusions [#"log4j\.properties" #"backtype" #"trident" >>> #"META-INF" #"meta-inf" #"\.yaml"] >>> ) >>> >>> >>> config.json >>> { >>> "library": "", >>> "topology_specs": "topologies/", >>> "virtualenv_specs": "virtualenvs/", >>> "envs": { >>> "prod": { >>> "user": "ram", >>> "nimbus": "10.218.173.100", >>> "workers": ["10.154.9.166"], >>> "log": { >>> "path": "/home/ram/log/storm/streamparse", >>> "max_bytes": 1000000, >>> "backup_count": 10, >>> "level": "info" >>> }, >>> "use_ssh_for_nimbus": true, >>> "use_virtualenv": false, >>> "virtualenv_root": "/home/ram/storm-topologies/meta" >>> } >>> } >>> } >>> >>> >>> When submitting topology as, *sparse submit * >>> getting, >>> >>> java.lang.RuntimeException: >>> org.apache.thrift7.protocol.TProtocolException: *Required field >>> 'nimbus_uptime_secs' is unset!* >>> Struct:ClusterSummary(supervisors:[SupervisorSummary(host:10.154.9.166, >>> uptime_secs:1654461, num_workers:2, num_used_workers:0, >>> supervisor_id:0a07f441-05f8-4103-b439-22cf42a1fcff, >>> version:0.10.0.2.4.2.0-258)], nimbus_uptime_secs:0, topologies:[]) >>> >>> >>> >>> Can anyone help me with this, >>> Thanks, >>> Ram >>> >>> >> >
