> 1. Where exactly can we configure the worker nodes? because I am not able to > identify any worker node related configurations in storm.yaml file attached.
See if this link https://storm.apache.org/releases/2.1.0/Setting-up-a-Storm-cluster.html <https://storm.apache.org/releases/2.1.0/Setting-up-a-Storm-cluster.html> can help you with it. You need to set up a zookeeper cluster, configure supervisors properly. Then supervisors will register themselves to zookeeper, to be available for nimbus to schedule tasks on. > 2. In my current cluster when I run any topology I am not able to see log > files getting created, You can start ui and logviewer daemons to understand the status of your storm cluster and topologies better if you haven’t done so. Make sure topology is “running" > 3. How to identify the reason for not getting this log file creation ?? Is the topology running? You can get some idea of topology status on UI. Then you can check daemon logs, like supervisor, nimbus logs. Also check <storm.log.dir>/workers-artifacts directory to see if any workers are scheduled. > On Jan 16, 2020, at 7:31 AM, Srikanth bathi <[email protected]> wrote: > > Hi Ethan, > > Thanks for quick reply, > > I am not able to understand the logs properly, can you please help me to > understand log file structure and config file for multi node cluster. > > 1. Where exactly can we configure the worker nodes? because I am not able to > identify any worker node related configurations in storm.yaml file attached. > 2. In my current cluster when I run any topology I am not able to see log > files getting created, > 3. How to identify the reason for not getting this log file creation ?? > > Please let me help how to configure to add some extra worker nodes. > > Thanks, > Srikanth > > On Fri, Jan 10, 2020 at 10:18 PM Ethan Li <[email protected] > <mailto:[email protected]>> wrote: > Hi Srikanth, > > It’s hard to tell without enough logs/informations. Could you attach your > configs, supervisor logs to start with? > > Best, > Ethan > > >> On Jan 10, 2020, at 10:28 AM, Srikanth bathi <[email protected] >> <mailto:[email protected]>> wrote: >> >> >> >> ---------- Forwarded message --------- >> From: Srikanth bathi <[email protected] >> <mailto:[email protected]>> >> Date: Fri, Jan 10, 2020 at 9:52 PM >> Subject: Worker never starts >> To: <[email protected] <mailto:[email protected]>> >> >> >> Hi Team, >> >> Can you please help me on the issue workers never getting started. >> >> Supervisor is trying to create a worker which is never happened. >> >> Please help me how to debug this, because i do not see any logs apart from >> Current supervisor time: 1578670653. State: :not-started, Heartbeat: nil >> >> >> Supervisor is trying to assign worker in one of the ports configured >> 6700 >> - 6701 >> - 6702 >> - 6703 >> - 6704 >> - 6705 >> - 6706 >> - 6707 >> - 6708 >> - 6709 >> - 6710 >> - 6711 >> - 6712 >> - 6713 >> - 6714 >> - 6715 >> - 6716 >> - 6717 >> - 6718 >> - 6719 >> - 6720 >> which is failing. >> >> -- >> srikanth >> >> >> >> -- >> srikanth >> >> <Screenshot 2020-01-10 at 9.18.15 PM.png> > > > > -- > srikanth > > <log.txt><storm.yaml>
