Hi Samuel, Thank you, that's very good advice. I'm already using the blobstore to store some large dictionaries. However, I do have some files that are stored locally or are packaged within the jar file. I am starting to feel the headache though, and it is indeed a good idea to start moving them to the blobstore.
Thanks On Mar 1, 2017 1:57 PM, <[email protected]> wrote: Hi Mostafa, just a quick thought: When using Storm, you should write code with a multi-node setup in mind. This means, you will not actually know what node your bolt will be effectively running on. Therefore, accessing local files is not a good idea. Instead, you could try using the distributed cache: http://storm.apache.org/releases/1.0.3/distcache-blobstore.html With kind regards Samuel *From:* Mostafa Gomaa [mailto:[email protected]] *Sent:* Mittwoch, 1. März 2017 12:53 *To:* [email protected] *Subject:* Re: Reading external file from a python bolt Nevermind, turned out that i made a very silly mistake. Sorry, everyone. On Mar 1, 2017 12:21 PM, "Mostafa Gomaa" <[email protected]> wrote: Hello all, I have a python bolt that tries to read a file in the /etc/ directory. However, the bolt crashes with a file not found exception. I suspect this is because the file is looked up starting from the project root. Anyone knows how can i read files that are external to the jar file? Thanks
