I haven't looked into the details of your configuration, but in general, Jupyter and the python kernels have no problem using whatever RAM the system makes available to it. I have created single NumPY arrays with 1TB of RAM with no problem. If you are running out of RAM, it is a system level thing related to the configuration of the system, physical RAM of the system and your deployment of Jupyter.
On Mon, Nov 20, 2017 at 11:58 AM, Karthik Ram <[email protected]> wrote: > Argg. Thank you Thomas. It did run longer(17 min as opposed to 10 min) this > time after I un-commented those lines, but still saw the same issue. Is > there any limitation in Jupyter that it cannot handle more than certain GB > data or query more than certain million or billion rows from post gre SQL DB > ? > > Its strange because when I do run the SQL script from SQL work bench locally > on my machine(which is less powerful than the server on which jupyter is > running), I do get the resulting rows. > > On Mon, Nov 20, 2017 at 3:35 AM, Thomas Kluyver <[email protected]> wrote: >> >> On 19 November 2017 at 22:28, Karthik Ram <[email protected]> wrote: >>> >>> I also changed the following in jupyterhub_config.py file. But still >>> seeing the issue. >>> >>> ... >>> >>> #c.Spawner.mem_guarantee = 8G >>> >> >> You'll need to uncomment these lines for them to affect anything, i.e. >> remove the # from the beginning. It also probably needs to be a string - put >> "8G" inside quotation marks. >> >> Thomas >> >> -- >> You received this message because you are subscribed to a topic in the >> Google Groups "Project Jupyter" group. >> To unsubscribe from this topic, visit >> https://groups.google.com/d/topic/jupyter/hY0Jq-E5Ki0/unsubscribe. >> To unsubscribe from this group and all its topics, send an email to >> [email protected]. >> To post to this group, send email to [email protected]. >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/jupyter/CAOvn4qiR9cRz4ydTya2nwPivkbjsS_yuT4RwwqXO3_T6oSti5g%40mail.gmail.com. >> >> For more options, visit https://groups.google.com/d/optout. > > > > > -- > "In the depth of winter, I finally learned that within me there lay an > invincible summer" > > -- > You received this message because you are subscribed to the Google Groups > "Project Jupyter" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To post to this group, send email to [email protected]. > To view this discussion on the web visit > https://groups.google.com/d/msgid/jupyter/CAFZay%2Bh5L-6fMTE8dX8DHhS2ZRByaojFbTa-HeNS01SiYyOwaA%40mail.gmail.com. > > For more options, visit https://groups.google.com/d/optout. -- Brian E. Granger Associate Professor of Physics and Data Science Cal Poly State University, San Luis Obispo @ellisonbg on Twitter and GitHub [email protected] and [email protected] -- You received this message because you are subscribed to the Google Groups "Project Jupyter" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/jupyter/CAH4pYpRjuTYMXdRT%2BfRf5OPgN3W2CLYuqtu9C3s2Udf1QWaK8A%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
