How much RAM do you expect to be available and how much RAM do you expect to be using?
On Mon, Nov 20, 2017 at 3:51 PM, Brian Granger <[email protected]> wrote: > I haven't looked into the details of your configuration, but in > general, Jupyter and the python kernels have no problem using whatever > RAM the system makes available to it. I have created single NumPY > arrays with 1TB of RAM with no problem. If you are running out of RAM, > it is a system level thing related to the configuration of the system, > physical RAM of the system and your deployment of Jupyter. > > On Mon, Nov 20, 2017 at 11:58 AM, Karthik Ram <[email protected]> wrote: >> Argg. Thank you Thomas. It did run longer(17 min as opposed to 10 min) this >> time after I un-commented those lines, but still saw the same issue. Is >> there any limitation in Jupyter that it cannot handle more than certain GB >> data or query more than certain million or billion rows from post gre SQL DB >> ? >> >> Its strange because when I do run the SQL script from SQL work bench locally >> on my machine(which is less powerful than the server on which jupyter is >> running), I do get the resulting rows. >> >> On Mon, Nov 20, 2017 at 3:35 AM, Thomas Kluyver <[email protected]> wrote: >>> >>> On 19 November 2017 at 22:28, Karthik Ram <[email protected]> wrote: >>>> >>>> I also changed the following in jupyterhub_config.py file. But still >>>> seeing the issue. >>>> >>>> ... >>>> >>>> #c.Spawner.mem_guarantee = 8G >>>> >>> >>> You'll need to uncomment these lines for them to affect anything, i.e. >>> remove the # from the beginning. It also probably needs to be a string - put >>> "8G" inside quotation marks. >>> >>> Thomas >>> >>> -- >>> You received this message because you are subscribed to a topic in the >>> Google Groups "Project Jupyter" group. >>> To unsubscribe from this topic, visit >>> https://groups.google.com/d/topic/jupyter/hY0Jq-E5Ki0/unsubscribe. >>> To unsubscribe from this group and all its topics, send an email to >>> [email protected]. >>> To post to this group, send email to [email protected]. >>> To view this discussion on the web visit >>> https://groups.google.com/d/msgid/jupyter/CAOvn4qiR9cRz4ydTya2nwPivkbjsS_yuT4RwwqXO3_T6oSti5g%40mail.gmail.com. >>> >>> For more options, visit https://groups.google.com/d/optout. >> >> >> >> >> -- >> "In the depth of winter, I finally learned that within me there lay an >> invincible summer" >> >> -- >> You received this message because you are subscribed to the Google Groups >> "Project Jupyter" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to [email protected]. >> To post to this group, send email to [email protected]. >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/jupyter/CAFZay%2Bh5L-6fMTE8dX8DHhS2ZRByaojFbTa-HeNS01SiYyOwaA%40mail.gmail.com. >> >> For more options, visit https://groups.google.com/d/optout. > > > > -- > Brian E. Granger > Associate Professor of Physics and Data Science > Cal Poly State University, San Luis Obispo > @ellisonbg on Twitter and GitHub > [email protected] and [email protected] -- Brian E. Granger Associate Professor of Physics and Data Science Cal Poly State University, San Luis Obispo @ellisonbg on Twitter and GitHub [email protected] and [email protected] -- You received this message because you are subscribed to the Google Groups "Project Jupyter" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/jupyter/CAH4pYpTYFi773Y%3D8bzHHE89E_8Cv3CWvxm5HCwbr6gLV3t-a4g%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
