On Wed, Mar 24, 2021 at 5:35 AM Vijay Patel <vijay96...@gmail.com> wrote: > > Hi, > > (This is great language, sincere thanks to all!) > > I took a quick glance of https://devguide.python.org/langchanges/ (20.3. > Suggesting new features and language changes), while writing this post. > > Please ignore this, if similar proposals are discussed earlier. > > Suggestion: > 1. Big Set, Big Dictionary - > During design time, i am considering this question. With limited RAM (example > 4 GB), how can I store a dictionary/set of size greater than RAM. > > Is it possible to introduce Big Set / Big Dictionary which stores data in > hard disk (based on some partition mechanism - like big data)? (i.e.Big > Set/Big Dictionary with set access mechanism identical to current set and > dictionary). > > Background: > I am working on machine learning NLP and would like to use such feature in > data generator. >
How would it be stored on disk? Would it be in some sort of database? If so, check out a database access module, and maybe some sort of access layer that gives you a set-like or dict-like interface. Flat files? It probably exists on PyPI, but you could easily make a set-like or dict-like interface to something that uses simple file storage. Ultimately, it's going to be a lot of tradeoffs that can't be made as part of the language, as they're heavily tied to the exact way you're going to use this. ChrisA _______________________________________________ Python-ideas mailing list -- python-ideas@python.org To unsubscribe send an email to python-ideas-le...@python.org https://mail.python.org/mailman3/lists/python-ideas.python.org/ Message archived at https://mail.python.org/archives/list/python-ideas@python.org/message/3KASMEAW7ILKQV4QSDLCBBCNSBFRMG27/ Code of Conduct: http://python.org/psf/codeofconduct/
