On Sat, Jan 8, 2022, 10:04 PM Nicholas Car < nicholas....@surroundaustralia.com> wrote:
> *> Are there e.g. Jupyter notebooks with executable snippets demonstrating > use of at least every store?* > > Not that I'm aware of, but some Jupyter demos would be useful! > > I've used Jupyter to demo aspects of RDFlib previously for university > students (https://github.com/nicholascar/comp7230-training) and I know > others have done similar things. > > We might consider a stand-alone documentation repo in the RDFlib GitHub > organization with Jupyter examples? > - [ ] choose a project url and name - rdflib/notebooks - pypi:notebooks is no good - rdflib/rdflib_notebooks - rdflib/rdflibnotebooks - rdflib/TBD # ~ RDF bnodes - [ ] generate an rdflib/TBD org project from the/a GitHub project template? - [ ] create an rdflib/ project template (To be clear, I'm often only good for *suggesting* tasks.) - [ ] DOC,BLD,ENH: Create a Jupyter Book folder and configuration for RDFlib demo/testing/store_benchmark notebooks `jupyter-book create TBD/` https://jupyterbook.org/start/create.html - [ ] DOC,ENH: can and shouldn't the sphinx-apidocs for rdflib.* -- maybe even gh:rdflib/* -- be included in a Jupyter-Book (Sphinx) JAMstack static HTML website, just like they are in the rdflib docs (Sphinx)? - [ ] BLD: Configure the repo for CI - [ ] GitHub Actions / Drone - Comprehensive RDFlib Store benchmarks (in notebooks) could cause a prohibitively slow build; which may be justified given the expected contribution frequency for this project > *> Which RDFlib tests/ directory should be the most comprehensive > reference of what does and doesn't work with a {given RDFlib store, SPARQL > endpoint, }?* > > We've slowly started to improve the Store documentation with, for example, > a beter listing of multiple stores at > https://rdflib.readthedocs.io/en/stable/plugin_stores.html but I agree > that the documentation is disjointed, for example, there is no link to that > Store listing page from the Persistence page ( > https://rdflib.readthedocs.io/en/stable/persistence.html). > - [ ] DOC: Distill store test guidelines for QA and performance purposes - `ls store_*/tests?/* | basename | sort -u` - [ ] TST,ENH,PERF: rdflib/rdflib: ITestRDFlibStore, ITestSPARQLendpoint; - [ ] DOC,ANN,REQ: @RDFlib/store_maintainers/*: add an e.g. tests/test_store_performance.py for e.g. the rdflib/rdflib_notebooks Jupyter Book benchmarks and better - re: benchmarks and python [web] app performance: - https://github.com/tiangolo/fastapi#optional-dependencies - https://github.com/bentoml/BentoML#ml-frameworks - In context to this existing (Python) fast open source webapp for hosting trained ML models, is RDFlib like an ML framework for *predictive* inferencing? - [ ] DOC,ENH: One or more [nbgrader-able] notebooks; for +training @online +selfpaced - https://jupyterhub-deploy-teaching.readthedocs.io/en/latest/ describes how to host a jupyterhub for everyone, so they can run your notebooks *AND* which other code on your costed resources. - [ ] BLD,ENH: generate a Jupyter Lite (WASM) build that includes rdflib, store plugins, and a recent build of JupyterLab https://github.com/jupyterlite/jupyterlite#%EF%B8%8F-build-your-own-jupyterlite-%EF%B8%8F > I think we should: > > - try and improve the documentation of Stores > - perhaps prepend all store examples with store_, so we should have: > - store_berkeleydb.py (not berkeleydb_example.py) > - store_starqlstore.py (not sparqlstore_example.py) > - grow the number of store examples > - HDT > - SQLAlchemy > - LevelDB > - SPARQL ReadWrite > > Good plan. What are some good DRY ways to include actual test cases from tests/ as rdflib API usage demos in Jupyter notebooks? - IPython / Jupyter magics: - %pdoc - %pfile - %psource https://ipython.readthedocs.io/en/stable/interactive/magics.html#magic-psource - fastai/nbdev is another way to be DRY (Don't Repeat Yourself) about tests and notebook demo examples with output and docs. https://nbdev.fast.ai/#Features-of-Nbdev : > Automatically generate docs from Jupyter notebooks. These docs are searchable and automatically hyperlinked to appropriate documentation pages by introspecting keywords you surround in backticks - Copy/paste and adapt from ~ demo examples in tests/ - Copying and pasting is forking; and who will continue to merge RDFlib api changes back to the docs notebooks when the CI tests of the demo notebooks (`jupyter-book build`) fail due to Exceptions caused by justified breaking refactorings? > > On Sun, Jan 9, 2022 at 2:58 AM Wes Turner <wes.tur...@gmail.com> wrote: > >> Are there e.g. Jupyter notebooks with executable snippets demonstrating >> use of at least every store? >> (Jupyter-book wraps Sphinx to generate docs from {.rst, .md, and .ipynb >> (with output cells)}) >> >> Which RDFlib tests/ directory should be the most comprehensive reference >> of what does and doesn't work with a {given RDFlib store, SPARQL endpoint, >> }? >> >> On Sat, Jan 8, 2022, 2:53 AM Nicholas Car < >> nicholas....@surroundaustralia.com> wrote: >> >>> > With RDFLIB, how transparent is the access, >>> >>> There are several ways to use Neptune with RDFlib, for example as a >>> back-end Store which is perhaps the most obvious/likely, but you could also >>> be using SPARQLWrapper [1] and sending SPARQL queries to Neptune that way >>> and just using RDFlib to parse RDF responses. >>> >>> > Are you doing updates? >>> >>> Store back-ends and SPARQLWrapper should allow for updates, both by >>> using SPARQL's UPDATE query. >>> >>> > Using transactions? >>> >>> RDFLib's SPARQLStore back-end supports transactions. >>> >>> > How is the performance? Is there a performance of feature "hit" for >>> going through RDFLIB? >>> >>> I've used RDFlib with Neptune but only to test things out and not enough >>> to make sensible comment on this. I guess also I'd need to know performance >>> as compared with what? Just lodging SPARQL queries in the Neptune native >>> system perhaps? >>> >>> [1] https://github.com/RDFLib/sparqlwrapper/ >>> >>> Cheers, >>> >>> Nick >>> >>> On Sat, Jan 8, 2022 at 1:49 PM Jim Amsden <jimams...@gmail.com> wrote: >>> >>>> Cory, >>>> I’ve made extensive use of the Python rdflib and have developed OSLC >>>> interfaces to do data science and analytics on jazz.net data. I found >>>> it full featured and easy to use. I have done many updates with it. >>>> >>>> On Jan 7, 2022, at 5:50 PM, Cory Casanave <cor...@modeldriven.com> >>>> wrote: >>>> >>>> We are interested in experience using AWS Neptune from Python with or >>>> without RDFLIB. >>>> >>>> With RDFLIB, how transparent is the access, e.g. can all of the >>>> functions be used or only query? Are you doing updates? Using transactions? >>>> How is the performance? Is there a performance of feature "hit" for going >>>> through RDFLIB? >>>> >>>> Without RDFLIB, what are you using to access Neptune? Same questions as >>>> above. >>>> >>>> Please feel free to add any pointers or context. >>>> Thanks in advance for any thoughts! >>>> >>>> -- >>>> http://github.com/RDFLib >>>> --- >>>> You received this message because you are subscribed to the Google >>>> Groups "rdflib-dev" group. >>>> To unsubscribe from this group and stop receiving emails from it, send >>>> an email to rdflib-dev+unsubscr...@googlegroups.com. >>>> To view this discussion on the web visit >>>> https://groups.google.com/d/msgid/rdflib-dev/2da5501e-b548-45c5-abcd-00a16d30576bn%40googlegroups.com >>>> <https://groups.google.com/d/msgid/rdflib-dev/2da5501e-b548-45c5-abcd-00a16d30576bn%40googlegroups.com?utm_medium=email&utm_source=footer> >>>> . >>>> >>>> >>>> -- >>>> http://github.com/RDFLib >>>> --- >>>> You received this message because you are subscribed to the Google >>>> Groups "rdflib-dev" group. >>>> To unsubscribe from this group and stop receiving emails from it, send >>>> an email to rdflib-dev+unsubscr...@googlegroups.com. >>>> To view this discussion on the web visit >>>> https://groups.google.com/d/msgid/rdflib-dev/972AE74E-9C03-41FF-BC71-5C543FD4053E%40gmail.com >>>> <https://groups.google.com/d/msgid/rdflib-dev/972AE74E-9C03-41FF-BC71-5C543FD4053E%40gmail.com?utm_medium=email&utm_source=footer> >>>> . >>>> >>> -- >>> http://github.com/RDFLib >>> --- >>> You received this message because you are subscribed to the Google >>> Groups "rdflib-dev" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to rdflib-dev+unsubscr...@googlegroups.com. >>> To view this discussion on the web visit >>> https://groups.google.com/d/msgid/rdflib-dev/CAP7nqh1d1kt5fKAxkhTAo9vmf5LHAEnfyR1kS40qv0qDWNCotQ%40mail.gmail.com >>> <https://groups.google.com/d/msgid/rdflib-dev/CAP7nqh1d1kt5fKAxkhTAo9vmf5LHAEnfyR1kS40qv0qDWNCotQ%40mail.gmail.com?utm_medium=email&utm_source=footer> >>> . >>> >> -- >> http://github.com/RDFLib >> --- >> You received this message because you are subscribed to the Google Groups >> "rdflib-dev" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to rdflib-dev+unsubscr...@googlegroups.com. >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/rdflib-dev/CACfEFw-EaHy1u2x2SM2pevaSW_F7DtD-oZcVWhovYO5AzgkCvA%40mail.gmail.com >> <https://groups.google.com/d/msgid/rdflib-dev/CACfEFw-EaHy1u2x2SM2pevaSW_F7DtD-oZcVWhovYO5AzgkCvA%40mail.gmail.com?utm_medium=email&utm_source=footer> >> . >> > -- > http://github.com/RDFLib > --- > You received this message because you are subscribed to the Google Groups > "rdflib-dev" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to rdflib-dev+unsubscr...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/rdflib-dev/CAP7nqh3q8-GH6t8Gq0ndkCd_U3%2B_QF_1Nub4QdTcLw6Nhuh3Kg%40mail.gmail.com > <https://groups.google.com/d/msgid/rdflib-dev/CAP7nqh3q8-GH6t8Gq0ndkCd_U3%2B_QF_1Nub4QdTcLw6Nhuh3Kg%40mail.gmail.com?utm_medium=email&utm_source=footer> > . > -- http://github.com/RDFLib --- You received this message because you are subscribed to the Google Groups "rdflib-dev" group. To unsubscribe from this group and stop receiving emails from it, send an email to rdflib-dev+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/rdflib-dev/CACfEFw9YHRC_QpWi-a63mBqqemJvHiemcWLOGX9VFuCrui9zjw%40mail.gmail.com.
