Jd version 4.44 available Load tables from parquet/feathers/orc/hdf5/... files!
CSV was the standard database interchange format for a long time and the Jd native csv loader is fast and robust. But parquet and other file formats are increasingly common. These new formats tend to be column oriented and fit well with Jd. They are space efficient and much faster to load. These new formats are complex and Jd has chosen to leverage work done in python rather than reinvent these wheels. With help from python/pandas you can now load tables from any supported file format into Jd. There is a tutorial that shows how to load tables from parquet and other format files. jdrt'parquet' *** read carefully if you are running a versions previous to 4.43 Be careful switching to this version as tables used in this version will be marked damaged if used with a previous version!!! Read 4.43 notes carefully: https://code.jsoftware.com/wiki/Jd/Release Read 'Run Production': https://code.jsoftware.com/wiki/Jd/General The code simplification and performance improvement justified the extra caution required in moving to this release. If you don't use multiple systems at different maintenance levels accessing the same tables, this update should not be a problem. ---------------------------------------------------------------------- For information about J forums see http://www.jsoftware.com/forums.htm
