Re: What's the proper procedure to publish a docker image to dockerhub?

2019-04-16 Thread Alberto Ramón
to! > > > > > > If we are able to create an official repository solely for Apache > Arrow, > > > it's more flexible to publish new images in future. > > > > > > How to create such a repository ? > > > > > > 16.04.2019, 01:27, &qu

Re: What's the proper procedure to publish a docker image to dockerhub?

2019-04-15 Thread Alberto Ramón
Hello Zhiyuan I can help you if you need help with this process The best option is request a offical repository for Apache Arrow Project (se are the ones that start with '_' Redis example On Mon, 15 Apr 2019 at 15:21, Zhiyuan Zheng wrote: > Hi, > > DataFusion

Re: How to append to parquet file periodically and read intermediate data - pyarrow.lib.ArrowIOError: Invalid parquet file. Corrupt footer.

2018-12-19 Thread Alberto Ramón
Some answers / ideas: The typical: Write in Kafka The Fashion: Pravega (from Apache Flink) The Future: Wait to Erasure Code in HDFS 3 On Wed, 19 Dec 2018 at 16:41, Wes McKinney wrote: > We could certainly develop some tools in C++ and/or Python to assist > with the compaction workflows. If you