Hi, I'm working on a Camel Component that use purely java to ingest data (and also scan table):
https://github.com/jbonofre/iceberg/blob/CAMEL/camel/camel-iceberg/src/main/java/org/apache/iceberg/camel/IcebergProducer.java NB: it's still a WIP, I'm working on it and I will share a proposal on the mailing list next week. Regards JB On Thu, May 16, 2024 at 7:53 PM John D. Ament <johndam...@apache.org> wrote: > > Completely naive question since I'm not familiar at all with the > technologies. I wanted to demonstrate using Iceberg files as a way to ingest > lots of data and persist it to S3. It seems like it can do this, but I have > a feeling I need tools like Spark to do it. is that true? or can I hook it > up to just a generic REST API that loads the data in? > > I have a feeling Spark will be part of the final solution, but I don't want > to get into that complexity quite yet, and it's not clear from the docs. > > Also apologies for posting this to your dev@ list. No user(s)@ list. > > John
