kishoreg commented on issue #4874: Pinot ingestion job - Standalone URL: https://github.com/apache/incubator-pinot/pull/4874#issuecomment-560722247 > Is the expectation that there will be more standalone utilities added to this sub-project? If not, then can we rename it to pinot-segment-generator? If yes, then can you describe what else do we expect to add to pinot-standalone? The parent folder (pinot-ingestion-jobs) will have many sub-modules, one per execution framework -hadoop, flink, spark, standalone. All of them will work on the same job spec. Something like (we will change the names) - run-ingestion-job-spark - run-ingestion-job-hadoop - run-ingestion-job-standalone (this is the first one we are adding) > The package name implies (to me) that this is a standalone (as opposed to a distributed) version of pinot. That is clearly not the case. Not sure what to call it, since we already have a pinot-admin. Can we just have all this in pinot-admin? Do you foresee pinot-hadoop using these methods? pinot-admin is in tools and does not provide the flexibility we need (data sources and format). Its also used inside Pinot in quite a few places. How about we move pinot-admin out into a separate module and make that as the single point of entry for everything?. It might be a good thing to do once we get the ingestion working.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
