Where is this 1TB dataset living today? [anup] Resides in a filesystem - What is the current nature of the dataset? Is it already in large bundles as files or is it a series of tiny messages, etc..? Does it need to be split/merged/etc.. [anup] Archived files of size 3MB each collected over a period. Directory (1TB) -> Sub-Directories -> Files
- What is the format of the data? Is it something that can easily be split/merged or will it require special processes to do so? [anup] zip, tar formats. -- View this message in context: http://apache-nifi-incubating-developer-list.39713.n7.nabble.com/Fetch-change-list-tp1351p2126.html Sent from the Apache NiFi (incubating) Developer List mailing list archive at Nabble.com.
