On Tue, May 18, 2021 at 7:20 AM Sam Sam <[email protected]> wrote: > HI everyone, > > I'm trying to use tup to model a data-oriented pipeline where several > programs are pipelined to generate large datasets. So far tup looked great, > but I was wondering how could I init a project where some target are > already generated. > > Simply doing a tup init then running tup expectedly fails with tup > complaining that a generated node already exists. > > Is this a use case that is definitely out of scope for tup ? >
Hi Sam, I'm not sure I fully understand your workflow. Are you looking for a way of turning the "generated node already exists" error into a warning message and allow tup to overwrite the file? I think I had plans to add a flag for that, but it doesn't exist yet. The workaround for this case is to remove the files yourself (or start with a fresh checkout of your tree before experimenting with tup). Since the file is removed this way, tup then needs to re-generate the output, of course. Adding the flag should be pretty straightforward to help with cases where it's impractical to remove a large number of files. If you're trying to find a way to get tup to recognize a file as an output in the database *and* avoid having to run the command with tup to generate it, I think that would be problematic. Without running the command in tup, you wouldn't allow discovery of all the normal inputs to the command that are determined from the FUSE or DLL/shared library wrappers. Tup then wouldn't know when it needs to re-run the command. Some background on sticky inputs (those you list in Tupfiles) and normal inputs (those discovered by wrapping and running the program) are here: http://gittup.org/tup/ex_dependencies.html and http://gittup.org/tup/ex_generated_header.html Let me know if I misunderstood your use case. If you can show it with a small example Tupfile that could help, too. Thanks, -Mike -- -- tup-users mailing list email: [email protected] unsubscribe: [email protected] options: http://groups.google.com/group/tup-users?hl=en --- You received this message because you are subscribed to the Google Groups "tup-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/tup-users/CA%2B6x0LWeNtkSvFJYiKRKp%3D3fA9ru%2BY30aRUrVCeCdfaPSc8mnw%40mail.gmail.com.
