allow archiving of all required files per run

[marrip]

Now that we started testing things a bit, it seems a bit overkill that we have to run SADET twice (LocalApp, TSOPPI) and then we should archive the output files once again after encrypting and taring them via SADET and then send them. Could we maybe add a functionality that handles this directly so that we end up with one file if desired?

[danielvo]

Since the archiving/encryption might be done outside of SADET itself and part of the files we are interested in are SADET run meta-information files (logs), I think the clean way to do this would be utilizing a wrapper for running SADET (it could for example run SADET, do the encryption outside of SADET and then package the small files into a separate archive). Since we are working in different environments, I am not sure what would be the best way to do this. Is this a NextFlow test case? Trying to deploy something that all the nodes could use in the same way without their own little solutions?

[marrip]

Hm, think it would be something we could establish. We could even add tacl so that file transfer is done as part of the workflow. In the future, we could include the workflow in an updated TSO500 pipeline if we ever want to do analysis and transfer in one go. I like that idea.

And yes, if SADET is doing the combining/archiving, it makes sense to have it in the script as you said.