Make URL Processing optional

[aidik]

It would be nice to have the ability to indicate whether or not URLs should be processed for offline browsing. This change will make SuckIT a more versatile tool for static page generation and allow its integration into more toolchains.

[Skallwar]

I'm not sure about what a use case would look like. Could you explain a bit more?

[aidik]

Hi @Skallwar,

sure, for example in our environment we compile a static website from multiple local sources, and after that, we push the static files to the CDN. The use of SuckIT will significantly speed up our build process, unfortunately, we can't use it because it insists on URL processing.

Essentially I'm looking for an equivalent of httrack's --keep-links=4

Thank you for considering

[Skallwar]

Oh I think I get it. The idea would be to download the website without modification.

It should be simple enough to implement I think.

I don't have much time right now so I can't give an ETA but I will gladly take a look and merge a PR adding this feature.