Periodic output mode for live logs

[ato]

@ibnesayeed suggests to allow it to work with live logs and report results in periodic chunks (say, every 5 minutes, or a configurable duration). This way, we can use it to monitor crawls and detect any potential issues.