Pipeline of groups, message results stays in Storage Backend

[ComeBertrand]

Issues

Let's say you have a pipeline of groups:

my_group = remoulade.group([message_a, message_b])
my_pipeline = my_group | message_c

The message_c needs the results of both message_a and message_b, so those results are stored in the storage back-end (redis), but once message_c is completed those message results are never read again and will not be cleared from the storage before their expire time.

In the case of complex pipelines with large message results this leads to the storage being clogged up very quickly.

A solution to this would be to forget the results of message_a and message_b once message_c has completed.

Checklist

• Does your title concisely summarize the problem?
• Did you include a minimal, reproducible example?
• What OS are you using?
• What version of Remoulade are you using?
• What did you do?
• What did you expect would happen?
• What happened?

What OS are you using?

Archlinux baby

What version of Remoulade are you using?

What did you do?

What did you expect would happen?

What happened?