Some problems encountered in testing with Aqua source code

[GDLTZzq]

I successfully implemented this adaptive experiment on the consumer's version of flexgen,It seems that consumers of vllm version will not voluntarily release memory?

[abhivijay96]

Hi @zhengzhiqin1823 , thank you for flagging this, yes, it looks like vllm is missing a call to aqua.respond, I am trying to finalize where is the best place to add it. I will keep this issue updated and raise a PR in the next couple of days.