Enable queue demo.queue(api_open=False).launch(share=True) in Gradio will cause proxy issue and could not pass prompt into model, error pops out as "Expecting value: line 1 column 1 (char 0)", to solve this problem need to disable queue in launch interface listed as below:
demo.launch(share=True,enable_queue=False)
Once queue is disabled, if more than one user is using this demo, unexpected error will raised and the previous task will be interrupted and ended, need to fix.
Enable queue
demo.queue(api_open=False).launch(share=True)in Gradio will cause proxy issue and could not pass prompt into model, error pops out as "Expecting value: line 1 column 1 (char 0)", to solve this problem need to disable queue in launch interface listed as below:demo.launch(share=True,enable_queue=False)Once queue is disabled, if more than one user is using this demo, unexpected error will raised and the previous task will be interrupted and ended, need to fix.