LiteLLM project support should be added to give user more power to choose different LLM easily instead of just Gpt #59
Description
Litellm is great foss project for helping users to run local api proxy server which will accept any response in open ai api format.You should read more on it and many projects have implemented it and this project need easy support for variety of llm so LiteLLM is the way.
Please implement it so that other users with different LLM can also test this project and give feedback for improvements wherever needed