The current proposal is to add this as an optional feature where the user can provide an API key for their LLM of choice to activate LLM-based search. This would require caution around handling of the provided API token so it is only used for that user's session.