[Feature Request]: Download models from the app

[sorantis]

Description

Add the ability to download a model from providers like Huggingface, Modelscope.
I wonder if there's a way to do this without having to curate a list of models.

Proposed Solution

No response

[Vali-98]

This has been in consideration for a while now - the issue is that I do not really want to develop features that relies too heavily on APIs from HF/Modelspace in case of changes or shutdowns of these services. Plus, the experience of downloading models via mobile browser is likely a lot safer/easier than relying on some internal JS function.

Though its not 100% out of question, its not a big priority.

[NulledInstance]

This has been in consideration for a while now - the issue is that I do not really want to develop features that relies too heavily on APIs from HF/Modelspace in case of changes or shutdowns of these services. Plus, the experience of downloading models via mobile browser is likely a lot safer/easier than relying on some internal JS function.

Though its not 100% out of question, its not a big priority.

well, why not just make the app call api to download the model with the code needed provided by the user? HF isn't where every LLM is...

[Prikalel]

This is 100% needed feature!)

[skynetcat]

I stand with the developer. It's just an additional hassle to deal with.

Downloading from browser or a downloader app is more reliable and this wouldn't require additional work/fixes.

[jooray]

This functionality can be a backend website. It doesn't need to live in the app, since it needs internet anyway. Maybe a curated list in github where people can share links to gguf files directly and do pull request based updates is enough. One click, browser downloads it and it's good.

Another option is to use ollama backend and access it the same way as ollama pull does. Although index is also web only.

[AdityaMH]

You can use this https://github.com/DroidSpectre/Aetherix-HF if you want.
But still not too good compare to this