My first attempt to build the framework, scripts, and objects for a local model.
Localized LLMs are growing in popularity due to corporate-owned models being trained, formed, and guardrailed for legal compliance and safety. While I regularly use ChatGPT, Gemini, and Claude to make most of workflows, research, and work product more efficient, I do have projects and work product isn't appropriate for one of those three models, or handles edge cases that are either unorthodox or uncommon. Among my edge cases are health monitoring, complex document processing, handling sensitive research, and work product that the aforemntioned models may be hesistant to work with out of the fear of being sued. Additionally, the aforementioned models have to comply with regulations and policies spanning the globe; I only have to worry about what applies to me.
While the core code is forkable under the GPLv3 license and I encourage others to fork the accessible parts of the code to meet their needs, whatever they may be, the internet is a crazy place, and I know that some of my cases can be unorthodox and head-scratching, thus I ask you to observe the following:
- What you do with your builds is up to you, but if your use cases are illegal where you are, leave me out of it.
- While I do have a background in law and finance, mostly in the research and analysis areas, I am not licensed to practice medicine, law, or finance in any part of the world. Any logic or evaluative code in those three domains is based on what's generally accepted in the United States and shouldn'be construed as advice in those domains.
- As of May of 2026, I am fairly new to building in Python and using GitHub and I am trying to avoid developing a crutch of having a public model generate code that I could create for myself. Additionally, I have multiple freelance assignments while I'm searching for a replacement full-time job for stability and benefits, thus any messages or PRs, whether on here or other social media may take a few days to respond to.
- These rules are modifiable at any time and for any reason.