The contract your paralegal pasted into a chatbot last Tuesday went to a server you have never seen, under terms you have never read. For many firms that is the whole reason AI is still banned in the office. Private AI removes the trip. An open model runs on a machine in your building, or on a server rented under your own name, and your documents never leave it.

People also call this on-premise AI, a local LLM, self-hosted AI or an on-premise ChatGPT. The idea is the same in every case: the model is a program you run, like your accounting software, and the data stays on your disk.

Current open models handle the work a small firm needs most: reading and sorting mail, drafting replies from your documents, summarising long files, answering questions from the knowledge vault, pulling fields out of invoices and forms. The very largest cloud models are still stronger at hard reasoning. We tell you which of your jobs fall on which side before you buy a machine.

The hardware is smaller than most people expect. A workstation with a strong graphics card serves a team of ten to twenty for everyday tasks. A firm with heavier volumes gets a server in its rack. Either way you buy it once, you own it, and there is no per-user fee for the model.

For firms in Germany, Austria and Switzerland this is often the cleanest answer to the data question. Client data stays in the country, the list of processors gets shorter, and your data protection officer can read the request log on the machine itself.

Limits we name up front. Someone has to keep the machine running and the models updated; we set that up and can hold the retainer for it, or hand it to your IT partner. Open models improve every few months, so the setup is built to swap the model without rebuilding the rest. And a private setup only pays off when the volume or the sensitivity of the work justifies it. If it does not, we say so on the call.

Questions we get asked

  • Is private AI as good as ChatGPT?

    For everyday office work over your own documents, yes. For the hardest reasoning tasks, the largest cloud models are still ahead. We map your tasks to both sides and, where you want it, build a setup that uses the local model by default and asks you before anything goes to a cloud model.

  • What does the machine cost?

    Between a good workstation and a small server, depending on volume. You get a specific recommendation with a specification after the call, and you buy the hardware yourself, from any vendor you like.

  • Do we need our own IT department?

    No. The setup runs like an appliance. Updates and monitoring run on a retainer with us or through your existing IT partner, whom we brief.

  • What about the GDPR?

    The data stays on hardware you control, which removes the AI vendor from your list of processors for this work. Your own duties under the GDPR remain, and we hand over the system description your data protection officer needs for the records.