Build It Yourself

How I'd turn a business's pile of documents into an AI knowledge base

I get this call a lot. A business has fifteen years of stuff sitting on a shared drive. Contracts, proposals, scanned invoices, Word docs, spreadsheets, a decade of emails. Somewhere in that pile is the answer to almost every question anyone asks, and nobody can find any of it. So they ask around, and they keep hearing the same thing: you can't really search that, you'll need a big enterprise platform, and that runs a fat monthly bill forever.

I don't buy it. Here's how I'd actually do it.

What "it can't be done" usually means

When someone says a pile of messy documents can't be searched, what they mean is the off-the-shelf tools want everything neat first. Tag it, upload it into their system, pay per seat, keep paying. The pile scares them because it is not clean. But the mess is the whole point. That is the stuff you actually need to find, and it is already yours.

The pile is the asset, not the problem

Every file in there has text in it. A contract, an email thread, a proposal from 2016. The job is not to reorganize any of it. The job is to read all of it once, build an index, and let people ask plain questions against it. You keep the files exactly where they are.

Keyword search alone won't cut it

Old-school search matches words. Someone types "lease renewal" and it only finds files with those two words in them. Real questions do not work like that. Someone wants "that contract about extending the office space," and the actual document never says lease or renewal.

So you run two searches at once. A fast full-text keyword search, and a semantic search that matches on meaning using AI embeddings. Then you blend them, weight the meaning higher, and re-rank the results with a relevance score. That hybrid is the difference between a search box people give up on and one they trust.

How I'd build it

Point it at their folders. It walks every file and pulls the text out, PDFs, Word docs, PowerPoints, spreadsheets, ebooks, plain text, whatever is in there. Scanned image-only PDFs get flagged for OCR so nothing silently disappears.

For each document it builds two things: a full-text entry for keyword hits, and a numeric fingerprint of the meaning, produced by a local AI model. A search then runs both, merges them, and hands back ranked results with a score badge on each one. Click a result and you get a short AI summary before you even open the file, so you know it is the right one.

Then the safety pass. A scanner runs over everything looking for Social Security numbers, card numbers, bank routing numbers, and the like, and pulls those documents out so they never end up in the searchable index. For a business sitting on client records, that part is not optional.

The best part: the whole thing runs on their own machine with local models. No accounts, no API keys, no data leaving the building, and no per-question fee ticking up every time someone uses it.

Someone already proved this works

If you think this is a fantasy, it is not. There is an open source project called DocuBrowser that does exactly this shape of thing, a local AI-powered document search engine that turns a messy pile of files into something you can actually search. It uses full-text search plus local AI embeddings, runs entirely offline, and scans for private info on the way in. It landed on the Hacker News front page with 171 points and 35 comments, which for a "search your own documents" tool is a crowd of engineers nodding along.

So no, the people saying it cannot be done are wrong. It is being done, in the open, right now.

Build it vs rent it

Enterprise search SaaS charges per seat, per month, forever, and your documents live on their servers. A custom build is one project, it runs on hardware the business already owns, and they own the thing at the end. For a shop with a big pile and a handful of people who need to search it, renting almost never pencils out.

If you have got the pile and you are tired of nobody being able to find anything in it, that is the exact kind of thing I build. Point me at the folder and I will turn it into something you can actually ask questions.

Get a robot doing it

Want a robot doing this for you?

Tell me the task and I will tell you straight whether I can build something for it, what it takes, and roughly what it saves. No pitch.

← Back to Build It Yourself