Universal Content Importer
Automates data entry from many sources into one, with fact checks and AI-assisted field matching, in six guided steps.
What it does
The job is data entry: many sources in, one source of truth out, without a person retyping any of it. AI does the reading and the matching, and the facts are checked as it goes. The six steps exist so none of that happens unsupervised — you see what it decided before any of it is published.
Those six steps are extract, import, settle clashes, assign functions, check the rules, and publish. Each is a checkpoint you pass through, rather than one long unattended run you can only inspect afterwards.
Sources are read with BeautifulSoup, lxml and pdfminer, which covers HTML and PDF, and with Playwright for pages that need a real browser to render. It suggests field matches instead of making you map every column by hand, and every change it makes is written to a local SQLite log.
There is no public download. If you have work that looks like this, get in touch and I will run it for you.
Features
- Six guided steps: extract, import, settle clashes, assign functions, check the rules, publish
- Suggested field matches instead of mapping every column by hand
- Every change written to a local log you can go back through
- Reads HTML and PDF sources, and pages that need a browser to render