This is the one I’m waiting the most from the LLM hype. It would be a massive benefit for companies around the world (mine included) if they could just dump their documentation in all shapes and flavours into a model and have it parse standardized documents for you.
But the generic OpenAI/Copilot models aren’t reliable enough just yet, hallucinations and made up data just doesn’t go with that. I’m not even sure if those models are ever capable on such task alone, maybe it needs additional component which checks the facts from originals or something to make it actually useful.
I created a relatively complex board/card game and just shoved the rulebook PDF into an LLM, so it’d be easy to answer people’s questions with exact references to cards and rulebook pages. So far it’s successfully corrected ME twice on specific rulings. It’s actually quite useful in this regard.
Generic models are not ready yet and won’t ever be but my company is using something from AWS called “Q” I think (heh, great name this day in age) but because it performs training rounds (*I think!) on a set of documents you define (like process documentation) its actually pretty good at finding exactly the information and suggesting additional reading. We’re using it on a process guide of a couple hundred pages; not sure how it scales to other sizes or what the cost is.
This is the one I’m waiting the most from the LLM hype. It would be a massive benefit for companies around the world (mine included) if they could just dump their documentation in all shapes and flavours into a model and have it parse standardized documents for you.
But the generic OpenAI/Copilot models aren’t reliable enough just yet, hallucinations and made up data just doesn’t go with that. I’m not even sure if those models are ever capable on such task alone, maybe it needs additional component which checks the facts from originals or something to make it actually useful.
I created a relatively complex board/card game and just shoved the rulebook PDF into an LLM, so it’d be easy to answer people’s questions with exact references to cards and rulebook pages. So far it’s successfully corrected ME twice on specific rulings. It’s actually quite useful in this regard.
Generic models are not ready yet and won’t ever be but my company is using something from AWS called “Q” I think (heh, great name this day in age) but because it performs training rounds (*I think!) on a set of documents you define (like process documentation) its actually pretty good at finding exactly the information and suggesting additional reading. We’re using it on a process guide of a couple hundred pages; not sure how it scales to other sizes or what the cost is.