Original Reddit post

I’m trying to figure out the best way to solve a fairly simple problem: I want to know what a specific expert actually thinks about a specific topic. For example: «“What has [Expert X] said about [Topic Y]?”» The problem is that their views may be scattered across years of content: articles, interviews, podcasts, YouTube videos, conference talks, Reddit comments, forums, LinkedIn posts, papers, blog posts, etc. I don’t just want an AI-generated summary based on a few search results. My main concern is accuracy and traceability. Ideally, I want a system that:

  • searches as broadly as reasonably possible for content from that specific person;
  • distinguishes between things the person actually said/wrote and things other people said about them;
  • preserves the original sources rather than replacing them with summaries;
  • can find relevant passages even if the person used different terminology;
  • provides the exact source, date, URL and preferably the relevant quote/passage for every important claim;
  • can recognize when the person’s opinion changed over time;
  • avoids presenting an inference as if it were the person’s actual opinion;
  • and, most importantly, says “I couldn’t find evidence that this person has expressed a position on this” when there isn’t enough evidence. I have tried tools such as ChatGPT/Gemini Deep Research, but for this particular use case I’m concerned about hallucinations, missed sources, aggressive summarization, and the model merging its own knowledge with what the person actually said. I’m not necessarily looking for a fully local solution or even a RAG system if there is a better approach. I care much more about retrieval quality, source coverage and verifiability than about speed. For people who have worked on something similar, what would you use today? Would you build a search/retrieval pipeline yourself, use an existing research tool, crawl/index the person’s content first, use RAG, or combine several approaches? And if you were optimizing specifically for minimum hallucination and maximum source coverage, how would you design it? submitted by /u/Outrageous_Seesaw774

Originally posted by u/Outrageous_Seesaw774 on r/ArtificialInteligence