GraphRAG Analysis, Part 2: Graph Creation and Retrieval vs Vector Database Retrieval
Author(s): Jonathan Bennion Originally published on Towards AI. Surprising similarities in most metrics, after Microsoft’s GraphRAG paper found questionable metrics with vaguely defined lift — the ROI of knowledge graphs may not always justify the hype. TLDR: GraphRAG enhances faithfulness over vector-based …
Confounds and Complex Bias Interplay from Human Bias Mitigation in Language Model Datasets Used for Finetuning LLMs
Author(s): Jonathan Bennion Originally published on Towards AI. A 2023 dataset that balanced occupational bias distribution in one dataset may have decreased racial bias (unintentionally), but increased gender and age biases compared to a vanilla Alpaca baseline. TLDR: Reducing a single human …
Automation Tool Use Deviation from AI-Related Tools Confirms Possible AI Hype Cycle Focus on Automation; Trend Now Reversing
Author(s): Jonathan Bennion Originally published on Towards AI. Trends suggest automation tools faced challenges during AI hype cycle TLDR: Automation tools (Zapier as an example) API public development declined (-13.1% y/y) until last month, while AI-related APIs have experienced steady growth (+12.0% …
Querying AI and Cloud Trends: Azure and OpenAI Growth Slows, Amazon Growth Peaked in June
Author(s): Jonathan Bennion Originally published on Towards AI. Cutting through the AI hype to query actual developer usage (as new repos, so with presumptions) for prioritization of safety tools and partnerships. TLDR (with caveats noted below): Public AI repos now appear as …
GraphRAG Analysis, Part 2: Graph Creation and Retrieval vs Vector Database Retrieval
Author(s): Jonathan Bennion Originally published on Towards AI. Surprising similarities in most metrics, after Microsoft’s GraphRAG paper found questionable metrics with vaguely defined lift — the ROI of knowledge graphs may not always justify the hype. TLDR: GraphRAG enhances faithfulness over vector-based …
Popular posts
Updates
Recent Posts
