I've been running Hermes Agent — an open-source AI agent framework by Nous Research — for a few weeks now, and I'm genuinely impressed with it. If you haven't seen what it's been doing for me, I wrote about that recently. What I haven't mentioned is that I've got it running on four machines simultaneously,... Continue Reading →
Podcast Episode: Local AI Tools And Workflows (summarising recent posts
Oh dear. Found this option in wordpress experimental features. Gave it a try. Is this useful to anyone? It weirds me out a bit. Anyway, transcript below: Pip: Prof. Peter Falkingham has been doing what academics do best: turning a simple question into a multi-week infrastructure project, then writing about it thoughtfully enough that you're... Continue Reading →
My experience training a local LLM (AI chatbot) on local data…
The user encountered challenges while attempting to use various methods to feed information into local Large Language Models (LLMs) via RAG (Retrieval-Augmented Generation). They explored methods such as Nvidia Chat with RTX, Ollama with Python scripts, and Ollama with Open-webui. Results varied, with some methods providing inaccurate or incomplete outputs. Comparatively, Microsoft Co-pilot, running GPT4-Turbo, significantly outperformed the local methods.