Chat w/ Docs in Your BrainDrive (RAG)

Help Build BrainDrive
1

Hi All,

In today’s Dev call livestream Dave J. and I discussed adding retrieval augmented generation capabilities to BrainDrive.

This will allow you to upload different collections of documents, have them parsed and added to an embedding database, and then call that context into your chats.

This will work similarly to ChatGPT and Claude projects, but with a big difference: Your documents stay under your ownership and control, and you can query them locally without even needing an internet connection.

This is Dave J’s top priority for the next couple of weeks.

The recording of our discussion is below. Questions, comments, ideas, and concerns welcome as always. Just hit the reply button.

Thanks
Dave

Recording:

Chat w/ Documents Plugin Development Updates
2

Hi All,

I had a call with Dave J yesterday where he showed off the new settings for the Chat w/ Docs plugin.

We’re hoping to have a full demo of everything ready to go for Monday’s call but wanted to go ahead and share updated progress here as well for anyone who is interested.

Questions, comments, concerns, and ideas welcome as always. Just hit the reply button.

Call Recording:

Thanks
Dave

3

Hi All,

Dave showed off progress on the new RAG plugin in this week’s dev call livestream. You can see the full install and wider discussion at the link above. I have also posted the walkthrough of the RAG system below for anyone who is interested. This is working on Windows now, Dave is going back to make sure nothing has broken on Ubuntu and then is going to start work on the Mac.

I’m going to install on my Windows machines tomorrow and assuming all goes well we will post an update and link for any Windows/Linux users that want to be an early tester.

Thanks,
Dave W.

4

Hi All,

@DJJones showed off the Mac Install for the RAG plugin in today’s livestream for anyone who wasn’t able to attend the call and wants to check it out.

Here’s the next list of to do items on our list in rough order of priority:

  • Going back over Windows and Linux to make sure nothing broke there.
  • Deleting collections
  • Remove/hide anything that is not functioning currently.
  • Status for download process
  • Status for buttons on the setting page
  • Disclaimer when changing embedding model
  • Message letting you know after the plugin is downloading that services are loading
  • Logging and Debugging
  • Give people control over the settings like Chunk size and document processing stuff

Questions, comments concerns and ideas welcome as always.

Just hit the reply button.

Thanks
Dave W.

5

I did 2 full installs and tests for Mac, Windows and Ubuntu. No issues and I noticed that the RAG for Ubuntu went even faster than the Mac, something interesting and looking forward to delving more into this later.

I did break this list down a bit, this is more for me though:

Checklist

  • Go back over Windows and Linux to make sure nothing broke
  • Delete collections [BrainDrive Chat and ensure the functionality exists within the Document Chat Service]
  • Remove or hide anything that is not currently functioning [BrainDrive RAG module]
  • Add status for the download process [BrainDrive Core - Jobs Behavior]
  • Add status for buttons on the settings page [BrainDrive RAG module]
  • Add disclaimer when changing the embedding model [BrainDrive RAG module]
  • Show message after the plugin is downloading indicating that services are loading [BrainDrive Core - Jobs Behavior]
  • Implement logging and debugging [BrainDrive Core] [BrainDrive RAG module]
  • Give users control over settings (e.g., chunk size, document processing options) [BrainDrive RAG module] [Related Document Services]
1 Like