AI Chat Plugin Polishing

Help Build BrainDrive
3

Hi All,

Here is the recording from today’s Chat Plugin Polishing update call followed by an AI powered summary of what was discussed.

Questions, comments, concerns and ideas welcome as always, just hit the reply button.

Thanks
Dave W.

Recording:

AI Powered Summary:

Chat Plugin Enhancements by Matt

  • Document Upload:
    • Implemented groundwork based on the specs.
    • UI includes a plus button to upload documents.
    • Backend built using Python + Pandas.
    • Supports: PDF, TXT, CSV, JSON.
    • Known issue: Word formatting with excessive new lines.
  • Chat UI Features:
    • Markdown rendering toggle requested (raw vs. formatted).
    • Regenerate, stop, and continue buttons added.
    • Markdown renders by default; toggle will improve flexibility.
    • Chat history and thinking model display refinements needed.
  • Interface Adjustments:
    • Working on minimizing UI clutter.
    • Proposal to consolidate options (add doc, web search) under a “more” menu.
    • New chat button to be relocated to the bottom-left.
    • Conversation history to move below the chat window.
    • Remove the streaming toggle — always stream by default.

:brain: Distinction: Lightweight Plugin vs. Beck’s RAG System

  • Matt’s plugin: Native to BrainDrive, lightweight, FastAPI-based.
  • Beck’s system: Full RAG, heavier, runs as an external plugin.
  • Analogy: Matt’s version = ChatGPT-style chat with documents; Beck’s = Claude/ChatGPT Projects workspace.

:test_tube: Backend & Parsing

  • Document parsing runs on the backend, leveraging Python tools.
  • Avoiding frontend parsing due to limited support.

:clipboard: Chat Interface Polish Review

  • PRD reviewed line by line.
  • Confirmed most UI behaviors now work as expected:
    • Smooth streaming and response scrolling.
    • Ability to start new chat without app reload.
    • Editable user messages.
  • Still needed:
    • Moving excessive top-bar items to “more” menu.
    • Auto-focus on input when starting new chat.
    • Refactor chat layout to reduce visual overload.

:puzzle_piece: Future Enhancements

  • Short-Term Priorities:
    1. Minimize and clean up UI.
    2. Polish chat with document display.
    3. Implement pasted URL scraping/chat.
    4. Return to web search implementation.
  • Medium-Term:
    • Explore CAG (Context-Augmented Generation) vs. RAG.
    • Mobile UI adaptation.
    • Better error handling for failed connections.
  • Backend Tasks (not Matt’s responsibility):
    • Improve context handling (e.g., truncating based on model limits).
    • Possibly add system context awareness for model selection.

:hammer_and_wrench: Technical Feedback & UX Philosophy

  • Goal: UI should feel familiar to users of ChatGPT/Claude.
  • Difference: BrainDrive uses pages instead of sidebars for task-specific experiences.
  • Design principles:
    • Hide complexity for novice users (e.g., Katie persona).
    • Offer advanced control through plugins or dev mode.

:white_check_mark: Keyboard Accessibility

  • Escape key stops generation.
  • Enter sends messages.
  • Shift+Enter inserts new lines (confirmed functionality).

:soon_arrow: Next Steps

  • Clean up UI and document display.
  • Implement scraped-link-to-context capability.
  • Defer lower-priority enhancements until core UI is stable.
  • Plan to push code to production next week (if progress allows).
  • Matt to share a demo update before next meeting.
BrainDrive Development Progress Updates