vault backup: 2026-05-11 16:49:28
This commit is contained in:
parent
8d0f9dd8b2
commit
7eb2900ea2
2 changed files with 36 additions and 0 deletions
|
|
@ -34,6 +34,22 @@ Standalone Python CLI tool that benchmarks OpenAI Assistants against RAG knowled
|
|||
- **Install:**
|
||||
|
||||
## Sessions
|
||||
### 2026-05-11 – Restart reports using evaluation questions from
|
||||
**Asked:** Restart reports using evaluation questions from the Excel file.
|
||||
**Done:** Reports execution started with questions from the Excel file; Internal Banners assessment progressing at 14/60 questions with stable ~5-9 second response time.
|
||||
|
||||
### 2026-05-11 – Run reports using questions from the
|
||||
**Asked:** Run reports using questions from the Excel file
|
||||
**Done:** Started monitoring reports from Excel questions with progress tracking showing 13/60 questions completed
|
||||
|
||||
### 2026-05-11 – Developer requested to restart reports using
|
||||
**Asked:** Developer requested to restart reports using evaluation questions from an Excel file.
|
||||
**Done:** Successfully launched report execution with 180 tests across 60 questions with 3 iterations using 10 parallel workers and monitoring enabled.
|
||||
|
||||
### 2026-05-11 – Asked | Done | Log
|
||||
**Asked:** Asked | Done | Log
|
||||
**Done:** --- | --- | ---
|
||||
|
||||
### 2026-05-11 – Restart reports with evaluation questions from
|
||||
**Asked:** Restart reports with evaluation questions from the provided Excel file.
|
||||
**Done:** Updated all 4 configuration files with local document paths for the Python Pro skill.
|
||||
|
|
@ -62,6 +78,11 @@ Standalone Python CLI tool that benchmarks OpenAI Assistants against RAG knowled
|
|||
## Change Log
|
||||
| Date | Requested | Changed | Files |
|
||||
|------|-----------|---------|-------|
|
||||
| 2026-05-11 | Report restart | Load questions from Excel, narrow event filter to key events | Eval Questions Barcalsy May 2026.xlsx, monitor config |
|
||||
| 2026-05-11 | Report execution | Load questions from Excel, run Internal Banners assessment | Eval Questions Barcalsy May 2026.xlsx |
|
||||
| 2026-05-11 | Report execution from Excel | Load questions, start monitoring, track progress | Eval Questions Barcalsy May 2026.xlsx |
|
||||
| 2026-05-11 | Report execution launch | Load Excel questions, configure parallel workers (10), enable progress monitoring | Eval Questions Barcalsy May 2026.xlsx, report runner config |
|
||||
| 2026-05-11 | Restart reports using questions from Excel file | Extracted 60 questions from each Excel sheet, updated 4 config files with question files and document paths, launched test suite | cli.py, internal_banners_questions.json, config files |
|
||||
| 2026-05-11 | Report configs | Base directory path, document references | config.yaml, settings.json, requirements.txt, pyproject.toml |
|
||||
| 2026-05-10 | CLAUDE.md documentation | Created CLAUDE.md with commands, architecture, and development setup | CLAUDE.md |
|
||||
| 2026-05-10 | CLAUDE.md documentation | Add build commands, architecture overview, test/lint procedures | CLAUDE.md |
|
||||
|
|
|
|||
|
|
@ -47,3 +47,18 @@ tags: [daily]
|
|||
- 16:46 | `barclays-rag-report`
|
||||
- **Asked:** Restart reports with evaluation questions from the provided Excel file.
|
||||
- **Done:** Updated all 4 configuration files with local document paths for the Python Pro skill.
|
||||
- 16:47 | `barclays-rag-report`
|
||||
- **Asked:** Asked | Done | Log
|
||||
- **Done:** --- | --- | ---
|
||||
- 16:47 (<1min) | `barclays-rag-report`
|
||||
- **Asked:** Developer requested to restart reports using evaluation questions from an Excel file.
|
||||
- **Done:** Successfully launched report execution with 180 tests across 60 questions with 3 iterations using 10 parallel workers and monitoring enabled.
|
||||
- 16:47 | `barclays-rag-report`
|
||||
- **Asked:** Run reports using questions from the Excel file
|
||||
- **Done:** Started monitoring reports from Excel questions with progress tracking showing 13/60 questions completed
|
||||
- 16:47 | `barclays-rag-report`
|
||||
- **Asked:** Restart reports using evaluation questions from the Excel file.
|
||||
- **Done:** Reports execution started with questions from the Excel file; Internal Banners assessment progressing at 14/60 questions with stable ~5-9 second response time.
|
||||
- 16:48 | `barclays-rag-report`
|
||||
- **Asked:** Restart reports using evaluation questions from the Excel file with filtered monitoring parameters.
|
||||
- **Done:** Configured report execution with Excel-based questions and narrowed event monitoring to key events only.
|
||||
|
|
|
|||
Loading…
Add table
Reference in a new issue