we can't sellect the load all, and can't do a perf test #5

Open
opened 2026-02-07 16:57:56 +00:00 by despiegk · 3 comments
Owner

image

the UI keeps on going back to 1000

![image](/attachments/50af7fd0-7b66-48ba-8729-6d479a87e4ed) the UI keeps on going back to 1000
296 KiB
despiegk added this to the ACTIVE project 2026-02-07 16:58:36 +00:00
Author
Owner

did lots of fixes already, but loading still fails

notice new logging pane

did lots of fixes already, but loading still fails notice new logging pane
Owner

Fixed

  1. Database lock errors - Refactored handle_corpus_download to use scoped locks and spawn_blocking. Decompression now happens outside the lock, preventing "Database already open" errors during concurrent access.

  2. UX improvements for Load Corpus pane:

  • Added smart state tracking (window.loaderState)
  • "Load All" option dynamically shows remaining count or disables when all loaded
  • Load button disables when corpus empty or all loaded
  • Progress bar shows namespace loading progress
  • Added finally block to reset state on errors
  1. Download TriviaQA button:
  • Shows "TriviaQA Ready" alert when already downloaded
  • Button disables after download completes
  • Status correctly checks for "already_loaded" response
  • Storage warnings - Added logging when namespace storage fails to open (was silently ignored)
  1. Other fixes:
  • Fixed rpcCall availability check (wait for base.html to load)
  • Fixed RPC method name (namespace.stats not namespace.info)
  • Added constants for hardcoded values (LOADER_CONFIG)
### Fixed 1. Database lock errors - Refactored handle_corpus_download to use scoped locks and spawn_blocking. Decompression now happens outside the lock, preventing "Database already open" errors during concurrent access. 2. UX improvements for Load Corpus pane: - Added smart state tracking (window.loaderState) - "Load All" option dynamically shows remaining count or disables when all loaded - Load button disables when corpus empty or all loaded - Progress bar shows namespace loading progress - Added finally block to reset state on errors 3. Download TriviaQA button: - Shows "TriviaQA Ready" alert when already downloaded - Button disables after download completes - Status correctly checks for "already_loaded" response - Storage warnings - Added logging when namespace storage fails to open (was silently ignored) 4. Other fixes: - Fixed rpcCall availability check (wait for base.html to load) - Fixed RPC method name (namespace.stats not namespace.info) - Added constants for hardcoded values (LOADER_CONFIG)
Author
Owner

sounds good

sounds good
Sign in to join this conversation.
No labels
No milestone
No project
No assignees
2 participants
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
lhumina_code/hero_embedder#5
No description provided.