lhumina_code/hero_embedder
23
0
Fork 0
Code Issues 1 Pull requests Projects Releases 1 Packages 1 Wiki Activity Actions

we can't sellect the load all, and can't do a perf test #5

New issue
Closed
opened 2026-02-07 16:57:56 +00:00 by despiegk · 3 comments
despiegk commented 2026-02-07 16:57:56 +00:00
Owner
Copy link

image

the UI keeps on going back to 1000

![image](/attachments/50af7fd0-7b66-48ba-8729-6d479a87e4ed) the UI keeps on going back to 1000
image.png
296 KiB
despiegk added this to the ACTIVE project 2026-02-07 16:58:36 +00:00
despiegk commented 2026-02-07 18:34:50 +00:00
Author
Owner
Copy link

did lots of fixes already, but loading still fails

notice new logging pane

did lots of fixes already, but loading still fails notice new logging pane
image.png
229 KiB
image.png
👍 1
mahmoud commented 2026-02-08 15:57:39 +00:00
Owner
Copy link

Fixed

  1. Database lock errors - Refactored handle_corpus_download to use scoped locks and spawn_blocking. Decompression now happens outside the lock, preventing "Database already open" errors during concurrent access.

  2. UX improvements for Load Corpus pane:

  • Added smart state tracking (window.loaderState)
  • "Load All" option dynamically shows remaining count or disables when all loaded
  • Load button disables when corpus empty or all loaded
  • Progress bar shows namespace loading progress
  • Added finally block to reset state on errors
  1. Download TriviaQA button:
  • Shows "TriviaQA Ready" alert when already downloaded
  • Button disables after download completes
  • Status correctly checks for "already_loaded" response
  • Storage warnings - Added logging when namespace storage fails to open (was silently ignored)
  1. Other fixes:
  • Fixed rpcCall availability check (wait for base.html to load)
  • Fixed RPC method name (namespace.stats not namespace.info)
  • Added constants for hardcoded values (LOADER_CONFIG)
### Fixed 1. Database lock errors - Refactored handle_corpus_download to use scoped locks and spawn_blocking. Decompression now happens outside the lock, preventing "Database already open" errors during concurrent access. 2. UX improvements for Load Corpus pane: - Added smart state tracking (window.loaderState) - "Load All" option dynamically shows remaining count or disables when all loaded - Load button disables when corpus empty or all loaded - Progress bar shows namespace loading progress - Added finally block to reset state on errors 3. Download TriviaQA button: - Shows "TriviaQA Ready" alert when already downloaded - Button disables after download completes - Status correctly checks for "already_loaded" response - Storage warnings - Added logging when namespace storage fails to open (was silently ignored) 4. Other fixes: - Fixed rpcCall availability check (wait for base.html to load) - Fixed RPC method name (namespace.stats not namespace.info) - Added constants for hardcoded values (LOADER_CONFIG)
despiegk commented 2026-02-08 16:24:15 +00:00
Author
Owner
Copy link

sounds good

sounds good
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
development
development_mik2
main
v0.1.3
v0.1.2
v0.1.1
v0.1.0
v0.0.1-rc1
Labels
Clear labels   
prio_critical

   
prio_low

   
type_bug

   
type_contact

   
type_issue

   
type_lead

   
type_question

   
type_story

   
type_task
No labels
prio_critical
prio_low
type_bug
type_contact
type_issue
type_lead
type_question
type_story
type_task
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
ACTIVE
Assignees
Clear assignees
No assignees
mahmoud
2 participants
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
lhumina_code/hero_embedder#5
No description provided.