lhumina_code/hero_books
20
0
Fork 0
Code Issues 8 Pull requests Projects Releases Packages Wiki Activity Actions

import form #16

New issue
Closed
opened 2026-02-07 15:11:55 +00:00 by despiegk · 1 comment
despiegk commented 2026-02-07 15:11:55 +00:00
Owner
Copy link

allow people to specify a git url for scanning

  • books
  • collections

we have to put marker .book in books
like we have marker .collection in collections

then we scan, so we can automatically import collections & books

need to make sure this can survive a server restart
also we need to be able to delete books

we should have reporting while we are scanning so people see what happens, so it something goes wrong they can see

we can also import 1 book (or re-import), this is good for development purposes

check carefully for errors and have a good way how to show the errors, so it becomes more like a dev tool

use

there is a new RPC endpoint for hero_embedder its a key/value store per namespace, we can use this to remember info we don't want to forget (in stead of a default redis), and this is per namespace, use this for checking if we need to process a page again or for other config

to remember info we need to remember

allow people to specify a git url for scanning - books - collections we have to put marker .book in books like we have marker .collection in collections then we scan, so we can automatically import collections & books need to make sure this can survive a server restart also we need to be able to delete books we should have reporting while we are scanning so people see what happens, so it something goes wrong they can see we can also import 1 book (or re-import), this is good for development purposes check carefully for errors and have a good way how to show the errors, so it becomes more like a dev tool use > there is a new RPC endpoint for hero_embedder its a key/value store per namespace, we can use this to remember info we don't want to forget (in stead of a default redis), and this is per namespace, use this for checking if we need to process a page again or for other config to remember info we need to remember
despiegk added this to the now milestone 2026-02-07 15:12:04 +00:00
despiegk added this to the ACTIVE project 2026-02-07 15:13:31 +00:00
mik-tf commented 2026-02-08 01:40:58 +00:00
Owner
Copy link

Addressed in PR #24 (branch development-fixes-feb).

Commits: c98cf72, dcbdad5

  • Import form at /import with git URL input, namespace selector, pull/reset options
  • Full pipeline: clone via scan_collections() → process_collection() for Q&A → push_ai_metadata() to remote → upload_collection_embeddings_and_build()
  • Push checkbox: optionally push .ai/ metadata back to the source repo
  • State persisted in KVS (survives restart when hero_embedder KVS is available)
  • Import status reporting via response page
Addressed in PR #24 (branch `development-fixes-feb`). **Commits:** `c98cf72`, `dcbdad5` - Import form at `/import` with git URL input, namespace selector, pull/reset options - Full pipeline: clone via `scan_collections()` → `process_collection()` for Q&A → `push_ai_metadata()` to remote → `upload_collection_embeddings_and_build()` - Push checkbox: optionally push `.ai/` metadata back to the source repo - State persisted in KVS (survives restart when hero_embedder KVS is available) - Import status reporting via response page
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
development
main
v0.1.3
v0.1.2
v0.1.1
v0.1.0
v0.0.1-rc1
Labels
Clear labels
No items
No labels
Milestone
Clear milestone
No items
No milestone
now
Projects
Clear projects
No items
No project
ACTIVE
Assignees
Clear assignees
No assignees
2 participants
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
lhumina_code/hero_books#16
No description provided.