fix: cap fetch_all_assets at 5000 items; filter non-dict page entries

Fetching up to MAX_PAGES*page_size (1M) assets before the 3000-item diversity pool cap was applied could exhaust memory on large Immich libraries. Early-exit once 5000 items are collected — the pool cap of 3000 makes anything beyond that wasteful. Also filter null/non-dict items from page responses at fetch time.
2026-06-14 03:49:45 +00:00
parent d6e4582401
commit cc092ec972
3 changed files with 11 additions and 3 deletions
@@ -1,6 +1,6 @@
 [project]
 name = "winnow"
-version = "0.4.5"
+version = "0.4.6"
 description = "Selects diverse, high-quality photos from Immich as training data for Frigate face recognition and object classification."
 license = "AGPL-3.0-or-later"
 requires-python = ">=3.13"