data: extract 33 scene modules and the Wojna Trojańska engine (68 builds)

The DLL collection gains every WORLD/KOLOROWANKA variant, MATRIX, QMAN
(TEST), INERTIA and BOARD, plus the later PIKLIB72 build from Wojna
Trojańska, taken from the game discs. All 68 builds re-extracted; engine
snapshots are unchanged except the Piklib 6.1 switch dispatch. Roadmap,
batch results and docs follow.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
Patryk Gensch
2026-10-28 21:38:11 +01:00
co-authored by Claude Opus 5.5
parent be5a701db8
commit e03037647e
219 changed files with 80517 additions and 2645 deletions
+3 -3
View File
@@ -1,4 +1,4 @@
# Resumable engine extraction
# Resumable engine and module extraction
Generate an inventory with `python -m ams.inventory ROOT --out inventory.json`, then run:
@@ -7,7 +7,7 @@ python -m ams.acquire.batch --manifest inventory.json --out-dir snapshots/batch
--ghidra-home /path/to/ghidra --timeout 1800 --limit 2
```
Only `engine` entries run. Plugins and native dependencies require their own extraction paths. Remove `--limit` for the full engine inventory. This queue measures successful extraction, not completeness or functional correctness.
`engine` and `plugin` entries run: the extractor recognises a scene module (`SCENE:DLLS=`) by its `CMC_ExternObject::resolve` when the DLL has no engine factory. Native dependencies (Sekai) and earlier engines are skipped. Remove `--limit` for the full inventory. This queue measures successful extraction, not completeness or functional correctness.
Snapshots are named `<sha256>.snapshot.json`. Each attempt runs in a fresh Python process and process group; the timeout kills that group, including native children. A supplied Ghidra home selects PyGhidra. Otherwise the current wrapper environment chooses the backend.
@@ -30,7 +30,7 @@ The API environment and Ghidra worker use separate Python environments. The test
No interactive Ghidra window or Hopper license is needed. `--ghidra-home` configures both `GHIDRA_HOME` and `GHIDRA_INSTALL_DIR` for the worker; setting `GHIDRA_HOME` was not a mistake. Each worker gets a temporary project and runtime home, and the original DLL is only read. Internal Ghidra program names are sanitized to ASCII because repository filenames can contain Polish characters; snapshots retain the original filename and SHA.
The bundled inventory records 64 file paths / 51 distinct SHA-256 values: 34 engine builds in scope, 2 script plugins, 8 native Sekai dependencies and 7 earlier engines excluded from this batch. WORLD and KOLOROWANKA have separately documented registration snapshots. Scope classification is based on filenames, so review newly added or renamed files.
The bundled inventory (`python -m ams.inventory /Users/genszu/_dll_repository --snapshots snapshots --out data/binary-inventory.json`) records 99 file paths / 84 distinct SHA-256 values: 35 engine builds, 33 scene modules (KOLOROWANKA 17, WORLD 9, MATRIX 3, QMAN 2, INERTIA 1, BOARD 1), 9 native Sekai dependencies and 7 earlier engines. The modules and the Wojna Trojańska engine were added on 2026-10-28 from the game discs (7-Zip; `bsdtar` and the original collector missed files on some images). Scope classification is based on filenames, so review newly added or renamed files.
Snapshot metadata retains all source paths and game aliases, extraction fingerprint and provider version. The original files must remain available to verify resumed successes. The queue is sequential; independent manifests can be processed in separate output directories. Do not edit extractor code while a queue is running.