171 lines
9.1 KiB
Markdown
171 lines
9.1 KiB
Markdown
<!-- event: create author: ticket-intake at: 2026-06-20T10:46:48Z -->
|
|
|
|
## 作成
|
|
|
|
LocalTicketBackend によって作成されました。
|
|
|
|
---
|
|
|
|
<!-- event: intake_summary author: ticket-intake at: 2026-06-20T10:46:54Z -->
|
|
|
|
## Intake summary
|
|
|
|
ユーザー要望を調査 Ticket ではなく concrete implementation Ticket として作成した。調査済み結論に基づき、`WebFetch` が `application/pdf` を `pdf-extract` で page-delimited Markdown-ish text として返せるようにする。Poppler/Pdfium/subprocess/OCR/semantic Markdown 化は非ゴール。既存 WebFetch safety bounds と HTML/text behavior は維持する。
|
|
|
|
---
|
|
|
|
<!-- event: state_changed author: ticket-intake at: 2026-06-20T10:46:54Z from: planning to: ready reason: implementation_ready field: state -->
|
|
|
|
## State changed
|
|
|
|
Intake 済み。Orchestrator は implementation routing として扱える。実装 side effect / worktree 作成 / coder 起動はここでは行っていない。
|
|
|
|
---
|
|
|
|
<!-- event: state_changed author: workspace-panel at: 2026-06-20T12:06:29Z from: ready to: queued reason: queued field: state -->
|
|
|
|
## State changed
|
|
|
|
Ticket を `workspace-panel` が queued にしました。
|
|
|
|
|
|
---
|
|
|
|
<!-- event: decision author: yoi-orchestrator at: 2026-06-20T12:08:15Z -->
|
|
|
|
## Decision
|
|
|
|
Routing decision: implementation_ready_parallel
|
|
|
|
Reason:
|
|
- Panel Queue により、この Ticket は Orchestrator routing 対象として明示許可された。
|
|
- User standing directive: blocker が無いものは並列実行する。現在の `00001KVJABS1A` は Profile scope review 中であり、WebFetch PDF 実装とは domain/file conflict がないため並列化できる。
|
|
- Ticket body は調査済みの PDF extraction 方針、`pdf-extract` 採用理由、binary path 分離、page-delimited Markdown-ish output、metadata、bounds、non-goals、validation を実装可能な粒度で定義している。
|
|
- 未解決 relation blocker はない。
|
|
- Orchestrator worktree は clean、matching branch/worktree はなし。
|
|
- Risk domain は security / dependency / public-api / output-bounds だが、Ticket は existing WebFetch network safety、`max_response_bytes` / `max_output_bytes`、unsupported binary rejection、no OCR/semantic Markdown/native dependency を明示している。bounded context check 後も implementation 前に必要な追加 human decision は見つからなかった。
|
|
|
|
Evidence checked:
|
|
- Ticket `00001KVJA7V2R` body / thread / relations / artifacts。
|
|
- `TicketRelationQuery(00001KVJA7V2R)`: no blockers。
|
|
- `TicketOrchestrationPlanQuery(00001KVJA7V2R)`: no previous plan records; accepted plan recorded now。
|
|
- Workspace state:
|
|
- Orchestrator worktree clean at `36b9ed45`。
|
|
- queued: `00001KVJA7V2R`, `00001KVJDJD02`。
|
|
- inprogress: `00001KVJABS1A` review only。
|
|
- no matching WebFetch PDF branch/worktree。
|
|
|
|
IntentPacket:
|
|
|
|
Intent:
|
|
- Extend `WebFetch` so `application/pdf` can be fetched and returned as bounded, page-delimited text suitable for LLM reading。
|
|
- Use `pdf_extract::extract_text_from_mem_by_pages()` and present output as Markdown-ish page sections, not semantic PDF-to-Markdown。
|
|
|
|
Binding decisions / invariants:
|
|
- Keep WebFetch as fetch/extraction tool; no summarization or research orchestration。
|
|
- PDF bytes must not go through the UTF-8 text / `reject_binary()` path。
|
|
- Preserve private/local host rejection, bounded redirects, Content-Length / `max_response_bytes`, `max_output_bytes`, embedded credential rejection, untrusted content warning。
|
|
- Initial supported MIME is `application/pdf` only; no extension sniffing or `application/octet-stream` PDF guessing。
|
|
- No Poppler/Pdfium/subprocess/native dependency/OCR/scanned-PDF support/table reconstruction/cache。
|
|
- Existing HTML/text/JSON/XML behavior and `html_extraction` metadata must not regress。
|
|
- New metadata should use `pdf_extraction` with method/pages/readable/diagnostic information。
|
|
|
|
Requirements / acceptance criteria:
|
|
- Valid PDF returns `## Page 1`, `## Page 2`, etc. page-delimited bounded text。
|
|
- `transformed_as` communicates `pdf_text_by_pages` or equivalent, not semantic Markdown。
|
|
- `output_truncated` is correct when PDF text exceeds `max_output_bytes`。
|
|
- Malformed/encrypted/textless PDFs do not panic; return diagnostic error or readable=false metadata。
|
|
- Non-PDF unsupported binary remains rejected。
|
|
- Focused WebFetch tests and relevant cargo/fmt/diff validation pass。
|
|
|
|
Next action:
|
|
- Record `queued -> inprogress` and commit Ticket records before creating implementation worktree and spawning Coder。
|
|
|
|
---
|
|
|
|
<!-- event: state_changed author: yoi-orchestrator at: 2026-06-20T12:08:34Z from: queued to: inprogress reason: orchestrator_acceptance_parallel_webfetch_pdf field: state -->
|
|
|
|
## State changed
|
|
|
|
Ticket body/thread, relation metadata, Orchestrator worktree state, visible Pods, existing branch/worktree, and bounded WebFetch/PDF context were checked. There is no unresolved blocking dependency, no conflicting inprogress implementation, and no missing planning decision. Accepting this queued Ticket for parallel implementation before worktree/Pod side effects.
|
|
|
|
---
|
|
|
|
<!-- event: implementation_report author: yoi-orchestrator at: 2026-06-20T12:09:50Z -->
|
|
|
|
## Implementation report
|
|
|
|
Implementation orchestration start:
|
|
- Acceptance records were committed on Orchestrator branch: `e752a720 ticket: accept webfetch pdf and intake gate`。
|
|
- Created implementation worktree `/home/hare/Projects/yoi/.worktree/00001KVJA7V2R-webfetch-pdf-text` on branch `impl/00001KVJA7V2R-webfetch-pdf-text` at `e752a720`。
|
|
- Spawned Coder Pod `yoi-coder-00001KVJA7V2R` with write scope limited to the implementation worktree and read-only root scope only for runtime workspace identity。
|
|
- Coder task explicitly forbids root/original workspace implementation, semantic PDF Markdown/OCR/native dependency scope creep, merge, Ticket close, and cleanup。
|
|
|
|
Next action:
|
|
- Wait for Coder implementation report, then inspect branch diff/validation evidence and route to Reviewer。
|
|
|
|
---
|
|
|
|
<!-- event: implementation_report author: yoi-orchestrator at: 2026-06-20T12:24:02Z -->
|
|
|
|
## Implementation report
|
|
|
|
Coder implementation report received from `yoi-coder-00001KVJA7V2R`.
|
|
|
|
Implementation commit:
|
|
- `b1af95ad web: fetch pdf text by pages`
|
|
|
|
Changed areas reported:
|
|
- `crates/tools/src/web.rs`:
|
|
- Added `application/pdf` handling for `WebFetch`。
|
|
- PDF bytes bypass UTF-8 / `reject_binary()` text path。
|
|
- Uses `pdf_extract::extract_text_from_mem_by_pages()` inside `tokio::task::spawn_blocking`。
|
|
- Returns Markdown-ish page sections like `## Page 1`, `## Page 2`。
|
|
- Adds `pdf_extraction` metadata with method/page/readability/diagnostic fields。
|
|
- Keeps existing `html_extraction` semantics intact。
|
|
- Preserves unsupported binary MIME rejection。
|
|
- Added deterministic in-memory PDF test fixtures and tests for PDF page-delimited output, output truncation, malformed PDF diagnostic error, and unsupported binary MIME rejection。
|
|
- `crates/tools/Cargo.toml`: added `pdf-extract = "0.10.0"`。
|
|
- `Cargo.lock`: updated for `pdf-extract` and transitive dependencies。
|
|
- `package.nix`: updated `cargoHash` to `sha256-rvsjn4BBxd9vt4nytPgUh4l/OQCRpqHbUR4jHoH589U=`。
|
|
|
|
Coder validation reported as passing:
|
|
- `cargo fmt --check`
|
|
- `cargo test -p tools web`
|
|
- `cargo check -p tools`
|
|
- `git diff --check`
|
|
- `nix build .#yoi --no-link`
|
|
|
|
Dependency / package impact:
|
|
- New Rust dependency: `pdf-extract 0.10.0`。
|
|
- Nix vendor hash updated and `nix build .#yoi --no-link` passed。
|
|
|
|
Known risks / deferrals:
|
|
- Only `application/pdf` is supported; no extension sniffing or `application/octet-stream` PDF guessing。
|
|
- No OCR, scanned-PDF support, table reconstruction, cache, subprocess, Poppler, or Pdfium integration。
|
|
- Malformed PDFs return diagnostic extraction error; textless PDFs are represented with `readable=false` metadata when extraction succeeds but no text is found。
|
|
|
|
Orchestrator evidence checked before review dispatch:
|
|
- Implementation worktree is clean。
|
|
- HEAD is `b1af95ad`。
|
|
- Diff from acceptance `e752a720..HEAD` is one implementation commit touching 4 files, about 552 insertions / 23 deletions。
|
|
- `git diff --check e752a720..HEAD` produced no diagnostics。
|
|
|
|
Next action:
|
|
- Dispatch Reviewer for r1 review against Ticket requirements, with focus on WebFetch network/binary safety preservation, PDF extraction bounds/metadata, dependency/Nix impact, malformed/textless behavior, unsupported binary rejection, and HTML/text regression safety。
|
|
|
|
---
|
|
|
|
<!-- event: plan author: yoi-orchestrator at: 2026-06-20T12:24:42Z -->
|
|
|
|
## Plan
|
|
|
|
Review dispatch:
|
|
- Spawned Reviewer Pod `yoi-reviewer-00001KVJA7V2R-r1` against implementation branch `impl/00001KVJA7V2R-webfetch-pdf-text`。
|
|
- Review target commit: `b1af95ad web: fetch pdf text by pages`。
|
|
- Review baseline: `e752a720`。
|
|
- Reviewer task focuses on WebFetch network safety preservation, PDF binary path separation, response/output bounds, `pdf_text_by_pages` metadata accuracy, malformed/textless behavior, unsupported binary rejection, existing HTML/text regression safety, dependency/package impact, and Nix validation。
|
|
- Reviewer is instructed not to edit source, commit, merge, close the Ticket, or use TicketReview directly; it will report verdict/evidence back to Orchestrator。
|
|
|
|
---
|