Compare commits

..
Author SHA1 Message Date
potaser de0b9f92be fix(review): EPS batch conversion in zip compile (v2)
- v1 fell through because it required pre-converted PDF in zip
- v2: convert all .eps files post-extract via gs -dSAFER
- 15s timeout per file; fail per-file, not blocking
- Size guards: 20MB per file warning, 100MB total abort
- Conversion log written to output.log
- Verified on real MDPI official zip → 7-page PDF

v1 lesson: test sample had pre-converted PDF but real zip does not
2026-10-14 09:47:49 +08:00
potaser 2797145104 feat(review): P4 two-phase zip compile + XDV→PDF diagnostics + EPS fallback
- inspect/upload zip then compile project (main-file detection, zip safety,
  single-slot queue, failed-envelope carries compile_id + log_url)
- keep failed project/ scene 24h (failed_project_ttl_s; KEEP_FAILED_PROJECTS=1
  forever), success deletes immediately; two-tier compile_jobs sweep
- add tectonic --print and persist full engine chatter to output.log so
  XDV→PDF (xdvipdfmx) errors are visible (MDPI: logo EPS inclusion failure)
- EPS fallback: swap X.eps refs for *-eps-converted-to.pdf when present and
  materialize X.pdf for extension-less graphicx lookup; friendly error when
  no converted PDF exists
- frontend: ReformatPanel zip upload/inspect/run flow; one-off
  scripts/debug_compile.py (gitignored)
- tests: backend 169 passed (22 zip_safety + 34 compile_zip + P3a regression),
  frontend edu vitest 43 passed
2026-10-13 18:42:04 +08:00
potaser 4e19350115 docs: add P3b PR report 2026-10-13 11:23:01 +08:00
potaser e036301e1a feat(review): show format rules summary per target journal
- New summary row: shows the journal's rules (even if no diff applies)
- Fixes user confusion when switching journals yields same diff
- When all rules are null: 'no explicit format requirements'
- Vitest: add case for summary rendering
2026-10-13 11:22:52 +08:00
potaser da84dff9bb fix(review): persist uploaded .tex file in reformat panel
- File now stored in edu.js store (reformatFile)
- Switching target journal no longer requires re-upload
- Explicit reset button clears file
- Vitest: 4 cases
2026-10-13 11:20:33 +08:00
potaser 3a72d3a861 feat(review): P3b enable compile PDF in reformat panel
- ReformatPanel: compile tab state machine (idle/loading/success/error)
- Blob URL for PDF preview; backend path hidden
- First-compile 1-3min hint banner (dismissible)
- QUEUE_FULL 429 with fixed message
- Store: compileStatus/compileResult/compileError + actions
- prewarm_tectonic.sh: minimal .tex compilation to pre-cache TeX bundles
- Vitest: 6 new cases (guide / button / loading / success / error / queue-full)
2026-10-13 10:24:55 +08:00
admin ac07cb2008 Merge pull request 'feat(review): AI 预审稿修复 + 审稿回复助手 Phase 1' (#3) from wjq/PlantAI-rag-new:feature/presubmit-explainable-engine into main
Reviewed-on: http://192.168.0.175:3000/admin/PlantAI-rag-new/pulls/3
2026-10-13 09:34:41 +08:00
potaser d077a5b930 test(docs): rebuttal + tracker tests + PR reports 2026-10-12 16:38:28 +08:00
potaser c4dc344a31 feat(edu): presubmit UI + rebuttal assistant + tracker removal
- PresubmitPanel: rationale / conflict chips / file persistence
- RebuttalPanel: Phase 1 UI (3-column, 5-type form, stance pre-check)
- ReformatPanel / ReportPanel: hide internal fields (job id / version)
- EduSideNav: SVG icon, remove tracker menu item
- EduWorkspace: unmount tracker
- edu.js: rebuttal state + presubmitFile + SECTIONS (drop tracker)
2026-10-12 16:38:28 +08:00
potaser cf5ccb3a37 feat(review): presubmit 4-bug fix + rebuttal Phase 1 backend
- 4 bugs: truncation window / keyword scanner / tier heuristic / vocab
- Scanner conflict demotion now truly affects recommendation (major → minor)
- Rebuttal Phase 1: store / parse / draft / 10 endpoints
- max_text_chars 150K + token guard + 400/413 retry
- Journals tier override (13 journals) + jif heuristic (exclude reviews)
2026-10-12 16:38:28 +08:00
potaser d99d5ef74a fix(review): replace presubmit recommendation quota with explainable rule engine
- Remove '3-8 major' quota that made accept/minor_revision unreachable
- Add recommend_engine.py: rule-based R0-R5 + tier-parameterized judgment
- Journal tier (1/2/3) from journals.json review_tier field
- LLM no longer outputs recommendation; engine is single source of truth
- Rationale exposed in API and rendered in PresubmitPanel
- Weak draft still major_revision (R1); strong draft now minor_revision (R5)
2026-10-12 09:55:07 +08:00
admin 4add9f176b Merge pull request 'feat(review): journal_directory 启动自动 seed(部署即运行)' (#2) from wjq/PlantAI-rag-new:feature/journal-seed-autoload into main
Reviewed-on: http://8.163.92.8:3000/admin/PlantAI-rag-new/pulls/2
2026-10-11 21:12:56 +08:00
potaser 1319328b85 feat(review): auto-seed journal_directory on startup when empty 2026-10-11 20:55:36 +08:00
admin 2d0e3a4858 fix(build): compile_sdk 白名单加入 review_proxy.py(科研审稿反代断流高危点) 2026-10-11 16:40:24 +08:00
admin ea0f2b3fad Merge pull request 'feat(review): 教育科研工作台 + 论文自动重排版 + journals v4 数据集' (#1) from wjq/PlantAI-rag-new:feature/academic-review-assistant into main
Reviewed-on: http://8.163.92.8:3000/admin/PlantAI-rag-new/pulls/1
Reviewed-by: admin <jerryhaozhang@gmail.com>
2026-10-11 13:49:12 +08:00
admin 19fa12eb39 merge main: 解决 .gitignore 冲突(合并部署文档忽略规则) 2026-10-11 13:47:47 +08:00
admin 11337a788f 更新 .gitignore
解决冲突

Signed-off-by: admin <jerryhaozhang@gmail.com>
2026-10-11 13:29:35 +08:00
potaser 55410b663a feat(review): journal format-rule fetch scripts (offline CLI)
- fetch_format_rules.py CLI: robots.txt-aware fetcher (httpx + bs4,
  >=2s per-host throttle) + DeepSeek quote-backed rule extractor
- Status: OUP/Wiley/Cell return 403 from this environment; the five
  featured journals' format_rules in journals.json were manually
  verified against official sites instead. Tooling kept for future
  re-runs; data/format_cache/ is runtime output and gitignored
- Service code never imports this toolchain (standalone CLI only)
2026-10-11 12:19:18 +08:00
potaser dddb70ff6f fix(review): directory partition source shown as constant note
Stop sending partition_source_url; respond with a fixed explanatory
note instead. DB values untouched (dropped after SELECT).
2026-10-11 12:19:18 +08:00
potaser 649e66f41d feat(review): tectonic PDF compile API (P3a) + rename journals panel
- POST/GET /api/review/compile[/{id}[/pdf|/log]]: isolated workdir,
  --untrusted, 60s timeout with process-group kill, single-slot queue
  (429 QUEUE_FULL), 7-day retention sweep
- tools/install_tectonic.sh: pinned tectonic 0.17.0 (sha256) + README
- Rename menu/panel title to 学术期刊情报
- Compile UI stays a placeholder per product decision (P3 deferred)
2026-10-11 12:19:18 +08:00
potaser 42aeb8fa4c feat(review): paper auto-reformat P1 (.tex rule engine + diff panel)
- Rule engine: font/margin/line-spacing/bib-style transformers,
  tighten-only + structural guard + idempotency
- POST/GET /api/review/reformat with 200-envelope errors and job store
- ReformatPanel: journal dropdown (featured + directory search),
  source/diff tabs; compile tab is a dev placeholder for now
- journals.json format_rules_default kept as generic fallback
2026-10-11 12:19:17 +08:00
potaser c747ebd77a feat(review): official format rules for 5 featured journals
- Replace featured list with accessible journals: Genome Biology,
  BMC Plant Biology, Molecular Plant, Frontiers in Plant Science, Rice
- Per-journal format_rules verified against official author guidelines
  (rules_source=official, source_url, last_verified=2026-10-10)
- Update recommend tests to the new seed set
2026-10-11 12:19:17 +08:00
potaser 5a71e29cf7 feat(edu): complete 7-panel academic assistant + journals v4 dataset
Backend:
- review_service: presubmit / recommend / journals / journals/directory /
  format-check / conferences endpoints
- journals.json 5 精选种子 + journal_directory 1056 条全量(v4 数据)
- v4 数据集:2025 JIF(2026 JCR 发布)+ 2025 中科院分区 + 1053 条官网 URL
- format_check 行距 bug 修复(基线 y + 物理过滤 + docx EMU)

BFF:
- review_proxy 反代(修复 httpx build_request await bug)
- REVIEW_ENABLED 开关(默认关闭,零痕部署)

Frontend:
- 教育科研工作台(7 面板 + 菜单 + 状态管理)
- TopBar 教育科研入口(v-show 覆盖层语义,RAG 会话不丢)
- 期刊情报:Tab 切换 / 搜索 / 筛选 / 分页 / 官网列 / 展开凭证
- 智能推荐 / AI预审稿 / 专业报告 / 投稿台账 / 排版规范 / 会议日历
2026-10-10 16:05:08 +08:00
potaser d43d30ee3f feat: add review_service with plant genomics presubmit, journals endpoint, and BFF proxy 2026-10-09 16:54:03 +08:00
103 changed files with 30615 additions and 9 deletions
+19 -1
View File
@@ -1,4 +1,4 @@
# 运行时产物与环境
# 运行时产物与环境
node_modules
dist/
.venv/
@@ -43,5 +43,23 @@ paper_writer_service/paper.db-shm
paper_writer_service/paper.db-wal
paper_writer_service/paper.log
# review_service 运行时产物(不入库)
review_service/review.db
review_service/review.db-wal
review_service/review.db-shm
review_service/review.log
review_service/data/reformat_jobs/
# 期刊种子 journals.json 是源码:顶层 **/data/ 会误伤 review_service/data/,显式放行
!review_service/data/
review_service/tools/tectonic
review_service/data/tectonic-cache/
review_service/data/format_cache/
review_service/data/compile_jobs/
review_service/data/compile_inspect/
review_service/prewarm.log
# 部署方案文档(含主机凭据,不入库)
docs/DEPLOY_PAPER_176.md
# 一次性诊断脚本(不入库)
scripts/debug_compile.py
+54
View File
@@ -0,0 +1,54 @@
# AGENTS.md —— 协作约束(科研审稿模块)
## 项目背景
本项目(PlantAI-rag-new)是植物基因组学文献知识工作台,拥有自研 RAG 与知识库
(Qdrant + Neo4j + vstore)。2026-10 起新增「科研投稿与智能审稿助手」功能
(审稿周期/期刊分析/期刊推荐/投稿前自审/审稿意见辅助/格式检查)。
## 审稿模块(review_service)约束 —— 必须遵守
1. **所有审稿相关新代码只允许写在 `review_service/` 目录下新增**。
- 服务自身:FastAPI 独立进程,端口 8100(模式同 `paper_writer_service` 8097 / `bioflow_service` 8098)。
- 环境变量前缀统一 `REVIEW_`;LLM 凭据复用 `DOCGEN_LLM_*` 裸键(回退链见 `review_service/app/services/llm.py`)。
2. **BFF(`sdk/`)层只允许条件注册代理路由**:
- 允许的全部改动 = `sdk/app/config.py` 增加 `review_enabled` / `review_service_url` 等开关键
+ `sdk/app/main.py` 按开关 `include_router(review_proxy.router)`
+ 新文件 `sdk/app/routers/review_proxy.py`(反代实现)。
- **严禁**修改 sdk 下其他 router/service/db 的任何既有逻辑。
3. **严禁修改现有 RAG 核心与既有服务代码**,包括但不限于:
- `agent/`(qa 8091 / methodology 8092 / legacy-rag 8093)
- `vstore/`(8094,审稿服务只经 HTTP 只读消费其 `/api/vstore/*` 接口)
- `paper_writer_service/`、`bioflow_service/`、`bioflow_kernel/`
- `ui/`(前端入口另行按 UI_SPEC 流程评审)
- `knowledge/`、`kb-libraries/`、`tooling/`(依赖锁另议)
4. **依赖纪律**:审稿服务只使用统一 venv(`tooling/requirements.lock`)中已有的库
(fastapi / httpx / pydantic-settings 等)。如确需新增全局依赖,
须先更新 `tooling/requirements.lock` 并经人工确认。
5. **上游对接只读**:PDF 解析走 vstore 8094(`POST /api/vstore/ingest` +
`GET/DELETE /api/vstore/documents/{id}`);LLM 走 DeepSeek OpenAI 兼容接口;
后续期刊数据/期刊推荐等子功能同样以新 service + 新路由在 `review_service/` 内扩展。
6. **format_check 例外**:format_check 允许用 pymupdf 本地解档获取版式元数据
(字体/边距/行距/页数),因为 vstore 只回文本不返回版式信息。正文提取仍走 vstore。
## 目录速览(审稿模块)
```
review_service/
├── app/main.py # FastAPI 入口(/health + 挂载业务路由)
├── app/config.py # pydantic-settings(REVIEW_ 前缀)
├── app/routers/presubmit.py # POST /api/review/presubmit(自审稿报告)
├── app/routers/format_check.py # POST /api/review/format-check(版式与规范检查)
├── app/services/llm.py # DeepSeek httpx 封装(complete_text/complete_json)
├── app/services/paper_parse.py # PDF → 纯文本(经 vstore 解析接口)
├── app/services/format_check.py# 版式规则引擎(pymupdf/docx 本地解档 + 规则检查)
├── restart.sh # 8100 重启脚本
└── pytest.ini
```
## 启动
```bash
cd review_service && bash restart.sh # 默认 8100,venv 从 ../plantai-rag-new-venv 推导
# BFF 开关:sdk/.env 加 REVIEW_ENABLED=1 后 bff_restart(反代 /api/review/*)
```
@@ -0,0 +1,42 @@
# feat(review): journal_directory 启动自动 seed(部署即运行)
## 背景
source_v4.xlsx(1056 条目录)此前需手动跑 import_journals.py 入库,部署后忘跑即出现"目录数据未导入"。本次实现启动时自动检测 + 自动导入。线上当前环境已由人工完成导入(review.db 内 1056 行),本功能消除的是新环境部署/重建库时的手动步骤风险。
## 修改内容
| 文件 | 变更 |
|---|---|
| `app/services/journal_seed.py`(新增) | 共享核心:schema/清洗/解析/upsert 从 CLI 原样迁入;`extract_rows_from_xlsx()`(口径 779/277 与 id 冲突闸门,不符不写库)、`upsert_to_db()`、`ensure_journal_directory_seeded()`(空表才导,四键 dict 契约,绝不抛异常) |
| `scripts/import_journals.py` | 瘦身为薄 CLI(-431/+92 行):对账报告/退出码 0/1/2/3 全保留,核心复用 journal_seed |
| `app/config.py` | +`seed_on_startup=True`(REVIEW_SEED_ON_STARTUP 可关)、+`journal_directory_seed_path` |
| `app/main.py` | lifespan:开关门控 → `asyncio.to_thread` 导入(不堵 event loop)→ try/except 不阻塞启动;路径走 `db.path` 注入链 |
| `tests/conftest.py`(新增) | 全局关 seed,防止单测触碰真库/拖慢套件 |
| `tests/test_seed.py`(新增) | 6 用例(见下) |
不动:source_v4.xlsx、journal_directory 路由/表 schema、db.py、前端。
## 测试用例与结果(pytest 78 passed,新增 6 条)
1. 空库 → seed 成功,rows=1056(en=779/zh=277)✓
2. 非空库(1 行)→ skip,count 不变 ✓
3. xlsx 不存在 → 返回 error,不抛异常,不写库 ✓
4. 幂等:连调两次,第二次 skip ✓
5. 开关 off(lifespan)→ 表不创建 ✓
6. 开关 on(lifespan)→ tmp 库 1056 行 ✓
## 部署验证
```bash
bash review_service/restart.sh # 非空库:日志 "already has 1056 rows, skip"
curl 'http://127.0.0.1:8100/api/review/journals/directory?lang=en' # total=779
# 空库冷启动(本机已验证等价路径):日志 "seeded 1056 rows (en=779, zh=277, N.Ns)"
# 特殊部署:REVIEW_SEED_ON_STARTUP=false → 日志 "seed skipped"
```
本机已实测:真机重启走 skip 路径(`INFO:app.main:already has 1056 rows, skip`),CLI 薄壳回归 exit=0 / `en=779 zh=277 → ✓ 相符`。
## 是否需要立即部署
待管理员确认。线上已手动导入 1056 行,本改动属部署便利性补强(消除新环境忘跑导入脚本的风险),可随下次正常发版评估带上。
@@ -0,0 +1,56 @@
# fix(review): 冲突降级真影响 recommendation(major → minor 真降级)
- 分支:`feature/academic-review-assistant`
- 日期:2026-10-12
- 服务:`review_service`(:8100)/ 前端 `PresubmitPanel.vue`
- 状态:**未 commit**,待验收
## 背景
s41588(已发表 Nature Genetics 论文)真实链路里,关键词扫描器报告"3 处冲突已降级为非硬性问题",但 `recommendation` 仍为大修、`major_weaknesses` 仍 5 条。诊断确认:原降级只做了"剥 hard_rule 标签 + 记 conflicts",**条目仍在 major 列表内**,`major_count` / 引擎输入未变,故判定不变。本次把"降级"从标签维度升级为**列表维度的真降级**(major → minor)。
## 变更
**后端**
- `paper_scanner.reconcile_hard_rules`:命中冲突的 major 从列表**移出**,`hard_rule=None` + `scanner_downgraded=true`,落入 demoted 列表;`fatal=true` 条目例外(只记 conflict 不降级,须人工过目)。
- `routers/presubmit.py`:demoted 追加进 `report.minor_weaknesses`;`major_weaknesses` 为过滤后列表;explanation 文案改"已降级为小修级问题"。
- `self_review.WeaknessItem`:新增 `scanner_downgraded: bool = False`(coerce 不读、LLM 无法伪造)。
- 引擎 `recommend_engine.decide_recommendation` **零改动**——计数因列表变短而自动真实。
**前端**
- `PresubmitPanel.vue`:minor 卡片对 `scanner_downgraded` 显示黄徽标"冲突降级"(与 major 卡片"硬性"红徽标对仗);冲突明细块保留。
## 测试
- pytest **104 passed**(新增:`test_reconcile_fatal_not_demoted`、`test_http_partial_conflict_leaves_residual_soft`;改写 `test_reconcile_*` 与 `test_http_scanner_conflict_downgrades` 为真降级断言)。
- vitest **382 passed / 5 failed**(5F 为既有他人 `benchpanel`+`Composer .mode-pill` labels.js 引发,与本改动无关);`npm run build` ✓。
## 验收(真 LLM,:8100)
| 样本 | rec | rule | M/S/minor | conflicts | downgraded→minor |
|---|---|---|---|---|---|
| diag_strong | minor_revision | R5 | 0/0/4 | 0 | 无 |
| diag_weak | major_revision | R1 | 6/2/7 | 1(hic) | 有(真降级生效) |
弱稿仍大修:4 条硬性命中(busco/accession/voucher/abs)为真缺,扫描器无冲突、不降级——真缺陷不放行。
## 验收:s41588(真 LLM,:8100)
输入 `/tmp/opencode/s41588-025-02113-5.pdf`,target_journal=Genome Biology(tier 1 override)。
| 项 | 修复前 | 修复后 |
|---|---|---|
| recommendation | major_revision | **minor_revision**(R5) |
| major_count / soft / minor | 5 / — / — | **0 / 0 / 6** |
| hard_hits | 含 busco/accession… | **[]** |
| scanner signals | — | accession_found=True, busco=partial, hic_found=True |
| major_weaknesses 列表 | 5 条 | **0 条** |
| scanner_conflicts | — | **2 条保留**(busco_missing 格式不完整、accession_missing 部分未给号)→ 均真降级进 minor(`scanner_downgraded=true`) |
判定链:扫描器证伪 2 条硬性 → 真降级 → 剩余为 minor → R5(tier1 accept 门槛 minor≤1,6 条 → minor_revision)。conflicts 透明保留、explanation 明示"已降级为小修级问题,请人工核对"。
注:本次 LLM 未再把"树图注未标数值 / GWAS 校正描述"判成 major(负向清单 Prompt 生效),故 major 从 5 归 0,优于预期的"降到 2"。
## 部署
待管理员确认。属判定正确性修复(真论文误判大修),建议随下次正常发版带上。
@@ -0,0 +1,81 @@
# fix(review): presubmit 四 Bug 修复——截断保真 / 分档 / 词表 / 扫描器兜底
## 背景
真实案例:已发表 Nature Genetics 论文(s41588-026-02682-z,黄瓜泛基因组)被判
"大修",但论文实有 BUSCO 98.57%(P2)、94.18% sequences anchored(P2)、
PRJCA038097 等 accession(P17 Data Availability)。诊断出四个独立缺陷:
1. **PDF 截断**:`max_text_chars=60000` 从头切,30 页论文 P17 的 Data Availability 被截掉;
2. **期刊分档**:Nature Genetics 不在 5 本精选 → 默认 tier 2(应 tier 1);
3. **硬性规则词表过窄**:缺 PRJCA/CRA(中国 NGDC/GSA)、Hi-C 同义词只认 anchoring rate、
BUSCO 仅百分比也算缺失;
4. **无程序层兜底**:hard_rule 全靠 LLM 输出,无关键词证伪机制。
## 修改内容
| 文件 | 变更 |
|---|---|
| `app/routers/presubmit.py` | **Bug 1**:段落感知装箱 `pack_feed_text`(超预算按
Abstract→Data Availability 全文→Methods 前 60%→Results→Discussion 优先保留,
dropped_sections 入 meta);无节标题回退头+尾窗(捞页尾 availability 块)。
**双层保护**:估算 token(len/1.5)>48K → 自动降 100K 重装;LLM 400/413 → 降 80K
重试一次。**Bug 4 接线**:coerce 后扫描器证伪 → rationale.scanner_conflicts |
**Bug 2**:tier_source ∈ override/featured/jif/默认 |
| `app/services/paper_scanner.py`(新增) | 关键词扫描器(纯 stdlib):accession
词表 PRJNA/PRJEB/PRJCA/SRP/ERP/DRP/CRA/SRR/ERR/DRR/GCA_/GCF_ **只在 Data Availability
段扫**(正文引用他人数据不误判);BUSCO 三级 none/partial/full;Hi-C 同义词
(anchored to chromosome(s)/anchoring rate/pseudo-chromosome(s)/chromosome-level)。
`reconcile_hard_rules`:LLM 报缺 X + 扫描器见 X → 剥硬性标签降 soft + 记冲突
(只证伪不证实,不引入新误判) |
| `app/services/recommend_engine.py` | **Bug 2**:tier 查找优先级 override
(13 本顶刊硬编码,"The " 前缀归一化)→ featured(journals.json)→ jif 启发式
(journal_directory 只读 jif 列;jif≥15→tier1;综述刊名含 Review/Trends/Annual
Review 除外)→ 默认 tier 2 |
| `app/services/self_review.py` | **Bug 3**:Prompt 词表扩充(PRJCA/CRA/SRR…);
BUSCO 三级判定(仅百分比→minor 不打 hard_rule);Hi-C 同义词清单。
**2026-10-12 追加 soft major 收紧**(s41588 复盘):维度三系统发育树分诊重写
(完全未做→major / 已声明仅图未标数值→presentation / 附带树→minor);新增
【负向清单】节(图未标统计量、标准方法描述不全、阈值缺数值、引用排版 →
minor/presentation,严禁列 major;总纲"只有补实验/补数据/重跑分析/改核心论证
才是 major";与各维度冲突时以本节为准) |
| `app/config.py` | `max_text_chars` 60000 → **150000**(REVIEW_MAX_TEXT_CHARS 可覆盖) |
| `ui/.../PresubmitPanel.vue` | 冲突黄标块(scanner_conflicts + 降级提示);截断
dropped_sections 美化提示;截断文案改为"保摘要/数据可用性/方法/结果/讨论" |
| `tests/test_presubmit.py` | 新增 15 用例(装箱/回退/token 守卫/400 重试/扫描器
三类信号/DA 段限定/冲突降级/端到端/tier 优先级矩阵/Prompt 新词表) |
## 测试用例与结果
- **pytest:102 passed**(87 基线 + 15 新增)。
- **vitest:379 passed / 5 failed**(5F 为既有他人 i18n labels 改动引发,与本改动
无关;新增冲突黄标/截断提示 2 条全绿)。`npm run build` ✓。
- **真实链路验收**(真 LLM,target_journal=Genome Biology → tier 1 override):
| 样本 | 修复前 | 修复后 | 扫描器 |
|---|---|---|---|
| 强稿 diag_strong.pdf | minor_revision | **minor_revision**(R5,0/0/5) | accession/busco=full/hic 全命中,0 冲突 ✓ |
| 弱稿 diag_weak.pdf | major_revision | **major_revision**(R1,硬性 4 + soft 4 + minor 5) | accession/busco 未命中(真缺不降);Hi-C 冲突降级并记录 ✓ |
| **真实案例 s41588**(NG 论文) | major_revision | 见下"验收"节 | — |
## 部署验证
```bash
bash review_service/restart.sh
curl -X POST http://127.0.0.1:8100/api/review/presubmit \
-F "file=@paper.pdf" -F "target_journal=Nature Genetics"
# 检查:meta.tier=1/tier_source=override;meta.dropped_sections;
# report.recommendation_rationale.scanner_conflicts
```
## 是否需要立即部署
待管理员确认。四修复均为判定正确性问题(真实发表论文误判大修),建议随下次正常发版带上。
## 遗留
- tier jif 启发式仅覆盖 journal_directory 已录入的 1056 刊;未收录刊名走默认 tier 2。
- 扫描器 accession 仅扫 DA 段——若论文把 accession 放 Methods 数据声明处且无 DA 节,
扫描器不证伪(保守方向,LLM 硬性判定仍生效,不会误放行)。
- BUSCO full 判定要求 S: 与 D: 标记在 200 字符窗内相邻——极端排版可能判 partial
(只会更严,不误放)。
@@ -0,0 +1,61 @@
# fix(review): presubmit recommendation 判定过严修复(配额制 → 规则引擎)
## 背景
用户反馈 AI 预审稿多次测试均返回 major_revision。2026-10-12 诊断确认根因是
**配额制**而非"尺子紧":
- `self_review.py` 硬性规则要求 `major_weaknesses 3-8 条`(强制配额)→ accept/minor_revision 几乎不可达;
- LLM 直接输出 recommendation,无程序层规则;JSON 示例锚定 `major_revision`、coerce 缺省回落 `major_revision`;
- 对照实验:近 GB 完备强稿(BUSCO 96.8% / Hi-C 98.7% / PRJNA+GCA+figshare 齐 / UFBoot 1000)仍被凑出 6 条 major,与弱稿(7 条)几乎无区分度;
- `target_journal` 传入但 Prompt 零分档标准。
## 修改内容
| 文件 | 变更 |
|---|---|
| `app/services/recommend_engine.py`(新增) | 纯函数规则引擎:R0 fatal→reject / R1 硬性 major→大修(不可协商,与 tier 无关)/ R2' tier3 仅 1-2 条 soft 可降小修 / R2 soft≥1→大修 / R4 0 major 且 minor≤tier 阈值→接收 / R5→小修;rationale 模板拼装(rule/hard_hits/计数/tier/explanation,含 tier 降级提示句);`resolve_tier` 按 journals.json `review_tier` 匹配,失败默认 tier 2 |
| `app/services/self_review.py` | Prompt 重写:严重分级标准(major/minor/presentation),**三类均不设下限、可 0 条、严禁凑数**;硬性规则 5 项打标签(busco/hic/accession/voucher/abs_missing);删除 recommendation 输出字段与示例锚定;coerce 不再读 recommendation(防注入),hard_rule 白名单过滤 |
| `app/routers/presubmit.py` | coerce 后接引擎;meta 增加 tier/tier_label/tier_source |
| `data/journals/journals.json` | 精选 5 本加 `review_tier`(GB/MP=1;BMC PB/FPS/Rice=2)+ notes 一行 |
| `ui/.../PresubmitPanel.vue` | 判定依据块(explanation + 硬性 chips);判定档位徽标;reject 红标"建议人工复核";顶部 AI 免责行;major 卡片"硬性/fatal"徽标 |
| `tests/test_presubmit.py` | 用例 1-10(引擎分支全覆盖 + tier 对照 + 注入忽略 + rationale 字段) |
判定链与旧链路唯一对外契约变化:`report.recommendation` 语义不变(四档枚举),
新增 `report.recommendation_rationale` 与 `meta.tier*`。
## 测试用例与结果
- **pytest:87 passed**(78 基线 + 9 新增/重写),含用例 1-10:
强稿形态不判大修、弱稿形态判大修且 hard_hits 正确、0 major 0/多 minor 分支、
soft major 分支、fatal→reject、tier3 降级与硬性豁免、tier1 accept 门槛、
LLM recommendation 注入被忽略、hard_rule 白名单过滤、rationale 含 tier/explanation。
- **vitest:377 passed / 5 failed**(5F 为既有他人 i18n labels 改动引发的 benchpanel
失败,与本改动无关;新增 4 条 rationale/档位/fatal 展示用例全绿)。
- **真实链路验收**(诊断同款样本、同 target_journal=Genome Biology,真 LLM 调用):
| 样本 | 修复前 | 修复后 | 依据 |
|---|---|---|---|
| 弱稿 diag_weak.pdf | major_revision(7 major) | **major_revision**(R1;硬性 5 命中:BUSCO/Hi-C/Accession/voucher/ABS + soft 2 + minor 6) | 真缺陷不漏判 ✓ |
| 强稿 diag_strong.pdf | major_revision(凑出 6 major) | **minor_revision**(R5;0 major / 5 minor) | 区分度恢复 ✓ |
## 部署验证
```bash
bash review_service/restart.sh
# 上传强/弱样本对比(或任意 PDF):
curl -X POST http://127.0.0.1:8100/api/review/presubmit \
-F "file=@paper.pdf" -F "target_journal=Genome Biology"
# 检查 report.recommendation_rationale.rule / meta.tier;前端看"判定依据"块
```
## 是否需要立即部署
待管理员确认。属判定质量修复(误报大修影响用户体验与信任),建议随下次正常发版带上。
## 遗留(Phase 2 候选)
- 程序层兜底 `_sanity_check_missing_hard_rules`:正文无 PRJNA/GCA_/SRP 关键词但 LLM
未报 accession_missing → 追加 warning(不进 recommendation 计算);先观察 LLM 是否
"躺平"再决定。
- tier 数据仅覆盖精选 5 本;扩展到 journal_directory 1056 条需人工核验后另行入库。
@@ -0,0 +1,161 @@
# PR 报告:Rebuttal Phase 1(审稿回复助手)
- 日期:2026-10-12
- 分支:`feature/academic-review-assistant`(未 commit,按用户约定统一处理)
- 范围:`review_service/` 新增 5 文件 + main 注册;`ui/` 新增面板与 store/api 扩展;无 sdk/、agent/、vstore/ 改动;无新增依赖。
## 功能概述
粘贴审稿意见文本(主入口)/ 上传批注版 PDF(次要入口)→ LLM+正则拆条(Reviewer→Comment)
→ 逐条填回复要点(5 类下拉,无 auto)→ 生成草稿(反幻觉校验前置)
→ 逐条勾确认 → 拼装 response letter → 下载 `.md`(human_ack 门槛)。docx 属 Phase 2。
## 10 个 API 端点(review_service:8100;BFF 8095 通用透传已验证可用)
| 方法 | 路径 | 说明 |
|---|---|---|
| POST | /api/review/rebuttal/jobs | 文本粘贴主入口 |
| POST | /api/review/rebuttal/jobs/pdf | PDF 次要入口(vstore 解析;非 PDF/超限→VALIDATION) |
| GET | /api/review/rebuttal/jobs/{id} | 全量还原 |
| PATCH | .../comments/{cid}/response | 保存 parts(改后旧 draft/validation 作废) |
| POST | .../comments/{cid}/draft | 生成草稿(校验C前置;MISSING_RESPONSE 时不调 LLM) |
| PATCH | .../comments/{cid}/structure | 手工 merge(≥2)/ split(≥2 非空子项) |
| PATCH | .../comments/{cid}/confirm | 逐条勾;后端重算 human_ack(全勾才 true,空 job 不置位) |
| POST | .../letter | 拼装 letter_md |
| GET | .../letter.md | 下载(human_ack=false → 400 HUMAN_ACK_REQUIRED) |
| DELETE | .../jobs/{id} | 手动删(替代 TTL) |
信封错误复用约定:HTTP 200 + `{ok:false,error:{code,message,degraded}}`。
## 数据模型
- Job:`{id,status,source:{kind,filename,raw_text},template:'generic',reviewers:[...],letter_md,validation,human_ack,created_at,updated_at}`
- Comment:`{id,group_id,severity,title,body,sub_items[],cross_refs[],response:{parts[]},draft,validation,human_confirmed}`
- part.type 枚举:`new_data | reanalysis | location | clarification | rebuttal`(决策 2:无 auto)
- SQLite 表 `rebuttal_jobs` 落在既有 `review_service/review.db`(自含短连接,不动 app/db.py);
启动幂等建表(main lifespan)。
## 关键实现决策(方案未写清处,按"保守、可测、不猜测")
1. **LLM 注入形态**:parse/draft 用 `async (messages, temperature) → dict` 回调,路由内适配
`llm.complete_json(system, user)`;单测直接 monkeypatch `llm.complete_json`。
2. **拆条双轨**:正则先切骨架(Reviewer 段头 + 编号行,兼容行内 `. 2.` 编号);
LLM 逐段出 `{title,severity,sub_items[]}`。LLM 失败/结构非法 → 该段回退正则
(title=首 60 字,severity=major)。`sub_items ≥2 且 max confidence ≥0.7` 才拆
(决策 3),拆出条目共享 group_id;未达阈值多子问题并回一条且 **body 保留段原文**
(不采信 LLM 改写)。
3. **交叉引用**:`see comment N / 参见第 N 条 / 同上` → 解析目标 id;解析不到
`target_id=null` 保留 raw(不猜)。
4. **反幻觉校验(负向词表收窄版)**:
- location:`shows that/as shown` 且无 `added/新增` → `LOCATION_EVIDENCE_WEAK` FAIL;
- rebuttal:命中 `we agree/accept/concede/you are right/we were wrong` →
`REBUTTAL_NEGATIVE` FAIL;无立场词(maintain/disagree/respectfully…)→
`REBUTTAL_NO_STANCE` FAIL;
- 其余三类 Phase 1 仅查非空。校验在 draft 端点前置,FAIL 不调 LLM。
5. **human_ack**:confirm 端点改完后由 store 重算(所有 comment 全 true 才置位;
空 job 不置位防平凡真)。前端无法直接置位。
6. **letter.md 下载**:纯文本端点(非信封),门槛失败返回 400 + 明文
`HUMAN_ACK_REQUIRED:…`;前端 `rebuttalDownloadLetterMd` 适配成 ApiError。
7. **MISSING_RESPONSE**:draft 端点 parts 为空或全空内容 → 信封错误,LLM 调用次数=0
(单测断言)。
8. **PDF 入口**:复用 vstore `parse_pdf_bytes`;校验顺序 = 非 .pdf → 空文件 → 超
`max_pdf_bytes`(50MB)→ 解析。与任务清单"PDF 超限/非 PDF"信封一致。
9. **前端状态**:`store.rebuttal` 纯内存(切面板不丢、刷新丢——与任务"状态持久化"
不同诉求,Phase 1 未要求 localStorage);draft 失败信封里的 job/validation 一并镜像。
10. **不改禁区**:sdk/agent/vstore/未动;PresubmitPanel 等既有面板未动;无新增依赖。
## 测试
### 后端 pytest(9 例新增,全量 113 passed)
```
tests/test_rebuttal.py::test_single_reviewer_single_comment PASSED
tests/test_rebuttal.py::test_multi_reviewer_attribution PASSED
tests/test_rebuttal.py::test_subitem_split_shares_group_id PASSED
tests/test_rebuttal.py::test_location_validation_fail_and_pass PASSED
tests/test_rebuttal.py::test_rebuttal_validation PASSED
tests/test_rebuttal.py::test_missing_response_no_llm_call PASSED
tests/test_rebuttal.py::test_cross_ref_unresolved_keeps_raw PASSED
tests/test_rebuttal.py::test_envelope_errors PASSED
tests/test_rebuttal.py::test_human_ack_gate_on_letter_download PASSED
全量: 113 passed in 10.05s(104 基线 + 9 新增)
```
### 前端 vitest(5 例新增)
```
rebuttal.panel.test.js 5 passed(5 类下拉无 auto / location hint 条件显示 /
未填禁用生成 / 未全确认禁用下载+横幅 / merge-split 仅 active 表单)
全量: 387 passed | 5 failed(失败全部为已知 labels.js 引发的 benchpanel×4 +
Composer .mode-pill×1 预存失败,与本次改动无关;基线 382P/5F → 387P/5F)
```
### build
`npm run build` ✓ built in 3.04s
## 手工冒烟(curl,8100 真 LLM + 真 SQLite)
```
POST /jobs(真实双 Reviewer 意见)→ ok=True job=rbt_ed245cd63b3a reviewers=2 comments=4
titles: 缺少FDR校正与q值报告 / Figure 3 blurry… / Missing coordinates… / Overstated novelty…
POST draft(未填) → ok=False code=MISSING_RESPONSE(LLM 0 调用)
PATCH response(location 弱) + POST draft
→ ok=False VALIDATION_FAILED findings=[LOCATION_EVIDENCE_WEAK]
PATCH response(location 合法) + POST draft → ok=True(真 LLM 草稿)
PATCH response(rebuttal 让步词) + draft → VALIDATION_FAILED findings=[REBUTTAL_NEGATIVE]
3 条合理回复(new_data/clarification/rebuttal)→ draft 全 ok=True
GET letter.md(未全勾) → HTTP 400 HUMAN_ACK_REQUIRED
PATCH confirm ×3 → human_ack=False(c0001 漏勾,恰好验证逐条门槛)
PATCH confirm c0001 → human_ack=True
POST letter → ok=True letter_md len=2731
GET letter.md → HTTP 200(/tmp/opencode/letter.md 落盘,含
Response to Reviewers + 4 条原文/回复)
DELETE job → ok=True meta={deleted:…};GET → NOT_FOUND
BFF 8095 探测 /rebuttal/jobs/nonexistent → HTTP 200(透传信封,REVIEW_ENABLED=1)
```
## 交付物清单
| 文件 | 动作 |
|---|---|
| review_service/app/services/rebuttal_store.py | 新增(SQLite CRUD + human_ack 重算) |
| review_service/app/services/rebuttal_parse.py | 新增(正则骨架 + LLM 拆分 + 交叉引用) |
| review_service/app/services/rebuttal_draft.py | 新增(5 类 Prompt + 反幻觉校验 + letter) |
| review_service/app/routers/rebuttal.py | 新增(10 端点) |
| review_service/app/main.py | +import +include_router +lifespan 建表(约 8 行) |
| review_service/tests/test_rebuttal.py | 新增(9 例) |
| ui/src/api/review.js | +10 API 封装 + rebuttal 错误码未进 CODE_HINTS(后端原话直达) |
| ui/src/stores/edu.js | +SECTIONS 'rebuttal' + rebuttal 状态块 + 10 actions |
| ui/src/components/edu/panels/RebuttalPanel.vue | 新增(拆条树/逐条表单/校验红条/draft 预览/手工拆合/letter) |
| ui/src/components/edu/EduSideNav.vue | +1 行菜单(审稿回复助手 💬) |
| ui/src/components/edu/EduWorkspace.vue | +import +panelMap 挂载 |
| tests/frontend/unit/edu/rebuttal.panel.test.js | 新增(5 例) |
| docs/pr-reports/2026-10-12-rebuttal-phase1.md | 本报告 |
## git status --short(新增部分)
```
?? docs/pr-reports/2026-10-12-rebuttal-phase1.md
?? review_service/app/routers/rebuttal.py
?? review_service/app/services/rebuttal_draft.py
?? review_service/app/services/rebuttal_parse.py
?? review_service/app/services/rebuttal_store.py
?? review_service/tests/test_rebuttal.py
?? tests/frontend/unit/edu/rebuttal.panel.test.js
?? ui/src/components/edu/panels/RebuttalPanel.vue
M review_service/app/main.py
M ui/src/api/review.js
M ui/src/components/edu/EduSideNav.vue
M ui/src/components/edu/EduWorkspace.vue
M ui/src/stores/edu.js
(此前 AI 预审稿修复的未 commit 改动保持原样,未混入本报告范围)
```
## 已知边界(Phase 1 明确不做)
- docx 导出(Phase 2,python-docx 已在 lock 备用);
- job TTL 自动清理(决策 5:手动 DELETE 替代);
- 跨 Reviewer 合并(merge 限同 Reviewer 内);
- 刷新页面后 job 恢复(纯内存态;GET /jobs/{id} 已备,Phase 2 可接列表入口)。
@@ -0,0 +1,111 @@
# PR 报告:P3b 编译 PDF Tab(论文重排版面板)
- 日期:2026-10-13
- 分支:`feature/p3b-compile-ui`(自最新 main 新开;未 commit,按用户约定统一处理)
- 范围:`ui/` 面板 + store/api 扩展;`review_service/` 仅 restart.sh 调起预热脚本 + 新增
scripts/prewarm_tectonic.sh。**后端 compile.py / latex_compile.py(P3a)零改动**;
无 sdk/、agent/、vstore/ 改动;无新增依赖。
## 概要
P3b:论文重排版面板启用"编译 PDF" Tab,实现"上传 .tex → 服务器编译 → 下载 PDF"的完整闭环。
## 修改内容
| 文件 | 变更 |
|---|---|
| ui/src/components/edu/panels/ReformatPanel.vue | 编译 Tab 状态机:无 job_id 引导 / 编译按钮 / loading 动画 + 首次 1-3 分钟黄条(可关闭)/ 成功 blob URL iframe 预览 + 下载 + 耗时 + 重新编译 / 失败错误摘要 + log 尾 200 行折叠 + 完整 log 下载;按钮不 await,状态全由 store 驱动(切 Tab/切面板编译继续) |
| ui/src/stores/edu.js | compileStatus/compileResult/compileError/compileLogTail + compilePdfUrl(blob URL,fetch 失败静默回退 pdf_url 直链)+ compileFirstHint;submitCompile(loading 重入保护)/ clearCompile(revoke blob);重新排版自动 clearCompile |
| ui/src/api/review.js | CODE_HINTS 增 QUEUE_FULL 固定文案"编译队列已满(最多 5 个任务),请稍后重试"(后端 message 带动态 pending 数,规范统一口径);compileTex() 为 P3a 已有封装 |
| review_service/restart.sh | 启动后后台调起 prewarm_tectonic.sh(nohup 非阻塞,日志 prewarm.log) |
| review_service/scripts/prewarm_tectonic.sh(新增) | 最小 hello.tex 实编译以缓存 TeX 环境。**注**:tectonic v0.17.0 无 `download` 子命令(实测 `no subcommand download`),改用 tools/README 的最小 .tex 预编译法;失败仅告警不影响服务启动 |
| tests/frontend/unit/edu/reformat.compile.test.js(新增) | 6 个用例(真实 reviewErrorMessage 经 importOriginal 保留,QUEUE_FULL 走 CODE_HINTS) |
## 关键实现决策
1. **无异步轮询**:后端编译同步阻塞返回(单槽队列,常规 10-30s,上限 `compile_queue_limit=5`),
无 stage 可显示 → loading 只做不确定时长旋转动画 + 文案说明。
2. **QUEUE_FULL**:HTTP 429 + 同款信封,http.js 抛 ApiError(code=QUEUE_FULL);
前端 CODE_HINTS 固定文案,报错后"重新编译"按钮立即可用(store finally 解锁)。
3. **PDF blob URL**:成功后异步 `fetch(pdf_url) → blob → createObjectURL`,
预览/下载不暴露后端路径;jsdom/网络失败回退 pdf_url 直链,不阻塞渲染。
4. **失败 log**:信封 detail = log 尾 200 行(折叠 `<pre>`);完整 log 下载兜底拼
`/api/review/compile/{job_id}/log`(失败信封不带 log_url,但 job_id 即 anchor_id)。
5. **首次编译提示条**:`compileFirstHint` 在首次 submitCompile 置位,loading 期间显示,
可手动关闭;`clearCompile`(重新排版)复位。
6. **预热命令修正**:任务原文 `./tools/tectonic -X download default` 在钉死版本
v0.17.0 不存在——实测后改为最小 .tex 实编译预热(同 tools/README.md 建议)。
## 测试结果
- 后端 pytest(review_service,后端未动):**113 passed**
- 前端 vitest 全量:**403 passed / 5 failed**(5F = 既有 labels.js 基线失败
benchpanel×4 + Composer pill×1,与本 PR 无关)
- vitest 新增 reformat.compile.test.js:**6/6 passed**
(无 job_id 引导 / 按钮可点 / 编译中+黄条+重入保护 / 成功 iframe+下载+耗时 /
失败 log 折叠 / QUEUE_FULL 文案+重试可用)
- npm run build:✓ 3.12s
## 手工冒烟(8100 真实链路)
- reformat /tmp/opencode/reformat_sample.tex → ok=True job_id=b3631727af68
- POST /compile {job_id=b3631727af68} → ok=True seconds=0.61 pdf_bytes=3596
- GET /compile/{cid}/pdf → 200,3596 bytes,application/pdf(file: PDF 1.5)
- GET /compile/{cid}/log → 200,3533 bytes
- job_id 不存在 / 格式非法 → VALIDATION 信封
- 坏 tex(\thisCommandDoesNotExist)→ COMPILE_FAILED + detail 尾 200 行
(含 "! Undefined control sequence")
- QUEUE_FULL → 429 + 信封(后端路径实测于 P3a;前端文案 vitest 6/6 覆盖)
- scripts/prewarm_tectonic.sh → exit=0 OK,宏包缓存就绪
## EPS 兼容性修复 v2(2026-10-14 追加)
背景:真实 MDPI 官方 zip(v6.5a)上传编译在 XDV→PDF 阶段失败:
`xdvipdfmx: image inclusion failed for "Definitions/logo-mdpi.eps"`。
v1 回退逻辑 gate 在"zip 自带 `*-eps-converted-to.pdf` 预转换版"——真实官方 zip
**不带**该文件(v1 本地 e2e 通过是因自造样本带了;测试样本与真实样本不一致,教训已记录)。
v2 方案:**不依赖扫描引用与 zip 自带预转换版**,解压后扫描项目内所有 `.eps`
批量现场转同名 `.pdf`(`latex_compile.process_eps_images`):
1. 工具优先级 **gs → epstopdf → ps2pdf**(`shutil.which` 逐个 fallback);gs 命令
约束1 强制 `-dSAFER -dNOPAUSE -dBATCH -sDEVICE=pdfwrite -dPDFSETTINGS=/prepress`
(-dSAFER 防 EPS 内嵌任意 PostScript 执行);无新 Python 依赖(subprocess)
2. 约束2:单文件转换 **15s 超时** → warning 行 `[eps-convert] xxx.eps 转换超时`
并跳过该文件继续
3. 约束3:单文件转换后 >20MB → warning;累计转换产物 >100MB →
`InspectError("ZIP_TOO_LARGE")` 中止(信封原样透出该 code)
4. 约束4:`[eps-convert] {src} → {dst} ({in} → {out}, {elapsed}s, {tool})`
写入 `output.log`(正常/超时两条路径都落盘,引擎 log 之后、chatter 之前)
5. 转换成功 → 显式 `X.eps` 引用字节替换为 `X.pdf`(.tex/.cls/.sty/.cfg/.def 全扫,
不碰编码、不改正文);无扩展名引用 `{.../X}` 由 graphicx 命中新 `X.pdf`
(解析顺序 .pdf→…→.eps,规避 .eps)
6. 全工具失败 → log 行 `[eps-convert] 全部工具失败,图片 xxx.eps 未转换` →
编译自然失败 → 前端提示「项目包含 EPS 图片,服务器转换失败,请转成 PDF/PNG 后重试」
真实官方 zip 实测(`scripts/debug_compile.py` 重打包 fba37ae3c853 现场 + 8100 HTTP 链路):
| 指标 | 结果 |
|---|---|
| 转换 EPS 数 | 2(logo-mdpi.eps、logo-updates.eps,均 gs) |
| 每个耗时 | 563678→13057B 0.27s;287998→16588B 0.27s(合计 0.54s) |
| 显式引用改写 | 1 个文件(Definitions/mdpi.cls) |
| 编译 | 2.83s(debug 脚本)/ 2.99s(HTTP) |
| 产出 PDF | 70688 / 70687 bytes,7 页,`%PDF-` ✓ |
测试:pytest **175 passed**(原 169 全保留,移除 3 个 v1 语义已变的 EPS 用例,
新增 9 个 v2 用例:preset 免转换 / 真实 gs 转换 / 工具 fallback / 全失败 /
超时 warning / 20MB warning / 100MB 中止 / 端到端成功 / 友好报错)。
教训(关键):**外部下载的模板类场景,e2e 必须用真实官方文件**——v1 的自造样本
带了预转换版,真实官方 zip 不带,导致修复上线后失效。
## 部署验证(部署后执行)
```bash
bash review_service/restart.sh
# 观察日志:prewarm_tectonic.sh 后台跑(非阻塞),prewarm.log 出现 "[prewarm] OK"
# 浏览器 → 教育科研 → 论文自动重排版 → 上传 .tex → 选期刊 → 重排版
# → 切"编译 PDF" → 点编译
# 期望:首次 1-3 分钟(若预热已完成则秒级)、后续秒回;失败可见 log 尾 200 行
```
+13
View File
@@ -0,0 +1,13 @@
Reviewer #1:
1. The GWAS analysis lacks multiple-testing correction. Please re-run with FDR control and report q-values for all significant loci. In addition, the sample size justification is missing — please add a power analysis or at least discuss the detectable effect size.
2. Figure 3 is blurry and the axis labels are unreadable. As noted in Comment 3, the same issue applies to Figure S2. Please replace all figures with high-resolution versions.
3. Minor: please add the standard error estimates to Supplementary Table 2.
Reviewer #2:
1. The claim of novelty overstates the advance relative to Zhang et al. 2023. The introduction should more clearly delineate what is new.
2. How were the batch effects between the two sequencing centers corrected? This is essential to support the conclusions.
+27
View File
@@ -0,0 +1,27 @@
# review_service/.env.example —— 运行时配置模板
# 用法: cp .env.example .env 后填写(.env 已被仓库 .gitignore 忽略,勿提交)
# restart.sh 会 `set -a; source .env` 导出给 uvicorn 进程。
# ---- LLM(DeepSeek;REVIEW_LLM_* 优先 → DOCGEN_LLM_* 回退 → 内置默认,见 services/llm.py)----
# 最简做法:从部署树抄一行即可复用同一把 key:
# grep '^DOCGEN_LLM_API_KEY=' /home/xzq/5090/teamWorkspace/zh/PlantAI-rag-new/sdk/.env >> .env
REVIEW_LLM_BASE_URL=https://api.deepseek.com/v1
REVIEW_LLM_API_KEY=
REVIEW_LLM_MODEL=deepseek-chat
#REVIEW_LLM_TIMEOUT=300
# ---- 上游(只读消费)----
#REVIEW_VSTORE_BASE_URL=http://127.0.0.1:8094
#REVIEW_METHODOLOGY_BASE_URL=http://127.0.0.1:8092 # 预留(MinerU 重链路,当前未用)
# ---- PDF 解析(经 vstore)----
#REVIEW_PARSE_TIMEOUT=180 # ingest→取文→清理 总读超时(秒)
#REVIEW_PARSE_DELETE_AFTER=1 # 1=解析后删除 vstore 临时文档(0=保留便于排查)
# ---- 自审稿 ----
#REVIEW_PRESUBMIT_READ_TIMEOUT=360 # LLM 长调用读超时(秒)
#REVIEW_MAX_TEXT_CHARS=60000 # 送 LLM 的正文截断上限
#REVIEW_MAX_PDF_BYTES=52428800 # 上传 PDF 上限 50MB
# ---- 服务(restart.sh 读取)----
#REVIEW_BIND_HOST=127.0.0.1
+7
View File
@@ -0,0 +1,7 @@
"""review_service —— 科研投稿与智能审稿助手(8100)。
独立部署树(模式同 paper_writer_service 8097 / bioflow_service 8098):
- BFF(sdk 8090) 经 routers/review_proxy.py 条件反代 /api/review/*(REVIEW_ENABLED)。
- 上游只读消费:vstore 8094(PDF 解析)、DeepSeek(LLM,REVIEW_LLM_*/DOCGEN_LLM_*)。
- 约束见根目录 AGENTS.md:审稿相关新代码只允许落在本目录。
"""
+1
View File
@@ -0,0 +1 @@
"""review 服务(8100)应用包。"""
+140
View File
@@ -0,0 +1,140 @@
"""config.py —— review 服务(8100)环境变量驱动配置(pydantic-settings)。
全部键可用环境变量覆盖(前缀 REVIEW_)。LLM 沿用 docgen 的裸键模式:
优先 REVIEW_LLM_*,回退 DOCGEN_LLM_*(与 paper_writer_service 共享同一套
DeepSeek 凭据,由 services/llm.py 直接读 os.environ)。零硬编码宿主路径。
"""
from __future__ import annotations
from functools import lru_cache
from pathlib import Path
from pydantic_settings import BaseSettings, SettingsConfigDict
class Settings(BaseSettings):
model_config = SettingsConfigDict(
env_file=".env",
env_file_encoding="utf-8",
extra="ignore",
env_prefix="REVIEW_",
)
app_name: str = "plantai-review-service"
version: str = "0.1.0"
# ---- 上游(只读消费;不修改 vstore/methodology 任何代码)----
# vstore 8094:POST /api/vstore/ingest + GET/DELETE /api/vstore/documents/{id}
# (pymupdf 段落解析,同步秒级;methodology 8092 的 MinerU 链路是
# 分钟级异步 job,不适配同步自审稿,仅预留地址供后续扩展)
vstore_base_url: str = "http://127.0.0.1:8094"
methodology_base_url: str = "http://127.0.0.1:8092"
# ---- PDF 解析 ----
parse_timeout: float = 180.0 # vstore ingest→fetch→delete 读超时(秒)
parse_delete_after: bool = True # 解析完成后删除 vstore 临时文档(不污染私有库)
# ---- 自审稿(presubmit)----
presubmit_read_timeout: float = 360.0 # LLM 长调用读超时(秒)
max_text_chars: int = 150000 # 送 LLM 的正文截断上限(REVIEW_MAX_TEXT_CHARS 覆盖;
# token 超 48K 自动降 100K,LLM 400/413 再降 80K 重试)
max_pdf_bytes: int = 50 * 1024 * 1024 # 上传 PDF 上限 50MB(对齐 extraction FR-EXTRACT-004)
# ---- 期刊情报与投稿推荐(recommend)----
db_path: str = "review.db" # 独立 SQLite(相对 review_service/;REVIEW_DB_PATH 覆盖)
journals_seed_path: str = "data/journals/journals.json" # 种子(相对 review_service/)
journal_directory_seed_path: str = "data/journals/source_v4.xlsx" # 目录源 xlsx(相对 review_service/)
seed_on_startup: bool = True # 启动自动 seed journal_directory(空表才导;false 关闭)
vstore_match_timeout: float = 30.0 # scope 入库/向量检索读超时(秒)
recommend_read_timeout: float = 60.0 # LLM 重排读超时(秒)
recommend_query_chars: int = 3000 # 送 vstore 的检索 query 截断(防嵌入模型超长)
recommend_scope_top_k: int = 10 # search-chunks top_k(vstore 上限 20)
# ---- 论文重排版(reformat,P1:.tex 源码级变换,不编译)----
max_tex_bytes: int = 2 * 1024 * 1024 # 上传 .tex 上限 2MB(PDF 的 50MB 不适用)
reformat_dir: str = "data/reformat_jobs" # 产物落盘(相对 review_service/)
# ---- LaTeX 编译 PDF(compile,P3:tectonic 单文件二进制)----
tectonic_path: str = "tools/tectonic" # 相对 review_service/;也可绝对路径
tectonic_cache_dir: str = "data/tectonic-cache" # 宏包缓存(部署时预热,运行期只读命中)
compile_timeout_s: float = 60.0 # 单次编译墙钟上限,超时整进程组 kill
max_compile_pdf_bytes: int = 50 * 1024 * 1024 # 产物 PDF 上限 50MB
compile_queue_limit: int = 5 # 等待槽位上限(>5 → QUEUE_FULL 429)
compile_retention_days: int = 7 # 编译产物保留天数(后台清扫)
# ---- LaTeX 项目 zip 编译(P4:两段式 inspect + run)----
max_zip_bytes: int = 50 * 1024 * 1024 # 上传 zip 上限 50MB
max_extract_bytes: int = 200 * 1024 * 1024 # 单项目解压总大小硬顶 200MB(实写字节计数)
max_zip_entries: int = 2000 # 条目数上限(预扫第一件事)
max_zip_entry_bytes: int = 50 * 1024 * 1024 # 单条目解压上限 50MB
max_zip_ratio: float = 100.0 # 单条目压缩比 file_size/compress_size 上限
max_zip_path_depth: int = 16 # 路径深度上限(深层嵌套拒绝)
max_zip_path_len: int = 200 # 单条目路径长度上限
compile_project_timeout_s: float = 120.0 # 项目 zip 编译墙钟上限(单文件仍 compile_timeout_s)
inspect_dir: str = "data/compile_inspect" # zip 解压暂存(1 小时 TTL,相对 review_service/)
inspect_ttl_s: int = 3600 # inspect 暂存过期秒数
inspect_sweep_interval_s: float = 300.0 # inspect 后台清扫周期(lifespan 定时任务)
compile_jobs_dir: str = "data/compile_jobs" # 项目编译产物(pdf/log/meta,7 天 sweep)
failed_project_ttl_s: int = 24 * 3600 # 编译失败保留 project/ 现场秒数(诊断用)
keep_failed_projects: bool = False # 失败 project/ 永久保留(调试开关;
# 亦读裸环境变量 KEEP_FAILED_PROJECTS=1)
@property
def _service_root(self) -> "Path":
# review_service/app/config.py → review_service/(相对本文件定位,不依赖 cwd)
return Path(__file__).resolve().parent.parent
@property
def db_path_abs(self) -> "Path":
# 绝对 db_path 会被 Path 除法原样返回;相对路径落在 review_service/ 下
return self._service_root / self.db_path
@property
def journals_seed_abs(self) -> "Path":
return self._service_root / self.journals_seed_path
@property
def journal_directory_seed_abs(self) -> "Path":
return self._service_root / self.journal_directory_seed_path
@property
def reformat_dir_abs(self) -> "Path":
p = Path(self.reformat_dir)
return p if p.is_absolute() else self._service_root / p
@property
def tectonic_abs(self) -> "Path":
p = Path(self.tectonic_path)
return p if p.is_absolute() else self._service_root / p
@property
def tectonic_cache_abs(self) -> Path:
p = Path(self.tectonic_cache_dir)
return p if p.is_absolute() else self._service_root / p
@property
def inspect_dir_abs(self) -> Path:
p = Path(self.inspect_dir)
return p if p.is_absolute() else self._service_root / p
@property
def compile_jobs_dir_abs(self) -> Path:
p = Path(self.compile_jobs_dir)
return p if p.is_absolute() else self._service_root / p
@property
def vstore_base(self) -> str:
return self.vstore_base_url.rstrip("/")
@property
def methodology_base(self) -> str:
return self.methodology_base_url.rstrip("/")
@lru_cache(maxsize=1)
def get_settings() -> Settings:
return Settings()
settings = get_settings()
+191
View File
@@ -0,0 +1,191 @@
"""app/db.py —— review 服务独立 SQLite(aiosqlite + WAL,无 ORM):journals 表。
- 单连接 + asyncio 写锁(模式对齐 paper_writer_service/bioflow,但表结构与种子
逻辑为本模块自研);路径默认 review_service/review.db(REVIEW_DB_PATH 覆盖)。
- 种子:data/journals/journals.json → journals 表(幂等 upsert,vstore_doc_id 列
永不被种子覆盖——该列记录 scope_desc 在 vstore 8094 的 document_id)。
- 只在 review_service/ 内使用,不触碰 BFF/生产服务数据库。
"""
from __future__ import annotations
import asyncio
import json
from pathlib import Path
from typing import Any, Iterable
import aiosqlite
from .config import get_settings
_SCHEMA = """
CREATE TABLE IF NOT EXISTS journals (
id TEXT PRIMARY KEY,
name TEXT NOT NULL,
scope_desc TEXT NOT NULL,
impact_factor REAL,
review_time_weeks REAL,
acceptance_rate REAL,
submission_deadline TEXT,
official_url TEXT,
last_updated TEXT NOT NULL,
vstore_doc_id TEXT
);
"""
# 种子 upsert 列(刻意不含 vstore_doc_id:种子刷新不得清掉向量库映射)
_SEED_COLS = (
"id",
"name",
"scope_desc",
"impact_factor",
"review_time_weeks",
"acceptance_rate",
"submission_deadline",
"official_url",
"last_updated",
)
_UPSERT_SQL = (
"INSERT INTO journals (" + ", ".join(_SEED_COLS) + ") VALUES ("
+ ", ".join("?" for _ in _SEED_COLS) + ") "
+ "ON CONFLICT(id) DO UPDATE SET "
+ ", ".join(f"{c}=excluded.{c}" for c in _SEED_COLS if c != "id")
)
class SeedError(Exception):
"""种子文件缺失/损坏(journals.json 不可读)。"""
class Database:
"""aiosqlite 单连接封装(WAL;写串行化)。"""
def __init__(self, path: str | Path | None = None) -> None:
self._path: Path | None = Path(path) if path is not None else None
self._conn: aiosqlite.Connection | None = None
self._lock = asyncio.Lock()
@property
def path(self) -> Path:
if self._path is None:
self._path = get_settings().db_path_abs
return self._path
def set_path(self, path: str | Path) -> None:
"""测试注入:在进入 TestClient lifespan 之前预置库路径(须尚未 connect)。"""
if self._conn is not None:
raise RuntimeError("Database 已连接,无法再改路径(先 close_db())")
self._path = Path(path)
@property
def connected(self) -> bool:
return self._conn is not None
async def connect(self) -> None:
self.path.parent.mkdir(parents=True, exist_ok=True)
self._conn = await aiosqlite.connect(self.path)
self._conn.row_factory = aiosqlite.Row
await self._conn.execute("PRAGMA journal_mode=WAL")
await self._conn.execute("PRAGMA busy_timeout=5000")
await self._conn.executescript(_SCHEMA)
await self._conn.commit()
async def close(self) -> None:
if self._conn is not None:
await self._conn.close()
self._conn = None
@property
def conn(self) -> aiosqlite.Connection:
if self._conn is None:
raise RuntimeError("Database 未初始化:先 await init_db()")
return self._conn
async def fetchall(self, sql: str, params: Iterable[Any] = ()) -> list[dict[str, Any]]:
async with self.conn.execute(sql, tuple(params)) as cur:
rows = await cur.fetchall()
return [dict(r) for r in rows]
async def fetchone(self, sql: str, params: Iterable[Any] = ()) -> dict[str, Any] | None:
async with self.conn.execute(sql, tuple(params)) as cur:
row = await cur.fetchone()
return dict(row) if row is not None else None
async def execute(self, sql: str, params: Iterable[Any] = ()) -> int:
async with self._lock:
cur = await self.conn.execute(sql, tuple(params))
await self._conn.commit() # type: ignore[union-attr]
return cur.lastrowid or 0
async def executemany(self, sql: str, seq: list[tuple[Any, ...]]) -> None:
async with self._lock:
await self.conn.executemany(sql, seq)
await self._conn.commit() # type: ignore[union-attr]
db = Database()
async def init_db(path: str | Path | None = None) -> None:
"""幂等初始化:已连接则跳过(测试可在 lifespan 前 set_path 注入路径)。"""
if path is not None:
db.set_path(path)
if db.connected:
return
await db.connect()
async def close_db() -> None:
await db.close()
def set_path(path: str | Path) -> None:
"""同步注入库路径(测试 fixture 用;须在 init_db 之前调用)。"""
db.set_path(path)
async def ensure_journals_seeded() -> int:
"""装载种子期刊(幂等)。返回 journals 表行数。"""
row = await db.fetchone("SELECT COUNT(*) AS c FROM journals")
if row and int(row["c"]) > 0:
return int(row["c"])
seed_file = get_settings().journals_seed_abs
try:
payload = json.loads(Path(seed_file).read_text(encoding="utf-8"))
except FileNotFoundError as exc:
raise SeedError(f"期刊种子文件不存在:{seed_file}") from exc
except (OSError, ValueError) as exc:
raise SeedError(f"期刊种子文件不可读:{exc}") from exc
journals = payload.get("journals") if isinstance(payload, dict) else None
if not isinstance(journals, list) or not journals:
raise SeedError(f"期刊种子文件缺少 journals 数组:{seed_file}")
rows: list[tuple[Any, ...]] = []
for item in journals:
if not isinstance(item, dict) or not item.get("id") or not item.get("name"):
continue
rows.append(tuple(item.get(c) for c in _SEED_COLS))
if not rows:
raise SeedError(f"期刊种子文件无有效条目:{seed_file}")
await db.executemany(_UPSERT_SQL, rows)
return len(rows)
async def list_journals() -> list[dict[str, Any]]:
"""全部期刊(impact_factor 降序,NULL 靠后)。"""
return await db.fetchall(
"SELECT * FROM journals ORDER BY impact_factor DESC, name ASC"
)
async def get_journal(journal_id: str) -> dict[str, Any] | None:
return await db.fetchone("SELECT * FROM journals WHERE id = ?", (journal_id,))
async def set_vstore_doc_id(journal_id: str, doc_id: str) -> None:
"""记录 scope_desc 在 vstore 的 document_id(向量白名单检索用)。"""
await db.execute(
"UPDATE journals SET vstore_doc_id = ? WHERE id = ?", (doc_id, journal_id)
)
+159
View File
@@ -0,0 +1,159 @@
"""main.py —— review 服务应用入口(uvicorn 入口)。
- 独立部署树 review_service/(科研投稿与智能审稿助手,端口 8100)。
- 端点:/health(GET,BFF 探活反代)+ /api/review/*(自审稿等业务路由)。
- 不依赖 BFF/生产服务(8090 等绝不探测/连接);上游仅消费 vstore 8094。
"""
from __future__ import annotations
import asyncio
import logging
import time
from contextlib import asynccontextmanager
import httpx
from fastapi import FastAPI
from fastapi.middleware.cors import CORSMiddleware
from .config import get_settings
from .db import close_db, db, init_db
from .routers import (
compile,
conferences,
format_check,
journal_directory,
journals,
presubmit,
reformat,
rebuttal,
)
logging.basicConfig(level=logging.INFO)
logger = logging.getLogger(__name__)
def create_app() -> FastAPI:
settings = get_settings()
app = FastAPI(title=settings.app_name, version=settings.version)
app.add_middleware(
CORSMiddleware,
allow_origins=["*"],
allow_credentials=False,
allow_methods=["*"],
allow_headers=["*"],
)
@asynccontextmanager
async def _lifespan(_app: FastAPI):
# journals 推荐依赖独立 SQLite:启动即建表(幂等;测试可先 set_path 注入
# tmp 路径,本函数沿用注入路径)
await init_db()
# rebuttal Phase 1:独立表,启动幂等建表(自含连接,不走 db.py)
try:
from .services.rebuttal_store import ensure_table
ensure_table()
except Exception: # noqa: BLE001
logger.warning("rebuttal 建表失败(忽略)", exc_info=True)
# 编译产物过期清扫:启动跑一次(失败不阻塞启动)
try:
from .services.latex_compile import sweep_expired
sweep_expired()
except Exception: # noqa: BLE001
logger.warning("compile sweep 启动清扫失败(忽略)", exc_info=True)
# P4:inspect 暂存(1h TTL)+ 项目编译产物(7 天)启动清扫
try:
from .services.latex_compile import (
sweep_compile_jobs_expired,
sweep_inspect_expired,
)
sweep_inspect_expired()
sweep_compile_jobs_expired()
except Exception: # noqa: BLE001
logger.warning("P4 sweep 启动清扫失败(忽略)", exc_info=True)
# P4:inspect 暂存后台定时清扫(默认 300s;补充 1——上传不点编译不堆积)
sweep_task: asyncio.Task[None] | None = None
try:
from .services.latex_compile import sweep_inspect_expired as _sweep_insp
async def _inspect_sweep_loop() -> None:
interval = get_settings().inspect_sweep_interval_s
while True:
await asyncio.sleep(interval)
try:
await asyncio.to_thread(_sweep_insp)
except Exception: # noqa: BLE001
logger.warning("inspect 后台清扫失败(忽略)", exc_info=True)
sweep_task = asyncio.create_task(_inspect_sweep_loop())
except Exception: # noqa: BLE001
logger.warning("inspect 后台清扫任务启动失败(忽略)", exc_info=True)
# journal_directory 自动 seed:空表才导(xlsx 解析约 1-3s,不堵 event loop;
# 路径沿用 db.path 注入链——生产=settings.db_path_abs,测试=tmp)
if settings.seed_on_startup:
try:
from .services.journal_seed import ensure_journal_directory_seeded
_t0 = time.time()
_result = await asyncio.to_thread(
ensure_journal_directory_seeded, db.path)
if _result.get("seeded"):
_c = _result.get("counts") or {}
logger.info(
"seeded %s rows (en=%s, zh=%s, %.1fs)",
_result["rows"], _c.get("en"), _c.get("zh"),
time.time() - _t0)
elif _result.get("error"):
logger.warning(
"journal_directory 启动 seed 失败(忽略,不阻塞启动): %s",
_result["error"])
else:
logger.info("%s", _result.get("reason") or "journal_directory seed skipped")
except Exception: # noqa: BLE001
logger.warning("journal_directory 启动 seed 失败(忽略,不阻塞启动)", exc_info=True)
else:
logger.info("journal_directory seed skipped (REVIEW_SEED_ON_STARTUP=false)")
try:
yield
finally:
if sweep_task is not None:
sweep_task.cancel()
try:
await sweep_task
except asyncio.CancelledError:
pass
except Exception: # noqa: BLE001
pass
await close_db()
app.router.lifespan_context = _lifespan
@app.get("/health")
async def health() -> dict[str, object]:
vstore_ok = False
vstore_error: str | None = None
try:
async with httpx.AsyncClient(timeout=2.0) as client:
resp = await client.get(f"{settings.vstore_base}/api/vstore/health")
resp.raise_for_status()
vstore_ok = bool(resp.json().get("ok"))
except Exception as exc: # noqa: BLE001
vstore_error = str(exc)
return {
"ok": True,
"status": "ok" if vstore_ok else "degraded",
"upstreams": {"vstore": {"connected": vstore_ok, "error": vstore_error}},
"version": settings.version,
}
app.include_router(presubmit.router)
app.include_router(rebuttal.router)
app.include_router(journals.router)
app.include_router(format_check.router)
app.include_router(conferences.router)
app.include_router(journal_directory.router)
app.include_router(reformat.router)
app.include_router(compile.router)
return app
app = create_app()
+1
View File
@@ -0,0 +1 @@
"""review 服务路由包。"""
+342
View File
@@ -0,0 +1,342 @@
"""routers/compile.py —— LaTeX 编译 PDF(P3a:tectonic)。
端点:
POST /api/review/compile multipart:file(.tex 可选) | job_id(可选,二选一)
→ {ok, compile_id, pdf_url, log_url, meta}
GET /api/review/compile/{cid} 编译元信息(meta.json)
GET /api/review/compile/{cid}/pdf output.pdf(FileResponse)
GET /api/review/compile/{cid}/log output.log(text/plain)
信封:业务错误 = HTTP 200 + {ok:false,error:{code,message,detail?,degraded:false}}
(QUEUE_FULL 例外:HTTP 429 + 同款信封体,前端仍按 ok/error 单一口径处理)。
detail = log 尾 200 行(COMPILE_FAILED / TIMEOUT)。
"""
from __future__ import annotations
import json
import logging
import re
import uuid
from pathlib import Path
from typing import Any
from fastapi import APIRouter, File, Form, UploadFile
from fastapi.responses import FileResponse, JSONResponse, PlainTextResponse
from pydantic import BaseModel
from ..config import get_settings
from ..services import latex_compile as lc
from ..services.latex_compile import (
CompileError,
QueueFullError,
ToolUnavailableError,
)
logger = logging.getLogger(__name__)
router = APIRouter(prefix="/api/review", tags=["review-compile"])
_CID_RE = re.compile(r"^[0-9a-f]{12}$")
class CompileResponse(BaseModel):
ok: bool
compile_id: str | None = None
pdf_url: str | None = None
log_url: str | None = None
meta: dict[str, Any] | None = None
error: dict[str, Any] | None = None
def _error(code: str, message: str, detail: str = "") -> CompileResponse:
err: dict[str, Any] = {"code": code, "message": message, "degraded": False}
if detail:
err["detail"] = detail
return CompileResponse(ok=False, error=err)
def _jobs_root() -> Path:
d = get_settings().reformat_dir_abs
d.mkdir(parents=True, exist_ok=True)
return d
@router.post("/compile", response_model=CompileResponse)
async def compile_tex(
file: UploadFile | None = File(None, description="LaTeX 源码(.tex,与 job_id 二选一)"),
job_id: str = Form("", description="P1 重排版任务 id(优先于 file)"),
) -> CompileResponse:
settings = get_settings()
# ---- 输入解析:job_id 优先,否则直接上传的 .tex ----
jid = (job_id or "").strip()
if jid:
if not _CID_RE.fullmatch(jid):
return _error("VALIDATION", "job_id 格式非法(应为 12 位 hex)")
src = _jobs_root() / f"{jid}.tex"
if not src.is_file():
return _error("VALIDATION", "job_id 对应的重排版结果不存在,请重新排版")
try:
source = src.read_text("utf-8")
except UnicodeDecodeError:
return _error("VALIDATION", "任务源码不是合法 UTF-8")
anchor_id = jid
else:
if file is None:
return _error("VALIDATION", "必须提供 file(.tex)或 job_id")
filename = file.filename or "paper.tex"
if Path(filename).name != filename or ".." in filename:
return _error("VALIDATION", "非法文件名")
if not filename.lower().endswith(".tex"):
return _error("VALIDATION", "仅支持 .tex 文件")
content = await file.read()
if not content:
return _error("VALIDATION", "上传文件为空")
if len(content) > settings.max_tex_bytes:
return _error("VALIDATION", "源码超过 2MB 上限")
try:
source = content.decode("utf-8")
except UnicodeDecodeError:
return _error("VALIDATION", "源码必须为 UTF-8 编码")
anchor_id = uuid.uuid4().hex[:12]
# ---- 编译(隔离目录;失败信封带 log 尾)----
lc.prepare_input(anchor_id, source)
try:
result = await lc.compile_tex(anchor_id)
except ToolUnavailableError as exc:
return _error("TOOL_UNAVAILABLE", str(exc))
except QueueFullError as exc:
return JSONResponse(
status_code=429,
content={
"ok": False,
"compile_id": None, "pdf_url": None, "log_url": None, "meta": None,
"error": {"code": "QUEUE_FULL", "message": str(exc), "degraded": False},
},
)
except CompileError as exc:
return _error(exc.code, str(exc), detail=exc.log_tail)
meta_path = lc.compile_dir(anchor_id) / "meta.json"
try:
meta = json.loads(meta_path.read_text("utf-8"))
except (OSError, ValueError):
meta = {"compile_id": anchor_id, "seconds": result["seconds"]}
return CompileResponse(
ok=True,
compile_id=anchor_id,
pdf_url=f"/api/review/compile/{anchor_id}/pdf",
log_url=f"/api/review/compile/{anchor_id}/log",
meta=meta,
)
# ================================================================ P4:项目 zip(两段式)
def _p4_error(code: str, message: str, detail: str = "",
compile_id: str | None = None,
log_url: str | None = None) -> CompileResponse:
"""P4 错误信封(补充 3:失败也带 compile_id + log_url,前端可下载完整 log)。"""
err: dict[str, Any] = {"code": code, "message": message, "degraded": False}
if detail:
err["detail"] = detail
return CompileResponse(
ok=False, compile_id=compile_id, log_url=log_url, error=err)
def _project_pdf_url(cid: str) -> str:
return f"/api/review/compile/zip/{cid}/pdf"
def _project_log_url(cid: str) -> str:
return f"/api/review/compile/zip/{cid}/log"
@router.post("/compile/inspect", response_model=CompileResponse)
async def inspect_zip_project(
file: UploadFile = File(..., description="LaTeX 项目 zip(含 main.tex/.cls/图片/.bib)"),
) -> CompileResponse:
"""两段式之①:安全解压 + 主文件识别 → job_id(1 小时 TTL,run 前不占编译队列)。
暂用 request.body() 整体缓冲(≤50MB);Phase 2 改流式上传
"""
settings = get_settings()
filename = file.filename or "project.zip"
if Path(filename).name != filename or ".." in filename:
return _p4_error("VALIDATION", "非法文件名")
if not filename.lower().endswith(".zip"):
return _p4_error("VALIDATION", "仅支持 .zip 文件")
# 暂用 request.body() 整体缓冲(≤50MB);Phase 2 改流式上传
content = await file.read()
if not content:
return _p4_error("VALIDATION", "上传文件为空")
if len(content) > settings.max_zip_bytes:
return _p4_error(
"VALIDATION",
f"zip 超过 {settings.max_zip_bytes // (1024 * 1024)}MB 上限")
try:
meta = await lc.inspect_zip(content)
except lc.InspectError as exc:
return _p4_error(exc.code, exc.message)
return CompileResponse(ok=True, meta=meta)
class RunZipRequest(BaseModel):
job_id: str
@router.post("/compile/run", response_model=CompileResponse)
async def run_zip_compile(payload: RunZipRequest) -> CompileResponse:
"""两段式之②:原子消费 inspect(rename 防并发双跑)→ tectonic 编译 → pdf/log。
队列/工具失败发生在消费**之前** → inspect 保留可重试;
编译失败(COMPILE_FAILED/TIMEOUT)信封仍带 compile_id + log_url(补充 3)。
"""
jid = (payload.job_id or "").strip()
if not _CID_RE.fullmatch(jid):
return _p4_error(
"VALIDATION", "job_id 格式非法(应为 12 位 hex)")
try:
result = await lc.compile_project_job(jid)
except lc.InspectError as exc:
return _p4_error(exc.code, exc.message)
except lc.ToolUnavailableError as exc:
return _p4_error("TOOL_UNAVAILABLE", str(exc))
except lc.QueueFullError as exc:
# 队列满发生在 consume_inspect 之前 → job 未消费,前端可直接重试
return JSONResponse(
status_code=429,
content={
"ok": False,
"compile_id": None, "pdf_url": None, "log_url": None, "meta": None,
"error": {"code": "QUEUE_FULL", "message": str(exc),
"degraded": False},
},
)
except lc.CompileError as exc:
# 补充 3:失败也带 compile_id + log_url(cid 由 compile_project_job 附加)
cid = getattr(exc, "compile_id", None)
return _p4_error(
exc.code, str(exc), detail=exc.log_tail,
compile_id=cid,
log_url=_project_log_url(cid) if cid else None)
return CompileResponse(
ok=True,
compile_id=result["compile_id"],
pdf_url=_project_pdf_url(result["compile_id"]),
log_url=_project_log_url(result["compile_id"]),
meta=json.loads((lc.compile_job_dir(result["compile_id"]) / "meta.json")
.read_text("utf-8"))
if (lc.compile_job_dir(result["compile_id"]) / "meta.json").is_file()
else {"compile_id": result["compile_id"], "seconds": result["seconds"]},
)
def _cid_dir(cid: str) -> Path | None:
if not _CID_RE.fullmatch(cid or ""):
return None
d = lc.compile_dir(cid)
return d if d.is_dir() else None
def _zip_cid_dir(cid: str) -> Path | None:
"""P4 项目产物目录 data/compile_jobs/{cid}/(独立于 P3a reformat_dir 树)。"""
if not _CID_RE.fullmatch(cid or ""):
return None
d = lc.compile_job_dir(cid)
return d if d.is_dir() else None
@router.get("/compile/zip/{compile_id}", response_model=CompileResponse)
async def get_zip_compile(compile_id: str) -> CompileResponse:
cdir = _zip_cid_dir(compile_id)
meta_path = cdir / "meta.json" if cdir else None
if meta_path is None or not meta_path.is_file():
return _p4_error("NOT_FOUND", "编译任务不存在或已过期,请重新编译")
try:
meta = json.loads(meta_path.read_text("utf-8"))
except (OSError, ValueError):
return _p4_error("NOT_FOUND", "编译产物损坏,请重新编译")
return CompileResponse(
ok=True,
compile_id=compile_id,
pdf_url=_project_pdf_url(compile_id),
log_url=_project_log_url(compile_id),
meta=meta,
)
@router.get("/compile/zip/{compile_id}/pdf", response_model=None)
async def download_zip_pdf(compile_id: str) -> FileResponse | JSONResponse:
cdir = _zip_cid_dir(compile_id)
pdf = cdir / "output.pdf" if cdir else None
if pdf is None or not pdf.is_file():
return JSONResponse(
status_code=200,
content={"ok": False, "error": {
"code": "NOT_FOUND", "message": "PDF 不存在或已过期",
"degraded": False}},
)
return FileResponse(pdf, media_type="application/pdf",
filename=f"{compile_id}.pdf")
@router.get("/compile/zip/{compile_id}/log", response_model=None)
async def download_zip_log(compile_id: str) -> PlainTextResponse | JSONResponse:
"""补充 3:成功/失败都可下载 output.log。"""
cdir = _zip_cid_dir(compile_id)
log = cdir / "output.log" if cdir else None
if log is None or not log.is_file():
return JSONResponse(
status_code=200,
content={"ok": False, "error": {
"code": "NOT_FOUND", "message": "日志不存在或已过期",
"degraded": False}},
)
return PlainTextResponse(log.read_text("utf-8", errors="replace"))
@router.get("/compile/{compile_id}", response_model=CompileResponse)
async def get_compile(compile_id: str) -> CompileResponse:
cdir = _cid_dir(compile_id)
meta_path = cdir / "meta.json" if cdir else None
if meta_path is None or not meta_path.is_file():
return _error("NOT_FOUND", "编译任务不存在或已过期,请重新编译")
try:
meta = json.loads(meta_path.read_text("utf-8"))
except (OSError, ValueError):
return _error("NOT_FOUND", "编译产物损坏,请重新编译")
return CompileResponse(
ok=True,
compile_id=compile_id,
pdf_url=f"/api/review/compile/{compile_id}/pdf",
log_url=f"/api/review/compile/{compile_id}/log",
meta=meta,
)
@router.get("/compile/{compile_id}/pdf", response_model=None)
async def download_compile_pdf(compile_id: str) -> FileResponse | JSONResponse:
cdir = _cid_dir(compile_id)
pdf = cdir / "output.pdf" if cdir else None
if pdf is None or not pdf.is_file():
return JSONResponse(
status_code=200,
content={"ok": False, "error": {
"code": "NOT_FOUND", "message": "PDF 不存在或已过期", "degraded": False}},
)
return FileResponse(pdf, media_type="application/pdf", filename=f"{compile_id}.pdf")
@router.get("/compile/{compile_id}/log", response_model=None)
async def download_compile_log(compile_id: str) -> PlainTextResponse | JSONResponse:
cdir = _cid_dir(compile_id)
log = cdir / "output.log" if cdir else None
if log is None or not log.is_file():
return JSONResponse(
status_code=200,
content={"ok": False, "error": {
"code": "NOT_FOUND", "message": "日志不存在或已过期", "degraded": False}},
)
return PlainTextResponse(log.read_text("utf-8", errors="replace"))
+209
View File
@@ -0,0 +1,209 @@
"""routers/conferences.py —— 会议投稿时间线(只读静态种子)。
- GET /api/review/conferences?domain=&ccf=&upcoming_days=180
data/journals/conferences.json → 过滤/排序 → 列表 + meta。
- 数据诚实性铁律:每条会议必须带 deadline_source ∈ {placeholder, official}、
last_verified 与 deadline_confidence ∈ {high, medium, low},缺失/非法条目加载时
跳过并记日志(宁缺毋造);本端点无任何生成日期的逻辑,日期只来自种子常量。
v2 共 27/27 全 placeholder,meta.data_source_note 显式声明占位与置信度,
由前端渲染「⚠ 日期待核验」及置信度提示。
- 过滤语义:domain 对 domain_tags 精确匹配(大小写不敏感);ccf ∈ {A,B,C};
upcoming_days=0 不过滤,>0 仅保留 deadline_full_paper ∈ [UTC now, now+N 天],
缺失/不可解析截稿日期在过滤开启时排除。排序:deadline_full_paper 升序,
缺失/不可解析恒排最后。
- 只读无写接口;文件不可读 → ok=false + DATA_UNAVAILABLE 信封;参数非法 →
VALIDATION 信封(均 HTTP 200,对齐本服务"错误信封永远 200"约定)。
- 静态文件首次请求加载进内存(lru_cache),进程内 O(1);不触碰 SQLite/BFF。
"""
from __future__ import annotations
import json
import logging
from datetime import datetime, timedelta, timezone
from functools import lru_cache
from pathlib import Path
from typing import Any
from fastapi import APIRouter
from pydantic import BaseModel
logger = logging.getLogger(__name__)
router = APIRouter(prefix="/api/review", tags=["review-conferences"])
# review_service/app/routers/ → parents[2] = review_service(对齐 format_check 写法)
_CONFERENCES_PATH = (
Path(__file__).resolve().parents[2] / "data" / "journals" / "conferences.json"
)
_CCF_OK = frozenset({"A", "B", "C"})
_REQUIRED = ("id", "name", "deadline_source", "last_verified", "deadline_confidence")
_CONFIDENCE_OK = frozenset({"high", "medium", "low"})
_SOURCE_NOTE = (
"会议截稿/通知日期首版均为占位数据(deadline_source=placeholder),"
"接入官方渠道前须人工核验;deadline_confidence 标注日期置信度"
"(high=官方已公布/历年极稳定,medium=按历年规律推算,low=待核验);"
"所有时间按 AoE (UTC-12) 时区。"
)
# ---- 请求/响应模型 ----
class ConferenceItem(BaseModel):
"""会议公开字段(种子全字段白名单;未知键丢弃)。"""
id: str
name: str
full_name: str = ""
domain_tags: list[str] = []
application_tags: list[str] = []
ccf_rank: str | None = None
deadline_abstract: str | None = None
deadline_full_paper: str | None = None
notification_date: str | None = None
conference_date: str | None = None
location: str | None = None
official_url: str | None = None
timezone_note: str | None = None
deadline_source: str
last_verified: str
deadline_confidence: str = ""
class ConferencesResponse(BaseModel):
ok: bool
items: list[ConferenceItem] = []
meta: dict[str, Any] | None = None
error: dict[str, Any] | None = None
def _error(code: str, message: str) -> ConferencesResponse:
return ConferencesResponse(
ok=False, items=[], meta=None,
error={"code": code, "message": message, "degraded": False},
)
# ---- 种子加载(首次调用读盘,进程内缓存)----
@lru_cache(maxsize=1)
def _load_conferences() -> list[dict[str, Any]] | None:
"""读 conferences.json → 合法会议列表;文件不可读 → None(DATA_UNAVAILABLE)。"""
try:
payload = json.loads(_CONFERENCES_PATH.read_text("utf-8"))
except (OSError, ValueError) as exc:
logger.warning("conferences: 种子文件不可读 %s: %s", _CONFERENCES_PATH, exc)
return None
raw = payload.get("conferences") if isinstance(payload, dict) else None
if not isinstance(raw, list):
logger.warning("conferences: 种子缺少 conferences 数组:%s", _CONFERENCES_PATH)
return None
items: list[dict[str, Any]] = []
for conf in raw:
if not isinstance(conf, dict):
continue
missing = [k for k in _REQUIRED if not conf.get(k)]
if missing:
logger.warning("conferences: 条目缺字段 %s(id=%s),跳过", missing, conf.get("id"))
continue
if conf.get("deadline_source") not in ("placeholder", "official"):
logger.warning(
"conferences: deadline_source 非法(id=%s),跳过", conf.get("id")
)
continue
if str(conf.get("deadline_confidence") or "").strip().lower() not in _CONFIDENCE_OK:
logger.warning(
"conferences: deadline_confidence 非法(id=%s),跳过", conf.get("id")
)
continue
items.append(conf)
return items
def _parse_deadline(value: Any) -> datetime | None:
"""截稿时间 → aware datetime(naive 视为 UTC);非法 → None。"""
if not isinstance(value, str) or not value.strip():
return None
try:
dt = datetime.fromisoformat(value.strip())
except ValueError:
return None
return dt.replace(tzinfo=timezone.utc) if dt.tzinfo is None else dt
# ---- GET /api/review/conferences ----
@router.get("/conferences", response_model=ConferencesResponse)
async def conferences_list(
domain: str = "",
ccf: str = "",
upcoming_days: int = 180,
) -> ConferencesResponse:
"""只读:会议投稿时间线(无写/删/改接口)。
- ?domain= 对 domain_tags 精确匹配(大小写不敏感),空=不过滤;
- ?ccf= ccf_rank ∈ A/B/C,空=不过滤,非法值 → VALIDATION 信封;
- ?upcoming_days= int≥0,默认 180;0=不过滤,>0 仅保留截稿在
[UTC now, now+N 天] 内的会议,负数 → VALIDATION 信封;
- 排序按 deadline_full_paper 升序,缺失/不可解析恒排最后;
- 空结果 → items=[] + meta.count=0(HTTP 200,不报错)。
"""
ccf_norm = (ccf or "").strip().upper()
if ccf_norm and ccf_norm not in _CCF_OK:
return _error("VALIDATION", f"不支持的 ccf={ccf!r},可选:A / B / C")
if upcoming_days < 0:
return _error(
"VALIDATION", f"upcoming_days 必须 ≥ 0,收到 {upcoming_days}"
)
all_items = _load_conferences()
if all_items is None:
return _error("DATA_UNAVAILABLE", "会议种子数据不可读,请联系管理员")
items = list(all_items)
dom = (domain or "").strip().casefold()
if dom:
items = [
c for c in items
if any(
str(t).strip().casefold() == dom
for t in (c.get("domain_tags") or [])
)
]
if ccf_norm:
items = [
c for c in items
if str(c.get("ccf_rank") or "").strip().upper() == ccf_norm
]
if upcoming_days > 0:
now = datetime.now(timezone.utc)
limit = now + timedelta(days=upcoming_days)
items = [
c for c in items
if (dl := _parse_deadline(c.get("deadline_full_paper"))) is not None
and now <= dl <= limit
]
def _sort_key(c: dict[str, Any]) -> tuple[bool, datetime]:
dl = _parse_deadline(c.get("deadline_full_paper"))
if dl is None:
return (True, datetime.max.replace(tzinfo=timezone.utc))
return (False, dl)
items.sort(key=_sort_key)
out = [ConferenceItem(**c) for c in items]
verified = max(
(str(c.get("last_verified") or "") for c in all_items), default=""
)
meta: dict[str, Any] = {
"count": len(out),
"last_verified": verified or None,
"data_source_note": _SOURCE_NOTE,
"query": {
"domain": (domain or "").strip(),
"ccf": ccf_norm,
"upcoming_days": upcoming_days,
},
}
return ConferencesResponse(ok=True, items=out, meta=meta, error=None)
@@ -0,0 +1,81 @@
"""routers/format_check.py —— 版式与规范检查(POST /api/review/format-check)。
纯规则引擎(services/format_check.py):PDF/Word 本地解档取版式元数据 +
journals.json 规则集(format_rules_default + 每条 format_rules 带 rules_source)。
无 LLM / 无 vstore,同步执行通常 <1s;恒 200 + {ok, checks, summary, meta|error} 信封。
"""
from __future__ import annotations
import logging
from fastapi import APIRouter, File, Form, UploadFile
from pydantic import BaseModel
from ..config import get_settings
from ..services import format_check
logger = logging.getLogger(__name__)
router = APIRouter(prefix="/api/review", tags=["review-format"])
class CheckItem(BaseModel):
key: str
name: str
status: str # pass | warn | fail
detail: str
suggestion: str = ""
class FormatCheckResponse(BaseModel):
ok: bool
checks: list[CheckItem] | None = None
summary: dict[str, int] | None = None
meta: dict[str, object] | None = None
error: dict[str, object] | None = None
def _error(code: str, message: str, *, degraded: bool = False) -> FormatCheckResponse:
return FormatCheckResponse(
ok=False, error={"code": code, "message": message, "degraded": degraded},
)
@router.post("/format-check", response_model=FormatCheckResponse)
async def format_check_endpoint(
file: UploadFile = File(..., description="待检查的 PDF / Word(.docx) / LaTeX(.tex) 文档"),
target_journal: str = Form("", description="目标期刊(可选,传 journals 的 id)"),
) -> FormatCheckResponse:
settings = get_settings()
filename = file.filename or ""
low = filename.lower()
if low.endswith(".pdf"):
kind = "pdf"
elif low.endswith(".docx"):
kind = "docx"
elif low.endswith(".tex"):
kind = "tex"
else:
return _error("VALIDATION", "仅支持 PDF / Word(.docx)/ LaTeX(.tex)文件")
content = await file.read()
if not content:
return _error("VALIDATION", "上传文件为空")
if len(content) > settings.max_pdf_bytes:
return _error("VALIDATION", "上传文件超过 50MB 上限")
try:
result = format_check.check_document(content, kind, (target_journal or "").strip())
except format_check.FormatCheckError as exc:
logger.warning("format-check: 解档失败:%s", exc)
return _error("PARSE_FAILED", str(exc))
meta = dict(result.get("meta") or {})
meta["filename"] = filename
return FormatCheckResponse(
ok=True,
checks=[CheckItem(**c) for c in result["checks"]],
summary=result["summary"],
meta=meta,
)
@@ -0,0 +1,280 @@
"""routers/journal_directory.py —— 期刊目录浏览(1056 本,只读分页)。
- GET /api/review/journals/directory:journal_directory 表(scripts/import_journals.py
导入的 v4 目录:2025 中科院分区 + 2025 JIF(2026 年 JCR 发布)+ 年报 2025 版
(中文统计年 2024)+ 官网网址/核对状态)→ 过滤/排序/分页 → 列表 + meta。
- 与 GET /journals(journals.json 精选 5 本,供 FormatPanel 下拉/recommend 语义)物理
分离(方案 A);本端点绝不读写 journals 表,recommend/journal_kb/journal_rank 零触碰。
- 读路径只 SELECT;表由导入脚本拥有(db.py 零改动);表不存在 → data_imported=false
优雅降级(HTTP 200 空列表)。
读时归一化(拍板细节 1-3,均在 API 层做,不动脚本/DB 原值):
细节1 lang=zh → cas_partition 恒 null + cas_partition_note="不按中科院分区口径列示";
细节2 jif_note 源文本映射(v4 值域已是用户可读文本,旧值映射保留兜底);
细节3 缺值即矛盾清零:en 且 jif=null → jif_source_url=null。
(zh 的 IF 载体是 composite/comprehensive,其 jif_source_url 本恒 null。)
决策2:响应不下发"来源"文本字段(partition_source/jif_source/data_source_label
已移除);jif_source_url/data_source_url 保留供展开行链接。
决策4(来源展示优化):partition_source_url 不再下发——DB 原值分毫未动
(仍 SELECT * 读出后被模型丢弃),响应改为常量字段 partition_source_note
文案,前端以灰色说明文字替代原"分区来源"超链接。
新增 official_check_status / jcr_release_year。
"""
from __future__ import annotations
import json
import logging
import sqlite3
from typing import Any
from fastapi import APIRouter
from pydantic import BaseModel
from ..db import db
logger = logging.getLogger(__name__)
router = APIRouter(prefix="/api/review", tags=["review-directory"])
_LANGS = frozenset({"en", "zh"})
# 排序列白名单(列名不可参数化 → 白名单防注入)
_FIELDS = frozenset({
"name",
"jif",
"composite_impact_factor",
"comprehensive_impact_factor",
"research_direction",
"cas_partition",
})
_ORDERS = frozenset({"asc", "desc"})
_PARTS = {"1": "1区", "2": "2区", "3": "3区", "4": "4区"}
_MAX_SIZE = 200
# 细节2:源核对状态 → 用户可读 note
_JIF_NOTE_MAP = {
"源表标N/A": "未被2024 JCR收录",
"所用年度来源未检得": "本次汇编未查到,建议查阅最新 JCR",
}
_ZH_PART_NOTE = "不按中科院分区口径列示"
# 决策4:分区来源改为常量说明文案(不下发 partition_source_url;DB 原值不动)
_PARTITION_SOURCE_NOTE = (
"2025 中科院官方表(2026 年起停更;官方入口 fenqubiao.com 需机构登录)"
)
_NOTE_EN = (
"分区:2025年中科院公开表(多表比对,2026年起停止更新);"
"JIF:2025年度指标(2026年JCR发布,两份公开汇编一致或已核对出版社官方指标);"
"整理日期2026-10-10。空白=来源未给值≠0;研究方向/期刊标记/文章类型为导航标签,非官方评级。"
)
_NOTE_ZH = (
"指标:国内自然科学期刊年报2025版(统计年2024,official,含复合/综合IF两口径);"
"中文期刊不按中科院分区口径列示;国内IF与JIF统计源不同,不可混排。"
)
_UNIMPORTED_NOTE = "目录数据未导入(请先运行 scripts/import_journals.py)"
# ---- 响应模型 ----
class DirectoryItem(BaseModel):
"""目录公开字段(DB 全列白名单;imported_at 等内部列丢弃)。"""
id: str
lang: str
name: str
research_direction: str | None = None
cas_partition: str | None = None
cas_partition_note: str | None = None
cas_partition_year: int | None = None
jif: float | None = None
jif_year: int | None = None
jif_note: str | None = None
jif_check_status: str | None = None
composite_impact_factor: float | None = None
comprehensive_impact_factor: float | None = None
metric_year: int | None = None
metric_report_year: int | None = None
metric_caliber: str | None = None
annual_report_page: int | None = None
top_flag: str | None = None
publisher_series: str | None = None
journal_mark: str | None = None
article_type: str | None = None
issn: str | None = None
eissn: str | None = None
jcr_disciplines: list[str] = []
supplement_note: str | None = None
evidence_note: str | None = None
official_url: str | None = None
official_check_status: str | None = None
jcr_release_year: int | None = None
jif_source_url: str | None = None
partition_source_note: str = _PARTITION_SOURCE_NOTE # 决策4:常量,替代分区来源链接
data_source_url: str | None = None
class DirectoryResponse(BaseModel):
ok: bool
items: list[DirectoryItem] = []
meta: dict[str, Any] | None = None
error: dict[str, Any] | None = None
def _error(code: str, message: str) -> DirectoryResponse:
return DirectoryResponse(
ok=False, items=[], meta=None,
error={"code": code, "message": message, "degraded": False},
)
# ---- 读时归一化(拍板细节 1-3)----
def _present(raw: dict[str, Any], lang: str) -> dict[str, Any]:
d = dict(raw)
# jcr_disciplines:JSON 数组字符串 → list
jcr = d.get("jcr_disciplines")
if jcr:
try:
parsed = json.loads(jcr)
d["jcr_disciplines"] = parsed if isinstance(parsed, list) else []
except (TypeError, ValueError):
d["jcr_disciplines"] = []
else:
d["jcr_disciplines"] = []
# 细节2:jif_note 源文本 → 用户可读
note = d.get("jif_note")
if note in _JIF_NOTE_MAP:
d["jif_note"] = _JIF_NOTE_MAP[note]
# 细节1:zh 分区归一(DB 原值"不按此口径列示"只留在库里)
if lang == "zh":
d["cas_partition"] = None
d["cas_partition_note"] = _ZH_PART_NOTE
# 细节3:缺值 → 来源链接清零(消除 null 值却挂来源链接的矛盾;
# 分区来源链接已按决策4 移出响应,改为常量 partition_source_note)
if lang == "en":
if d.get("jif") is None:
d["jif_source_url"] = None
return d
def _escape_like(s: str) -> str:
return s.replace("\\", "\\\\").replace("%", "\\%").replace("_", "\\_")
# ---- GET /api/review/journals/directory ----
@router.get("/journals/directory", response_model=DirectoryResponse)
async def journals_directory(
lang: str = "en",
domain: str = "",
cas_partition: str = "",
q: str = "",
page: int = 1,
size: int = 50,
field: str = "",
order: str = "",
) -> DirectoryResponse:
"""只读:期刊目录分页浏览(无写接口)。
- ?lang=en|zh(默认 en;**强制单语,保证国际/中文永不混排**);
- ?domain= 研究方向精确匹配;?cas_partition=1|2|3|4(仅 lang=en,zh 忽略);
- ?q= 期刊名模糊(ASCII 大小写不敏感);?page≥1 ?size 1-200(默认 50);
- ?field= 排序白名单(name/jif/composite_impact_factor/
comprehensive_impact_factor/research_direction/cas_partition),?order=asc|desc;
未传 field → 默认排序 en=jif 降序 / zh=复合IF 降序(NULL 恒排最后);
- 参数非法 → VALIDATION 信封;表不存在 → data_imported=false 空列表(HTTP 200)。
"""
lang_n = (lang or "").strip().lower()
if lang_n not in _LANGS:
return _error("VALIDATION", f"不支持的 lang={lang!r},可选:en / zh")
if page < 1:
return _error("VALIDATION", f"page 必须 ≥ 1,收到 {page}")
if size < 1 or size > _MAX_SIZE:
return _error("VALIDATION", f"size 必须在 1-{_MAX_SIZE},收到 {size}")
field_n = (field or "").strip()
if field_n and field_n not in _FIELDS:
return _error(
"VALIDATION",
f"不支持的 field={field!r},可选:{', '.join(sorted(_FIELDS))}",
)
order_n = (order or "").strip().lower()
if order_n and order_n not in _ORDERS:
return _error("VALIDATION", f"不支持的 order={order!r},可选:asc / desc")
part_q = (cas_partition or "").strip()
if part_q:
part_q = _PARTS.get(part_q, _PARTS.get(part_q.rstrip("区").strip(), ""))
if not part_q:
return _error(
"VALIDATION",
f"不支持的 cas_partition={cas_partition!r},可选:1 / 2 / 3 / 4",
)
# 过滤条件(白名单拼接;参数全部占位符)
where = ["lang = ?"]
params: list[Any] = [lang_n]
domain_n = (domain or "").strip()
if domain_n:
where.append("research_direction = ?")
params.append(domain_n)
if part_q and lang_n == "en": # zh 不分区:忽略(meta 回显)
where.append("cas_partition = ?")
params.append(part_q)
q_n = (q or "").strip()
if q_n:
where.append("name LIKE ? ESCAPE '\\'")
params.append(f"%{_escape_like(q_n)}%")
where_sql = " AND ".join(where)
# 排序(列名出自白名单;NULL 恒排最后)
if field_n:
dir_sql = "DESC" if order_n == "desc" else "ASC"
order_sql = f"{field_n} IS NULL, {field_n} {dir_sql}"
else:
col = "jif" if lang_n == "en" else "composite_impact_factor"
order_sql = f"{col} IS NULL, {col} DESC"
try:
total_row = await db.fetchone(
f"SELECT COUNT(*) AS c FROM journal_directory WHERE {where_sql}", params # noqa: S608
)
total = int(total_row["c"]) if total_row else 0
rows = await db.fetchall(
f"SELECT * FROM journal_directory WHERE {where_sql} " # noqa: S608
f"ORDER BY {order_sql} LIMIT ? OFFSET ?",
[*params, size, (page - 1) * size],
)
dom_rows = await db.fetchall(
"SELECT research_direction AS d, COUNT(*) AS c FROM journal_directory "
"WHERE lang = ? AND research_direction IS NOT NULL "
"GROUP BY 1 ORDER BY c DESC, d ASC",
[lang_n],
)
except sqlite3.OperationalError as exc:
# 表不存在(脚本未跑)→ 优雅降级,HTTP 200
logger.warning("journal_directory: 表不可用(目录未导入?): %s", exc)
return DirectoryResponse(
ok=True, items=[],
meta={
"total": 0, "page": page, "size": size, "lang": lang_n,
"domain": domain_n, "cas_partition": part_q, "q": q_n,
"domains": [], "data_source_note": _UNIMPORTED_NOTE,
"data_imported": False,
},
error=None,
)
items = [DirectoryItem(**_present(dict(r), lang_n)) for r in rows]
meta: dict[str, Any] = {
"total": total,
"page": page,
"size": size,
"lang": lang_n,
"domain": domain_n,
"cas_partition": part_q if lang_n == "en" else "",
"q": q_n,
"domains": [r["d"] for r in dom_rows if r["d"]],
"data_source_note": _NOTE_EN if lang_n == "en" else _NOTE_ZH,
"data_imported": True,
}
return DirectoryResponse(ok=True, items=items, meta=meta, error=None)
+354
View File
@@ -0,0 +1,354 @@
"""routers/journals.py —— 期刊情报与智能投稿推荐。
- GET /api/review/journals 只读:journals 表全量列表(?field=/&order= 排序),
meta 含 count / last_updated / data_source_note。无任何写接口;空表返回
空数组 + meta.count=0(HTTP 200,绝不 500)。
- POST /api/review/recommend 智能投稿推荐:vstore 向量匹配(摘要 vs
scope_desc,白名单检索)→ LLM 按 id 白名单重排(幻觉期刊丢弃、缺漏规则
补位)→ 三档输出:挑战型 / 适配型 / 稳妥型,附匹配理由与风险提示。
降级哲学(同 presubmit):向量失败 → 全量候选 + vector_ok=false;
LLM 失败 → 规则分档 + llm_ok=false;推荐永不 5xx。仅入参非法返回
VALIDATION 错误信封(HTTP 200,与本服务其余端点一致)。
"""
from __future__ import annotations
import json
import logging
from functools import lru_cache
from pathlib import Path
from typing import Any, Literal
from fastapi import APIRouter
from pydantic import BaseModel, Field
from ..config import get_settings
from ..db import SeedError, ensure_journals_seeded, list_journals
from ..services import journal_kb, journal_rank, llm
logger = logging.getLogger(__name__)
router = APIRouter(prefix="/api/review", tags=["review-journals"])
# ---- 请求/响应模型 ----
class Preferences(BaseModel):
max_review_weeks: float | None = Field(default=None, ge=1, le=104)
min_impact_factor: float | None = Field(default=None, ge=0, le=200)
tier_focus: Literal["all", "challenge", "fit", "safe"] = "all"
class RecommendRequest(BaseModel):
abstract: str
preferences: Preferences = Preferences()
class JournalItem(BaseModel):
id: str
name: str
impact_factor: float | None = None
review_time_weeks: float | None = None
acceptance_rate: float | None = None
official_url: str | None = None
similarity: float | None = None
tier: str
match_reason: str
risk_note: str
class TierBox(BaseModel):
label: str
items: list[JournalItem]
class RecommendResponse(BaseModel):
ok: bool
tiers: dict[str, TierBox] | None = None
meta: dict[str, Any] | None = None
error: dict[str, Any] | None = None
# ---- GET /api/review/journals(只读列表)----
class JournalBrief(BaseModel):
"""期刊公开字段(journals 表全列;不含 vstore_doc_id 内部映射)。
标签/分区 6 字段不进 SQLite:GET 时按 id 从 journals.json 内存缓存合并;
JSON 缺该 id → 空数组/null 默认值。
"""
id: str
name: str
scope_desc: str = ""
impact_factor: float | None = None
review_time_weeks: float | None = None
acceptance_rate: float | None = None
submission_deadline: str | None = None
official_url: str | None = None
last_updated: str = ""
scope_tags: list[str] = []
application_tags: list[str] = []
cas_partition: str | None = None
jcr_quartile: str | None = None
partition_source: str | None = None
cross_domain: list[str] = []
class JournalsListResponse(BaseModel):
ok: bool
items: list[JournalBrief] = []
meta: dict[str, Any] | None = None
error: dict[str, Any] | None = None
# ?field= 排序白名单(列名无法参数化,白名单防注入;非法值 → VALIDATION 信封)
_SORT_FIELDS = frozenset({
"id",
"name",
"impact_factor",
"review_time_weeks",
"acceptance_rate",
"last_updated",
})
_DATA_SOURCE_NOTE = (
"IF/审稿周期为公开近似值,acceptance_rate 为 null 表示暂无公开数据,需人工核验。"
"CAS/JCR 分区为首版占位数据,需核验。"
)
# journals.json 新增字段(标签/分区;刻意不进 SQLite,见 C-2 方案)
_TAG_FIELDS = (
"scope_tags",
"application_tags",
"cas_partition",
"jcr_quartile",
"partition_source",
"cross_domain",
)
@lru_cache(maxsize=1)
def _load_tag_extras() -> dict[str, dict[str, Any]]:
"""journals.json 标签/分区字段 → {id: {6 新字段}}。
首次请求读盘后进程内缓存,后续 GET O(1) 按 id 合并(不做每请求磁盘 IO)。
JSON 缺该 id → 合并时用空数组/null 默认;文件不可读 → 空 dict 降级(不 500)。
"""
seed = get_settings().journals_seed_abs
try:
payload = json.loads(Path(seed).read_text("utf-8"))
except (OSError, ValueError) as exc:
logger.warning("journals: 标签扩展文件不可读,合并降级为默认值:%s", exc)
return {}
raw = payload.get("journals") if isinstance(payload, dict) else None
if not isinstance(raw, list):
return {}
out: dict[str, dict[str, Any]] = {}
for j in raw:
if isinstance(j, dict) and j.get("id"):
out[str(j["id"])] = {k: j.get(k) for k in _TAG_FIELDS}
return out
def _tag_fields(extra: dict[str, Any] | None) -> dict[str, Any]:
"""缓存条目 → JournalBrief 关键字参数(JSON 缺该 id → 空数组/null 默认)。"""
ex = extra or {}
return {
"scope_tags": list(ex.get("scope_tags") or []),
"application_tags": list(ex.get("application_tags") or []),
"cas_partition": ex.get("cas_partition"),
"jcr_quartile": ex.get("jcr_quartile"),
"partition_source": ex.get("partition_source"),
"cross_domain": list(ex.get("cross_domain") or []),
}
def _sort_rows(rows: list[dict[str, Any]], field: str, order: str) -> list[dict[str, Any]]:
"""按白名单字段排序;NULL 恒排最后;次序不稳定时按 db 默认序(稳定排序保留)。"""
present = [r for r in rows if r.get(field) is not None]
missing = [r for r in rows if r.get(field) is None]
present.sort(key=lambda r: r.get(field), reverse=(order == "desc"))
return present + missing
def _list_error(message: str) -> JournalsListResponse:
return JournalsListResponse(
ok=False, items=[], meta=None,
error={"code": "VALIDATION", "message": message, "degraded": False},
)
@router.get("/journals", response_model=JournalsListResponse)
async def journals_list(
field: str = "name",
order: str = "asc",
) -> JournalsListResponse:
"""只读:journals 表全量列表(无写/删/改接口)。
- ?field= 排序字段白名单:id/name/impact_factor/review_time_weeks/
acceptance_rate/last_updated,默认 name;
- ?order=asc|desc,默认 asc;
- 空表 → items=[] + meta.count=0(HTTP 200,不报错)。种子装载由
POST /recommend 首次调用幂等完成,本端点严格只读。
"""
col = (field or "").strip()
if col not in _SORT_FIELDS:
return _list_error(
f"不支持的排序字段 field={field!r},可选:{', '.join(sorted(_SORT_FIELDS))}"
)
ord_norm = (order or "asc").strip().lower()
if ord_norm not in ("asc", "desc"):
return _list_error(f"不支持的排序方向 order={order!r},可选:asc, desc")
rows = await list_journals()
rows = _sort_rows(rows, col, ord_norm)
tag_extras = _load_tag_extras()
items = [
JournalBrief(
id=str(r.get("id") or ""),
name=str(r.get("name") or ""),
scope_desc=str(r.get("scope_desc") or ""),
impact_factor=r.get("impact_factor"),
review_time_weeks=r.get("review_time_weeks"),
acceptance_rate=r.get("acceptance_rate"),
submission_deadline=r.get("submission_deadline"),
official_url=r.get("official_url"),
last_updated=str(r.get("last_updated") or ""),
**_tag_fields(tag_extras.get(str(r.get("id") or ""))),
)
for r in rows
]
latest = max((str(r.get("last_updated") or "") for r in rows), default="")
meta: dict[str, Any] = {
"count": len(items),
"last_updated": latest or None,
"data_source_note": _DATA_SOURCE_NOTE,
}
return JournalsListResponse(ok=True, items=items, meta=meta, error=None)
def _error(code: str, message: str, *, degraded: bool = False) -> RecommendResponse:
return RecommendResponse(
ok=False, tiers=None, meta=None,
error={"code": code, "message": message, "degraded": degraded},
)
def _item_sort_key(it: JournalItem) -> tuple[int, float, float]:
return (
1 if it.similarity is None else 0,
-(it.similarity or 0.0),
-(it.impact_factor or 0.0),
)
def _apply_soft_preferences(item: JournalItem, prefs: Preferences) -> None:
"""软偏好:不满足只加风险提示,不删条目。"""
weeks = item.review_time_weeks
if prefs.max_review_weeks is not None and weeks is not None and weeks > prefs.max_review_weeks:
prefix = f"⚠ 审稿约 {weeks:g} 周,超出你 {prefs.max_review_weeks:g} 周的周期偏好;"
item.risk_note = prefix + ("无" if item.risk_note == "无" else item.risk_note)
inf = item.impact_factor
if prefs.min_impact_factor is not None:
if inf is None:
item.risk_note = "⚠ 影响因子未收录,无法确认满足你的要求;" + item.risk_note
elif inf < prefs.min_impact_factor:
prefix = f"⚠ 影响因子 {inf:g} 低于你 {prefs.min_impact_factor:g} 的要求;"
item.risk_note = prefix + ("无" if item.risk_note == "无" else item.risk_note)
@router.post("/recommend", response_model=RecommendResponse)
async def recommend(req: RecommendRequest) -> RecommendResponse:
settings = get_settings()
# ---- 入参校验(手动,错误信封与本服务其余端点一致)----
abstract = (req.abstract or "").strip()
if len(abstract) < 50:
return _error("VALIDATION", "abstract 至少需要 50 个字符(请提供摘要或正文片段)")
if len(abstract) > 20000:
return _error("VALIDATION", "abstract 超过 20000 字符上限")
prefs = req.preferences
# ---- 种子 + 期刊元数据 ----
try:
await ensure_journals_seeded()
journals = await list_journals()
except SeedError as exc:
logger.error("recommend: 种子装载失败:%s", exc)
return _error("SEED_UNAVAILABLE", str(exc), degraded=True)
if not journals:
return _error("SEED_UNAVAILABLE", "期刊库为空", degraded=True)
# ---- ① vstore 向量匹配(摘要 vs scope_desc)----
try:
candidates, vector_ok = await journal_kb.match(abstract, journals)
except journal_kb.MatchError as exc:
logger.warning("recommend: 向量匹配降级:%s", exc)
candidates, vector_ok = [], False
if not candidates:
# 无有效语义分 → 全量候选(similarity=None),LLM 仍可按 scope 文本重排
candidates = [{"journal": j, "similarity": None} for j in journals]
vector_ok = False
# ---- ② LLM 重排(id 白名单硬校验)----
prefs_dict = prefs.model_dump(exclude_none=True)
llm_ok = True
dropped = 0
repaired = 0
try:
rankings, dropped, repaired = await journal_rank.rerank(abstract, candidates, prefs_dict)
except (llm.LLMError, journal_rank.RankError, ValueError) as exc:
# ValueError:complete_json 最终 json.loads 修复仍失败(同 presubmit 宽容口径)
logger.warning("recommend: LLM 重排降级为规则分档:%s", exc)
rankings = journal_rank.fallback_rankings(candidates)
llm_ok = False
# ---- ③ 三档组装(名称/指标全部来自 DB,不采信 LLM 文本)----
by_id = {str(c["journal"]["id"]): c for c in candidates}
tiers: dict[str, list[JournalItem]] = {t: [] for t in journal_rank.TIERS}
for r in rankings:
cand = by_id.get(r.journal_id)
if cand is None:
continue
j = cand["journal"]
sim = cand.get("similarity")
item = JournalItem(
id=str(j["id"]),
name=str(j.get("name") or j["id"]),
impact_factor=j.get("impact_factor"),
review_time_weeks=j.get("review_time_weeks"),
acceptance_rate=j.get("acceptance_rate"),
official_url=j.get("official_url"),
similarity=round(float(sim), 4) if sim is not None else None,
tier=r.tier,
match_reason=r.match_reason,
risk_note=r.risk_note,
)
_apply_soft_preferences(item, prefs)
tiers.setdefault(r.tier, []).append(item)
# 档内排序:相似度(None 靠后)→ 影响因子
for box in tiers.values():
box.sort(key=_item_sort_key)
# tier_focus:软展示聚焦(默认 all;聚焦时其余档 items 置空,label 保留)
out_tiers: dict[str, TierBox] = {}
for t in journal_rank.TIERS:
items = tiers.get(t, [])
if prefs.tier_focus != "all" and t != prefs.tier_focus:
items = []
out_tiers[t] = TierBox(label=journal_rank.TIER_LABELS[t], items=items)
meta: dict[str, Any] = {
"model": llm._llm_config()["model"],
"vector_ok": vector_ok,
"llm_ok": llm_ok,
"seed_count": len(journals),
"candidate_count": len(candidates),
"dropped_hallucinated": dropped,
"repaired": repaired,
"preferences": prefs_dict,
"abstract_chars": len(abstract),
}
return RecommendResponse(ok=True, tiers=out_tiers, meta=meta, error=None)
+269
View File
@@ -0,0 +1,269 @@
"""routers/presubmit.py —— 投稿前自审稿(POST /api/review/presubmit)。
流程:上传 PDF → paper_parse(vstore 8094 解析)→ 段落感知装箱 + token 双层保护
→ LLM 结构化审稿(DeepSeek json_object,System Prompt 为植物基因组学六维专属
清单,见 services/self_review.py)→ coerce 归一化 → 关键词扫描器证伪硬性缺项
(services/paper_scanner.py)→ 规则引擎计算 recommendation。
"""
from __future__ import annotations
import logging
import re
from fastapi import APIRouter, File, Form, UploadFile
from pydantic import BaseModel
from ..config import get_settings
from ..services import llm, paper_parse, paper_scanner, self_review
from ..services.recommend_engine import decide_recommendation, resolve_tier
logger = logging.getLogger(__name__)
router = APIRouter(prefix="/api/review", tags=["review-presubmit"])
# ---- token 双层保护(2026-10-12)----
# 第一层:估算 token 超阈值 → 自动降到 TOKEN_GUARD_REPACK_CHARS 字符重装箱
# 第二层:LLM 返回 HTTP 400/413 → 降到 LLM_REJECT_RETRY_CHARS 字符重试一次
_EST_TOKENS_DIVISOR = 1.5 # 粗略上界:英文 ~4 字符/token,1.5 偏保守
_TOKEN_GUARD_THRESHOLD = 48000
_TOKEN_GUARD_REPACK_CHARS = 100000
_LLM_REJECT_RETRY_CHARS = 80000
# 无节标题可辨时的尾窗(捞页尾 Data Availability 块)
_TAIL_FALLBACK_CHARS = 5000
# 节标题(行首、允许编号前缀、独占一行);键 → 装箱分组名
_SECTION_HEADER_RE = re.compile(
r"^[ \t]*(?:\d+(?:\.\d+)*\.?\s+)?"
r"(Abstract|Summary|Introduction|Results|Discussion|Methods"
r"|Materials\s+and\s+Methods"
r"|Data\s+(?:and\s+(?:code\s+)?)?[Aa]vailability"
r"|Availability\s+of\s+[Dd]ata"
r"|Data\s+and\s+[Mm]aterials\s+[Aa]vailability"
r"|References|Acknowledg(?:e)?ments?)\s*$",
re.IGNORECASE | re.MULTILINE,
)
_SECTION_GROUP = {
"abstract": "abstract", "summary": "abstract",
"introduction": "introduction",
"results": "results",
"discussion": "discussion",
"methods": "methods", "materials and methods": "methods",
"data availability": "data_availability",
"data and code availability": "data_availability",
"data availability statement": "data_availability",
"availability of data": "data_availability",
"data and materials availability": "data_availability",
"references": "references", "acknowledgements": "acknowledgements",
"acknowledgments": "acknowledgements",
}
# 装箱优先级(首条命中优先;methods 限 60% 预算——六维清单大量依赖 Methods)
_PACK_PRIORITY = ("abstract", "data_availability", "methods", "results", "discussion")
_METHODS_CAP_RATIO = 0.6
def estimate_tokens(text: str) -> int:
"""粗略 token 上界估计(len/1.5),无需 tokenizer 依赖。"""
return int(len(text) / _EST_TOKENS_DIVISOR)
def _split_segments(text: str) -> list[tuple[str, str]] | None:
"""按节标题切段 → [(group, content)...]。无可辨标题 → None。"""
matches = list(_SECTION_HEADER_RE.finditer(text))
if not matches:
return None
segments: list[tuple[str, str]] = []
if matches[0].start() > 0:
segments.append(("preamble", text[:matches[0].start()]))
for i, m in enumerate(matches):
end = matches[i + 1].start() if i + 1 < len(matches) else len(text)
group = _SECTION_GROUP.get(m.group(1).casefold(), m.group(1).casefold())
segments.append((group, text[m.start():end]))
return segments
def pack_feed_text(text: str, budget: int) -> tuple[str, list[str]]:
"""段落感知装箱 → (feed_text, dropped_sections)。
预算内:原文返回。超预算:按优先级保留
① Abstract ② Data Availability 全文 ③ Methods 前 60% ④ Results
⑤ Discussion,其余按原序填满;未收段记入 dropped。
无节标题可辨 → 头 + 尾窗拼接(捞页尾 availability 块),不优于现状亦不劣于。
"""
if len(text) <= budget:
return text, []
segments = _split_segments(text)
if not segments:
sep = "\n[...]\n"
head = max(0, budget - _TAIL_FALLBACK_CHARS - len(sep))
return (
text[:head] + sep + text[-_TAIL_FALLBACK_CHARS:],
["[无节标题回退:保留头+尾窗]"],
)
methods_cap = int(budget * _METHODS_CAP_RATIO)
chosen: dict[int, str] = {}
used = 0
for group in _PACK_PRIORITY:
for i, (g, content) in enumerate(segments):
if g != group or i in chosen:
continue
room = budget - used
if room <= 0:
break
piece = content[:methods_cap] if group == "methods" else content
if len(piece) > room:
piece = piece[:room]
if not piece:
break
chosen[i] = piece
used += len(piece)
break
for i, (_, content) in enumerate(segments):
if i in chosen or used >= budget:
continue
room = budget - used
chosen[i] = content if len(content) <= room else content[:room]
used += len(chosen[i])
feed = "".join(chosen[i] for i in sorted(chosen))
dropped: list[str] = []
for i, (g, _) in enumerate(segments):
if i not in chosen and g not in dropped:
dropped.append(g)
return feed, dropped
def _fit_feed_text(text: str, budget: int) -> tuple[str, list[str]]:
"""装箱 + 第一层 token 保护(估算超阈值自动降到 100K 字符重装)。"""
feed, dropped = pack_feed_text(text, budget)
if estimate_tokens(feed) > _TOKEN_GUARD_THRESHOLD and len(feed) > _TOKEN_GUARD_REPACK_CHARS:
logger.info(
"presubmit: token 估算 %d > %d,降到 %d 字符重装箱",
estimate_tokens(feed), _TOKEN_GUARD_THRESHOLD, _TOKEN_GUARD_REPACK_CHARS,
)
feed, dropped = pack_feed_text(text, _TOKEN_GUARD_REPACK_CHARS)
return feed, dropped
class PresubmitResponse(BaseModel):
ok: bool
report: self_review.SelfReviewReport | None = None
error: dict[str, object] | None = None
meta: dict[str, object] | None = None
def _error(code: str, message: str, *, degraded: bool = False) -> PresubmitResponse:
return PresubmitResponse(
ok=False, report=None,
error={"code": code, "message": message, "degraded": degraded},
)
@router.post("/presubmit", response_model=PresubmitResponse)
async def presubmit_review(
file: UploadFile = File(..., description="待审稿 PDF"),
target_journal: str = Form("", description="目标期刊(可选,影响格式类意见)"),
) -> PresubmitResponse:
settings = get_settings()
filename = file.filename or "paper.pdf"
if not filename.lower().endswith(".pdf"):
return _error("VALIDATION", "仅支持 PDF 文件")
content = await file.read()
if not content:
return _error("VALIDATION", "上传文件为空")
if len(content) > settings.max_pdf_bytes:
return _error("VALIDATION", "PDF 超过 50MB 上限")
# ---- 解析(vstore 8094)----
try:
text = await paper_parse.parse_pdf_bytes(content, filename=filename)
except paper_parse.ParseError as exc:
logger.warning("presubmit: 解析失败:%s", exc)
return _error("PARSE_FAILED", str(exc), degraded=True)
truncated = len(text) > settings.max_text_chars
feed_text, dropped_sections = _fit_feed_text(text, settings.max_text_chars)
# ---- LLM 结构化自审(植物基因组学六维清单)----
# 第二层保护:HTTP 400/413(疑似超长/形态拒绝)→ 降 80K 字符重试一次
user_prompt = self_review.build_user_prompt(feed_text, (target_journal or "").strip())
try:
try:
payload = await llm.complete_json(
self_review.SYSTEM_PROMPT,
user_prompt,
temperature=0.2,
max_tokens=8000,
timeout=settings.presubmit_read_timeout,
)
except llm.LLMError as exc:
msg = str(exc)
if ("HTTP 400" in msg or "HTTP 413" in msg) and len(feed_text) > _LLM_REJECT_RETRY_CHARS:
logger.warning("presubmit: LLM 拒绝输入(%s),降到 %d 字符重试",
msg[:120], _LLM_REJECT_RETRY_CHARS)
feed_text, dropped_sections = pack_feed_text(text, _LLM_REJECT_RETRY_CHARS)
truncated = True
payload = await llm.complete_json(
self_review.SYSTEM_PROMPT,
self_review.build_user_prompt(feed_text, (target_journal or "").strip()),
temperature=0.2,
max_tokens=8000,
timeout=settings.presubmit_read_timeout,
)
else:
raise
except llm.LLMError as exc:
logger.error("presubmit: LLM 审稿失败:%s", exc)
return _error("UPSTREAM_DOWN", f"审稿模型调用失败:{exc}", degraded=True)
report = self_review.coerce_report(payload)
# ---- 关键词扫描器:证伪 LLM 的硬性缺项(有 X 却报缺 X → 真降级至 minor)----
# A2(2026-10-12):被冲突的 major 不再留在 major 列表里只剥标签,而是移出
# major、append 到 minor(scanner_downgraded=True)——major_count/引擎输入真实
# 减少;fatal 条目例外(只记冲突不降级,须人工过目)。
signals = paper_scanner.scan_paper_signals(feed_text)
kept_majors, demoted_minors, scanner_conflicts = paper_scanner.reconcile_hard_rules(
report.major_weaknesses, signals
)
report.major_weaknesses = kept_majors
if demoted_minors:
report.minor_weaknesses = list(report.minor_weaknesses) + list(demoted_minors)
# recommendation 由规则引擎计算(LLM 输出的同名字段已被 coerce 忽略)
tier, tier_source = resolve_tier((target_journal or "").strip())
decision = decide_recommendation(
majors=report.major_weaknesses,
minors=report.minor_weaknesses,
presentations=report.presentation_format,
tier=tier,
)
rationale = decision["rationale"]
rationale["scanner_conflicts"] = scanner_conflicts
if scanner_conflicts:
rationale["explanation"] += (
f" 关键词扫描器与审稿意见存在 {len(scanner_conflicts)} 处冲突,"
f"已降级为小修级问题,请人工核对。"
)
report.recommendation = decision["recommendation"]
report.recommendation_rationale = rationale
return PresubmitResponse(
ok=True,
report=report,
meta={
"filename": filename,
"target_journal": (target_journal or "").strip(),
"text_chars": len(feed_text),
"truncated": truncated,
"dropped_sections": dropped_sections,
"scanner": {
"accession_found": bool((signals.get("accession") or {}).get("found")),
"busco_level": (signals.get("busco") or {}).get("level"),
"hic_found": bool((signals.get("hic") or {}).get("found")),
},
"model": llm._llm_config()["model"],
"tier": tier,
"tier_label": decision["rationale"]["tier_label"],
"tier_source": tier_source,
},
)
+288
View File
@@ -0,0 +1,288 @@
"""routers/rebuttal.py —— Rebuttal Phase 1(审稿回复助手,10 端点)。
信封与其余 review 端点一致:业务错误 = HTTP 200 + {ok:false,error:{code,message,degraded}}。
- 文本粘贴主入口 / PDF 次要入口(PDF 经 vstore 8094 解析);
- 逐条 response → draft(校验C前置)→ confirm(后端重算 human_ack)→ letter 拼装;
- letter.md 下载门槛 = human_ack;DELETE 手动清(无 TTL,决策 5)。
"""
from __future__ import annotations
import logging
from typing import Any, Literal
from fastapi import APIRouter, File, UploadFile
from fastapi.responses import PlainTextResponse
from pydantic import BaseModel, Field
from ..config import get_settings
from ..services import llm, paper_parse
from ..services.rebuttal_draft import PART_TYPES, assemble_letter, generate_draft, validate_parts
from ..services.rebuttal_parse import parse_review_text
from ..services import rebuttal_store
logger = logging.getLogger(__name__)
router = APIRouter(prefix="/api/review/rebuttal", tags=["review-rebuttal"])
_MAX_RAW_CHARS = 200_000 # 粘贴文本上限(审稿意见通常 <20K,保守给大)
# ---------- 信封 ----------
class RebuttalResponse(BaseModel):
ok: bool
job: dict[str, Any] | None = None
error: dict[str, Any] | None = None
meta: dict[str, Any] | None = None
def _error(code: str, message: str) -> RebuttalResponse:
return RebuttalResponse(ok=False, error={"code": code, "message": message, "degraded": False})
def _ok(job: dict[str, Any], **meta: Any) -> RebuttalResponse:
return RebuttalResponse(ok=True, job=job, meta=meta or None)
# ---------- 请求体 ----------
class JobCreateBody(BaseModel):
text: str = Field(min_length=1)
class PartBody(BaseModel):
type: Literal["new_data", "reanalysis", "location", "clarification", "rebuttal"]
content: str = ""
location_hint: str | None = None
class ResponseBody(BaseModel):
parts: list[PartBody] = Field(default_factory=list)
class StructureBody(BaseModel):
action: Literal["merge", "split"]
# merge: comment_ids(含当前 cid,≥2 条);split: items [{title, body}]
comment_ids: list[str] | None = None
items: list[dict[str, str]] | None = None
class ConfirmBody(BaseModel):
confirmed: bool
# ---------- 内部工具 ----------
async def _messages_llm(messages: list[dict[str, str]], *, temperature: float = 0.3) -> dict[str, Any]:
"""适配 rebuttal_parse/draft 的 messages 形态 → llm.complete_json。"""
system = next((m["content"] for m in messages if m.get("role") == "system"), "")
user = next((m["content"] for m in messages if m.get("role") == "user"), "")
return await llm.complete_json(system, user, temperature=temperature)
def _find_comment(job: dict[str, Any], cid: str) -> tuple[dict, dict] | None:
for r in job["reviewers"]:
for c in r["comments"]:
if c["id"] == cid:
return r, c
return None
async def _build_job(raw_text: str, *, kind: str, filename: str | None) -> RebuttalResponse:
raw_text = (raw_text or "").strip()
if not raw_text:
return _error("VALIDATION", "审稿意见文本为空")
if len(raw_text) > _MAX_RAW_CHARS:
return _error("VALIDATION", f"文本超过 {_MAX_RAW_CHARS} 字符上限")
reviewers = await parse_review_text(raw_text, _messages_llm)
if not reviewers:
return _error("PARSE_FAILED", "未能从文本中解析出任何审稿意见条目")
job = {
"id": rebuttal_store.new_id("rbt_"),
"status": "ready",
"source": {"kind": kind, "filename": filename, "raw_text": raw_text},
"template": "generic",
"reviewers": reviewers,
"letter_md": None,
"validation": None,
"human_ack": False,
}
rebuttal_store.insert_job(job)
n_comments = sum(len(r["comments"]) for r in reviewers)
return _ok(job, reviewers=len(reviewers), comments=n_comments)
# ---------- 端点 ----------
@router.post("/jobs", response_model=RebuttalResponse)
async def create_job(body: JobCreateBody) -> RebuttalResponse:
"""文本粘贴主入口。"""
return await _build_job(body.text, kind="text", filename=None)
@router.post("/jobs/pdf", response_model=RebuttalResponse)
async def create_job_pdf(file: UploadFile = File(...)) -> RebuttalResponse:
"""PDF 次要入口(批注版审稿 PDF;经 vstore 8094 解析)。"""
settings = get_settings()
filename = file.filename or "review.pdf"
if not filename.lower().endswith(".pdf"):
return _error("VALIDATION", "仅支持 PDF 文件(推荐直接粘贴文本)")
data = await file.read()
if not data:
return _error("VALIDATION", "上传文件为空")
if len(data) > settings.max_pdf_bytes:
return _error("VALIDATION", f"PDF 超过 {settings.max_pdf_bytes // (1024 * 1024)}MB 上限")
try:
text = await paper_parse.parse_pdf_bytes(data, filename=filename)
except Exception as exc: # noqa: BLE001
return _error("UPSTREAM_DOWN", f"PDF 解析失败:{exc}")
return await _build_job(text, kind="pdf", filename=filename)
@router.get("/jobs/{job_id}", response_model=RebuttalResponse)
async def get_job(job_id: str) -> RebuttalResponse:
job = rebuttal_store.get_job(job_id)
if job is None:
return _error("NOT_FOUND", f"job {job_id} 不存在或已删除")
return _ok(job)
@router.patch("/jobs/{job_id}/comments/{cid}/response", response_model=RebuttalResponse)
async def patch_response(job_id: str, cid: str, body: ResponseBody) -> RebuttalResponse:
job = rebuttal_store.get_job(job_id)
if job is None:
return _error("NOT_FOUND", f"job {job_id} 不存在或已删除")
found = _find_comment(job, cid)
if found is None:
return _error("NOT_FOUND", f"comment {cid} 不存在")
_, comment = found
for p in body.parts:
if p.type not in PART_TYPES:
return _error("VALIDATION", f"未知 part.type: {p.type}")
comment["response"] = {"parts": [p.model_dump() for p in body.parts]}
# 改回复 → 旧 draft/validation 作废(保守:不保留过期草稿)
comment["draft"] = None
comment["validation"] = None
job = rebuttal_store.update_job(job_id, reviewers=job["reviewers"]) or job
return _ok(job)
@router.post("/jobs/{job_id}/comments/{cid}/draft", response_model=RebuttalResponse)
async def post_draft(job_id: str, cid: str) -> RebuttalResponse:
job = rebuttal_store.get_job(job_id)
if job is None:
return _error("NOT_FOUND", f"job {job_id} 不存在或已删除")
found = _find_comment(job, cid)
if found is None:
return _error("NOT_FOUND", f"comment {cid} 不存在")
_, comment = found
parts = (comment.get("response") or {}).get("parts") or []
if not parts or not any(str(p.get("content") or "").strip() for p in parts):
# 决策 4:生成前必须填 user_response;LLM 调用次数=0
return _error("MISSING_RESPONSE", "请先填写回复要点(user_response)再生成草稿")
validation = validate_parts(parts)
comment["validation"] = validation
if not validation["passed"]:
job = rebuttal_store.update_job(job_id, reviewers=job["reviewers"]) or job
return RebuttalResponse(
ok=False, job=job,
error={"code": "VALIDATION_FAILED", "message": "反幻觉校验未通过",
"degraded": False},
meta={"validation": validation},
)
comment["draft"] = await generate_draft(_messages_llm, comment)
job = rebuttal_store.update_job(job_id, reviewers=job["reviewers"]) or job
return _ok(job, validation=validation)
@router.patch("/jobs/{job_id}/comments/{cid}/structure", response_model=RebuttalResponse)
async def patch_structure(job_id: str, cid: str, body: StructureBody) -> RebuttalResponse:
job = rebuttal_store.get_job(job_id)
if job is None:
return _error("NOT_FOUND", f"job {job_id} 不存在或已删除")
found = _find_comment(job, cid)
if found is None:
return _error("NOT_FOUND", f"comment {cid} 不存在")
reviewer, comment = found
comments = reviewer["comments"]
idx = comments.index(comment)
if body.action == "merge":
ids = body.comment_ids or []
if cid not in ids:
ids = [cid] + ids
if len(ids) < 2:
return _error("VALIDATION", "merge 至少需要 2 条 comment")
targets = [c for c in comments if c["id"] in ids]
if len(targets) < 2:
return _error("VALIDATION", "merge 目标中有效 comment 不足 2 条")
merged_body = "\n\n".join(c["body"] for c in targets)
comment["body"] = merged_body
comment["title"] = f"{comment['title']} (+{len(targets) - 1} merged)"
reviewer["comments"] = [
c for c in comments
if c is comment or c["id"] not in ids
]
else: # split
items = body.items or []
items = [i for i in items if str(i.get("body") or "").strip()]
if len(items) < 2:
return _error("VALIDATION", "split 至少需要 2 个非空子项")
group_id = comment.get("group_id") or f"g_{cid}"
new_comments = []
for n, it in enumerate(items, start=1):
c = dict(comment)
c["id"] = rebuttal_store.new_id(f"{cid}s{n}")
c["group_id"] = group_id
c["title"] = str(it.get("title") or f"{comment['title']} ({n})")
c["body"] = str(it.get("body") or "").strip()
c["sub_items"] = []
c["response"] = {"parts": []}
c["draft"] = None
c["validation"] = None
c["human_confirmed"] = False
new_comments.append(c)
comments[idx:idx + 1] = new_comments
job = rebuttal_store.update_job(job_id, reviewers=job["reviewers"]) or job
return _ok(job)
@router.patch("/jobs/{job_id}/comments/{cid}/confirm", response_model=RebuttalResponse)
async def patch_confirm(job_id: str, cid: str, body: ConfirmBody) -> RebuttalResponse:
job = rebuttal_store.get_job(job_id)
if job is None:
return _error("NOT_FOUND", f"job {job_id} 不存在或已删除")
found = _find_comment(job, cid)
if found is None:
return _error("NOT_FOUND", f"comment {cid} 不存在")
_, comment = found
comment["human_confirmed"] = bool(body.confirmed)
# human_ack 由 store 重算(决策 4:全勾才置位,不信前端)
job = rebuttal_store.update_job(job_id, reviewers=job["reviewers"]) or job
return _ok(job, human_ack=job["human_ack"])
@router.post("/jobs/{job_id}/letter", response_model=RebuttalResponse)
async def post_letter(job_id: str) -> RebuttalResponse:
job = rebuttal_store.get_job(job_id)
if job is None:
return _error("NOT_FOUND", f"job {job_id} 不存在或已删除")
job = rebuttal_store.update_job(job_id, letter_md=assemble_letter(job)) or job
return _ok(job)
@router.get("/jobs/{job_id}/letter.md")
async def download_letter(job_id: str) -> PlainTextResponse:
job = rebuttal_store.get_job(job_id)
if job is None:
return PlainTextResponse(
"job not found", status_code=404, media_type="text/plain; charset=utf-8")
if not job.get("human_ack"):
# 信封口径与下载端点适配:GET 下载返回纯文本,业务拒绝用 400 + 明文
return PlainTextResponse(
"HUMAN_ACK_REQUIRED: 请逐条勾选确认后再下载 letter.md",
status_code=400, media_type="text/plain; charset=utf-8")
md = job.get("letter_md") or assemble_letter(job)
return PlainTextResponse(md, media_type="text/markdown; charset=utf-8")
@router.delete("/jobs/{job_id}", response_model=RebuttalResponse)
async def delete_job(job_id: str) -> RebuttalResponse:
if not rebuttal_store.delete_job(job_id):
return _error("NOT_FOUND", f"job {job_id} 不存在或已删除")
return RebuttalResponse(ok=True, job=None, meta={"deleted": job_id})
+165
View File
@@ -0,0 +1,165 @@
"""routers/reformat.py —— 论文自动排版 P1(.tex 源码级重排版,不编译)。
端点:
POST /api/review/reformat multipart 上传 .tex + target_journal →
修改后源码 + 逐行 diff 报告(job 落盘)
GET /api/review/reformat/{id} 取完整报告(重启后仍在)
GET /api/review/reformat/{id}/file 下载修改后的 .tex
信封与其余 review 端点一致:业务错误 = HTTP 200 + {ok:false,error:{code,message,degraded:false}},
前端经 review.js unwrap 归一为 ApiError。本次改动无上游依赖(零 LLM/零 vstore),
degraded 恒 false。
"""
from __future__ import annotations
import hashlib
import json
import logging
import re
import uuid
from datetime import datetime, timezone
from pathlib import Path
from typing import Any
from fastapi import APIRouter, File, Form, UploadFile
from fastapi.responses import FileResponse, JSONResponse
from pydantic import BaseModel
from ..config import get_settings
from ..services.reformat import ReformatError, reformat_tex, resolve_rules
logger = logging.getLogger(__name__)
router = APIRouter(prefix="/api/review", tags=["review-reformat"])
_JOB_ID_RE = re.compile(r"^[0-9a-f]{12}$")
_ENGINE = "reformat-p1/1.0"
class ReformatResponse(BaseModel):
ok: bool
job_id: str | None = None
modified_tex: str | None = None
changes: list[dict[str, Any]] | None = None
warnings: list[dict[str, Any]] | None = None
meta: dict[str, Any] | None = None
error: dict[str, Any] | None = None
def _error(code: str, message: str) -> ReformatResponse:
return ReformatResponse(
ok=False,
error={"code": code, "message": message, "degraded": False},
)
def _jobs_dir() -> Path:
d = get_settings().reformat_dir_abs
d.mkdir(parents=True, exist_ok=True)
return d
@router.post("/reformat", response_model=ReformatResponse)
async def reformat(
file: UploadFile = File(..., description="LaTeX 源码(.tex 单文件)"),
target_journal: str = Form("", description="目标期刊 id/名称,或 default=通用规则"),
) -> ReformatResponse:
settings = get_settings()
# ---- 入参校验(拍板 5:只收 .tex,docx/pdf 走 format-check 审核不重排)----
filename = file.filename or "paper.tex"
if not filename.lower().endswith(".tex"):
return _error("VALIDATION", "仅支持 .tex 文件(docx/pdf 请走格式审核)")
target = (target_journal or "").strip()
if not target:
return _error("VALIDATION", "必须指定目标期刊(或选择「通用规则」)")
content = await file.read()
if not content:
return _error("VALIDATION", "上传文件为空")
if len(content) > settings.max_tex_bytes:
return _error("VALIDATION", "源码超过 2MB 上限")
try:
source = content.decode("utf-8")
except UnicodeDecodeError:
return _error("VALIDATION", "源码必须为 UTF-8 编码")
# ---- 规则解析(journals.json / format_cache / journal_directory 只读回链)----
resolved = await resolve_rules(target)
# ---- 变换(纯规则引擎;结构畸形 → PARSER_FAILED)----
try:
result = reformat_tex(source, resolved["rules"])
except ReformatError as exc:
logger.warning("reformat: 结构守卫拒收 %s: %s", filename, exc)
return _error(exc.code, str(exc))
# ---- 落盘(.tex + .json 报告;重启后 GET 仍可用)----
job_id = uuid.uuid4().hex[:12]
base = _jobs_dir()
(base / f"{job_id}.tex").write_text(result["modified_tex"], encoding="utf-8")
meta: dict[str, Any] = {
"journal_id": resolved["journal_id"],
"journal_name": resolved["journal_name"],
"rules": resolved["rules"],
"rules_source": resolved["rules_source"],
"rules_note": resolved["rules_note"],
"filename": filename,
"original_sha256": hashlib.sha256(content).hexdigest(),
"engine": _ENGINE,
"generated_at": datetime.now(timezone.utc).isoformat(timespec="seconds"),
}
payload = {
"ok": True,
"job_id": job_id,
"modified_tex": result["modified_tex"],
"changes": result["changes"],
"warnings": result["warnings"],
"meta": meta,
}
(base / f"{job_id}.json").write_text(
json.dumps(payload, ensure_ascii=False, indent=2), encoding="utf-8"
)
logger.info(
"reformat: %s → job %s(%d 处修改, %d 条提示, 规则 %s)",
filename, job_id,
sum(1 for c in result["changes"] if c["action"] == "modified"),
sum(1 for c in result["changes"] if c["action"] == "warning"),
resolved["rules_source"],
)
return ReformatResponse(**payload)
def _load_job(job_id: str) -> dict[str, Any] | None:
if not _JOB_ID_RE.fullmatch(job_id or ""):
return None
path = _jobs_dir() / f"{job_id}.json"
try:
payload = json.loads(path.read_text("utf-8"))
except (OSError, ValueError):
return None
return payload if isinstance(payload, dict) and payload.get("ok") else None
_NOT_FOUND = {"ok": False, "error": {"code": "NOT_FOUND",
"message": "任务不存在或已过期,请重新上传源码",
"degraded": False}}
@router.get("/reformat/{job_id}", response_model=ReformatResponse)
async def get_reformat_job(job_id: str) -> ReformatResponse:
payload = _load_job(job_id)
if payload is None:
return _error("NOT_FOUND", "任务不存在或已过期,请重新上传源码")
return ReformatResponse(**payload)
@router.get("/reformat/{job_id}/file", response_model=None)
async def download_reformat_file(job_id: str) -> FileResponse | JSONResponse:
"""下载修改后的 .tex;缺件/非法 id → 200 信封(前端单一错误口径)。"""
valid = bool(_JOB_ID_RE.fullmatch(job_id or ""))
tex = _jobs_dir() / f"{job_id}.tex" if valid else None
if tex is None or not tex.is_file():
return JSONResponse(status_code=200, content=_NOT_FOUND)
return FileResponse(tex, media_type="application/x-tex", filename=f"{job_id}.tex")
+1
View File
@@ -0,0 +1 @@
"""review 服务服务层包。"""
+788
View File
@@ -0,0 +1,788 @@
"""services/format_check.py —— 版式与规范规则引擎(⑤ 论文排版与规范)。
纯规则、无 LLM、无 vstore、同步执行(通常 <1s):
- PDF → pymupdf 本地解档(AGENTS.md 约束 6 例外:vstore 只回文本,字体/边距/
行距/页数等版式元数据拿不到;正文提取仍走 vstore,本服务不碰正文语义);
- Word → python-docx(页边距/行距精确,页数取 docProps/app.xml 的 <Pages>);
- 规则集 → data/journals/journals.json:
顶层 format_rules_default(通用默认值,rules_source="default")
每条目可选 format_rules(按期刊覆盖,必须带 rules_source: placeholder|official|default)
⚠ 诚实原则:不知道期刊真实投稿指南 → 该条只写 {"rules_source": "placeholder"},
所有具体数字回退 default 通用值,绝不编造期刊专属数字。
输出:{checks[{name,key,status,detail,suggestion}], summary{pass,warn,fail}, meta{...}}
status ∈ pass|warn|fail。参考文献样式宽容化:仅"明确不符"(如 [J] 标引但规则要求 APA)
才 fail,"疑似但不确定/检测不到"一律 warn,避免误伤。
"""
from __future__ import annotations
import io
import json
import re
import statistics
import zipfile
from pathlib import Path
from typing import Any
import fitz # pymupdf(venv 已装 1.28.x)
from docx import Document
from docx.shared import Length
# review_service/app/services/ → parents[2] = review_service
_JOURNALS_PATH = Path(__file__).resolve().parents[2] / "data" / "journals" / "journals.json"
_MAX_SCAN_PAGES = 80 # 版式扫描页数上限(正文/字体/边距;稿件通常远小于此)
_MAX_REFS_SCAN = 40 # 从文末向前找参考文献标题的页数窗口
_MAX_PARAS = 8000 # docx 段落扫描上限
_PT_TO_MM = 25.4 / 72.0
_EMU_TO_MM = 1.0 / 36000.0
_HEADING_RE = re.compile(
r"^\s*(references|bibliography|literature cited|works cited|参考文献|文献)\s*[::]?\s*$",
re.IGNORECASE,
)
_FIG_RE = re.compile(r"(?im)^\s*(figure|fig\.?|图)\s*\d+")
_TAB_RE = re.compile(r"(?im)^\s*(table|表)\s*\d+")
_GB_TAG_RE = re.compile(r"\[[A-Z]{1,3}\d*\]") # [J] [M] [D] [C] …(GB/T 7714 标引)
_PAREN_YEAR_RE = re.compile(r"\((?:19|20)\d{2}\)") # (2024) 作者-年份制
_BRACKET_NUM_RE = re.compile(r"^\[\d+\]") # [1] 编号制
_DOI_RE = re.compile(r"doi:?\.?org|doi:\s*1\.", re.IGNORECASE)
_STYLE_LABEL = {
"gb7714": "GB/T 7714",
"author_year": "作者-年份制(类 APA)",
"numbered": "编号制(顺序编码)",
"unknown": "无法确定",
}
class FormatCheckError(Exception):
"""解档/规则加载失败(路由器转 PARSE_FAILED)。"""
# ---------------------------------------------------------------- 规则集加载
def load_ruleset(target_journal: str) -> tuple[dict[str, Any], dict[str, Any]]:
"""返回 (rules, ruleset_meta)。target_journal 传 id 或 name 均可;未知 → default。"""
try:
data = json.loads(_JOURNALS_PATH.read_text("utf-8"))
except Exception as exc: # noqa: BLE001
raise FormatCheckError(f"规则集加载失败:{exc}") from exc
default = data.get("format_rules_default") or {}
jid = (target_journal or "").strip()
entry = None
if jid:
for j in data.get("journals") or []:
if j.get("id") == jid or j.get("name") == jid:
entry = j
break
if entry is None:
rules = dict(default)
meta = {
"journal_id": None,
"journal_name": None,
"ruleset_source": "default",
"rules_source": str(default.get("rules_source", "default")),
}
else:
journal_rules = entry.get("format_rules") or {}
rules = {**default, **journal_rules}
meta = {
"journal_id": entry.get("id"),
"journal_name": entry.get("name"),
"ruleset_source": "journal",
# 占位规则(无官方核验)→ 前端黄字提示
"rules_source": str(journal_rules.get("rules_source", "placeholder")),
}
rules.setdefault("rules_source", "default")
return rules, meta
# ---------------------------------------------------------------- PDF 解档(pymupdf)
def _norm_font(name: str) -> str:
n = (name or "").split("+")[-1].strip()
return n or "unknown"
def extract_profile_pdf(data: bytes) -> dict[str, Any]:
try:
doc = fitz.open(stream=data, filetype="pdf")
except Exception as exc: # noqa: BLE001
raise FormatCheckError(f"PDF 解档失败:{exc}") from exc
if getattr(doc, "needs_pass", False):
doc.close()
raise FormatCheckError("PDF 已加密,无法解析")
pages_total = doc.page_count
scan = min(pages_total, _MAX_SCAN_PAGES)
margin_rows: list[tuple[float, float, float, float]] = [] # t r b l (mm)
font_w: dict[str, int] = {}
size_w: dict[float, int] = {}
ratios: list[float] = []
img_ids: set[int] = set()
fig_caps = tab_caps = 0
for pno in range(scan):
page = doc[pno]
rect = page.rect
blocks = page.get_text("blocks")
content = [b for b in blocks if b[4].strip()]
if content:
left = min(b[0] for b in content)
top = min(b[1] for b in content)
right = rect.width - max(b[2] for b in content)
bottom = rect.height - max(b[3] for b in content)
margin_rows.append(
(
max(0.0, top) * _PT_TO_MM,
max(0.0, right) * _PT_TO_MM,
max(0.0, bottom) * _PT_TO_MM,
max(0.0, left) * _PT_TO_MM,
)
)
for img in page.get_images(full=True):
img_ids.add(img[0])
text = page.get_text()
fig_caps += len(_FIG_RE.findall(text))
tab_caps += len(_TAB_RE.findall(text))
d = page.get_text("dict")
for block in d.get("blocks", []):
if block.get("type") != 0:
continue
line_meta: list[tuple[float, float]] = [] # (基线 y, 字号)
for line in block.get("lines", []):
spans = [s for s in line.get("spans", []) if s.get("text", "").strip()]
if not spans:
continue
row_size = max(s.get("size", 0.0) for s in spans)
if row_size <= 0:
continue
for s in spans:
size = round(float(s.get("size", 0.0)), 1)
chars = len(s.get("text", ""))
if size > 0:
norm = _norm_font(s.get("font", ""))
font_w[norm] = font_w.get(norm, 0) + chars
size_w[size] = size_w.get(size, 0) + chars
# 行距基准用 span.origin 基线 y,不用 bbox 顶缘:bbox 顶随字形高低
# 漂移,表格/图注等同基线并列文本会产出假性小 delta,混入中位数会把
# 行距拉成 0.1x 的不可能值。
origin = spans[0].get("origin")
line_meta.append((origin[1] if origin else line["bbox"][1], row_size))
for i in range(1, len(line_meta)):
delta = line_meta[i][0] - line_meta[i - 1][0]
size = line_meta[i][1]
# 行距倍数 = 相邻行基线 y 差 / 当前行字号;
# 过滤物理不可能值:<0.5(行重叠/同基线并列表格)、>4.0(异常结构)
ratio = delta / size
if 0.5 <= ratio <= 4.0:
ratios.append(ratio)
refs_text, refs_found = _find_refs_pdf(doc, pages_total)
doc.close()
if margin_rows:
med = [statistics.median(col) for col in zip(*margin_rows)]
margins = {"top": med[0], "right": med[1], "bottom": med[2], "left": med[3]}
else:
margins = None
return {
"source_kind": "pdf",
"pages": pages_total,
"margins_mm": margins,
"font_weights": font_w,
"size_weights": size_w,
"line_spacing_median": statistics.median(ratios) if ratios else None,
"figures": max(len(img_ids), fig_caps),
"tables": tab_caps,
"refs_text": refs_text,
"refs_found": refs_found,
}
def _find_refs_pdf(doc: "fitz.Document", pages_total: int) -> tuple[str | None, bool]:
"""从文末向前找参考文献标题行;找到 → 标题行至文末文本;找不到 → (None, False)。"""
buf: list[str] = []
start = max(0, pages_total - _MAX_REFS_SCAN)
for pno in range(pages_total - 1, start - 1, -1):
page_text = doc[pno].get_text()
lines = page_text.splitlines()
for idx in range(len(lines) - 1, -1, -1):
if _HEADING_RE.match(lines[idx].strip()):
tail = "\n".join(lines[idx + 1:])
joined = "\n".join([tail] + buf).strip()
return (joined if len(joined) >= 50 else None), bool(joined)
buf.insert(0, page_text)
return None, False
# ---------------------------------------------------------------- Word 解档(python-docx)
def _docx_app_pages(data: bytes) -> int | None:
try:
with zipfile.ZipFile(io.BytesIO(data)) as zf:
xml = zf.read("docProps/app.xml").decode("utf-8", "ignore")
m = re.search(r"<Pages>(\d+)</Pages>", xml)
return int(m.group(1)) if m else None
except Exception: # noqa: BLE001
return None
def extract_profile_docx(data: bytes) -> dict[str, Any]:
try:
doc = Document(io.BytesIO(data))
except Exception as exc: # noqa: BLE001
raise FormatCheckError(f"Word 文件解析失败:{exc}") from exc
side_lists: dict[str, list[float]] = {"top": [], "right": [], "bottom": [], "left": []}
for sec in doc.sections:
for k, v in (
("top", sec.top_margin),
("right", sec.right_margin),
("bottom", sec.bottom_margin),
("left", sec.left_margin),
):
if v is not None:
side_lists[k].append(float(v) * _EMU_TO_MM)
margins = None
if all(side_lists.values()):
margins = {k: statistics.median(v) for k, v in side_lists.items()}
try:
normal = doc.styles["Normal"].font
default_name = normal.name
default_size = float(normal.size.pt) if normal.size is not None else None
except Exception: # noqa: BLE001
default_name, default_size = None, None
font_w: dict[str, int] = {}
size_w: dict[float, int] = {}
ratios: list[float] = []
fig_caps = tab_caps = 0
paras = doc.paragraphs
scan_count = min(len(paras), _MAX_PARAS)
for i in range(scan_count):
para = paras[i]
text = para.text
if not text.strip():
continue
ls = para.paragraph_format.line_spacing
if isinstance(ls, Length):
# 精确行距(exactly)以 EMU 存储,Length 是 int 子类——直接当倍数会得出
# 十万级的假值;用正文默认字号换算成倍数
if default_size:
r = float(ls.pt) / default_size
if 0.5 <= r <= 4.0:
ratios.append(r)
elif isinstance(ls, (int, float)) and not isinstance(ls, bool) and ls > 0:
r = float(ls) # multiple 行距本身就是倍数
if 0.5 <= r <= 4.0:
ratios.append(r)
if _FIG_RE.match(text):
fig_caps += 1
elif _TAB_RE.match(text):
tab_caps += 1
for run in para.runs:
if not run.text:
continue
name = run.font.name or default_name or "unknown"
pt = run.font.size.pt if run.font.size is not None else default_size
chars = len(run.text)
font_w[str(name)] = font_w.get(str(name), 0) + chars
if pt:
size_w[round(float(pt), 1)] = size_w.get(round(float(pt), 1), 0) + chars
# 参考文献节:标题段落之后全部文本
refs_text, refs_found = None, False
for i, para in enumerate(paras):
if _HEADING_RE.match((para.text or "").strip()):
tail = "\n".join(p.text for p in paras[i + 1:] if (p.text or "").strip())
if len(tail) >= 50:
refs_text, refs_found = tail, True
break
return {
"source_kind": "docx",
"pages": _docx_app_pages(data), # Word 未记录 → None(检查项降级为 warn)
"margins_mm": margins,
"font_weights": font_w,
"size_weights": size_w,
"line_spacing_median": statistics.median(ratios) if ratios else None,
"figures": max(len(doc.inline_shapes), fig_caps),
"tables": max(len(doc.tables), tab_caps),
"refs_text": refs_text,
"refs_found": refs_found,
}
# ---------------------------------------------------------------- LaTeX 解档(正则+状态机,零新依赖)
#
# 决策前提:只做"解析 + 检查 + 建议代码片段",不自动改写 LaTeX(用户可能有自定义宏,
# 自动改写会引错;LaTeX 应由用户自己编辑)。不引入 pylatexenc/texsoup。
# 会相互覆盖的字体类宏包:≥2 个同时引入 → warn(times + mathptmx 类冲突)
_TEX_FONT_PKGS = {"times", "mathptmx", "newtx", "newpx", "txfonts", "pxfonts", "mathpazo"}
def _strip_tex_comments(src: str) -> str:
r"""去行内 % 注释(r-string,避免 \% 被解释为转义序列)。"""
return re.sub(r"(?<!\\)%.*", "", src)
def _parse_geometry(src: str) -> dict[str, float] | None:
"""\\usepackage[...]{geometry} 或 \\geometry{...} → {边: mm}(可缺边,检查端容缺)。"""
m = re.search(r"\\usepackage\s*\[([^\]]*)\]\s*\{\s*geometry\s*\}", src)
if not m:
m = re.search(r"\\geometry\s*\{([^}]*)\}", src)
if not m:
return None
opts = m.group(1)
def to_mm(val: str) -> float | None:
mm = re.match(r"\s*([\d.]+)\s*(mm|cm|in|pt)?\s*$", val)
if not mm:
return None
x = float(mm.group(1))
unit = mm.group(2) or "pt" # geometry 裸数字按 TeX 惯例为 pt
return {"mm": x, "cm": x * 10, "in": x * 25.4, "pt": x * 25.4 / 72.0}[unit]
kv = {}
for pair in opts.split(","):
if "=" in pair:
k, v = pair.split("=", 1)
kv[k.strip().lower()] = v.strip()
out: dict[str, float] = {}
if "margin" in kv:
v = to_mm(kv["margin"])
if v is not None:
return {"top": v, "right": v, "bottom": v, "left": v}
for k in ("top", "right", "bottom", "left"):
if k in kv:
v = to_mm(kv[k])
if v is not None:
out[k] = v
if "inner" in kv:
v = to_mm(kv["inner"])
if v is not None:
out.setdefault("left", v)
if "outer" in kv:
v = to_mm(kv["outer"])
if v is not None:
out.setdefault("right", v)
return out or None
def extract_tex_profile(data: bytes) -> dict[str, Any]:
"""正则 + 轻量状态机解析 .tex 源文件 → 与 DocProfile 同构(+tex 扩展字段)。"""
try:
text = data.decode("utf-8")
except UnicodeDecodeError:
text = data.decode("latin-1", errors="replace")
src = _strip_tex_comments(text)
# \documentclass[10pt,a4paper]{article}
m_cls = re.search(r"\\documentclass\s*(?:\[[^\]]*\])?\s*\{\s*([\w*]+)\s*\}", src)
cls = m_cls.group(1) if m_cls else None
m_opt = re.search(r"\\documentclass\s*\[([^\]]*)\]", src)
cls_opts = m_opt.group(1) if m_opt else ""
m_pt = re.search(r"(\d+)\s*pt", cls_opts)
# 标准类未写选项时 LaTeX 默认 10pt;无 documentclass → None(检查项降级 warn)
fontsize = int(m_pt.group(1)) if m_pt else (10 if cls else None)
paper = "a4paper" if "a4paper" in cls_opts else ("letterpaper" if "letterpaper" in cls_opts else None)
# \usepackage 列表(支持 {a,b} 逗号多包)
packages: list[str] = []
for m in re.finditer(r"\\usepackage\s*(?:\[[^\]]*\])?\s*\{\s*([^}]+?)\s*\}", src):
packages += [p.strip().lower() for p in m.group(1).split(",") if p.strip()]
# 行距:\linespread{...} 或 \setstretch{...}(值直接按"行距倍数"口径评估——
# 按步骤4 规格:低于 min_line_spacing 即 fail;LaTeX 实际倍数还含 baselinestretch
# 的字号比,本引擎取显式设置值做保守判定)
line_spread: float | None = None
m = re.search(r"\\linespread\s*\{\s*([\d.]+)\s*\}", src)
if not m:
m = re.search(r"\\setstretch\s*\{\s*([\d.]+)\s*\}", src)
if m:
line_spread = float(m.group(1))
# 页边距(geometry)
margins = _parse_geometry(src)
# 计数
figures = len(re.findall(r"\\begin\s*\{\s*figure\*?\s*\}", src))
tables = len(re.findall(r"\\begin\s*\{\s*table\*?\s*\}", src))
cites = len(re.findall(r"\\cite\w*\s*\{", src))
# 参考文献:\bibliography{...}(BibTeX)/ \printbibliography(biblatex)/ thebibliography
has_bibtex = bool(re.search(r"\\bibliography\s*\{", src))
has_printbib = bool(re.search(r"\\printbibliography", src))
has_thebib = bool(re.search(r"\\begin\s*\{\s*thebibliography\s*\}", src))
has_bibstyle = bool(re.search(r"\\bibliographystyle\s*\{", src)) # BibTeX 必需;biblatex 不需要
has_bib = has_bibtex or has_printbib or has_thebib
refs_text: str | None = None
m_bib = re.search(r"\\begin\s*\{\s*thebibliography\s*\}[\s\S]*?\\end\s*\{\s*thebibliography\s*\}", src)
if m_bib:
refs_text = m_bib.group(0)
# 宏表(\newcommand{\xxx} / \renewcommand)——用于解析准确性(识别自定义宏)
macros = re.findall(r"\\(?:new|re)command\s*\{\s*\\(\w+)\s*\}", src)
# 匿名评审命令探测(规则集 anonymous:true 时检查)
m_anon = re.search(r"\\(?:anonymi[sz]e|anon\b|hideauthor|ifdoubleblind)", src, re.IGNORECASE)
return {
"source_kind": "tex",
"pages": None, # LaTeX 源文件页数需编译后才有 → 检查项降级 warn(宽容化)
"margins_mm": margins,
"font_weights": {},
"size_weights": {float(fontsize): 100} if fontsize else {},
"line_spacing_median": line_spread,
"figures": figures,
"tables": tables,
"refs_text": refs_text,
"refs_found": has_bib,
"tex": {
"class": cls,
"fontsize_pt": fontsize,
"paper": paper,
"packages": packages,
"cites": cites,
"macros": macros,
"anon_cmd": m_anon.group(0) if m_anon else None,
"bib_bibtex": has_bibtex,
"bib_style": has_bibstyle,
},
}
# ---------------------------------------------------------------- 参考文献样式检测
def detect_refs_style(text: str | None) -> tuple[str, str]:
"""宽容化检测:返回 (detected, sample_line)。含糊 → unknown(后续只 warn)。"""
if not text:
return "unknown", ""
lines = [l.strip() for l in text.splitlines() if l.strip()][:40]
if not lines:
return "unknown", ""
n = len(lines)
gb = sum(1 for l in lines if _GB_TAG_RE.search(l))
year = sum(1 for l in lines if _PAREN_YEAR_RE.search(l))
num = sum(1 for l in lines if _BRACKET_NUM_RE.match(l))
doi = sum(1 for l in lines if _DOI_RE.search(l))
sample = lines[0][:80]
if gb / n >= 0.4:
return "gb7714", sample
if num / n >= 0.4 and year / n < 0.3:
return "numbered", sample
if year / n >= 0.3 or doi / n >= 0.3:
return "author_year", sample
return "unknown", sample
# ---------------------------------------------------------------- 检查项构建
def _chk(key: str, name: str, status: str, detail: str, suggestion: str = "") -> dict[str, str]:
return {"key": key, "name": name, "status": status, "detail": detail, "suggestion": suggestion}
def _check_pages(profile: dict[str, Any], rules: dict[str, Any]) -> dict[str, str]:
limit = int(rules.get("max_pages", 10))
pages = profile.get("pages")
kind = profile.get("source_kind") or "doc"
if pages is None:
# 宽容化:Word/LaTeX 页数缺失绝不 fail
if kind == "tex":
return _chk(
"pages", "页数", "warn",
f"LaTeX 源无法直接统计页数(规则上限 {limit} 页),需编译后核对",
"编译后确认(如 xelatex main.tex)总页数 ≤ 上限",
)
return _chk(
"pages", "页数", "warn",
"Word 未记录页数,请自行核对",
f"在 Word 中按 Ctrl+End 查看总页数,或导出 PDF 后重查(规则上限 {limit} 页)",
)
if pages <= limit:
return _chk("pages", "页数", "pass", f"共 {pages} 页,规则上限 {limit} 页")
return _chk(
"pages", "页数", "fail", f"共 {pages} 页,超出规则上限 {limit} 页",
f"压缩至 ≤{limit} 页,或将方法/图表移入补充材料",
)
def _check_fonts(profile: dict[str, Any], rules: dict[str, Any]) -> dict[str, str]:
min_font = float(rules.get("min_font_pt", 9))
# LaTeX:字号来自 \documentclass 选项(10/11/12pt,粒度粗)
if profile.get("source_kind") == "tex":
tex = profile.get("tex") or {}
cls = tex.get("class") or "documentclass"
fs = tex.get("fontsize_pt")
pkgs = tex.get("packages") or []
font_pkgs = sorted(p for p in pkgs if p in _TEX_FONT_PKGS or p in ("helvet", "courier", "charter", "fourier"))
detail = (
f"\\documentclass 选项字号 {fs}pt(类 {cls});"
f"字体宏包:{'、'.join(font_pkgs) if font_pkgs else '未引入'}"
+ (f";纸张 {tex['paper']}" if tex.get("paper") else "")
)
if fs is None:
return _chk("fonts", "字体字号", "warn", detail + "\n建议:\n \\documentclass[11pt]{article}", "补充 \\documentclass 声明")
if fs < min_font:
# LaTeX 粒度粗 → 按步骤4 规格降为 warn(非 fail)
return _chk(
"fonts", "字体字号", "warn", detail + f"\n建议:\n \\documentclass[11pt]{{{cls}}}",
f"正文字号低于下限 {min_font:.0f}pt,请改用 11pt/12pt 选项",
)
return _chk("fonts", "字体字号", "pass", detail)
size_w: dict[float, int] = profile.get("size_weights") or {}
font_w: dict[str, int] = profile.get("font_weights") or {}
if not size_w:
return _chk("fonts", "字体字号", "warn", "未能提取字体信息", "确认文档含可选中文本(扫描件无法检查字体)")
min_font = float(rules.get("min_font_pt", 9))
max_fonts = int(rules.get("max_fonts", 6))
total = sum(size_w.values())
body_pt = max(size_w, key=size_w.get)
body_ratio = int(size_w[body_pt] / total * 100)
distinct = len(font_w)
top_fonts = sorted(font_w.items(), key=lambda kv: -kv[1])[:3]
top_text = "、".join(f"{k}({v}字)" for k, v in top_fonts)
detail = f"主要字号 {body_pt}pt(约 {body_ratio}%),共 {distinct} 种字体;高频字体:{top_text}"
if body_pt < min_font:
return _chk(
"fonts", "字体字号", "fail", detail,
f"将正文字号提高至 ≥{min_font}pt(当前主字号 {body_pt}pt)",
)
if distinct > max_fonts:
return _chk(
"fonts", "字体字号", "warn", detail,
f"字体种类偏多({distinct} > {max_fonts}),建议全文统一为 1–2 种正文字体",
)
return _chk("fonts", "字体字号", "pass", detail)
def _check_margins(profile: dict[str, Any], rules: dict[str, Any]) -> dict[str, str]:
limit = float(rules.get("min_margin_mm", 15))
margins = profile.get("margins_mm")
# LaTeX:页边距来自 geometry;低于下限按步骤4 规格给 warn(非 fail),附建议片段
if profile.get("source_kind") == "tex":
if not margins:
return _chk(
"margins", "页边距", "warn",
"未通过 geometry 设置页边距(按类默认评估)"
+ f"\n建议:\n \\usepackage[margin=25mm]{{geometry}}",
"在导言区显式声明页边距",
)
lo = min(margins.values())
detail = f"geometry 页边距最小 {lo:.0f}mm(" + "、".join(f"{k}{v:.0f}" for k, v in margins.items()) + f"),规则下限 {limit:.0f}mm"
if lo < limit:
return _chk(
"margins", "页边距", "warn",
detail + f"\n建议:\n \\usepackage[margin={limit:.0f}mm]{{geometry}}",
f"调大页边距至 ≥{limit:.0f}mm",
)
return _chk("margins", "页边距", "pass", detail)
if not margins:
return _chk("margins", "页边距", "warn", "未能提取页边距信息", "检查文档是否含可定位文本")
vals = [margins.get(k) for k in ("top", "right", "bottom", "left")]
vals = [v for v in vals if v is not None]
if not vals:
return _chk("margins", "页边距", "warn", "未能提取页边距信息", "检查文档是否含可定位文本")
t, r = margins.get("top"), margins.get("right")
b, l = margins.get("bottom"), margins.get("left")
lo = min(vals)
sides = "、".join(
f"{name}{v:.0f}" for name, v in (("上", t), ("右", r), ("下", b), ("左", l)) if v is not None
)
detail = f"四边最小 {lo:.0f}mm({sides}),规则下限 {limit:.0f}mm"
if lo >= limit:
return _chk("margins", "页边距", "pass", detail)
if lo >= limit * 0.8:
return _chk("margins", "页边距", "warn", detail, f"将页边距调大至 ≥{limit:.0f}mm")
return _chk("margins", "页边距", "fail", detail, f"页边距过小,请调至 ≥{limit:.0f}mm(版式设置)")
def _check_spacing(profile: dict[str, Any], rules: dict[str, Any]) -> dict[str, str]:
lo = float(rules.get("min_line_spacing", 1.15))
ratio = profile.get("line_spacing_median")
# LaTeX:\linespread/\setstretch 显式设置值;低于下限按步骤4 规格直接 fail
if profile.get("source_kind") == "tex":
if ratio is None:
return _chk(
"spacing", "行距", "pass",
"未显式设置 \\linespread/\\setstretch,LaTeX 类默认约 1.2 倍(如 10pt→12pt baselineskip)",
)
detail = f"\\linespread/\\setstretch = {ratio:.2f},规则下限 {lo:.2f}"
if ratio < lo:
return _chk(
"spacing", "行距", "fail",
detail + f"\n建议:\n \\linespread{{{lo:.2f}}} % 或 \\setstretch{{{lo:.2f}}}(导言区)",
"在导言区调大行距设置",
)
return _chk("spacing", "行距", "pass", detail)
if ratio is None:
return _chk("spacing", "行距", "warn", "未能提取行距信息", "确认段落使用固定/多倍行距设置")
lo = float(rules.get("min_line_spacing", 1.15))
detail = f"正文中位行距约 {ratio:.2f} 倍,规则下限 {lo:.2f} 倍"
if ratio >= lo:
return _chk("spacing", "行距", "pass", detail)
if ratio >= lo * 0.9:
return _chk("spacing", "行距", "warn", detail, f"段落行距设为 ≥{lo:.2f} 倍(如 1.5 倍行距)")
return _chk("spacing", "行距", "fail", detail, f"行距过密,请设为 ≥{lo:.2f} 倍行距")
def _check_figures(profile: dict[str, Any], rules: dict[str, Any]) -> dict[str, str]:
figures = int(profile.get("figures") or 0)
tables = int(profile.get("tables") or 0)
min_f = int(rules.get("min_figures", 1))
detail = f"检测到图 {figures} 张、表 {tables} 个(图注/表注正则 + 内嵌对象启发式)"
if figures >= min_f:
return _chk("figures", "图表数量", "pass", detail)
# 启发式检测不可靠 → 低于阈值只 warn 不 fail
return _chk(
"figures", "图表数量", "warn", detail,
f"常规研究论文建议 ≥{min_f} 图;若为综述/短文可忽略(本项为启发式检测)",
)
# 仅"明确不符"才 fail 的 (expected, detected) 组合(宽容化:其余含糊组合一律 warn)
_REF_FAIL_PAIRS = {
("apa", "gb7714"), # 找到 [J] 标引但规则要求 APA
("gb7714", "author_year"), # 无 [J] 标引的作者-年份制,但规则要求 GB/T 7714
("apa", "numbered"), # 编号制引文但规则要求 APA
}
def _check_refs(profile: dict[str, Any], rules: dict[str, Any]) -> dict[str, str]:
expected = str(rules.get("refs_style", "apa")).lower()
exp_label = _STYLE_LABEL.get(expected, expected)
if not profile.get("refs_found"):
return _chk(
"refs", "参考文献格式", "warn",
"未找到参考文献节(References/参考文献 / \\bibliography / thebibliography)",
"确认存在参考文献声明后重查",
)
if profile.get("source_kind") == "tex":
tex = profile.get("tex") or {}
# BibTeX:\bibliography 存在但缺 \bibliographystyle → warn(样式引擎未知)
if tex.get("bib_bibtex") and not tex.get("bib_style"):
return _chk(
"refs", "参考文献格式", "warn",
f"规则要求 {exp_label};检测到 \\bibliography 但缺少 \\bibliographystyle(BibTeX 无法确定引用样式)"
+ "\n建议:\n \\bibliographystyle{plain} % 按期刊/模板指定实际样式",
"在 \\bibliography 前补 \\bibliographystyle",
)
if not profile.get("refs_text"):
# 条目在 .bbl/编译产物,源文件无文本 → 宽容化只 warn
return _chk(
"refs", "参考文献格式", "warn",
f"规则要求 {exp_label};检测到参考文献声明(条目由编译生成,源文件无条目文本)",
"编译后核对参考文献条目样式",
)
detected, sample = detect_refs_style(profile.get("refs_text"))
det_label = _STYLE_LABEL[detected]
detail = f"规则要求 {exp_label};检测到 {det_label};样例:{sample}"
# 宽容化:仅"明确不符"(_REF_FAIL_PAIRS)才 fail;含糊/不确定一律 warn
if (expected, detected) in _REF_FAIL_PAIRS:
return _chk("refs", "参考文献格式", "fail", detail, f"按 {exp_label} 调整全部文献条目(可用文献管理工具一键转换)")
if detected == "unknown":
return _chk("refs", "参考文献格式", "warn", detail, f"请人工核对是否符合 {exp_label}")
if expected == "gb7714" and detected == "numbered":
return _chk("refs", "参考文献格式", "warn", detail, "GB/T 7714 顺序编码制也用编号,需人工确认条目含 [J] 等类型标引")
if expected == "author-year-journal" and detected in ("gb7714", "numbered"):
return _chk("refs", "参考文献格式", "warn", detail, f"请对照期刊投稿指南核对是否符合 {exp_label}")
return _chk("refs", "参考文献格式", "pass", detail)
def _check_font_packages(profile: dict[str, Any], rules: dict[str, Any]) -> dict[str, str]:
"""LaTeX 特有:多个相互覆盖的字体宏包(times + mathptmx 类)→ warn。"""
pkgs = set((profile.get("tex") or {}).get("packages") or [])
clash = sorted(pkgs & _TEX_FONT_PKGS)
if len(clash) >= 2:
detail = (
f"检测到多个相互覆盖的字体宏包:{'、'.join(clash)}(后加载者覆盖前者,易产生冲突)"
+ "\n建议:\n %只保留一套字体方案,例如:\n \\usepackage{newtx} % newtxtext + newtxmath 一体"
)
return _chk("fontpkgs", "字体包兼容", "warn", detail, "移除重复/冲突的字体宏包,只保留一套")
return _chk(
"fontpkgs", "字体包兼容", "pass",
"字体宏包:" + ("、".join(clash) if clash else "未引入冲突类字体包"),
)
def _check_anonymous(profile: dict[str, Any], rules: dict[str, Any]) -> dict[str, str]:
"""LaTeX 特有且规则集 anonymous:true 时才出:源文件需含匿名处理命令。"""
tex = profile.get("tex") or {}
cmd = tex.get("anon_cmd")
if cmd:
return _chk("anonymous", "匿名评审", "pass", f"检测到匿名处理命令 {cmd}")
return _chk(
"anonymous", "匿名评审", "warn",
"规则要求匿名评审,源文件未检测到匿名处理命令"
+ "\n建议:\n %隐去作者/致谢/自引,或定义匿名宏:\n \\newcommand{\\anon}[1]{[ANON]}",
"按期刊要求对作者信息做匿名处理",
)
def build_checks(profile: dict[str, Any], rules: dict[str, Any]) -> list[dict[str, str]]:
checks = [
_check_pages(profile, rules),
_check_fonts(profile, rules),
_check_margins(profile, rules),
_check_spacing(profile, rules),
]
if profile.get("source_kind") == "tex":
checks.append(_check_font_packages(profile, rules))
checks.append(_check_figures(profile, rules))
checks.append(_check_refs(profile, rules))
if profile.get("source_kind") == "tex" and rules.get("anonymous"):
checks.append(_check_anonymous(profile, rules))
return checks
# ---------------------------------------------------------------- 入口
def check_document(data: bytes, kind: str, target_journal: str) -> dict[str, Any]:
"""kind ∈ pdf|docx|tex。返回 {checks, summary, meta}(filename 由路由器补入 meta)。"""
if kind == "pdf":
profile = extract_profile_pdf(data)
elif kind == "docx":
profile = extract_profile_docx(data)
elif kind == "tex":
profile = extract_tex_profile(data)
else:
raise FormatCheckError(f"不支持的文件类型:{kind}")
rules, ruleset_meta = load_ruleset(target_journal)
checks = build_checks(profile, rules)
summary = {"pass": 0, "warn": 0, "fail": 0}
for c in checks:
summary[c["status"]] = summary.get(c["status"], 0) + 1
detected, _ = detect_refs_style(profile.get("refs_text")) if profile.get("refs_found") else ("unknown", "")
meta = {
**ruleset_meta,
"file_type": kind,
"pages": profile.get("pages"),
"refs_style_expected": str(rules.get("refs_style", "apa")).lower(),
"refs_style_detected": detected,
}
if kind == "tex":
tex = profile.get("tex") or {}
meta["tex"] = {
"class": tex.get("class"),
"fontsize_pt": tex.get("fontsize_pt"),
"paper": tex.get("paper"),
"packages": tex.get("packages"),
"cites": tex.get("cites"),
"macros": (tex.get("macros") or [])[:10],
}
return {"checks": checks, "summary": summary, "meta": meta}
@@ -0,0 +1,232 @@
"""services/format_extractor.py —— 投稿指南 → 格式规则 JSON(LLM 抽取,第一批)。
- 调 services/llm.py 的 complete_json(DeepSeek json_object + 修复重试,零新依赖)
- Prompt = 「格式规则抽取器」模板:目标字段与 journals.json format_rules_default
同构(max_pages / min_font_pt / min_margin_mm / min_line_spacing / min_figures /
max_fonts / refs_style / anonymous),强制每字段带 source_quotes + confidence
- 诚实原则:正文没写 → null,绝不编造(与 format_check 诚实原则一致)
- 解析/校验失败 → {"ok": False, "error": ...}
返回:
成功 {"ok": True, "rules": {...}, "source_quotes": {...},
"confidence": {...}, "notes": str, "raw": LLM原始JSON, "error": None}
失败 {"ok": False, "error": "...", 其余键为 None}
source_url 由调用方(scripts/fetch_format_rules.py)在落盘时补入结果文件。
"""
from __future__ import annotations
import logging
import re
from typing import Any
from .llm import LLMError, complete_json
logger = logging.getLogger(__name__)
# 「格式规则抽取器」模板(system prompt)
_SYSTEM = """你是「格式规则抽取器」:从期刊官方投稿指南的 Markdown 正文中抽取格式规则,供投稿排版检查引擎使用。
# 目标字段(rules 对象,严格用以下字段名)
- max_pages:正文页数上限(整数;原文无明确上限 → null)
- min_font_pt:最小字号(数字,单位 pt;原文若用 cm/mm/inch 给出则换算为 pt)
- min_margin_mm:最小页边距(数字,单位 mm;原文若用 inch 给出则 ×25.4 换算)
- min_line_spacing:最小行距倍数(数字;如 "double-spaced" → 2.0,"1.5 spacing" → 1.5)
- min_figures:研究论文最少图数(整数;无明确要求 → null)
- max_fonts:全文最多字体种类(整数;无明确要求 → null)
- refs_style:参考文献样式,枚举 apa | gb7714 | author_year | numbered | vancouver | mla | chicago | other(无法判断 → null)
- anonymous:是否要求匿名/双盲评审(true / false / null)
# 凭证(强制)
- 每个非 null 字段必须给 source_quotes[字段名]:从正文【逐字】摘录的 1-3 句原文,
不改写、不翻译、不丢掉含关键数字的句子。
- source_quotes["_general"]:整体最有凭证价值的 1-3 条原文摘录。
- confidence:{"overall": 0-1, "per_field": {"字段名": 0-1}}。
直接原文命中 ≥0.9;单位换算 0.6-0.9;靠上下文推断 <0.6。
# 诚实原则
- 正文没写到的字段一律 null,绝不用常识或训练记忆补值。
- 单位换算允许做,但该字段 confidence 不得超过 0.9。
- 换算过程、拿不准的点、页面疑似不完整,写进 notes。
# 输出
只输出一个 JSON 对象,不要代码块、不要解释文字:
{"rules": {"max_pages": null, "min_font_pt": null, "min_margin_mm": null,
"min_line_spacing": null, "min_figures": null, "max_fonts": null,
"refs_style": null, "anonymous": null},
"source_quotes": {"字段名": ["原文1", "..."], "_general": ["原文1", "..."]},
"confidence": {"overall": 0.0, "per_field": {"字段名": 0.0}},
"notes": "一句话说明抽取依据与不确定点"}"""
_USER_TMPL = """期刊:{journal_name}
=== 官方投稿指南正文(Markdown,已截断) ===
{markdown}"""
_RULE_INT_KEYS = ("max_pages", "min_figures", "max_fonts")
_REFS_ALLOWED = {"apa", "gb7714", "author_year", "numbered", "vancouver",
"mla", "chicago", "other"}
_REFS_ALIAS = {
"apa-7": "apa", "apa7": "apa", "apa 7th": "apa", "apa_7th": "apa",
"harvard": "author_year", "author-year": "author_year", "authoryear": "author_year",
"gb/t 7714": "gb7714", "gb/t-7714": "gb7714", "gb7714-2015": "gb7714",
"gb/t7714": "gb7714", "chicago author-date": "chicago",
}
# 字符串值带显式单位时的目标单位换算表(LLM 若回传原文单位的兜底;无单位=数值即目标单位)
_UNIT_TO_MM = {"mm": 1.0, "cm": 10.0, "in": 25.4, "inch": 25.4, "inches": 25.4, "pt": 25.4 / 72}
_UNIT_TO_PT = {"pt": 1.0, "mm": 72 / 25.4, "cm": 72 / 2.54, "in": 72.0, "inch": 72.0, "inches": 72.0}
def _to_int(v: Any) -> int | None:
if isinstance(v, bool) or v is None:
return None
if isinstance(v, int):
return v
if isinstance(v, float):
return int(round(v))
if isinstance(v, str):
m = re.search(r"-?\d+", v)
if m:
return int(m.group(0))
return None
def _to_float(v: Any, units: dict[str, float] | None = None) -> float | None:
if isinstance(v, bool) or v is None:
return None
if isinstance(v, (int, float)):
return float(v)
if isinstance(v, str):
m = re.search(r"(-?\d+(?:\.\d+)?)\s*([a-zA-Z]+)?", v)
if not m:
return None
x = float(m.group(1))
unit = (m.group(2) or "").lower()
if units and unit:
factor = units.get(unit)
if factor is None:
return None # 未知单位不猜
x *= factor
return x
return None
def _to_bool(v: Any) -> bool | None:
if isinstance(v, bool):
return v
if isinstance(v, (int, float)) and not isinstance(v, bool):
if v in (0, 1):
return bool(v)
if isinstance(v, str):
low = v.strip().lower()
if low in ("true", "yes", "required"):
return True
if low in ("false", "no", "not required"):
return False
return None
def _norm_refs(v: Any) -> str | None:
if not isinstance(v, str) or not v.strip():
return None
low = v.strip().lower()
low = _REFS_ALIAS.get(low, low)
return low if low in _REFS_ALLOWED else "other"
def _norm_conf(v: Any) -> float | None:
if isinstance(v, bool) or not isinstance(v, (int, float)):
return None
return max(0.0, min(1.0, float(v)))
def _normalize(raw: dict[str, Any]) -> dict[str, Any]:
"""白名单归一:类型错的值置 null(宁缺勿错,raw 全量保留在结果里)。"""
src = raw.get("rules")
src = src if isinstance(src, dict) else {}
rules: dict[str, Any] = {}
for k in _RULE_INT_KEYS:
rules[k] = _to_int(src.get(k))
rules["min_font_pt"] = _to_float(src.get("min_font_pt"), _UNIT_TO_PT)
rules["min_margin_mm"] = _to_float(src.get("min_margin_mm"), _UNIT_TO_MM)
rules["min_line_spacing"] = _to_float(src.get("min_line_spacing"))
rules["refs_style"] = _norm_refs(src.get("refs_style"))
rules["anonymous"] = _to_bool(src.get("anonymous"))
sq_src = raw.get("source_quotes")
sq_src = sq_src if isinstance(sq_src, dict) else {}
quotes: dict[str, list[str]] = {}
for key, val in sq_src.items():
if key != "_general" and key not in rules:
continue
items = val if isinstance(val, list) else [val]
cleaned = [str(x).strip() for x in items if isinstance(x, (str, int, float))
and str(x).strip()]
if cleaned:
quotes[key] = cleaned
conf_src = raw.get("confidence")
conf_src = conf_src if isinstance(conf_src, dict) else {}
pf_src = conf_src.get("per_field")
pf_src = pf_src if isinstance(pf_src, dict) else {}
per_field: dict[str, float] = {}
for k, v in pf_src.items():
c = _norm_conf(v)
if c is not None and (k in rules or k == "_general"):
per_field[k] = c
overall = _norm_conf(conf_src.get("overall"))
if overall is None and per_field:
overall = sum(per_field.values()) / len(per_field)
confidence = {"overall": overall, "per_field": per_field}
notes = raw.get("notes")
return {
"rules": rules,
"source_quotes": quotes,
"confidence": confidence,
"notes": str(notes) if notes else "",
}
def _validation_error(norm: dict[str, Any]) -> str | None:
"""强制凭证:任一非 null 字段缺 source_quotes → 拒收(ok=False)。"""
missing = [k for k, v in norm["rules"].items()
if v is not None and k not in norm["source_quotes"]]
if missing:
return f"LLM 输出缺少非 null 字段的 source_quotes:{', '.join(missing)}"
if not norm["source_quotes"].get("_general"):
return "LLM 输出缺少 source_quotes._general 整体引证"
if any(v is not None for v in norm["rules"].values()):
return None
return "LLM 未抽出任何非 null 字段(rules 全空)"
async def extract_format_rules(markdown: str, journal_name: str) -> dict:
"""markdown(≤30000 字符)+ 期刊名 → 抽取结果(schema 见模块 docstring)。"""
if not markdown or not markdown.strip():
return {"ok": False, "error": "markdown 为空", "rules": None,
"source_quotes": None, "confidence": None, "notes": None, "raw": None}
user = _USER_TMPL.format(journal_name=journal_name, markdown=markdown)
try:
raw = await complete_json(_SYSTEM, user, temperature=0.1, max_tokens=8000)
except LLMError as exc:
return {"ok": False, "error": f"LLM 调用失败:{exc}", "rules": None,
"source_quotes": None, "confidence": None, "notes": None, "raw": None}
if not isinstance(raw, dict):
return {"ok": False, "error": f"LLM 输出非 JSON 对象:{type(raw).__name__}",
"rules": None, "source_quotes": None, "confidence": None,
"notes": None, "raw": None}
norm = _normalize(raw)
err = _validation_error(norm)
if err:
logger.warning("[extract] %s 校验失败:%s", journal_name, err)
return {"ok": False, "error": err, "rules": None,
"source_quotes": norm["source_quotes"], "confidence": norm["confidence"],
"notes": norm["notes"], "raw": raw}
filled = sum(1 for v in norm["rules"].values() if v is not None)
logger.info("[extract] %s → 8 字段中 %d 个非 null", journal_name, filled)
return {"ok": True, "error": None, "rules": norm["rules"],
"source_quotes": norm["source_quotes"],
"confidence": norm["confidence"], "notes": norm["notes"], "raw": raw}
@@ -0,0 +1,356 @@
"""services/format_fetcher.py —— 投稿指南页面抓取(格式规则自动获取·第一批)。
约束(用户拍板 2026-10-10):
- 零新依赖:httpx + beautifulsoup4(venv 已装 4.15.0,用户明确指定使用;
lxml 6.1.2 在 requirements.lock 内,作 bs4 解析器)
- 同域限速 ≥ 2s(robots.txt 与正文请求共用计时器)
- 抓正文前先 GET /robots.txt,命中 Disallow → ok=False 跳过
- UA: "PlantAI-RAG-Bot/1.0 (+contact: admin@example.com)"
- 只提取正文(去导航/页脚/脚本),截断至 30000 字符
返回固定四键:{"ok": bool, "markdown": str, "error": str | None, "fetched_at": str}
"""
from __future__ import annotations
import asyncio
import logging
import re
import time
from datetime import datetime, timezone
from urllib.parse import urlparse
import httpx
from bs4 import BeautifulSoup, NavigableString
logger = logging.getLogger(__name__)
USER_AGENT = "PlantAI-RAG-Bot/1.0 (+contact: admin@example.com)"
TIMEOUT = 30.0
MAX_CHARS = 30_000
MIN_INTERVAL_PER_HOST = 2.0 # 同域请求间隔 ≥ 2s(robots 与正文共用)
_MIN_TEXT_CHARS = 200 # 正文短于此 → 疑似 JS 渲染/反爬页
_HEADERS = {
"User-Agent": USER_AGENT,
"Accept": "text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8",
"Accept-Language": "en-US,en;q=0.9",
}
# 同域限速:host → 上次请求完成时刻(monotonic)
_last_hit: dict[str, float] = {}
_throttle_lock = asyncio.Lock()
def _now_iso() -> str:
return datetime.now(timezone.utc).isoformat(timespec="seconds")
def _fail(error: str) -> dict:
return {"ok": False, "markdown": "", "error": error, "fetched_at": _now_iso()}
async def _throttle(host: str) -> None:
"""同域串行 + ≥2s 间隔(全局锁:本批抓取量小,简单可靠优先)。"""
async with _throttle_lock:
now = time.monotonic()
wait = _last_hit.get(host, now) + MIN_INTERVAL_PER_HOST - now
if wait > 0:
await asyncio.sleep(wait)
_last_hit[host] = time.monotonic()
# ---------------------------------------------------------------- robots.txt
def _parse_robots(text: str) -> list[tuple[list[str], list[tuple[str, str]]]]:
"""→ [(agents, [(kind, pattern)...]), ...](连续 UA 行同组;规则行后出现 UA=新组)。"""
groups: list[tuple[list[str], list[tuple[str, str]]]] = []
agents: list[str] = []
rules: list[tuple[str, str]] = []
for raw in text.splitlines():
line = raw.split("#", 1)[0].strip()
if not line or ":" not in line:
continue
key, _, value = line.partition(":")
key, value = key.strip().lower(), value.strip()
if key == "user-agent":
if agents and rules: # 上一组已出规则 → 当前 UA 行开新组
groups.append((agents, rules))
agents, rules = [], []
agents.append(value)
elif key in ("allow", "disallow"):
if not agents: # 无前置 UA 的规则按 * 组处理
agents = ["*"]
rules.append((key, value))
if agents:
groups.append((agents, rules))
return groups
def _robots_path_allowed(groups, path: str) -> tuple[bool, str]:
"""最长匹配决胜(同长 Allow 优先;`$` 结尾=精确匹配;空 Disallow 跳过)。"""
def matched_by(pat: str) -> bool:
if pat.endswith("$"):
return path == pat[:-1]
return path.startswith(pat)
token = "plantai-rag-bot"
matched = [rules for agents, rules in groups
if any(token in a.lower() for a in agents)]
if not matched:
matched = [rules for agents, rules in groups
if any(a.lower() == "*" for a in agents)]
if not matched:
return True, "robots.txt 无匹配组(本 bot 不受限)"
best_len, best_allow, best_pat = -1, False, ""
for rules in matched:
for kind, pat in rules:
if not pat: # "Disallow:" 空值 = 放行一切(该组无需处理)
continue
if not matched_by(pat):
continue
length = len(pat)
allow = kind == "allow"
if length > best_len or (length == best_len and allow and not best_allow):
best_len, best_allow, best_pat = length, allow, pat
if best_len < 0:
return True, "robots.txt 允许(无路径匹配)"
if best_allow:
return True, f"robots.txt Allow 命中({best_pat})"
return False, f"robots.txt Disallow 命中({best_pat})"
async def _robots_allows(client: httpx.AsyncClient, url: str) -> tuple[bool, str]:
p = urlparse(url)
robots_url = f"{p.scheme}://{p.netloc}/robots.txt"
await _throttle(p.netloc.lower())
try:
resp = await client.get(robots_url, headers=_HEADERS)
except httpx.HTTPError as exc:
return True, f"robots.txt 获取失败({type(exc).__name__}),按允许处理"
if resp.status_code != 200:
return True, f"robots.txt HTTP {resp.status_code},按允许处理"
groups = _parse_robots(resp.text)
return _robots_path_allowed(groups, p.path or "/")
# ---------------------------------------------------------------- 正文提取
_STRIP_TAGS = ("script", "style", "noscript", "iframe", "form", "nav",
"footer", "aside", "button", "select", "textarea", "input", "svg")
_STRIP_ROLES = ("navigation", "contentinfo", "complementary", "search")
# 正文容器候选(按优先级;首个文本 ≥500 字符者胜出)
_CONTENT_SELECTORS = (
"main", "article", '[role="main"]', "#content", "#main", "#main-content",
".article-body", "#article-body", ".article__body", ".hub-article-body",
".page-content", ".main-content", ".content-area",
)
_CHALLENGE_MARKERS = ("just a moment", "attention required", "captcha",
"access denied", "ddos protection", "verify you are human")
def _decode_html(resp: httpx.Response) -> str:
"""header charset → <meta charset> → utf-8(errors=replace),防 OUP/Wiley 无 header 乱码。"""
enc = None
m = re.search(r"charset=([\w.-]+)", resp.headers.get("content-type", ""), re.I)
if m:
enc = m.group(1)
if not enc:
m = re.search(rb"""charset\s*=\s*["']?([\w.-]+)""", resp.content[:4096], re.I)
if m:
enc = m.group(1).decode("ascii", "ignore")
try:
return resp.content.decode(enc or "utf-8", errors="replace")
except LookupError:
return resp.content.decode("utf-8", errors="replace")
def _squeeze(s: str) -> str:
"""行内空白压缩 + 去空行(保留单换行)。"""
lines = [re.sub(r"[ \t\r\f\v]+", " ", line).strip() for line in s.split("\n")]
return "\n".join(line for line in lines if line)
def _inline(el) -> str:
"""行内渲染:a→md链接 / strong→** / em→* / code→` / br→换行;跳过列表与图片。"""
parts: list[str] = []
for child in el.children:
name = getattr(child, "name", None)
if name is None: # NavigableString
parts.append(str(child))
continue
if name in ("ul", "ol", "img", "picture", "figure"):
continue
if name == "a":
href = (child.get("href") or "").strip()
txt = _inline(child).strip()
if not txt:
continue
parts.append(f"[{txt}]({href})" if href.startswith(("http://", "https://")) else txt)
elif name in ("strong", "b"):
parts.append(f"**{_inline(child)}**")
elif name in ("em", "i"):
parts.append(f"*{_inline(child)}*")
elif name == "code":
parts.append(f"`{_inline(child).strip()}`")
elif name == "br":
parts.append("\n")
else:
parts.append(_inline(child))
return "".join(parts)
def _list_md(el, ordered: bool) -> str:
lines: list[str] = []
idx = 1
for li in el.find_all("li", recursive=False):
# li 文本不含嵌套列表(嵌套列表随后缩进输出)
buf = []
for child in li.children:
if getattr(child, "name", None) in ("ul", "ol"):
continue
buf.append(_inline(child) if getattr(child, "name", None) else str(child))
txt = " ".join("".join(buf).split())
if txt:
lines.append(f"{idx}. {txt}" if ordered else f"- {txt}")
idx += 1
for nested in li.find_all(("ul", "ol"), recursive=False):
sub = _list_md(nested, nested.name == "ol")
if sub:
lines.extend(" " + line for line in sub.split("\n"))
return "\n".join(lines)
def _table_md(table) -> str | None:
rows: list[list[str]] = []
for tr in table.find_all("tr"):
cells = [" ".join(_squeeze(_inline(c)).split())
for c in tr.find_all(("td", "th"))]
if cells:
rows.append(cells)
if not rows:
return None
out = ["| " + " | ".join(rows[0]) + " |"]
if table.find("th"): # 首行含表头 → 补分隔行(合法 GFM 表)
out.append("| " + " | ".join(["---"] * len(rows[0])) + " |")
out += ["| " + " | ".join(r) + " |" for r in rows[1:]]
return "\n".join(out)
def _blocks(el, out: list[str]) -> None:
for child in el.children:
name = getattr(child, "name", None)
if name is None: # 裸文本
txt = _squeeze(str(child))
if txt:
out.append(txt)
continue
if name in _STRIP_TAGS:
continue
if name in ("h1", "h2", "h3", "h4", "h5", "h6"):
txt = " ".join(_squeeze(_inline(child)).split())
if txt:
out.append("#" * int(name[1]) + " " + txt)
elif name == "p":
txt = _squeeze(_inline(child))
if txt:
out.append(txt)
elif name in ("ul", "ol"):
md = _list_md(child, name == "ol")
if md:
out.append(md)
elif name == "table":
md = _table_md(child)
if md:
out.append(md)
elif name == "blockquote":
txt = _squeeze(_inline(child))
if txt:
out.append("\n".join("> " + line for line in txt.split("\n")))
elif name == "pre":
code = child.get_text().strip("\n")
if code.strip():
out.append("```\n" + code + "\n```")
elif name == "hr":
out.append("---")
else: # div/section/article/main/figure/dl/details/… 容器递归
_blocks(child, out)
def _html_to_markdown(html: str) -> tuple[str, str | None]:
"""→ (markdown, error)。选正文容器 → 去壳 → DOM 递归转 Markdown。"""
soup = BeautifulSoup(html, "lxml") # lxml 在 lock 内;缺时 bs4 自动回退 html.parser
title = (soup.title.get_text() if soup.title else "") or ""
for tag in soup.find_all(_STRIP_TAGS):
tag.decompose()
for tag in soup.find_all(attrs={"role": _STRIP_ROLES}):
tag.decompose()
container = None
fallback_hits = []
for sel in _CONTENT_SELECTORS:
for node in soup.select(sel):
text_len = len(node.get_text(" ", strip=True))
fallback_hits.append((text_len, node))
if text_len >= 500:
container = node
break
if container is not None:
break
if container is None:
if fallback_hits:
container = max(fallback_hits, key=lambda x: x[0])[1]
else:
container = soup.body or soup
blocks: list[str] = []
_blocks(container, blocks)
md = "\n\n".join(blocks)
probe = (title + " " + md[:500]).lower()
marker = next((m for m in _CHALLENGE_MARKERS if m in probe), None)
if marker:
return "", f"疑似反爬/挑战页(命中 {marker!r},title={title[:80]!r})"
if len(md) < _MIN_TEXT_CHARS:
return "", f"正文提取过短({len(md)} < {_MIN_TEXT_CHARS} 字符),疑似 JS 渲染或空壳页"
if len(md) > MAX_CHARS:
md = md[:MAX_CHARS - 1] + "…"
return md, None
# ---------------------------------------------------------------- 入口
async def fetch_submission_guidelines(url: str) -> dict:
"""抓投稿指南页面 → 正文 Markdown。
流程:robots.txt 检查(≥2s 限速)→ 禁止即跳过 → GET 正文(≥2s 限速)
→ 状态/类型校验 → 正文提取 → 截断 30000 字符。
"""
parsed = urlparse(url)
if parsed.scheme not in ("http", "https") or not parsed.netloc:
return _fail(f"非法 URL:{url!r}")
host = parsed.netloc.lower()
async with httpx.AsyncClient(follow_redirects=True, timeout=TIMEOUT) as client:
allowed, robots_reason = await _robots_allows(client, url)
if not allowed:
logger.info("[fetch] robots 禁止,跳过 %s(%s)", url, robots_reason)
return _fail(robots_reason)
await _throttle(host)
try:
resp = await client.get(url, headers=_HEADERS)
except httpx.HTTPError as exc:
return _fail(f"请求失败({type(exc).__name__}):{exc}")
if resp.status_code != 200:
return _fail(f"HTTP {resp.status_code}")
ctype = resp.headers.get("content-type", "")
if "html" not in ctype and "xhtml" not in ctype:
return _fail(f"非 HTML 响应:{ctype or '无 Content-Type'}")
markdown, err = _html_to_markdown(_decode_html(resp))
if err:
return _fail(f"{err}(robots: {robots_reason})")
logger.info("[fetch] %s → %d 字符(robots: %s)", url, len(markdown), robots_reason)
return {"ok": True, "markdown": markdown, "error": None, "fetched_at": _now_iso()}
+223
View File
@@ -0,0 +1,223 @@
"""services/journal_kb.py —— 期刊 scope_desc → vstore 入库 + 向量匹配(只读消费 8094)。
链路(全部复用 vstore 既有 API,零改动):
1. ensure_scope_docs:各期刊 scope_desc 以 .txt 入库(category=journal_scope,
name=期刊名),document_id 回写 journals.vstore_doc_id(幂等:已有 id 不重灌)。
2. match:GET /api/vstore/search-chunks?q=<摘要截断>&doc_ids=<id 白名单>&top_k=N
→ 按 doc_id 映射回期刊,取该期刊最高 chunk 分数为 similarity。
3. 自愈:白名单命中 0 条 → GET /documents/{id} 探活 → 失效的重灌(vstore 去重
语义下同内容重灌会换 doc_id,需回写)→ 重试一次 → 仍 0 视为语义低相似。
错误语义:连通性/上游异常抛 MatchError(路由降级为全量候选);
返回 ([], False) 表示检索成功但无有效匹配(路由同样降级)。
"""
from __future__ import annotations
import logging
from typing import Any
import httpx
from ..config import get_settings
from ..db import set_vstore_doc_id
logger = logging.getLogger(__name__)
SCOPE_CATEGORY = "journal_scope"
class MatchError(Exception):
"""vstore 向量匹配失败(不可达/响应异常)。"""
def _timeout() -> httpx.Timeout:
t = get_settings().vstore_match_timeout
return httpx.Timeout(connect=5.0, read=t, write=t, pool=5.0)
def _err_body(resp: httpx.Response) -> str:
try:
payload = resp.json()
except ValueError:
return (resp.text or "").strip()[:500] or "(空响应体)"
if isinstance(payload, dict):
err = payload.get("error")
if isinstance(err, dict) and err.get("message"):
return str(err["message"])
if isinstance(err, str):
return err
return str(payload)[:500]
async def _ingest_scope(client: httpx.AsyncClient, base: str, journal: dict[str, Any]) -> str:
"""单本期刊 scope_desc 入库,返回 document_id。"""
content = str(journal.get("scope_desc") or "").strip()
if not content:
raise MatchError(f"期刊 scope_desc 为空:{journal.get('id')}")
jid = str(journal.get("id") or "")
try:
resp = await client.post(
f"{base}/api/vstore/ingest",
files={"file": (f"{jid}.txt", content.encode("utf-8"), "text/plain")},
data={
"name": str(journal.get("name") or jid),
"category": SCOPE_CATEGORY,
"description": "review_service 期刊范围种子(scope_desc 向量匹配)",
},
)
except httpx.HTTPError as exc:
raise MatchError(f"vstore 不可达({base}):{exc}") from exc
if resp.status_code >= 400:
raise MatchError(f"vstore ingest 失败(HTTP {resp.status_code}):{_err_body(resp)}")
try:
payload = resp.json()
except ValueError as exc:
raise MatchError(f"vstore ingest 响应非 JSON:{exc}") from exc
if not isinstance(payload, dict) or not payload.get("ok"):
raise MatchError(
str((payload.get("error") or {}).get("message") if isinstance(payload, dict) else "") or "vstore ingest 失败"
)
doc_id = str((payload.get("item") or {}).get("document_id") or "")
if not doc_id:
raise MatchError("vstore ingest 响应缺少 document_id")
return doc_id
async def ensure_scope_docs(journals: list[dict[str, Any]]) -> list[dict[str, Any]]:
"""补齐缺失的 scope 入库映射(就地回写 vstore_doc_id 并持久到 DB)。"""
settings = get_settings()
missing = [j for j in journals if not j.get("vstore_doc_id")]
if not missing:
return journals
async with httpx.AsyncClient(timeout=_timeout()) as client:
for j in missing:
try:
doc_id = await _ingest_scope(client, settings.vstore_base, j)
except MatchError as exc:
# 单本失败不阻断其余(该期刊将不进白名单,由路由降级兜底)
logger.warning("journal_kb: scope 入库失败(%s):%s", j.get("id"), exc)
continue
j["vstore_doc_id"] = doc_id
await set_vstore_doc_id(str(j["id"]), doc_id)
return journals
async def _search(
client: httpx.AsyncClient, base: str, query: str, doc_ids: list[str]
) -> list[dict[str, Any]]:
"""chunk 级白名单检索。连通/上游错误抛 MatchError。"""
if not doc_ids:
# doc_ids 为空时 vstore 侧等于不过滤 → 会命中用户私有库,必须拦死
raise MatchError("白名单为空,拒绝全库检索")
try:
resp = await client.get(
f"{base}/api/vstore/search-chunks",
params={
"q": query,
"top_k": get_settings().recommend_scope_top_k,
"doc_ids": ",".join(doc_ids),
},
)
except httpx.HTTPError as exc:
raise MatchError(f"vstore search-chunks 不可达:{exc}") from exc
if resp.status_code >= 400:
raise MatchError(f"vstore search-chunks 失败(HTTP {resp.status_code}):{_err_body(resp)}")
try:
payload = resp.json()
except ValueError as exc:
raise MatchError(f"vstore search-chunks 响应非 JSON:{exc}") from exc
if not isinstance(payload, dict) or not payload.get("ok"):
raise MatchError(
str((payload.get("error") or {}).get("message") if isinstance(payload, dict) else "") or "vstore search-chunks 失败"
)
items = payload.get("items")
return items if isinstance(items, list) else []
async def _doc_alive(client: httpx.AsyncClient, base: str, doc_id: str) -> bool:
try:
resp = await client.get(f"{base}/api/vstore/documents/{doc_id}")
except httpx.HTTPError:
return False
if resp.status_code != 200:
return False
try:
payload = resp.json()
except ValueError:
return False
return bool(isinstance(payload, dict) and payload.get("ok"))
async def _refresh_dead_docs(
client: httpx.AsyncClient, base: str, journals: list[dict[str, Any]]
) -> None:
"""白名单 0 命中时探活:失效文档重灌并回写新 id。"""
for j in journals:
doc_id = str(j.get("vstore_doc_id") or "")
if not doc_id or await _doc_alive(client, base, doc_id):
continue
try:
new_id = await _ingest_scope(client, base, j)
except MatchError as exc:
logger.warning("journal_kb: scope 重灌失败(%s):%s", j.get("id"), exc)
continue
j["vstore_doc_id"] = new_id
await set_vstore_doc_id(str(j["id"]), new_id)
async def match(
abstract: str, journals: list[dict[str, Any]]
) -> tuple[list[dict[str, Any]], bool]:
"""摘要 vs scope_desc 向量匹配。
返回 (candidates, vector_ok);candidates 元素:
{"journal": <journals 行>, "similarity": float}
按 similarity 降序。MatchError → 路由降级;([], False) → 语义低相似。
"""
settings = get_settings()
query = abstract.strip()[: settings.recommend_query_chars]
if not query:
return [], False
await ensure_scope_docs(journals)
whitelisted = [j for j in journals if j.get("vstore_doc_id")]
if not whitelisted:
raise MatchError("无任何期刊 scope 入库成功(vstore_doc_id 为空)")
doc_map = {str(j["vstore_doc_id"]): j for j in whitelisted}
timeout = _timeout()
async with httpx.AsyncClient(timeout=timeout) as client:
items = await _search(client, settings.vstore_base, query, list(doc_map))
if not items:
await _refresh_dead_docs(client, settings.vstore_base, whitelisted)
doc_map = {str(j["vstore_doc_id"]): j for j in whitelisted if j.get("vstore_doc_id")}
if not doc_map:
return [], False
items = await _search(client, settings.vstore_base, query, list(doc_map))
# 聚合:每本期刊取最高 chunk 分
best: dict[str, float] = {}
for item in items:
if not isinstance(item, dict):
continue
j = doc_map.get(str(item.get("doc_id") or ""))
if j is None:
continue
try:
score = float(item.get("score"))
except (TypeError, ValueError):
continue
jid = str(j["id"])
if jid not in best or score > best[jid]:
best[jid] = score
if not best:
return [], False
by_id = {str(j["id"]): j for j in journals}
candidates = [
{"journal": by_id[jid], "similarity": score}
for jid, score in best.items()
if jid in by_id
]
candidates.sort(key=lambda c: c["similarity"], reverse=True)
return candidates, bool(candidates)
+210
View File
@@ -0,0 +1,210 @@
"""services/journal_rank.py —— LLM 重排 + 幻觉防护 + 三档归类。
职责:
1. rerank:把带语义分的候选期刊(来自 journal_kb)+ 用户偏好交给 LLM,
要求按 id 白名单返回 {rankings:[{id, tier, match_reason, risk_note}]}。
2. validate:硬校验——白名单外 id 丢弃(幻觉拦截);tier 非法/LLM 缺漏的
期刊按规则补位(绝不因 LLM 输出丢失候选期刊);期刊名称/指标一律不采信
LLM,最终展示全部用 DB 字段(防止改名型幻觉)。
3. fallback_rankings:LLM 不可用时的确定性规则分档(按 impact_factor)。
三档语义:challenge 挑战型(高影响/慢审稿)、fit 适配型(均衡)、
safe 稳妥型(快速/门槛低)。
"""
from __future__ import annotations
import json
from dataclasses import dataclass
from typing import Any
from ..config import get_settings
from . import llm
TIERS = ("challenge", "fit", "safe")
TIER_LABELS = {
"challenge": "挑战型(高影响因子/慢审稿)",
"fit": "适配型(中等影响/周期适中)",
"safe": "稳妥型(快速发表/门槛较低)",
}
# 规则分档阈值(近似值,可后续配置化)
_CHALLENGE_MIN_IF = 9.0
_SAFE_MAX_IF = 4.0
# tier 同义词归一(LLM 偶发中文标签)
_TIER_ALIASES = {
"挑战": "challenge",
"挑战型": "challenge",
"高风险": "challenge",
"适配": "fit",
"适配型": "fit",
"稳妥": "safe",
"稳妥型": "safe",
"低风险": "safe",
}
SYSTEM_PROMPT = """你是学术投稿推荐专家(植物基因组学方向)。根据给定候选期刊、论文摘要与用户偏好,为**每一个**候选期刊输出推荐分档与理由。
硬规则(违反即视为无效输出):
1. id 白名单:只能使用输入 candidates 中出现的 id;绝对禁止添加、替换或臆造列表之外的任何期刊。
2. 每个输入 id 恰好输出一次,不得遗漏、不得重复;期刊名称等元数据由系统填充,你只输出 id。
3. tier 只能取 challenge | fit | safe:
- challenge(挑战型):高影响因子、审稿较慢或竞争激烈的期刊
- fit(适配型):影响力与发表周期均衡、与论文契合的期刊
- safe(稳妥型):审稿较快、门槛较低、命中概率较高的期刊
4. match_reason:中文,1-2 句,结合摘要的研究主题与该刊 scope_desc 及指标(如有 similarity 一并参考),说明为何匹配/不匹配。
5. risk_note:中文,1-2 句,指出投稿风险(超出用户偏好、IF 门槛偏高、范围匹配偏弱、审稿周期长等);无明显风险写「无」。
6. 用户 preferences 为软约束:不满足偏好的期刊仍必须输出,并在 risk_note 中明确说明。
7. 不确定时宁可保守陈述,禁止编造统计数据(录用率、审稿天数等)。
输出:仅一个 JSON 对象,格式:
{"rankings":[{"id":"...","tier":"challenge","match_reason":"...","risk_note":"..."}]}
不要输出任何 JSON 之外的内容。"""
class RankError(Exception):
"""LLM 输出形态异常(无法按 JSON 解析/结构非法)。"""
@dataclass
class Ranking:
journal_id: str
tier: str
match_reason: str
risk_note: str
def rule_tier(journal: dict[str, Any]) -> str:
"""确定性分档规则(LLM 缺漏/不可用时兜底)。"""
inf = journal.get("impact_factor")
weeks = journal.get("review_time_weeks")
if isinstance(inf, (int, float)):
if inf >= _CHALLENGE_MIN_IF:
return "challenge"
if inf <= _SAFE_MAX_IF:
return "safe"
elif isinstance(weeks, (int, float)) and weeks <= 4:
return "safe"
return "fit"
def build_user_prompt(
abstract: str,
candidates: list[dict[str, Any]],
preferences: dict[str, Any],
) -> str:
"""候选 + 偏好 + 摘要 → 用户消息(JSON)。"""
payload = {
"abstract": abstract.strip()[:4000],
"preferences": preferences or {},
"candidates": [
{
"id": str(c["journal"]["id"]),
"name": str(c["journal"].get("name") or ""),
"impact_factor": c["journal"].get("impact_factor"),
"review_time_weeks": c["journal"].get("review_time_weeks"),
"acceptance_rate": c["journal"].get("acceptance_rate"),
"similarity": c.get("similarity"),
"scope_desc": str(c["journal"].get("scope_desc") or "")[:400],
}
for c in candidates
],
}
return json.dumps(payload, ensure_ascii=False)
def _normalize_tier(raw: Any) -> str | None:
tier = str(raw or "").strip().lower()
tier = _TIER_ALIASES.get(str(raw or "").strip(), tier)
return tier if tier in TIERS else None
def validate_rankings(
payload: Any, candidates: list[dict[str, Any]]
) -> tuple[list[Ranking], int, int]:
"""校验 LLM 输出。
返回 (rankings, dropped_hallucinated, repaired):
- 白名单外 id / 重复 id → 丢弃并计数(repaired 中重复不计);
- tier 非法、LLM 缺漏的 id → 按规则补位(repaired 计数)。
"""
if not isinstance(payload, dict) or not isinstance(payload.get("rankings"), list):
raise RankError("LLM 输出缺少 rankings 数组")
by_id = {str(c["journal"]["id"]): c["journal"] for c in candidates}
input_ids = list(by_id)
seen: set[str] = set()
rankings: list[Ranking] = []
dropped = 0
repaired = 0
for entry in payload["rankings"]:
if not isinstance(entry, dict):
dropped += 1
continue
jid = str(entry.get("id") or "").strip()
if jid in seen:
continue
if jid not in by_id:
dropped += 1 # 幻觉期刊:绝不进输出
continue
seen.add(jid)
tier = _normalize_tier(entry.get("tier"))
if tier is None:
tier = rule_tier(by_id[jid])
repaired += 1
reason = str(entry.get("match_reason") or "").strip() or "基于期刊范围与指标的匹配"
risk = str(entry.get("risk_note") or "").strip() or "无"
rankings.append(Ranking(journal_id=jid, tier=tier, match_reason=reason, risk_note=risk))
for jid in input_ids:
if jid in seen:
continue
rankings.append(
Ranking(
journal_id=jid,
tier=rule_tier(by_id[jid]),
match_reason="LLM 未给出该期刊条目,已按影响因子/周期规则补位",
risk_note="未提供(LLM 输出缺漏,规则兜底)",
)
)
repaired += 1
return rankings, dropped, repaired
async def rerank(
abstract: str,
candidates: list[dict[str, Any]],
preferences: dict[str, Any],
) -> tuple[list[Ranking], int, int]:
"""LLM 重排 + 校验。LLMError / RankError 上抛(路由降级为规则分档)。"""
settings = get_settings()
payload = await llm.complete_json(
SYSTEM_PROMPT,
build_user_prompt(abstract, candidates, preferences),
temperature=0.2,
max_tokens=3000,
timeout=settings.recommend_read_timeout,
)
return validate_rankings(payload, candidates)
def fallback_rankings(candidates: list[dict[str, Any]]) -> list[Ranking]:
"""LLM 不可用时的确定性分档(不丢任何候选期刊)。"""
rankings: list[Ranking] = []
for c in candidates:
j = c["journal"]
inf = j.get("impact_factor")
weeks = j.get("review_time_weeks")
rankings.append(
Ranking(
journal_id=str(j["id"]),
tier=rule_tier(j),
match_reason=(
f"规则分档:影响因子 {inf if inf is not None else '未收录'}、"
f"审稿约 {weeks if weeks is not None else '未收录'} 周"
),
risk_note="LLM 不可用,本条按影响因子/周期规则估算",
)
)
return rankings
+520
View File
@@ -0,0 +1,520 @@
"""app/services/journal_seed.py —— journal_directory 核心导入逻辑(CLI 与启动 seed 共享)。
数据流(schema 仍由本模块独家拥有,app 路由层只读不建表):
openpyxl 非 read_only 加载(读 cell.hyperlink.target 来源链接)
→ 「国际期刊」「中文期刊」两 sheet 按【列名】映射
→ 行级清洗(空→None 绝不填 0;分区数字→"N区";JCR学科→JSON 数组)
→ 按 id 幂等 upsert(ON CONFLICT DO UPDATE,重跑 count 不变)
两个入口:
- scripts/import_journals.py(CLI):extract_rows_from_xlsx + upsert_to_db
+ 对账报告(exit code 语义见脚本 docstring)
- ensure_journal_directory_seeded():服务启动自动 seed(main.py lifespan),
仅当表不存在或为空才导入;任何失败收敛为 dict 返回值,绝不抛异常。
v4 源(2026-10-10):JIF=2025 统计年/2026 JCR 发布;中文 IF=2024 统计年/
年报 2025 版。源 xlsx 路径走 settings.journal_directory_seed_abs
(REVIEW_JOURNAL_DIRECTORY_SEED_PATH 覆盖)。
id 策略:有 ISSN → "{lang}:{ISSN}"; 无 ISSN → "{lang}:{slug(name)}";
同 lang 内冲突 → 抛 JournalSeedError(CLI 中止导入 / startup 返回 error)。
"""
from __future__ import annotations
import json
import re
import sqlite3
import unicodedata
from collections import Counter
from datetime import datetime
from pathlib import Path
from typing import Any
import openpyxl
from ..config import get_settings
SHEET_INTL = "国际期刊"
SHEET_ZH = "中文期刊"
EXPECT_INTL = 779 # 口径 sheet 声明(v4 不变)
EXPECT_ZH = 277
# 官网列(v4 实际列名「官网网址」在首位;其余为历史/备用别名)
OFFICIAL_URL_HEADERS = ("官网网址", "官网", "官方网址", "期刊官网")
# JCR 学科列别名:v4 改名「JCR学科(2024源表)」,v2 为「JCR学科(源表)」
JCR_DISCIPLINE_HEADERS = ("JCR学科(2024源表)", "JCR学科(源表)")
# 既有表缺列时的幂等迁移(缺哪加哪,重复跑不报错)
MIGRATE_COLS = (
("official_url", "TEXT"),
("official_check_status", "TEXT"),
("jcr_release_year", "INTEGER"),
)
SCHEMA_SQL = """
CREATE TABLE IF NOT EXISTS journal_directory (
id TEXT PRIMARY KEY,
lang TEXT NOT NULL,
name TEXT NOT NULL,
research_direction TEXT,
cas_partition TEXT,
cas_partition_note TEXT,
cas_partition_year INTEGER,
jif REAL,
jif_year INTEGER,
jif_note TEXT,
jif_check_status TEXT,
composite_impact_factor REAL,
comprehensive_impact_factor REAL,
metric_year INTEGER,
metric_report_year INTEGER,
metric_caliber TEXT,
annual_report_page INTEGER,
top_flag TEXT,
publisher_series TEXT,
journal_mark TEXT,
article_type TEXT,
issn TEXT,
eissn TEXT,
jcr_disciplines TEXT,
supplement_note TEXT,
evidence_note TEXT,
official_url TEXT,
official_check_status TEXT,
jcr_release_year INTEGER,
partition_source TEXT,
jif_source TEXT,
jif_source_url TEXT,
partition_source_url TEXT,
data_source_label TEXT,
data_source_url TEXT,
imported_at TEXT
);
CREATE INDEX IF NOT EXISTS idx_dir_lang_name ON journal_directory(lang, name);
CREATE INDEX IF NOT EXISTS idx_dir_lang_jif ON journal_directory(lang, jif);
CREATE INDEX IF NOT EXISTS idx_dir_lang_cif ON journal_directory(lang, composite_impact_factor);
CREATE INDEX IF NOT EXISTS idx_dir_lang_part ON journal_directory(lang, cas_partition);
CREATE INDEX IF NOT EXISTS idx_dir_lang_domain ON journal_directory(lang, research_direction);
"""
# upsert 列序(除 id 外全部 ON CONFLICT DO UPDATE)
COLS = (
"lang", "name", "research_direction", "cas_partition", "cas_partition_note",
"cas_partition_year", "jif", "jif_year", "jif_note", "jif_check_status",
"composite_impact_factor", "comprehensive_impact_factor", "metric_year",
"metric_report_year", "metric_caliber", "annual_report_page", "top_flag",
"publisher_series", "journal_mark", "article_type", "issn", "eissn",
"jcr_disciplines", "supplement_note", "evidence_note", "official_url",
"official_check_status", "jcr_release_year",
"partition_source", "jif_source", "jif_source_url", "partition_source_url",
"data_source_label", "data_source_url", "imported_at",
)
UPSERT_SQL = (
"INSERT INTO journal_directory (id, " + ", ".join(COLS) + ") VALUES ("
+ ", ".join("?" for _ in range(len(COLS) + 1)) + ") "
+ "ON CONFLICT(id) DO UPDATE SET "
+ ", ".join(f"{c}=excluded.{c}" for c in COLS)
)
class JournalSeedError(Exception):
"""xlsx 缺失/结构错误/口径不符/id 冲突(不写库)。
exit_code 对齐 CLI 语义:1=id 冲突中止;2=行数与口径不符;3=文件/结构错误。
"""
def __init__(
self,
message: str,
*,
exit_code: int = 3,
stage: str = "读取失败",
conflicts: list[str] | None = None,
) -> None:
super().__init__(message)
self.exit_code = exit_code
self.stage = stage
self.conflicts = conflicts or []
def new_stats() -> dict[str, Any]:
"""对账统计骨架(CLI 报告与解析共享)。"""
return {
"read_intl": 0, "read_zh": 0, "success": 0, "skipped": 0, "failed": 0,
"jif_missing": [], "cif_missing": [], "part_blank": [], "part_notfound": [],
"part_dist": Counter(), "hl_jif": 0, "hl_part": 0, "hl_zh": 0,
"id_issn": 0, "id_slug": 0, "official_url_detected": False,
"migrated_cols": [], "migrated_skipped": [],
"official_total": 0, "official_filled": 0, "official_check_filled": 0,
"jcr_filled": 0, "official_missing": [],
}
def migrate(conn: sqlite3.Connection) -> tuple[list[str], list[str]]:
"""幂等加列:PRAGMA 探测现有列,缺哪个 ALTER ADD 哪个。"""
existing = {r[1] for r in conn.execute("PRAGMA table_info(journal_directory)")}
added: list[str] = []
skipped: list[str] = []
for col, decl in MIGRATE_COLS:
if col in existing:
skipped.append(col)
else:
conn.execute(f"ALTER TABLE journal_directory ADD COLUMN {col} {decl}")
added.append(col)
conn.commit()
return added, skipped
# ---- 清洗原语 ----
def text(v: Any) -> str | None:
"""单元格 → strip 后的文本;空/纯空白 → None(绝不填 0/空串)。"""
if v is None:
return None
s = str(v).strip()
return s or None
def to_float(v: Any) -> float | None:
if v is None or (isinstance(v, str) and not v.strip()):
return None
try:
return float(v)
except (TypeError, ValueError):
return None
def to_int(v: Any) -> int | None:
f = to_float(v)
if f is None:
return None
return int(f)
def slugify(name: str) -> str:
"""小写 + 非词字符折叠为连字符;\\w 含 CJK(中文期刊无 ISSN 时的 id 兜底)。"""
s = unicodedata.normalize("NFC", name.strip().casefold())
s = re.sub(r"[^\w]+", "-", s, flags=re.UNICODE)
s = re.sub(r"-{2,}", "-", s)
return s.strip("-")
def make_id(lang: str, name: str, issn: str | None) -> str:
if issn:
return f"{lang}:{issn}"
return f"{lang}:{slugify(name)}"
def parse_partition(raw: Any) -> tuple[str | None, str | None]:
"""分区 → (cas_partition, note)。数字 1-4 → 'N区';'未检得' → note;空白 → 双 None。"""
if raw is None:
return None, None
if isinstance(raw, (int, float)) and not isinstance(raw, bool):
n = int(raw)
if 1 <= n <= 4:
return f"{n}区", None
return None, None
s = str(raw).strip()
if not s:
return None, None
if "未检得" in s:
return None, "未检得"
m = re.fullmatch(r"([1-4])\s*区?", s)
if m:
return f"{m.group(1)}区", None
return s, None # 未知文本:原样保留(不丢信息)
def split_disciplines(raw: Any) -> str | None:
"""'A(SCIE);B(SCIE)' → JSON 数组字符串。"""
s = text(raw)
if not s:
return None
parts = [p.strip() for p in s.split(";") if p.strip()]
return json.dumps(parts, ensure_ascii=False) if parts else None
def hyperlink_target(cell) -> str | None:
"""超链接单元格 → target URL;无链接 → None(需要非 read_only 模式)。"""
try:
target = cell.hyperlink.target if cell.hyperlink is not None else None
except Exception: # noqa: BLE001
return None
return text(target)
# ---- sheet 解析 ----
def header_index(ws) -> dict[str, int]:
headers = [text(c.value) for c in ws[1]]
return {h: i for i, h in enumerate(headers) if h is not None}
def read_intl(ws, imported_at: str, stats: dict) -> list[tuple]:
"""国际期刊 sheet → 行元组(顺序同 COLS 前置 id)。"""
ix = header_index(ws)
for req in ("期刊名称", "研究方向", "中科院分区", "JIF影响因子"):
if req not in ix:
raise JournalSeedError(
f"{SHEET_INTL} 缺列:{req}(实际列:{list(ix)})",
exit_code=3, stage="结构错误",
)
url_col = next((ix[h] for h in OFFICIAL_URL_HEADERS if h in ix), None)
jcr_hdr = next((h for h in JCR_DISCIPLINE_HEADERS if h in ix), None)
stats["official_url_detected"] = url_col is not None
if url_col is not None:
stats["official_url_headers"] = next(h for h in OFFICIAL_URL_HEADERS if h in ix)
rows: list[tuple] = []
for row in ws.iter_rows(min_row=2):
if not any(c.value is not None for c in row):
continue # 尾部幻影空行:不计入 skipped
name = text(row[ix["期刊名称"]].value) if ix["期刊名称"] < len(row) else None
if not name:
stats["skipped"] += 1
continue
issn = text(row[ix["ISSN"]].value) if "ISSN" in ix else None
jif = to_float(row[ix["JIF影响因子"]].value)
check_status = text(row[ix["JIF核对状态"]].value) if "JIF核对状态" in ix else None
official_check = text(row[ix["官网核对状态"]].value) if "官网核对状态" in ix else None
jcr_year = to_int(row[ix["JCR发布年"]].value) if "JCR发布年" in ix else None
part, part_note = parse_partition(row[ix["中科院分区"]].value)
# JIF 空 → note = 核对状态原文("未检得"/"源表标N/A" 等说明)
jif_note = check_status if jif is None else None
jif_url = hyperlink_target(row[ix["JIF数据来源"]]) if "JIF数据来源" in ix else None
part_url = hyperlink_target(row[ix["分区数据来源"]]) if "分区数据来源" in ix else None
official = None
if url_col is not None and url_col < len(row):
official = text(row[url_col].value) or hyperlink_target(row[url_col])
rows.append((
make_id("en", name, issn), "en", name,
text(row[ix["研究方向"]].value),
part, part_note,
to_int(row[ix["分区版本年"]].value) if "分区版本年" in ix else None,
jif,
to_int(row[ix["JIF统计年"]].value) if "JIF统计年" in ix else None,
jif_note, check_status,
None, None, None, None, None, None,
text(row[ix["Top(源表)"]].value) if "Top(源表)" in ix else None,
text(row[ix["出版系列"]].value) if "出版系列" in ix else None,
text(row[ix["期刊标记"]].value) if "期刊标记" in ix else None,
text(row[ix["文章类型"]].value) if "文章类型" in ix else None,
issn,
text(row[ix["eISSN"]].value) if "eISSN" in ix else None,
split_disciplines(row[ix[jcr_hdr]].value) if jcr_hdr else None,
text(row[ix["补充说明"]].value) if "补充说明" in ix else None,
text(row[ix["补充证据"]].value) if "补充证据" in ix else None,
official,
official_check,
jcr_year,
"official", "official",
jif_url, part_url,
text(row[ix["JIF数据来源"]].value) if "JIF数据来源" in ix else None,
None, # data_source_url(国际表来源即 jif/partition 两链接)
imported_at,
))
# 统计
stats["official_total"] += 1
stats["official_filled"] += 1 if official else 0
stats["official_check_filled"] += 1 if official_check else 0
stats["jcr_filled"] += 1 if jcr_year else 0
if not official:
stats["official_missing"].append(("en", name))
if jif is None:
stats["jif_missing"].append((name, check_status or ""))
if part is None and part_note == "未检得":
stats["part_notfound"].append(name)
elif part is None:
stats["part_blank"].append(name)
stats["hl_jif"] += 1 if jif_url else 0
stats["hl_part"] += 1 if part_url else 0
stats["id_issn" if issn else "id_slug"] += 1
return rows
def read_zh(ws, imported_at: str, stats: dict) -> list[tuple]:
"""中文期刊 sheet → 行元组。"""
ix = header_index(ws)
for req in ("中文期刊名称", "复合影响因子", "综合影响因子"):
if req not in ix:
raise JournalSeedError(
f"{SHEET_ZH} 缺列:{req}(实际列:{list(ix)})",
exit_code=3, stage="结构错误",
)
url_col = next((ix[h] for h in OFFICIAL_URL_HEADERS if h in ix), None)
stats["official_url_detected_zh"] = url_col is not None
rows: list[tuple] = []
for row in ws.iter_rows(min_row=2):
if not any(c.value is not None for c in row):
continue # 尾部幻影空行:不计入 skipped
name = text(row[ix["中文期刊名称"]].value)
if not name:
stats["skipped"] += 1
continue
composite = to_float(row[ix["复合影响因子"]].value)
comprehensive = to_float(row[ix["综合影响因子"]].value)
check_status = text(row[ix["核对状态"]].value) if "核对状态" in ix else None
src_label = text(row[ix["数据来源"]].value) if "数据来源" in ix else None
src_url = hyperlink_target(row[ix["数据来源"]]) if "数据来源" in ix else None
official = None
if url_col is not None and url_col < len(row):
official = text(row[url_col].value) or hyperlink_target(row[url_col])
official_check = text(row[ix["官网核对状态"]].value) if "官网核对状态" in ix else None
rows.append((
make_id("zh", name, None), "zh", name,
text(row[ix["研究方向"]].value),
# 中文分区原样(常量"不按此口径列示"),不分区 → partition_source=None
text(row[ix["中科院分区"]].value) if "中科院分区" in ix else None,
None, # cas_partition_note:中文表无"未检得"语义(口径=不按此口径列示)
None, # cas_partition_year
None, None, None, check_status,
composite, comprehensive,
to_int(row[ix["指标统计年"]].value) if "指标统计年" in ix else None,
to_int(row[ix["年报版本年"]].value) if "年报版本年" in ix else None,
text(row[ix["指标口径"]].value) if "指标口径" in ix else None,
to_int(row[ix["年报PDF页码"]].value) if "年报PDF页码" in ix else None,
None, None, None, None, None, None, None,
text(row[ix["备注"]].value) if "备注" in ix else None,
None, # evidence_note(中文表无此列)
official,
official_check,
None, # jcr_release_year:中文表无 JCR 发布年列(前端中文 Tab 不显示)
None, # partition_source:中文不按中科院口径
"official", # jif_source:国内年报(official)
None, None,
src_label, src_url,
imported_at,
))
stats["official_total"] += 1
stats["official_filled"] += 1 if official else 0
stats["official_check_filled"] += 1 if official_check else 0
if not official:
stats["official_missing"].append(("zh", name))
if composite is None:
stats["cif_missing"].append((name, check_status or ""))
stats["hl_zh"] += 1 if src_url else 0
stats["id_slug"] += 1
return rows
# ---- 共享主流程 ----
def extract_rows_from_xlsx(
source: Path,
*,
imported_at: str | None = None,
stats: dict | None = None,
) -> tuple[list[tuple], list[tuple], dict]:
"""xlsx → (rows_en, rows_zh, stats)。口径不符/id 冲突抛 JournalSeedError(不写库)。"""
stats = stats if stats is not None else new_stats()
imported_at = imported_at or datetime.now().isoformat(timespec="seconds")
try:
wb = openpyxl.load_workbook(source, data_only=True)
except FileNotFoundError as exc:
raise JournalSeedError(
f"源文件不存在: {source}", exit_code=3, stage="读取失败"
) from exc
except Exception as exc: # noqa: BLE001
raise JournalSeedError(
f"无法打开 Excel: {exc}", exit_code=3, stage="读取失败"
) from exc
if SHEET_INTL not in wb.sheetnames or SHEET_ZH not in wb.sheetnames:
raise JournalSeedError(
f"缺少 sheet:需要 {SHEET_INTL}/{SHEET_ZH},实际 {wb.sheetnames}",
exit_code=3, stage="结构错误",
)
rows_en = read_intl(wb[SHEET_INTL], imported_at, stats)
rows_zh = read_zh(wb[SHEET_ZH], imported_at, stats)
stats["read_intl"], stats["read_zh"] = len(rows_en), len(rows_zh)
for r in rows_en:
stats["part_dist"][r[4] or ("未检得" if r[5] else "空白")] += 1
# 口径行数校验(不符 → 抛错,不写库)
if len(rows_en) != EXPECT_INTL or len(rows_zh) != EXPECT_ZH:
raise JournalSeedError(
f"行数与口径不符:国际 {len(rows_en)}/{EXPECT_INTL}、"
f"中文 {len(rows_zh)}/{EXPECT_ZH},中止导入",
exit_code=2, stage="行数校验失败",
)
# id 冲突检测(同 lang 内重复 → 抛错,不写库)
ids = [r[0] for r in rows_en + rows_zh]
dup = [i for i, c in Counter(ids).items() if c > 1]
if dup:
conflicts = [f"{i} × {Counter(ids)[i]}" for i in sorted(dup)]
raise JournalSeedError(
f"发现 {len(conflicts)} 个重复 id,中止导入(未写库)",
exit_code=1, stage="id 冲突中止", conflicts=conflicts,
)
return rows_en, rows_zh, stats
def upsert_to_db(db_path: Path, rows_en: list[tuple], rows_zh: list[tuple]) -> dict[str, int]:
"""建表(IF NOT EXISTS)+幂等加列+upsert → {"en","zh","total"}。"""
db_path = Path(db_path)
db_path.parent.mkdir(parents=True, exist_ok=True)
conn = sqlite3.connect(str(db_path))
try:
conn.executescript(SCHEMA_SQL)
migrate(conn)
conn.executemany(UPSERT_SQL, list(rows_en) + list(rows_zh))
conn.commit()
d = dict(conn.execute(
"SELECT lang, COUNT(*) FROM journal_directory GROUP BY lang").fetchall())
return {"en": d.get("en", 0), "zh": d.get("zh", 0), "total": sum(d.values())}
finally:
conn.close()
def ensure_journal_directory_seeded(
db_path: Path | None = None,
source_xlsx: Path | None = None,
) -> dict:
"""启动自动 seed:空表才导入;任何失败收敛为 dict,绝不抛异常。
返回统一四键:seeded/reason/error/rows(另有 counts 仅成功时给出 en/zh 明细)。
- 已有数据(只认空/非空,不做补差)→ seeded=False, reason="already has N rows, skip"
- 空表导入成功 → seeded=True, rows=1056
- xlsx 缺失/结构错误/口径不符/id 冲突 → seeded=False, error="..."
"""
settings = get_settings()
db = Path(db_path) if db_path is not None else settings.db_path_abs
source = Path(source_xlsx) if source_xlsx is not None else settings.journal_directory_seed_abs
try:
if db.exists():
conn = sqlite3.connect(str(db))
try:
row = conn.execute("SELECT COUNT(*) FROM journal_directory").fetchone()
except sqlite3.OperationalError:
row = None # 表不存在 → 视为空
finally:
conn.close()
else:
row = None
if row is not None and int(row[0]) > 0:
n = int(row[0])
return {
"seeded": False, "reason": f"already has {n} rows, skip",
"error": None, "rows": n,
}
rows_en, rows_zh, _ = extract_rows_from_xlsx(source)
counts = upsert_to_db(db, rows_en, rows_zh)
return {
"seeded": True, "reason": None, "error": None,
"rows": counts["total"], "counts": counts,
}
except JournalSeedError as exc:
return {"seeded": False, "reason": None, "error": str(exc), "rows": None}
except Exception as exc: # noqa: BLE001
return {"seeded": False, "reason": None, "error": str(exc), "rows": None}
@@ -0,0 +1,869 @@
"""services/latex_compile.py —— tectonic 编译 .tex → PDF(P3a + P4 项目 zip)。
隔离与安全(对齐设计清单):
1. 一编译一目录:{reformat_dir}/{anchor_id}/compile/(input.tex/output.pdf/output.log/meta.json)
2. 文件名永不落盘:用户文件名只做后缀校验,写入一律 input.tex
3. tectonic --untrusted(官方旗标:禁用已知不安全特性,含 shell escape 路径)
4. 子进程 start_new_session + 超时 killpg(SIGKILL)(整进程组)
5. 单槽队列:asyncio.Lock + pending 计数,超出 compile_queue_limit → QueueFullError
6. 产物 PDF > max_compile_pdf_bytes → 删文件 + OutputTooLargeError
7. 启动/每次编译前机会性清扫 retention_days 天前的 job 目录(只删 12 位 hex 锚点目录)
P4 项目 zip(两段式 inspect + run,与 P3a 共享单槽队列/清扫/错误类):
- inspect_zip:安全解压(zip_safety)→ 主文件识别 → compile_inspect/{job_id}/(1h TTL)
- compile_project_job:原子 rename 消费 inspect → compile_jobs/{cid}/ → tectonic →
finally 删 project 树(只留 output.pdf/output.log/meta.json)
- 失败也保证 output.log 落盘(补充 3);classify_compile_error 给出用户友好文案
- P3a 单文件路径(prepare_input/compile_tex/_run_once)零改动
tectonic 二进制缺失 → ToolUnavailableError(路由层回安装指引)。
"""
from __future__ import annotations
import asyncio
import json
import logging
import os
import re
import shutil
import signal
import subprocess
import time
import uuid
from dataclasses import dataclass
from datetime import datetime, timezone
from pathlib import Path
from typing import Any
from ..config import get_settings
logger = logging.getLogger(__name__)
_ANCHOR_ID_RE = re.compile(r"^[0-9a-f]{12}$")
_ENGINE = "tectonic-p3/0.17.0"
_LOG_TAIL_LINES = 200
# 单槽并发控制(进程内;重启归零可接受——本服务无持久队列需求)
_lock = asyncio.Lock()
_pending = 0
class CompileError(Exception):
"""编译失败(含 log 尾)。code ∈ {COMPILE_FAILED, TIMEOUT, OUTPUT_TOO_LARGE}。"""
# compile_id:P4 项目编译失败时由 compile_project_job 附加(P3a 单文件为 None),
# 路由层据此在失败信封里回 compile_id + log_url(补充 3)。
compile_id: str | None = None
def __init__(self, code: str, message: str, log_tail: str = "") -> None:
super().__init__(message)
self.code = code
self.log_tail = log_tail
class QueueFullError(Exception):
"""等待槽位超限。"""
class ToolUnavailableError(Exception):
"""tectonic 二进制缺失/不可执行。"""
def _tectonic_bin() -> Path:
return get_settings().tectonic_abs
def _ensure_tool() -> Path:
bin_path = _tectonic_bin()
if not (bin_path.is_file() and os.access(bin_path, os.X_OK)):
raise ToolUnavailableError(
f"tectonic 未安装({bin_path})。"
"请执行:cd review_service && bash tools/install_tectonic.sh"
)
return bin_path
def _log_tail(path: Path, lines: int = _LOG_TAIL_LINES) -> str:
try:
text = path.read_text("utf-8", errors="replace")
except OSError:
return ""
return "\n".join(text.splitlines()[-lines:])
def compile_dir(anchor_id: str) -> Path:
"""{reformat_dir}/{anchor_id}/compile/(存在性由调用方按需 mkdir)。"""
return get_settings().reformat_dir_abs / anchor_id / "compile"
def prepare_input(anchor_id: str, source: str) -> Path:
"""写入隔离目录 input.tex;返回其路径。"""
cdir = compile_dir(anchor_id)
cdir.mkdir(parents=True, exist_ok=True)
input_tex = cdir / "input.tex"
input_tex.write_text(source, encoding="utf-8")
return input_tex
async def compile_tex(anchor_id: str) -> dict[str, Any]:
"""同步编译 anchor 的 input.tex(须先 prepare_input)。
→ {compile_id: anchor_id, pdf_path, log_path, seconds, pdf_bytes}
失败抛 CompileError / QueueFullError / ToolUnavailableError。
"""
global _pending
settings = get_settings()
_ensure_tool() # 快速失败:不占队列
sweep_expired()
if _pending >= settings.compile_queue_limit:
raise QueueFullError(
f"编译队列已满({_pending} 个任务排队),请稍后重试"
)
_pending += 1
try:
async with _lock:
return await _run_once(anchor_id)
finally:
_pending -= 1
async def _run_once(anchor_id: str) -> dict[str, Any]:
settings = get_settings()
cdir = compile_dir(anchor_id)
input_tex = cdir / "input.tex"
pdf_path = cdir / "output.pdf"
log_path = cdir / "output.log"
if not input_tex.is_file():
raise CompileError("COMPILE_FAILED", "编译输入不存在,请重新上传源码")
env = dict(os.environ)
env["TECTONIC_CACHE_DIR"] = str(settings.tectonic_cache_abs)
cmd = [
str(_tectonic_bin()), "-X", "compile", input_tex.name,
"--untrusted", "--keep-logs", "--outdir", ".",
]
started = time.monotonic()
try:
proc = await asyncio.create_subprocess_exec(
*cmd, cwd=cdir, env=env,
stdout=asyncio.subprocess.PIPE, stderr=asyncio.subprocess.STDOUT,
start_new_session=True,
)
try:
await asyncio.wait_for(
proc.communicate(), timeout=settings.compile_timeout_s
)
except asyncio.TimeoutError:
_kill_group(proc)
try:
await asyncio.wait_for(proc.wait(), timeout=5.0)
except asyncio.TimeoutError:
pass
log_path.write_text(_log_tail(log_path) + "\n[timeout] 编译超时,进程已终止",
encoding="utf-8")
raise CompileError(
"TIMEOUT",
f"编译超过 {settings.compile_timeout_s:g} 秒未完成,已终止",
_log_tail(log_path),
) from None
except FileNotFoundError as exc:
raise ToolUnavailableError(f"tectonic 不可执行:{exc}") from exc
finally:
seconds = round(time.monotonic() - started, 2)
# tectonic --keep-logs 把日志写在 cwd 的 input.log
produced_log = cdir / "input.log"
if produced_log.is_file():
shutil.move(str(produced_log), str(log_path))
if not log_path.is_file():
log_path.write_text("", encoding="utf-8")
produced_pdf = cdir / "input.pdf"
if not produced_pdf.is_file():
raise CompileError(
"COMPILE_FAILED",
"编译失败(未产出 PDF),请查看日志定位 LaTeX 错误",
_log_tail(log_path),
)
pdf_bytes = produced_pdf.stat().st_size
if pdf_bytes > settings.max_compile_pdf_bytes:
produced_pdf.unlink(missing_ok=True)
raise CompileError(
"OUTPUT_TOO_LARGE",
f"产出 PDF 超过 {settings.max_compile_pdf_bytes // (1024 * 1024)}MB 上限,已删除",
_log_tail(log_path),
)
produced_pdf.rename(pdf_path)
meta = {
"compile_id": anchor_id,
"engine": _ENGINE,
"seconds": seconds,
"pdf_bytes": pdf_bytes,
"returncode": 0,
"compiled_at": datetime.now(timezone.utc).isoformat(timespec="seconds"),
}
(cdir / "meta.json").write_text(
json.dumps(meta, ensure_ascii=False, indent=2), encoding="utf-8"
)
logger.info("compile: %s → PDF %d bytes, %.2fs", anchor_id, pdf_bytes, seconds)
return {
"compile_id": anchor_id,
"pdf_path": pdf_path,
"log_path": log_path,
"seconds": seconds,
"pdf_bytes": pdf_bytes,
}
def _kill_group(proc: asyncio.subprocess.Process) -> None:
try:
os.killpg(os.getpgid(proc.pid), signal.SIGKILL)
except (ProcessLookupError, PermissionError, OSError):
try:
proc.kill()
except ProcessLookupError:
pass
def sweep_expired() -> int:
"""删除 mtime 超 retention_days 的 12-hex 锚点目录(编译产物+P1 落盘一并清)。"""
settings = get_settings()
base = settings.reformat_dir_abs
if not base.is_dir():
return 0
cutoff = time.time() - settings.compile_retention_days * 86400
removed = 0
for child in base.iterdir():
if not child.is_dir() or not _ANCHOR_ID_RE.fullmatch(child.name):
continue
try:
if child.stat().st_mtime < cutoff:
shutil.rmtree(child, ignore_errors=True)
removed += 1
except OSError:
continue
if removed:
logger.info("compile sweep: 清理 %d 个过期任务目录(>%d 天)",
removed, settings.compile_retention_days)
return removed
# ================================================================ P4:项目 zip(inspect + run)
#
# 与 P3a 共用:_lock/_pending 单槽队列、_ensure_tool、CompileError/QueueFullError/
# ToolUnavailableError、_kill_group、_log_tail、12-hex 目录与 mtime sweep 约定。
# P3a 函数(prepare_input/compile_tex/_run_once)零改动。
class InspectError(Exception):
"""inspect/消费阶段业务失败。
code ∈ {VALIDATION, ZIP_UNSAFE, ZIP_BOMB, ZIP_INVALID, ZIP_TOO_LARGE}。
"""
def __init__(self, code: str, message: str) -> None:
super().__init__(message)
self.code = code
self.message = message
_DOCCLASS_RE = re.compile(r"(?<!\\)\\documentclass\s*(\[|\{)")
_IMG_LIKE_EXT = {".png", ".jpg", ".jpeg", ".pdf", ".eps", ".svg"}
def inspect_root() -> Path:
"""data/compile_inspect/(1 小时 TTL 暂存根,存在性由调用方按需 mkdir)。"""
return get_settings().inspect_dir_abs
def compile_job_dir(cid: str) -> Path:
"""data/compile_jobs/{cid}/(产物根;不走 reformat_dir,P4 独立清扫)。"""
return get_settings().compile_jobs_dir_abs / cid
def _strip_tex_comments(text: str) -> str:
"""粗剥注释:行内 % 截断(\\% 误伤可接受,MVP 设计决策)。"""
return "\n".join(ln.split("%", 1)[0] for ln in text.splitlines())
def _read_tex(path: Path) -> str:
"""utf-8 → gb18030 → latin-1 降级读(中文模板常见 GBK)。"""
raw = path.read_bytes()
for enc in ("utf-8", "gb18030", "latin-1"):
try:
return raw.decode(enc)
except UnicodeDecodeError:
continue
return raw.decode("utf-8", errors="replace")
def find_main_tex(project_dir: Path) -> tuple[str | None, list[str], int]:
"""主文件识别(补充 2)→ (main_rel | None, 含 documentclass 的相对路径清单, .tex 总数)。
场景:唯一候选 → main;0 个 .tex / 0 候选 / ≥2 候选 → None + 清单(调用方报错)。
返回的相对路径用 posix 分隔符(与 zip 条目名一致)。
"""
tex_files = sorted(
p for p in project_dir.rglob("*")
if p.is_file() and p.suffix.lower() == ".tex"
)
if not tex_files:
return None, [], 0
candidates: list[str] = []
for p in tex_files:
if _DOCCLASS_RE.search(_strip_tex_comments(_read_tex(p))):
candidates.append(p.relative_to(project_dir).as_posix())
if len(candidates) == 1:
return candidates[0], candidates, len(tex_files)
return None, candidates, len(tex_files)
_MISSING_FILE_RE = re.compile(
r"LaTeX Error: File [`']([^`']+)' not found"
r"|I can't find file [`']([^`']+)'"
)
_IMG_INCLUSION_RE = re.compile(r"""image inclusion failed for ["']([^"']+)["']""")
_EPS_CONVERTED_SUFFIX = "-eps-converted-to.pdf"
_REF_TEXT_EXTS = {".tex", ".cls", ".sty", ".cfg", ".def"}
# EPS 现场转换 v2(约束 1-4):xdvipdfmx 无法内嵌 EPS → 解压后批量转同名 .pdf
_EPS_CONVERT_TIMEOUT_S = 15 # 约束2:单文件转换超时(秒)
_EPS_CONVERT_MAX_FILE = 20 * 1024 * 1024 # 约束3:单文件转换后上限(warning)
_EPS_CONVERT_MAX_TOTAL = 100 * 1024 * 1024 # 约束3:转换产物总上限(中止)
def _eps_tool_commands(eps: Path, pdf: Path) -> list[tuple[str, list[str]]]:
"""转换工具优先级:gs(约束1 必须 -dSAFER)→ epstopdf → ps2pdf;只列 PATH 里可用的。"""
tools: list[tuple[str, list[str]]] = []
gs = shutil.which("gs")
if gs:
tools.append(("gs", [
gs, "-dSAFER", "-dNOPAUSE", "-dBATCH", "-sDEVICE=pdfwrite",
"-dPDFSETTINGS=/prepress",
f"-sOutputFile={pdf}", str(eps),
]))
epstopdf = shutil.which("epstopdf")
if epstopdf:
# epstopdf 默认输出到同目录同名 .pdf(即 pdf 路径)
tools.append(("epstopdf", [epstopdf, str(eps)]))
ps2pdf = shutil.which("ps2pdf")
if ps2pdf:
tools.append(("ps2pdf", [ps2pdf, str(eps), str(pdf)]))
return tools
def _convert_eps_file(eps: Path, pdf: Path) -> tuple[str, str]:
"""逐工具尝试把 eps 转成同名 pdf → ("ok", tool) | ("timeout", tool) | ("fail", "")。
约束2:单工具 15s 超时 → 放弃该文件(继续下一个 eps,不再试后续工具)。
成功判定:退出后 pdf 存在且非空(防半成品)。
"""
tools = _eps_tool_commands(eps, pdf)
if not tools:
return "fail", ""
for tool, cmd in tools:
pdf.unlink(missing_ok=True) # 清上一个工具的半成品
try:
subprocess.run(
cmd, timeout=_EPS_CONVERT_TIMEOUT_S,
stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL,
check=False,
)
except subprocess.TimeoutExpired:
pdf.unlink(missing_ok=True)
return "timeout", tool
except OSError:
continue
if pdf.is_file() and pdf.stat().st_size > 0:
return "ok", tool
pdf.unlink(missing_ok=True)
return "fail", ""
def process_eps_images(project: Path) -> list[str]:
"""EPS 兼容 v2:解压后**批量转换项目内所有 .eps**(不依赖 zip 自带预转换版)。
对每个 X.eps(原 .eps 保留):
1. 已有同名 X.pdf → 跳过转换(引用照常切换为 .pdf);
2. zip 自带 X-eps-converted-to.pdf 预转换版 → 复制为 X.pdf(免转换);
3. 否则现场转换:gs(-dSAFER) → epstopdf → ps2pdf 逐个 fallback(约束1),
单文件 15s 超时 → warning 后继续下一个(约束2)。
转换成功 → 显式 `X.eps` 引用字节替换为 `X.pdf`(.tex/.cls/.sty/.cfg/.def 全扫,
纯字节 ASCII/UTF-8 替换不碰编码);无扩展名引用 `{.../X}` 由 graphicx 直接
命中新生成的 X.pdf(解析顺序 .pdf→…→.eps)。
约束3:单文件转换后 >20MB → warning;转换产物累计 >100MB → 抛
InspectError("ZIP_TOO_LARGE") 中止;约束4:返回值为写入 output.log 的
"[eps-convert]" 日志行(由 _run_project 落盘)。
→ 日志行列表(无 .eps 项目 → 空)。
"""
eps_files = sorted(
p for p in project.rglob("*")
if p.is_file() and p.suffix.lower() == ".eps"
)
if not eps_files:
return []
lines: list[str] = []
handled: list[tuple[bytes, bytes]] = []
total_out = 0
def _rel(p: Path) -> str:
return p.relative_to(project).as_posix()
for eps in eps_files:
pdf = eps.with_suffix(".pdf")
src_rel, dst_rel = _rel(eps), _rel(pdf)
if pdf.is_file():
handled.append((eps.name.encode("utf-8"), pdf.name.encode("utf-8")))
continue
converted = eps.with_name(eps.stem + _EPS_CONVERTED_SUFFIX)
if converted.is_file():
t0 = time.monotonic()
shutil.copyfile(converted, pdf)
elapsed = time.monotonic() - t0
tool = "preset"
else:
t0 = time.monotonic()
status, tool = _convert_eps_file(eps, pdf)
elapsed = time.monotonic() - t0
if status == "timeout":
lines.append(f"[eps-convert] {src_rel} 转换超时") # 约束2
continue
if status != "ok":
lines.append(
f"[eps-convert] 全部工具失败,图片 {src_rel} 未转换")
continue
# 约束4:转换日志(成功路径)
lines.append(
f"[eps-convert] {src_rel} → {dst_rel} "
f"({eps.stat().st_size} → {pdf.stat().st_size}, "
f"{elapsed:.2f}s, {tool})")
size_out = pdf.stat().st_size
if size_out > _EPS_CONVERT_MAX_FILE: # 约束3
lines.append(
f"[eps-convert] 警告:{dst_rel} 转换后 {size_out} 字节"
f"超过 {_EPS_CONVERT_MAX_FILE // (1024 * 1024)}MB 上限")
total_out += size_out
if total_out > _EPS_CONVERT_MAX_TOTAL: # 约束3
raise InspectError(
"ZIP_TOO_LARGE",
f"EPS 转换后总大小超过 {_EPS_CONVERT_MAX_TOTAL // (1024 * 1024)}MB 上限"
f"(已达 {total_out // (1024 * 1024)}MB),请压缩图片后重试")
handled.append((eps.name.encode("utf-8"), pdf.name.encode("utf-8")))
# 显式 .eps 引用 → .pdf(仅对转换成功者;失败的保持 .eps → 编译兜底友好报错)
changed = 0
if handled:
for f in project.rglob("*"):
if not (f.is_file() and f.suffix.lower() in _REF_TEXT_EXTS):
continue
data = f.read_bytes()
new = data
for old_b, new_b in handled:
new = new.replace(old_b, new_b)
if new != data:
f.write_bytes(new)
changed += 1
if changed:
lines.append(f"[eps-convert] {changed} 个文件的显式 .eps 引用已改写为 .pdf")
if lines:
logger.info("eps v2: %s", " | ".join(lines))
return lines
def _append_eps_lines(log_path: Path, lines: list[str] | None) -> None:
"""约束4:把 [eps-convert] 转换日志写入 output.log(引擎 log 之后、chatter 之前)。"""
if not lines:
return
with log_path.open("a", encoding="utf-8") as fh:
fh.write("\n".join(lines) + "\n")
def classify_compile_error(log_tail: str) -> str:
"""COMPILE_FAILED 的日志 → 用户友好文案(Q4/§4.4)。"""
m = _MISSING_FILE_RE.search(log_tail)
if m:
name = next(g for g in m.groups() if g)
ext = Path(name).suffix.lower()
if ext == ".cls":
return f"项目缺少 {name},请从期刊官网下载模板后重新上传"
if ext in (".sty", ".def", ".clo"):
return f"缺少 LaTeX 宏包 {name},可能是模板不完整"
if ext in _IMG_LIKE_EXT:
return f"图片 {name} 未在 zip 里,请检查引用路径与大小写"
if ext == ".bib":
return f"缺少文献库 {name},请确认 .bib 已包含在 zip 中"
return f"编译找不到文件 {name},请检查 zip 内文件路径"
m = _IMG_INCLUSION_RE.search(log_tail)
if m:
name = m.group(1)
if Path(name).suffix.lower() == ".eps":
# EPS v2 已现场转换;仍失败 = 服务器转换没成功(工具缺失/超时/格式怪异)
return "项目包含 EPS 图片,服务器转换失败,请转成 PDF/PNG 后重试"
return f"图片 {name} 无法内嵌,请检查图片格式与路径(建议使用 PDF/PNG)"
if re.search(r"Emergency stop|Undefined control sequence", log_tail):
return "LaTeX 源码有语法错误,请展开日志定位出错行"
return "编译失败,请查看日志定位 LaTeX 错误"
async def inspect_zip(zip_bytes: bytes) -> dict[str, Any]:
"""两段式之①:安全解压 + 主文件识别 + 落盘 inspect 暂存(1h TTL)。
→ {job_id, main, stats{files,tex,images,cls,bib,other,bytes}, skipped[], skipped_count}
失败抛 InspectError(路由层转信封);任何失败 → rmtree 暂存目录,磁盘零残留。
"""
from .zip_safety import ZipSafetyError, safe_extract
settings = get_settings()
sweep_inspect_expired() # 机会性清扫(同 P3a 模式)
job_id = uuid.uuid4().hex[:12]
jdir = inspect_root() / job_id
project = jdir / "project"
try:
try:
result = await asyncio.to_thread(safe_extract, zip_bytes, project, settings)
except ZipSafetyError as exc:
raise InspectError(exc.code, exc.message) from exc
main, candidates, tex_total = find_main_tex(project)
if tex_total == 0:
raise InspectError("VALIDATION", "zip 中没有 .tex 文件")
if not candidates:
raise InspectError(
"VALIDATION", "未找到含 \\documentclass 的 .tex 文件")
if main is None:
shown = ", ".join(Path(c).name for c in candidates)
raise InspectError(
"VALIDATION",
f"检测到多个主文件({shown}),请合并为单一入口后重新上传")
meta = {
"job_id": job_id,
"main": main,
"stats": {
"files": result.files, "tex": result.tex, "images": result.images,
"cls": result.cls, "bib": result.bib, "other": result.other,
"bytes": result.bytes,
},
"skipped": [{"name": s.name, "reason": s.reason} for s in result.skipped],
"skipped_count": result.skipped_count,
"created_at": datetime.now(timezone.utc).isoformat(timespec="seconds"),
}
jdir.mkdir(parents=True, exist_ok=True)
(jdir / "inspect.json").write_text(
json.dumps(meta, ensure_ascii=False, indent=2), encoding="utf-8")
return meta
except BaseException:
shutil.rmtree(jdir, ignore_errors=True)
raise
def consume_inspect(job_id: str, cid: str) -> tuple[Path, dict[str, Any]]:
"""两段式之②前置:**原子 rename 消费** inspect 暂存 → compile_jobs/{cid}/project。
并发正确性(防同一 job 双跑):
os.rename(src, dst) 在同一文件系统内是原子的,且 src 不存在 → FileNotFoundError。
两个并发 run 拿同一 job_id 时,只有一个能成功 rename;后到者拿到
FileNotFoundError → 路由层转 VALIDATION"已过期/不存在",**绝不可能双编译**。
inspect 残壳(inspect.json)在 rename 成功后立即删除,也杜绝二跑读到半状态。
"""
settings = get_settings()
if not _ANCHOR_ID_RE.fullmatch(job_id or ""):
raise InspectError("VALIDATION", "job_id 格式非法(应为 12 位 hex)")
src_root = inspect_root() / job_id
meta_path = src_root / "inspect.json"
src_project = src_root / "project"
if not (meta_path.is_file() and src_project.is_dir()):
raise InspectError(
"VALIDATION", "上传任务不存在或已过期(1 小时),请重新上传 zip")
try:
meta = json.loads(meta_path.read_text("utf-8"))
except (OSError, ValueError) as exc:
raise InspectError(
"VALIDATION", "上传任务数据损坏,请重新上传 zip") from exc
dst_root = compile_job_dir(cid)
dst_project = dst_root / "project"
dst_root.mkdir(parents=True, exist_ok=True)
try:
os.rename(src_project, dst_project)
except FileNotFoundError as exc:
raise InspectError(
"VALIDATION", "上传任务不存在或已过期(1 小时),请重新上传 zip") from exc
except OSError as exc: # 跨设备等罕见失败 → 保持 inspect 原样可重试
raise InspectError(
"VALIDATION", "任务消费失败,请重试或重新上传") from exc
shutil.rmtree(src_root, ignore_errors=True) # 消费成功 → 删残壳
return dst_project, meta
async def compile_project_job(job_id: str) -> dict[str, Any]:
"""两段式之②:原子消费 inspect → tectonic 编译 → 产物留 pdf/log/meta。
队列/工具检查**先于消费**(inspect 保留 → 失败可直接重试);
EPS v2:解压后批量转换所有 .eps → 同名 .pdf(gs -dSAFER → epstopdf → ps2pdf,
单文件 15s 超时;产物累计 >100MB → ZIP_TOO_LARGE 中止),转换日志进 output.log;
成功 → 立即删 project/;失败(COMPILE_FAILED/TIMEOUT)→ **保留 project/ 现场 24h**
供诊断(sweep_compile_jobs_expired 按 failed_project_ttl_s 清理;
KEEP_FAILED_PROJECTS=1 永久保留);
失败必落完整 output.log(含 --print 的 XDV→PDF 阶段输出,补充 3)。
→ {compile_id, pdf_path, log_path, seconds, pdf_bytes}
"""
global _pending
settings = get_settings()
_ensure_tool() # 快速失败:不消费 inspect、不占队列
sweep_inspect_expired()
sweep_compile_jobs_expired()
if _pending >= settings.compile_queue_limit:
raise QueueFullError(
f"编译队列已满({_pending} 个任务排队),请稍后重试")
_pending += 1 # 占位先于消费:QUEUE_FULL 时 inspect 未动
cid = uuid.uuid4().hex[:12]
project: Path | None = None
meta: dict[str, Any] = {}
try:
project, meta = await asyncio.to_thread(consume_inspect, job_id, cid)
try:
# EPS v2:解压后批量转换所有 .eps → 同名 .pdf 并切换显式引用
# (不依赖 zip 自带预转换版;失败现场保留转换后的改写结果)
eps_lines = await asyncio.to_thread(process_eps_images, project)
async with _lock:
result = await _run_project(
cid, project, str(meta.get("main", "")), eps_lines)
# 成功 → 立即清理 project 树(失败路径在 finally 保留现场)
shutil.rmtree(project, ignore_errors=True)
project = None
return result
except CompileError as exc:
# 补充 3:失败信封也要能下载 log → 异常携带产物 cid(log 落盘于 compile_jobs/{cid}/)
exc.compile_id = cid
raise
finally:
_pending -= 1
if project is not None:
# 编译失败 → 保留 compile_jobs/{cid}/project/ 现场供诊断;
# touch 目录使 24h 保留窗从失败时刻起算
try:
os.utime(project, None)
except OSError:
pass
async def _run_project(
cid: str,
project: Path,
main_rel: str,
eps_log_lines: list[str] | None = None,
) -> dict[str, Any]:
"""单槽内执行项目编译:cwd=main 所在目录(相对路径解析),outdir=compile_jobs/{cid}。
eps_log_lines:EPS v2 的 [eps-convert] 转换日志(约束4),正常/超时两条路径
都会写进 output.log(引擎 log 之后、chatter/[timeout] 之前)。
"""
settings = get_settings()
outdir = compile_job_dir(cid)
outdir.mkdir(parents=True, exist_ok=True)
main_path = project / main_rel
if not main_rel or not main_path.is_file():
raise InspectError("VALIDATION", "主文件缺失,请重新上传 zip")
cwd = main_path.parent
stem = main_path.stem
env = dict(os.environ)
env["TECTONIC_CACHE_DIR"] = str(settings.tectonic_cache_abs)
# --print:打印引擎完整 chatter(含 XDV→PDF/xdvipdfmx 阶段输出);
# 不加时 xdvipdfmx 报错只进 tectonic stderr、不落 {stem}.log,导致"LaTeX 成功但
# 无 PDF"且 log 无错误行(MDPI 模板实测)。stdout/stderr 统一落盘 output.log。
cmd = [
str(_tectonic_bin()), "-X", "compile", main_path.name,
"--untrusted", "--keep-logs", "--print", "--outdir", str(outdir),
]
timeout = settings.compile_project_timeout_s
log_path = outdir / "output.log"
started = time.monotonic()
try:
proc = await asyncio.create_subprocess_exec(
*cmd, cwd=str(cwd), env=env,
stdout=asyncio.subprocess.PIPE, stderr=asyncio.subprocess.STDOUT,
start_new_session=True,
)
try:
stdout_bytes, _ = await asyncio.wait_for(
proc.communicate(), timeout=timeout)
except asyncio.TimeoutError:
_kill_group(proc)
try:
await asyncio.wait_for(proc.wait(), timeout=5.0)
except asyncio.TimeoutError:
pass
# 超时后 communicate 已取消,chatter 不可取;.log(--keep-logs)仍完整
_ensure_project_log(outdir, stem, cwd)
# 约束4:转换日志先落(转换发生在编译之前),再追加超时标记
_append_eps_lines(log_path, eps_log_lines)
# 追加而非覆盖:保留完整引擎输出(诊断 XDV→PDF 阶段必需)
with log_path.open("a", encoding="utf-8") as fh:
fh.write(f"\n[timeout] 编译超时({timeout:g}s),进程已终止\n")
raise CompileError(
"TIMEOUT",
f"编译超过 {timeout:g} 秒未完成,已终止"
"(项目首次编译需下载宏包,可能较慢,请重试)",
_log_tail(log_path),
) from None
except FileNotFoundError as exc:
raise ToolUnavailableError(f"tectonic 不可执行:{exc}") from exc
finally:
seconds = round(time.monotonic() - started, 2)
_ensure_project_log(outdir, stem, cwd)
# 产物归一:{stem}.pdf/.log → output.pdf/.log(补充 3:失败也必有 output.log)
produced_pdf = outdir / f"{stem}.pdf"
produced_log = outdir / f"{stem}.log"
if produced_log.is_file():
shutil.move(str(produced_log), str(log_path))
if not log_path.is_file():
log_path.write_text(
"[no log] tectonic 未产出日志(进程异常退出)", encoding="utf-8")
# 约束4:[eps-convert] 转换日志(引擎 log 之后、chatter 之前)
_append_eps_lines(log_path, eps_log_lines)
# --print 的进程输出(含 XDV→PDF 阶段)追加到 output.log 全文之后;
# 信封 detail 仍只取尾 200 行,磁盘保留完整 log 供"查看完整 log"下载
_append_chatter(log_path, stdout_bytes)
if not produced_pdf.is_file():
raise CompileError(
"COMPILE_FAILED",
classify_compile_error(_log_tail(log_path)),
_log_tail(log_path),
)
pdf_bytes = produced_pdf.stat().st_size
if pdf_bytes > settings.max_compile_pdf_bytes:
produced_pdf.unlink(missing_ok=True)
raise CompileError(
"OUTPUT_TOO_LARGE",
f"产出 PDF 超过 {settings.max_compile_pdf_bytes // (1024 * 1024)}MB 上限,已删除",
_log_tail(log_path),
)
produced_pdf.rename(outdir / "output.pdf")
meta = {
"compile_id": cid,
"project": True,
"main": main_rel,
"engine": _ENGINE,
"seconds": seconds,
"pdf_bytes": pdf_bytes,
"returncode": 0,
"compiled_at": datetime.now(timezone.utc).isoformat(timespec="seconds"),
}
(outdir / "meta.json").write_text(
json.dumps(meta, ensure_ascii=False, indent=2), encoding="utf-8")
logger.info("compile(project): %s main=%s → PDF %d bytes, %.2fs",
cid, main_rel, pdf_bytes, seconds)
return {
"compile_id": cid,
"pdf_path": outdir / "output.pdf",
"log_path": log_path,
"seconds": seconds,
"pdf_bytes": pdf_bytes,
}
def _ensure_project_log(outdir: Path, stem: str, cwd: Path) -> None:
"""tectonic 落 log 到 outdir 或 cwd → 统一挪到 outdir/output.log;都没有则占位。"""
log_path = outdir / "output.log"
if log_path.is_file():
return
for cand in (outdir / f"{stem}.log", cwd / f"{stem}.log"):
if cand.is_file():
shutil.move(str(cand), str(log_path))
return
def _append_chatter(log_path: Path, stdout_bytes: bytes | None) -> None:
"""把 tectonic --print 的进程 stdout(含 XDV→PDF/xdvipdfmx 阶段)追加到 output.log。
{stem}.log 只有 LaTeX 引擎内容(止于 "Output written on … .xdv");
XDV→PDF 转换错误只出现在进程 chatter 里——不落盘则"无 PDF 且 log 无错误行"。
"""
if not stdout_bytes:
return
chatter = stdout_bytes.decode("utf-8", errors="replace").strip()
if not chatter:
return
with log_path.open("a", encoding="utf-8") as fh:
fh.write("\n\n===== tectonic --print(进程输出,含 XDV→PDF 阶段)=====\n")
fh.write(chatter)
fh.write("\n")
def sweep_inspect_expired() -> int:
"""删 mtime 超 inspect_ttl_s(默认 1h)的 12-hex inspect 暂存目录。"""
settings = get_settings()
base = settings.inspect_dir_abs
if not base.is_dir():
return 0
cutoff = time.time() - settings.inspect_ttl_s
removed = 0
for child in base.iterdir():
if not child.is_dir() or not _ANCHOR_ID_RE.fullmatch(child.name):
continue
try:
if child.stat().st_mtime < cutoff:
shutil.rmtree(child, ignore_errors=True)
removed += 1
except OSError:
continue
if removed:
logger.info("inspect sweep: 清理 %d 个过期 inspect 暂存(>%d 秒)",
removed, settings.inspect_ttl_s)
return removed
def _keep_failed_projects() -> bool:
"""失败现场是否永久保留(调试):REVIEW_KEEP_FAILED_PROJECTS=1 或裸 KEEP_FAILED_PROJECTS=1。"""
if get_settings().keep_failed_projects:
return True
return os.environ.get("KEEP_FAILED_PROJECTS", "").strip() == "1"
def sweep_compile_jobs_expired() -> int:
"""编译产物清扫,两级:
① 失败现场 project/ 子目录:mtime 超 failed_project_ttl_s(默认 24h)→ 删子目录
(compile_jobs/{cid} 本体与 output.log/meta 保留,供"查看完整 log");
KEEP_FAILED_PROJECTS=1 跳过(永久保留,调试用)。
② 整个 compile_jobs/{cid}:mtime 超 compile_retention_days(7 天)→ 整目录删。
"""
settings = get_settings()
base = settings.compile_jobs_dir_abs
if not base.is_dir():
return 0
removed = 0
keep_failed = _keep_failed_projects()
# ① 失败现场 24h 清理(成功编译的 project/ 已在 compile_project_job 立即删)
if not keep_failed:
proj_cutoff = time.time() - settings.failed_project_ttl_s
for child in base.iterdir():
if not child.is_dir() or not _ANCHOR_ID_RE.fullmatch(child.name):
continue
proj = child / "project"
if not proj.is_dir():
continue
try:
if proj.stat().st_mtime < proj_cutoff:
shutil.rmtree(proj, ignore_errors=True)
removed += 1
except OSError:
continue
# ② 整目录 7 天清理
cutoff = time.time() - settings.compile_retention_days * 86400
for child in base.iterdir():
if not child.is_dir() or not _ANCHOR_ID_RE.fullmatch(child.name):
continue
try:
if child.stat().st_mtime < cutoff:
shutil.rmtree(child, ignore_errors=True)
removed += 1
except OSError:
continue
if removed:
logger.info("compile_jobs sweep: 清理 %d 个过期项目产物/失败现场", removed)
return removed
+203
View File
@@ -0,0 +1,203 @@
"""services/llm.py —— LLM 调用(httpx 裸调 DeepSeek,模式同 paper_writer_service)。
- complete_text(system, user, *, temperature=0.3, max_tokens=8000, timeout=None) -> str
- complete_json(...)(response_format json_object + 一次 JSON 修复重试)
- 4 次尝试(1.5s / 3s / 6s 指数退避,429 / 5xx / 超时)
- env 键(优先 REVIEW_LLM_*,回退 DOCGEN_LLM_*,再回退内置默认):
*_LLM_BASE_URL / *_LLM_API_KEY / *_LLM_MODEL / *_LLM_TIMEOUT
"""
from __future__ import annotations
import asyncio
import json
import logging
import os
from typing import Any
import httpx
logger = logging.getLogger(__name__)
DEFAULT_LLM_BASE_URL = "https://api.deepseek.com/v1"
DEFAULT_LLM_MODEL = "deepseek-chat"
DEFAULT_LLM_TIMEOUT = 300.0
BACKOFF_SECONDS = (1.5, 3.0, 6.0)
MAX_ATTEMPTS = 4
class LLMError(Exception):
"""LLM 调用失败(重试尽/响应异常)。"""
def _env(keys: tuple[str, ...], default: str = "") -> str:
for key in keys:
val = os.environ.get(key)
if val:
return val
return default
def _llm_config() -> dict[str, Any]:
return {
"base_url": _env(
("REVIEW_LLM_BASE_URL", "DOCGEN_LLM_BASE_URL"), DEFAULT_LLM_BASE_URL
).rstrip("/"),
"api_key": _env(("REVIEW_LLM_API_KEY", "DOCGEN_LLM_API_KEY"), ""),
"model": _env(("REVIEW_LLM_MODEL", "DOCGEN_LLM_MODEL"), DEFAULT_LLM_MODEL),
"timeout": float(
_env(("REVIEW_LLM_TIMEOUT", "DOCGEN_LLM_TIMEOUT"), str(DEFAULT_LLM_TIMEOUT))
),
}
def _extract_text(payload: dict[str, Any]) -> str:
try:
choices = payload.get("choices") or []
if choices:
content = choices[0].get("message", {}).get("content")
if isinstance(content, str):
return content
if isinstance(content, list):
return "".join(
str(c.get("text", "")) if isinstance(c, dict) else str(c) for c in content
)
except Exception:
pass
return ""
async def _chat_once(
client: httpx.AsyncClient,
cfg: dict[str, Any],
system: str,
user: str,
*,
temperature: float,
max_tokens: int,
json_mode: bool,
timeout: float | None,
) -> str:
headers = {"Content-Type": "application/json"}
if cfg["api_key"]:
headers["Authorization"] = f"Bearer {cfg['api_key']}"
body: dict[str, Any] = {
"model": cfg["model"],
"messages": [
{"role": "system", "content": system},
{"role": "user", "content": user},
],
"temperature": temperature,
"max_tokens": max_tokens,
}
if json_mode:
body["response_format"] = {"type": "json_object"}
resp = await client.post(
f"{cfg['base_url']}/chat/completions",
headers=headers,
json=body,
timeout=timeout if timeout is not None else cfg["timeout"],
)
resp.raise_for_status()
payload = resp.json()
if not isinstance(payload, dict):
raise LLMError("LLM 响应形态异常(非 JSON 对象)")
text = _extract_text(payload)
if not text:
raise LLMError("LLM 响应缺少 choices[0].message.content")
return text
async def _complete(
system: str,
user: str,
*,
temperature: float,
max_tokens: int,
json_mode: bool,
timeout: float | None,
) -> str:
cfg = _llm_config()
last_exc: BaseException | None = None
async with httpx.AsyncClient() as client:
for attempt in range(MAX_ATTEMPTS):
try:
return await _chat_once(
client, cfg, system, user,
temperature=temperature, max_tokens=max_tokens, json_mode=json_mode,
timeout=timeout,
)
except LLMError:
raise
except (httpx.HTTPStatusError, httpx.HTTPError, httpx.TimeoutException) as exc:
last_exc = exc
status = getattr(getattr(exc, "response", None), "status_code", None)
retryable = status is None or status == 429 or status >= 500
if not retryable or attempt == MAX_ATTEMPTS - 1:
raise LLMError(f"LLM 调用失败(HTTP {status or '网络'}):{exc}") from exc
await asyncio.sleep(BACKOFF_SECONDS[min(attempt, len(BACKOFF_SECONDS) - 1)])
raise LLMError(f"LLM 调用失败:{last_exc}")
async def complete_text(
system: str,
user: str,
*,
temperature: float = 0.3,
max_tokens: int = 8000,
timeout: float | None = None,
) -> str:
"""文本补全。失败抛 LLMError。"""
return await _complete(
system, user, temperature=temperature, max_tokens=max_tokens, json_mode=False,
timeout=timeout,
)
def _repair_json(text: str) -> str:
text = text.strip()
if text.startswith("```"):
text = text.strip("`")
if text.lower().startswith("json"):
text = text[4:]
text = text.strip()
if not text:
raise LLMError("LLM 返回空内容")
if text.startswith("{"):
return text
start = text.find("{")
end = text.rfind("}")
if start >= 0 and end > start:
return text[start:end + 1]
raise LLMError("LLM 输出中未找到 JSON 对象")
async def complete_json(
system: str,
user: str,
*,
temperature: float = 0.3,
max_tokens: int = 8000,
timeout: float | None = None,
) -> dict[str, Any]:
"""JSON 补全(json_object + 一次修复重试)。"""
text = await _complete(
system, user, temperature=temperature, max_tokens=max_tokens, json_mode=True,
timeout=timeout,
)
try:
return json.loads(text)
except ValueError:
pass
text2 = await _complete(
system + "\n(重要:你的回答必须是单个合法 JSON 对象,不要输出其他任何内容)",
user,
temperature=temperature,
max_tokens=max_tokens,
json_mode=True,
timeout=timeout,
)
try:
return json.loads(text2)
except ValueError:
repaired = _repair_json(text2)
return json.loads(repaired)
+139
View File
@@ -0,0 +1,139 @@
"""paper_parse.py —— PDF → 纯文本(经 vstore 8094 现有解析接口,零改动复用)。
链路(全部只读消费 vstore 既有 API,不修改 vstore 代码):
1. POST {vstore}/api/vstore/ingest multipart file(vstore 内部 pymupdf 解析)
2. GET {vstore}/api/vstore/documents/{doc_id} → document.paragraphs 拼接纯文本
3. DELETE {vstore}/api/vstore/documents/{doc_id} (临时解析件 best-effort 清理,
REVIEW_PARSE_DELETE_AFTER=0 可关闭——保留文档便于人工排查)
为何不用 methodology 8092:其 /extract-upload 是 MinerU 分钟级异步 job
(MinerU 子进程 + LLM 抽取两阶段),不适配同步自审稿;vstore 段落解析秒级
返回,满足 presubmit 场景。methodology 地址在 config 中预留供后续扩展。
"""
from __future__ import annotations
import logging
from typing import Any
import httpx
from ..config import get_settings
logger = logging.getLogger(__name__)
class ParseError(Exception):
"""PDF 解析失败(上游不可达/响应异常/空文本)。"""
async def parse_pdf(path: str) -> str:
"""接收 PDF 文件路径,返回拼接后的纯文本。失败抛 ParseError。"""
try:
with open(path, "rb") as fh:
file_bytes = fh.read()
except OSError as exc:
raise ParseError(f"读取 PDF 失败:{exc}") from exc
return await parse_pdf_bytes(file_bytes, filename=str(path).rsplit("/", 1)[-1] or "paper.pdf")
async def parse_pdf_bytes(file_bytes: bytes, filename: str = "paper.pdf") -> str:
"""接收 PDF 字节流,返回拼接后的纯文本。失败抛 ParseError。"""
if not file_bytes:
raise ParseError("PDF 内容为空")
settings = get_settings()
base = settings.vstore_base
timeout = httpx.Timeout(
connect=5.0, read=settings.parse_timeout, write=settings.parse_timeout, pool=5.0
)
async with httpx.AsyncClient(timeout=timeout) as client:
# ---- 1) ingest(vstore 内部 pymupdf 解析 + 嵌入 + 加密落盘)----
try:
resp = await client.post(
f"{base}/api/vstore/ingest",
files={"file": (filename, file_bytes, "application/pdf")},
data={
"name": filename,
"category": "review_presubmit",
"description": "review_service 临时解析件",
},
)
except httpx.HTTPError as exc:
raise ParseError(f"vstore 不可达({base}):{exc}") from exc
if resp.status_code >= 400:
# 读上游错误体(信封 JSON 或裸文本),区分“不可达”与“上游报错”
raise ParseError(f"vstore ingest 失败(HTTP {resp.status_code}):{_err_body(resp)}")
try:
payload = resp.json()
except ValueError as exc:
raise ParseError(f"vstore ingest 响应非 JSON:{exc}") from exc
if not isinstance(payload, dict) or not payload.get("ok"):
message = _err_message(payload) or "vstore ingest 失败"
raise ParseError(message)
doc_id = str((payload.get("item") or {}).get("document_id") or "")
if not doc_id:
raise ParseError("vstore ingest 响应缺少 document_id")
# ---- 2) 取明文全文(paragraphs 拼接)+ 3) 清理临时件 ----
try:
text = await _fetch_text(client, base, doc_id)
finally:
if settings.parse_delete_after:
await _best_effort_delete(client, base, doc_id)
text = text.strip()
if not text:
raise ParseError("PDF 解析结果为空(可能是扫描件/图片型 PDF,vstore 无 OCR)")
return text
async def _fetch_text(client: httpx.AsyncClient, base: str, doc_id: str) -> str:
"""取 vstore 文档明文并按段落拼接纯文本。"""
try:
resp = await client.get(f"{base}/api/vstore/documents/{doc_id}")
except httpx.HTTPError as exc:
raise ParseError(f"vstore 取文档失败({doc_id}):{exc}") from exc
if resp.status_code >= 400:
raise ParseError(
f"vstore 取文档失败({doc_id},HTTP {resp.status_code}):{_err_body(resp)}"
)
try:
payload = resp.json()
except ValueError as exc:
raise ParseError(f"vstore 取文档响应非 JSON({doc_id}):{exc}") from exc
if not isinstance(payload, dict) or not payload.get("ok"):
raise ParseError(_err_message(payload) or f"vstore 取文档失败({doc_id})")
document: dict[str, Any] = payload.get("document") or {}
paragraphs = document.get("paragraphs") or []
return "\n".join(str(p) for p in paragraphs if str(p).strip())
async def _best_effort_delete(client: httpx.AsyncClient, base: str, doc_id: str) -> None:
try:
await client.delete(f"{base}/api/vstore/documents/{doc_id}")
except Exception: # noqa: BLE001 - 清理失败不阻断(文档级 secure_delete 已尽力)
logger.warning("paper_parse: vstore 临时文档清理失败(%s)", doc_id, exc_info=True)
def _err_message(payload: Any) -> str:
if isinstance(payload, dict):
err = payload.get("error")
if isinstance(err, dict):
return str(err.get("message") or "")
if isinstance(err, str):
return err
return ""
def _err_body(resp: httpx.Response) -> str:
"""上游错误体:优先 JSON 信封 message,回退裸文本(截断 500 字符)。"""
try:
payload = resp.json()
except ValueError:
return (resp.text or "").strip()[:500] or "(空响应体)"
return _err_message(payload) or str(payload)[:500]
@@ -0,0 +1,226 @@
"""services/paper_scanner.py —— 关键词兜底扫描器(纯 stdlib,零 LLM)。
背景(2026-10-12):hard_rule 标签由 LLM 输出,存在"正文明明有 accession/BUSCO/挂载率
却报缺失"的漏检风险(真实案例 s41588 Nature Genetics:正文有 PRJCA038097 等 +
BUSCO 98.57% + 94.18% anchored,仍被判 busco/accession/hic_missing → 大修)。
本模块做**程序层证伪**:LLM 说缺某项、扫描器在文中找到该项 → 剥掉 hard_rule
降级为非硬性 major,并在 rationale 记录冲突(前端黄色提示,请人工核对)。
边界(刻意保守,不引入新误判):
- 只做"证伪硬性缺项",不做"证实"——扫不到不等于真缺(可能同义表述),不升级任何条目
- accession 只在 Data Availability 段内扫(用户指令):正文引用他人数据的
accession 不得误认为"自己有"
"""
from __future__ import annotations
import re
from typing import Any
# ---- accession(只在 DA 段扫)----
ACCESSION_RE = re.compile(
r"\b(PRJNA|PRJEB|PRJCA|SRP|ERP|DRP|CRA|SRR|ERR|DRR|GCA_|GCF_)\s?(\d[\d._]*)",
re.IGNORECASE,
)
# ---- DA 段定位:标题多变体(行首允许编号前缀)----
_DA_START_RE = re.compile(
r"^[ \t]*(?:\d+(?:\.\d+)*\.?\s+)?"
r"(?:Data\s+(?:and\s+(?:code\s+)?)?[Aa]vailability"
r"|Availability\s+of\s+(?:data|Data)"
r"|Data\s+and\s+[Mm]aterials\s+[Aa]vailability"
r"|Data\s+availability\s+statement)",
re.MULTILINE,
)
# DA 段结束 = 下一个一级节标题
_NEXT_HEADER_RE = re.compile(
r"^[ \t]*(?:\d+(?:\.\d+)*\.?\s+)?"
r"(?:Abstract|Summary|Introduction|Results|Discussion|Methods"
r"|Materials\s+and\s+Methods|References|Acknowledg(?:e)?ments?"
r"|Author\s+[Ii]nformation|Rights\s+and\s+permissions|Change\s+history"
r"|Data\s+(?:and\s+(?:code\s+)?)?[Aa]vailability"
r"|Availability\s+of\s+[Dd]ata|Data\s+and\s+[Mm]aterials\s+[Aa]vailability)"
r"\s*$",
re.MULTILINE,
)
# 回退窗:DA 无行首标题时,短语出现处 + 上下文
_DA_PHRASE_RE = re.compile(r"data\s+availability", re.IGNORECASE)
_DA_FALLBACK_WINDOW = 3000
# ---- BUSCO(全文)----
_BUSCO_MENTION_RE = re.compile(r"\bBUSCO\b", re.IGNORECASE)
_BUSCO_FULL_RE = re.compile(
r"(?:\bS\s*:\s*\d|\bSingle[- ]copy)"
r".{0,200}?"
r"(?:\bD\s*:\s*\d|\bDuplicat)",
re.IGNORECASE | re.DOTALL,
)
# ---- Hi-C 挂载率(全文)----
HIC_RE = re.compile(
r"(anchored\s+to\s+chromosomes?"
r"|anchoring\s+rate"
r"|pseudo[- ]?chromosomes?"
r"|chromosome[- ]level"
r"|%[^.\n]{0,40}anchored)",
re.IGNORECASE,
)
_MAX_HITS = 20
def _extract_da_section(text: str) -> str:
"""定位 Data Availability 段正文(标题后 → 下一个一级节标题)。
无行首标题时回退:短语出现处向后 3000 字符窗。均未命中 → ""。
"""
m = _DA_START_RE.search(text)
if m:
nxt = _NEXT_HEADER_RE.search(text, m.end())
end = nxt.start() if nxt else min(len(text), m.end() + _DA_FALLBACK_WINDOW)
return text[m.start():end]
m2 = _DA_PHRASE_RE.search(text)
if m2:
return text[m2.start():min(len(text), m2.start() + _DA_FALLBACK_WINDOW)]
return ""
def _scan_accession(da_text: str) -> dict[str, Any]:
if not da_text:
return {"found": False, "hits": [], "in_da_section": False}
hits: list[str] = []
seen: set[str] = set()
for m in ACCESSION_RE.finditer(da_text):
token = (m.group(1) + m.group(2)).upper()
if token not in seen:
seen.add(token)
hits.append(token)
if len(hits) >= _MAX_HITS:
break
return {"found": bool(hits), "hits": hits, "in_da_section": True}
def _scan_busco(text: str) -> dict[str, Any]:
m = _BUSCO_MENTION_RE.search(text)
if not m:
return {"level": "none", "excerpt": ""}
excerpt = text[m.start():m.start() + 200]
if _BUSCO_FULL_RE.search(text):
level = "full"
else:
level = "partial" # 只有百分比、无 S/D 分项 → prompt 已定为 minor
return {"level": level, "excerpt": excerpt}
def _scan_hic(text: str) -> dict[str, Any]:
m = HIC_RE.search(text)
if not m:
return {"found": False, "excerpt": ""}
start = max(0, m.start() - 40)
return {"found": True, "excerpt": text[start:m.end() + 80]}
def scan_paper_signals(text: str) -> dict[str, Any]:
"""全文 → 结构化信号。accession 只在 DA 段;busco/hic 全文。"""
if not text:
return {
"accession": {"found": False, "hits": [], "in_da_section": False},
"busco": {"level": "none", "excerpt": ""},
"hic": {"found": False, "excerpt": ""},
}
return {
"accession": _scan_accession(_extract_da_section(text)),
"busco": _scan_busco(text),
"hic": _scan_hic(text),
}
def _get_hr(item: Any) -> Any:
if isinstance(item, dict):
return item.get("hard_rule")
return getattr(item, "hard_rule", None)
def _item_fatal(item: Any) -> bool:
if isinstance(item, dict):
return bool(item.get("fatal"))
return bool(getattr(item, "fatal", False))
def _set_downgraded(item: Any) -> None:
if isinstance(item, dict):
item["scanner_downgraded"] = True
else:
try:
item.scanner_downgraded = True
except Exception: # pydantic 严格模式等极端场景:吞掉,冲突记录仍保留
pass
def _set_hr_none(item: Any) -> None:
if isinstance(item, dict):
item["hard_rule"] = None
else:
try:
item.hard_rule = None
except Exception: # pydantic 严格模式等极端场景:吞掉,冲突记录仍保留
pass
def _item_title(item: Any) -> str:
if isinstance(item, dict):
return str(item.get("title") or "")
return str(getattr(item, "title", "") or "")
# 冲突映射:hard_rule 标签 → (信号检查, 冲突描述)
def _conflict_for(tag: str, signals: dict[str, Any]) -> str | None:
acc = signals.get("accession") or {}
busco = signals.get("busco") or {}
hic = signals.get("hic") or {}
if tag == "accession_missing" and acc.get("found"):
hits = ", ".join(acc.get("hits") or [])[:120]
return f"Data Availability 段已检出 accession({hits})"
if tag == "busco_missing" and busco.get("level") in ("partial", "full"):
return f"正文已提及 BUSCO({busco.get('level')} 格式)"
if tag == "hic_missing" and hic.get("found"):
excerpt = (hic.get("excerpt") or "").strip()[:80]
return f"正文已检出挂载率描述({excerpt})"
return None
def reconcile_hard_rules(
majors: list[Any], signals: dict[str, Any]
) -> tuple[list[Any], list[Any], list[dict[str, Any]]]:
"""对带 hard_rule 的 major 做扫描器证伪:命中 → 剥标签 + **移出 major 降级至
minor**(A2 语义,2026-10-12)→ 记冲突。
返回 (kept_majors, demoted_minors, conflicts):
- kept_majors:未冲突/未处理的 major(原序)
- demoted_minors:被冲突降级的条目(hard_rule 置 None、scanner_downgraded=True)
- conflicts:{hard_rule, title, reason}——fatal 条目只记冲突不降级
(拒稿级问题须人工过目,扫描器证伪不了伦理判断)。
"""
kept: list[Any] = []
demoted: list[Any] = []
conflicts: list[dict[str, Any]] = []
for m in majors:
tag = _get_hr(m)
if not isinstance(tag, str):
kept.append(m)
continue
reason = _conflict_for(tag, signals)
if reason is None:
kept.append(m)
continue
conflicts.append({
"hard_rule": tag,
"title": _item_title(m),
"reason": reason,
})
if _item_fatal(m):
kept.append(m) # fatal 保留原位(含其 hard_rule 供引擎 R1/R0 使用)
continue
_set_hr_none(m)
_set_downgraded(m)
demoted.append(m)
return kept, demoted, conflicts
@@ -0,0 +1,153 @@
"""services/rebuttal_draft.py —— 5 类回复片段 Prompt + 反幻觉校验 + letter 拼装。
- part.type 枚举(决策 2,无 auto):new_data | reanalysis | location | clarification | rebuttal。
- 反幻觉校验(补充 2 收窄版,只做负向证伪,不做泛化打分):
* location:出现 "shows that / as shown" 但无 "added/新增" 迹证 → FAIL
("S3 shows that..." 红 FAIL;"we have added ... in S3" 过)。
* rebuttal:命中负向词表 we agree / we accept / we concede / you are right /
we were wrong → FAIL;无立场词(maintain/disagree/respectfully/坚持/不同意…)
→ FAIL;"respectfully maintain" 过。
* 其他三类:Phase 1 仅查非空。
- 校验前置(决策:校验C前置):draft 生成前先跑校验,FAIL 则不调 LLM。
- letter 拼装:按 reviewer → comment 顺序,原文 + 草稿;无草稿留 "[待补充]"。
"""
from __future__ import annotations
import re
from typing import Any, Callable
LLMCallable = Callable[..., Any]
PART_TYPES = ("new_data", "reanalysis", "location", "clarification", "rebuttal")
_TYPE_FRAGMENTS: dict[str, str] = {
"new_data": (
"你的回复属于【补充新数据】类:说明新增了哪些实验/数据(图/表编号、关键数值),"
"并明确回应原审稿关切。不得虚构未提供的数据——只用 user_response 给出的事实。"
),
"reanalysis": (
"你的回复属于【重新分析】类:说明重跑了哪些分析、方法/参数变化与新结论要点。"
"不得虚构未提供的结果——只用 user_response 给出的事实。"
),
"location": (
"你的回复属于【定位/指出位置】类:明确指出修改或证据在稿件中的位置"
"(如 Section 3 / Fig. S2 / Methods 段落),与 user_response 给出的位置一致。"
"不得虚构未提供的位置。"
),
"clarification": (
"你的回复属于【澄清说明】类:针对误解给出准确、简洁的解释,"
"只用 user_response 与原评论内容,不引入新主张。"
),
"rebuttal": (
"你的回复属于【礼貌反驳】类:礼貌但明确地表达不同立场(maintain/disagree),"
"给出理由(基于 user_response 与原文),不得虚构证据。"
),
}
_BASELINE = (
"通用底线:只基于原评论与 user_response 起草;不得编造数据、图表编号、"
"统计结果或已做修改;不确定处用占位([XX])而非猜测。"
"输出 JSON:{\"draft_md\": \"英文正式回复正文(markdown,≤200词)\"}。只输出 JSON。"
)
_STANCE = re.compile(
r"\b(maintain|disagree|respectfully|cannot\s+agree|dispute|stand\s+by|"
r"hold\s+to)\b|坚持|不同意|保留|异议",
re.IGNORECASE,
)
_NEGATIVE = re.compile(
r"\bwe\s+agree\b|\bwe\s+accept\b|\bwe\s+concede\b|\byou\s+are\s+right\b|"
r"\bwe\s+were\s+wrong\b",
re.IGNORECASE,
)
_LOC_SHOWS = re.compile(r"shows?\s+that|as\s+shown|表明", re.IGNORECASE)
_LOC_ADDED = re.compile(r"\badded\b|新增|have\s+added|we\s+have\s+added", re.IGNORECASE)
def validate_parts(parts: list[dict[str, Any]]) -> dict[str, Any]:
"""反幻觉校验 → {passed: bool, findings: [{part_index, code, message}]}。"""
findings: list[dict[str, Any]] = []
for i, p in enumerate(parts):
ptype = str(p.get("type") or "")
content = str(p.get("content") or "").strip()
if not content:
findings.append({"part_index": i, "code": "EMPTY_CONTENT",
"message": "回复内容不能为空"})
continue
if ptype == "location":
if _LOC_SHOWS.search(content) and not _LOC_ADDED.search(content):
findings.append({
"part_index": i, "code": "LOCATION_EVIDENCE_WEAK",
"message": "location 类回复出现“shows that/如所示”但未给出新增位置;"
"请写明“we have added … in S{n}”式定位",
})
elif ptype == "rebuttal":
if _NEGATIVE.search(content):
findings.append({
"part_index": i, "code": "REBUTTAL_NEGATIVE",
"message": "rebuttal 类回复出现让步词(we agree/accept/concede…);"
"该类应礼貌但明确地表达不同立场",
})
elif not _STANCE.search(content):
findings.append({
"part_index": i, "code": "REBUTTAL_NO_STANCE",
"message": "rebuttal 类回复缺少立场词(maintain/disagree/respectfully…)",
})
# new_data / reanalysis / clarification:Phase 1 仅非空
return {"passed": not findings, "findings": findings}
def _draft_system(parts: list[dict[str, Any]]) -> str:
frags = [_TYPE_FRAGMENTS.get(str(p.get("type") or ""), "") for p in parts]
frags = [f for f in frags if f]
return " ".join(frags) + " " + _BASELINE if frags else _BASELINE
async def generate_draft(llm: LLMCallable, comment: dict[str, Any]) -> str:
"""按 comment.response.parts 起草 draft_md(调用方须先过 validate_parts)。"""
parts = (comment.get("response") or {}).get("parts") or []
user_lines = []
for p in parts:
hint = str(p.get("location_hint") or "").strip()
line = f"- [{p.get('type')}] {p.get('content')}"
if hint:
line += f" (location_hint: {hint})"
user_lines.append(line)
user_msg = (
f"原审稿意见:\n{comment.get('body') or comment.get('title') or ''}\n\n"
f"作者拟回复要点(user_response):\n" + "\n".join(user_lines)
)
try:
data = await llm(
[{"role": "system", "content": _draft_system(parts)},
{"role": "user", "content": user_msg}],
temperature=0.2,
)
draft = str((data or {}).get("draft_md") or "").strip()
return draft or "[draft generation returned empty]"
except Exception: # noqa: BLE001
return "[draft generation failed — 请重试]"
def assemble_letter(job: dict[str, Any]) -> str:
"""拼装整封 response letter markdown(Phase 1 纯 .md,docx 放 Phase 2)。"""
lines: list[str] = ["# Response to Reviewers", ""]
lines.append(f"_Job: {job.get('id')} · template: {job.get('template') or 'generic'}_")
lines.append("")
for r in job.get("reviewers") or []:
lines.append(f"## {r.get('label') or 'Reviewer'}")
lines.append("")
for c in r.get("comments") or []:
title = c.get("title") or c.get("id") or "Comment"
lines.append(f"### {title}")
lines.append("")
lines.append("**Original comment:**")
lines.append("")
lines.append(str(c.get("body") or "").strip())
lines.append("")
lines.append("**Our response:**")
lines.append("")
draft = str(c.get("draft") or "").strip()
lines.append(draft if draft else "[待补充]")
lines.append("")
return "\n".join(lines)
@@ -0,0 +1,207 @@
"""services/rebuttal_parse.py —— 审稿意见文本 → 结构化 Comment 树。
流程(保守:正则先切骨架,LLM 只做分类/拆子条,行数交叉核对不匹配则回退正则):
1. 归一化换行;正则识别 Reviewer 段头(Reviewer 1 / 审稿人 2 / Review A 等),
无段头 → 单 Reviewer(label=Reviewer)。
2. 每个 Reviewer 段内按编号行切 comment 段("1." "2)" "(3)" 等);
切不出编号 → 整段作 1 条。
3. LLM complete_json 对每段做:{title, severity, sub_items:[{title,body,confidence}]}。
- LLM 返回段数 != 提交段数 → 全量回退正则(title=首 60 字,severity 默认 major)。
- sub_items ≥ 2 且最高 confidence ≥ 0.7 → 拆多条(共享 group_id);否则单条。
4. cross_refs:正文里 "see comment 3 / 参见第 2 条" → 解析目标;解析不到
target_id=null 保留 raw(决策:不猜)。
不做:auto 分类(已砍);severity 以外的任何 LLM 自由发挥字段。
"""
from __future__ import annotations
import re
from typing import Any, Callable
# LLM 依赖注入(测试打桩):async (messages, temperature=..) -> dict
LLMCallable = Callable[..., Any]
_REVIEWER_HEADER = re.compile(
r"^(?:reviewers?\s*#?\s*([0-9]+|[A-Z])|审稿人\s*#?\s*([0-9A-Z]+)|review\s+([A-Z]))\s*[::.))]?",
re.IGNORECASE | re.MULTILINE,
)
_COMMENT_NUM = re.compile(
r"(?:(?<=\n)|(?<=\.\s)|^)\s*(?:[#((]?\s*(\d{1,2})\s*[)).:、]|[((]\s*([ivx]{1,4}|[a-z])\s*[))])\s+",
re.IGNORECASE | re.MULTILINE,
)
_CROSS_REF = re.compile(
r"(?:see|noted\s+in|refer(?:ring)?\s+to|per)\s+comment\s*#?\s*(\d+)|"
r"(?:please\s+)?refer\s+to\s+comment\s*#?\s*(\d+)|"
r"参见\s*第?\s*(\d+)\s*条|见\s*comment\s*#?\s*(\d+)|同上(?:一条)?评论",
re.IGNORECASE,
)
_SPLIT_CONFIDENCE = 0.7 # 决策 3:confidence ≥ 0.7 才拆
def _norm(text: str) -> str:
return text.replace("\r\n", "\n").replace("\r", "\n").strip()
def split_reviewers(text: str) -> list[tuple[str, str]]:
"""→ [(label, block_text)];无段头 → [(Reviewer, 全文)]。"""
text = _norm(text)
matches = list(_REVIEWER_HEADER.finditer(text))
if not matches:
return [("Reviewer", text)]
out: list[tuple[str, str]] = []
for i, m in enumerate(matches):
raw = next(g for g in m.groups() if g is not None)
label = raw.upper() if raw.isalpha() else f"Reviewer {raw}"
start = m.end()
end = matches[i + 1].start() if i + 1 < len(matches) else len(text)
block = text[start:end].strip()
if block:
out.append((label, block))
if not out: # 段头全空块 → 兜底
return [("Reviewer", text)]
# 段头前的引言(无段头内容)丢弃——保守:不猜归属
return out
def split_comments(block: str) -> list[str]:
"""段内按编号行切 comment 块;无编号 → [整段]。"""
block = _norm(block)
matches = list(_COMMENT_NUM.finditer(block))
if len(matches) < 2: # 单个编号或无编号 → 整段一条
return [block] if block else []
out: list[str] = []
for i, m in enumerate(matches):
start = m.end()
end = matches[i + 1].start() if i + 1 < len(matches) else len(block)
chunk = block[start:end].strip()
if chunk:
out.append(chunk)
return out or [block]
def _fallback_segment(seg: str) -> dict[str, Any]:
title = re.sub(r"\s+", " ", seg)[:60]
return {
"title": title,
"severity": "major",
"sub_items": [{"title": title, "body": seg, "confidence": 1.0}],
}
_SEG_SYSTEM = (
"你是学术审稿意见解析助手。输入是一段审稿意见原文。输出 JSON:"
'{"title": "≤12词标题", "severity": "major|minor|question", '
'"sub_items": [{"title": "...", "body": "该子问题完整原文", "confidence": 0.0-1.0}]}。'
"severity:major=要求补实验/补数据/重分析;minor=格式/表述小问题;"
"question=仅提问、无需修改稿件。"
"若该段含多个可独立回复的子问题则拆成多个 sub_items(confidence 给拆分把握度),"
"否则 1 个 sub_items(confidence=1.0)。只输出 JSON。"
)
async def _ask_llm_segment(llm: LLMCallable, seg: str) -> dict[str, Any] | None:
try:
data = await llm(
[{"role": "system", "content": _SEG_SYSTEM},
{"role": "user", "content": seg}],
temperature=0.0,
)
if not isinstance(data, dict) or not isinstance(data.get("sub_items"), list):
return None
sev = str(data.get("severity", "")).lower()
title = str(data.get("title") or "").strip() or seg[:60]
subs: list[dict[str, Any]] = []
for s in data["sub_items"][:8]:
if not isinstance(s, dict):
continue
body = str(s.get("body") or "").strip()
if not body:
continue
try:
conf = float(s.get("confidence", 1.0))
except (TypeError, ValueError):
conf = 0.0
subs.append({
"title": str(s.get("title") or "").strip() or title,
"body": body,
"confidence": max(0.0, min(1.0, conf)),
})
if not subs:
return None
return {"title": title,
"severity": sev if sev in ("major", "minor", "question") else "major",
"sub_items": subs}
except Exception: # noqa: BLE001 — LLM 失败即回退正则,不猜测
return None
def _resolve_cross_refs(body: str, ordinal_map: dict[int, str]) -> list[dict[str, Any]]:
refs: list[dict[str, Any]] = []
for m in _CROSS_REF.finditer(body):
raw = m.group(0).strip()
num = next((int(g) for g in m.groups() if g and g.isdigit()), None)
if num is None and "同上" in raw:
num = _prev_ordinal(ordinal_map, m.start()) # 同上 → 上一条,保守仅前一条
target = ordinal_map.get(num) if num is not None else None
refs.append({"raw": raw, "target_id": target})
return refs
def _prev_ordinal(ordinal_map: dict[int, str], _pos: int) -> int | None:
# 简化:同上 → 已知最大编号(即前一条)
return max(ordinal_map) if ordinal_map else None
async def parse_review_text(text: str, llm: LLMCallable) -> list[dict[str, Any]]:
"""→ reviewers=[{id, label, ordinal, comments:[Comment]}](不含 job 包装)。"""
reviewers_out: list[dict[str, Any]] = []
cid_seq = 0
for r_ord, (label, block) in enumerate(split_reviewers(text), start=1):
segs = split_comments(block)
if not segs:
continue
comments: list[dict[str, Any]] = []
ordinal_map: dict[int, str] = {}
parsed_seg: list[dict[str, Any]] = []
for seg in segs:
llm_res = await _ask_llm_segment(llm, seg)
# 交叉核对:LLM 无法给出结构 → 该段回退正则
parsed_seg.append(llm_res if llm_res else _fallback_segment(seg))
for seg_idx, (seg, p) in enumerate(zip(segs, parsed_seg), start=1):
subs = p["sub_items"]
split = len(subs) >= 2 and max(s["confidence"] for s in subs) >= _SPLIT_CONFIDENCE
group_id = f"g{r_ord}-{seg_idx}"
items = subs if split else [subs[0]]
if not split and len(subs) > 1:
# 未达阈值 → 多子问题并回一条(body 用整段原文)
items = [{"title": p["title"], "body": seg, "confidence": 1.0}]
for it in items:
cid_seq += 1
cid = f"c{cid_seq:04d}"
# 保守:不拆时 body 保留该段原文(不采信 LLM 改写);拆时用子项 body
body = it["body"] if split else seg
ordinal_map[seg_idx] = cid
comments.append({
"id": cid,
"group_id": group_id if split else None,
"severity": p["severity"],
"title": it["title"],
"body": body,
"sub_items": [s["title"] for s in subs] if split else [],
"cross_refs": _resolve_cross_refs(body, ordinal_map),
"response": {"parts": []},
"draft": None,
"validation": None,
"human_confirmed": False,
"scanner_downgraded": False,
})
# cross_refs 需全量 comment id 后再扫一遍(前面扫时 map 未齐)
for c in comments:
c["cross_refs"] = _resolve_cross_refs(c["body"], ordinal_map)
if comments:
reviewers_out.append({
"id": f"r{r_ord}", "label": label, "ordinal": r_ord,
"comments": comments,
})
return reviewers_out
@@ -0,0 +1,162 @@
"""services/rebuttal_store.py —— Rebuttal Phase 1 任务持久化(SQLite,自含连接)。
设计(2026-10-12 定稿):
- 表 rebuttal_jobs 落在 review_service/review.db(与 journals 同库不同表);
本模块自开短连接(低频 CRUD,WAL 下足够),不改既有 app/db.py。
- Job/Comment 全量以 JSON 存 reviewers_json 列(Phase 1 规模 ≤ 数十条,
整读整写最简单且可测;并发写靠 updated_at + 单进程串行)。
- human_ack 不信前端置位:confirm 端点改完 comment 后由本模块重算——
所有 comment.human_confirmed 全 true 才置 1(决策 4)。
- 不做 TTL 自动清理(决策 5);DELETE 端点手动删。
"""
from __future__ import annotations
import json
import sqlite3
import uuid
from datetime import datetime, timezone
from pathlib import Path
from typing import Any
from ..config import get_settings
_SCHEMA = """
CREATE TABLE IF NOT EXISTS rebuttal_jobs (
id TEXT PRIMARY KEY,
status TEXT NOT NULL,
source_kind TEXT,
filename TEXT,
raw_text TEXT,
template TEXT DEFAULT 'generic',
reviewers_json TEXT NOT NULL,
letter_md TEXT,
validation_json TEXT,
human_ack INTEGER DEFAULT 0,
created_at TEXT,
updated_at TEXT
);
"""
def _now() -> str:
return datetime.now(timezone.utc).isoformat(timespec="seconds")
def new_id(prefix: str = "") -> str:
return prefix + uuid.uuid4().hex[:12]
def _connect() -> sqlite3.Connection:
db_path: Path = get_settings().db_path_abs
db_path.parent.mkdir(parents=True, exist_ok=True)
conn = sqlite3.connect(str(db_path), timeout=5)
conn.row_factory = sqlite3.Row
conn.execute("PRAGMA journal_mode=WAL")
return conn
def ensure_table() -> None:
with _connect() as conn:
conn.executescript(_SCHEMA)
def _row_to_job(row: sqlite3.Row) -> dict[str, Any]:
return {
"id": row["id"],
"status": row["status"],
"source": {
"kind": row["source_kind"] or "text",
"filename": row["filename"],
"raw_text": row["raw_text"] or "",
},
"template": row["template"] or "generic",
"reviewers": json.loads(row["reviewers_json"] or "[]"),
"letter_md": row["letter_md"],
"validation": json.loads(row["validation_json"]) if row["validation_json"] else None,
"human_ack": bool(row["human_ack"]),
"created_at": row["created_at"],
"updated_at": row["updated_at"],
}
def insert_job(job: dict[str, Any]) -> None:
"""写入完整 job(reviewers 等结构由调用方构造好)。"""
now = job.get("created_at") or _now()
with _connect() as conn:
conn.execute(
"INSERT INTO rebuttal_jobs (id, status, source_kind, filename, raw_text,"
" template, reviewers_json, letter_md, validation_json, human_ack,"
" created_at, updated_at) VALUES (?,?,?,?,?,?,?,?,?,?,?,?)",
(
job["id"], job.get("status") or "ready",
(job.get("source") or {}).get("kind"),
(job.get("source") or {}).get("filename"),
(job.get("source") or {}).get("raw_text"),
job.get("template") or "generic",
json.dumps(job.get("reviewers") or [], ensure_ascii=False),
job.get("letter_md"),
json.dumps(job.get("validation"), ensure_ascii=False)
if job.get("validation") is not None else None,
1 if job.get("human_ack") else 0,
now, now,
),
)
def get_job(job_id: str) -> dict[str, Any] | None:
with _connect() as conn:
row = conn.execute(
"SELECT * FROM rebuttal_jobs WHERE id=?", (job_id,)
).fetchone()
return _row_to_job(row) if row else None
def update_job(job_id: str, *, reviewers: list[dict[str, Any]] | None = None,
letter_md: str | None = None, status: str | None = None) -> dict[str, Any] | None:
"""局部更新;reviewers 变更时重算 human_ack(全勾才 true)。"""
job = get_job(job_id)
if job is None:
return None
if reviewers is not None:
job["reviewers"] = reviewers
if letter_md is not None:
job["letter_md"] = letter_md
if status is not None:
job["status"] = status
job["human_ack"] = all_comments_confirmed(job["reviewers"])
job["updated_at"] = _now()
with _connect() as conn:
conn.execute(
"UPDATE rebuttal_jobs SET reviewers_json=?, letter_md=?, status=?,"
" human_ack=?, updated_at=? WHERE id=?",
(
json.dumps(job["reviewers"], ensure_ascii=False),
job.get("letter_md"),
job["status"],
1 if job["human_ack"] else 0,
job["updated_at"],
job_id,
),
)
return job
def delete_job(job_id: str) -> bool:
with _connect() as conn:
cur = conn.execute("DELETE FROM rebuttal_jobs WHERE id=?", (job_id,))
return cur.rowcount > 0
def all_comments(reviewers: list[dict[str, Any]]) -> list[dict[str, Any]]:
out: list[dict[str, Any]] = []
for r in reviewers or []:
out.extend(r.get("comments") or [])
return out
def all_comments_confirmed(reviewers: list[dict[str, Any]]) -> bool:
comments = all_comments(reviewers)
# 空 job(未解析出任何 comment)不置位 human_ack,避免"全勾"平凡真
if not comments:
return False
return all(bool(c.get("human_confirmed")) for c in comments)
@@ -0,0 +1,232 @@
"""services/recommend_engine.py —— presubmit recommendation 规则引擎(纯函数,零 LLM)。
背景(2026-10-12 诊断):旧链路由 LLM 直接输出 recommendation,且 SYSTEM_PROMPT 配额
强制 "major_weaknesses 3-8 条",导致 accept/minor_revision 几乎不可达(对照实验中
强稿——BUSCO 96.8%/Hi-C 98.7%/accession 齐/UFBoot 1000——仍被凑出 6 条 major)。
新链路:LLM 只如实列 weakness(major 带 hard_rule/fatal 标签),本引擎按可测规则
计算 recommendation + rationale(模板拼装,可复现,不经 LLM)。
判定链(自上而下首条命中):
R0 任一 major 带 fatal=true → reject(须人工复核)
R1 H = 硬性 major 数 ≥ 1 → major_revision(与 tier 无关,不可协商)
R2' tier==3 且 1≤S≤2 且 H==0 → minor_revision(入门刊仅 soft 可降)
R2 S = soft major 数 ≥ 1 → major_revision(S≥5 标 severe,仍非 reject)
R4 S == 0 且 minor ≤ accept_max_minor[tier] → accept
R5 S == 0 → minor_revision
其中 S = 总 major 数 − 硬性标签数(标签漏打时 S 变大,只会更严不会漏放)。
"""
from __future__ import annotations
import json
import re
import sqlite3
from functools import lru_cache
from pathlib import Path
from typing import Any, Iterable
from ..config import get_settings
# 硬性规则标签(SYSTEM_PROMPT 与 coerce 共用白名单;未知标签一律置 None)
HARD_RULE_TAGS = (
"busco_missing", # 组装类论文缺 BUSCO 完整格式
"hic_missing", # 宣称 chromosome-level/Hi-C 但缺挂载率
"accession_missing", # 缺数据 Accession("will be deposited" 视为缺)
"voucher_missing", # 野生材料缺凭证标本
"abs_missing", # 缺 ABS/名古屋合规声明
)
HARD_RULE_LABELS = {
"busco_missing": "BUSCO 完整度缺失",
"hic_missing": "Hi-C 挂载率缺失",
"accession_missing": "数据 Accession 缺失",
"voucher_missing": "凭证标本缺失",
"abs_missing": "ABS/名古屋合规声明缺失",
}
TIER_LABELS = {1: "顶刊", 2: "主流期刊", 3: "入门期刊"}
# tier 参数:accept 门槛(minor 上限);tier3 额外允许 ≤2 条 soft major 降为小修
TIER_ACCEPT_MAX_MINOR = {1: 1, 2: 2, 3: 3}
TIER3_SOFT_MAJOR_AS_MINOR_MAX = 2
# ---- tier 查找优先级(2026-10-12):override → featured → jif → 默认 ----
# ① 用户高频投稿顶刊硬编码(精确名匹配,不受 jif/综述刊启发式影响;
# "The " 前缀归一化,"Plant Cell"/"The Plant Cell" 互认)
TIER1_OVERRIDES = frozenset(
re.sub(r"^the\s+", "", name.casefold()) for name in (
"Nature", "Nature Genetics", "Nature Plants", "Nature Biotechnology",
"Nature Methods", "Cell", "Science", "Genome Biology", "Molecular Plant",
"The Plant Cell", "Nature Communications", "Science Advances", "Cell Research",
)
)
# 综述刊不因高 jif 升 tier1(Annual Review of… / Trends in… / …Reviews)
_REVIEW_JOURNAL_RE = re.compile(r"reviews?\b|\btrends\b|annual\s+review", re.IGNORECASE)
_JIF_TIER1_MIN = 15.0 # jif >= 15 → tier1;5 ≤ jif < 15 → tier2;<5/NULL → 默认 tier2
@lru_cache(maxsize=1)
def _tier_by_name() -> dict[str, int]:
"""journals.json 精选期刊 name(casefold) → review_tier(读文件一次,缓存)。"""
path = get_settings().journals_seed_abs
try:
payload = json.loads(Path(path).read_text(encoding="utf-8"))
except (OSError, ValueError):
return {}
out: dict[str, int] = {}
for j in payload.get("journals") or []:
if not isinstance(j, dict):
continue
name = str(j.get("name") or "").strip().casefold()
tier = j.get("review_tier")
if name and isinstance(tier, int) and tier in (1, 2, 3):
out[name] = tier
return out
@lru_cache(maxsize=256)
def _jif_by_name(name_bare_cf: str) -> float | None:
"""journal_directory 按名查 jif(只读一列;表缺失/查不到 → None)。"""
db = get_settings().db_path_abs
if not Path(db).exists():
return None
try:
conn = sqlite3.connect(f"file:{db}?mode=ro", uri=True, timeout=2)
try:
row = conn.execute(
"SELECT jif FROM journal_directory WHERE lang='en' "
"AND (lower(name)=? OR lower(name)=?) "
"ORDER BY jif DESC LIMIT 1",
(name_bare_cf, "the " + name_bare_cf),
).fetchone()
finally:
conn.close()
except sqlite3.Error:
return None
if not row or row[0] is None:
return None
try:
return float(row[0])
except (TypeError, ValueError):
return None
def resolve_tier(target_journal: str) -> tuple[int, str]:
"""目标期刊 → (tier, source)。source ∈ override/featured/jif/默认。
查找优先级:① 硬编码 13 本顶刊 ② journals.json review_tier
③ journal_directory jif 启发式(综述刊除外)④ 默认 tier 2。
"""
raw = (target_journal or "").strip()
if not raw:
return 2, "默认"
key = raw.casefold()
bare = re.sub(r"^the\s+", "", key)
if bare in TIER1_OVERRIDES:
return 1, "override"
featured = _tier_by_name()
tier = featured.get(key, featured.get(bare))
if isinstance(tier, int) and tier in (1, 2, 3):
return tier, "featured"
if not _REVIEW_JOURNAL_RE.search(bare):
jif = _jif_by_name(bare)
if jif is not None:
return (1 if jif >= _JIF_TIER1_MIN else 2), "jif"
return 2, "默认"
def _item_field(item: Any, key: str) -> Any:
if isinstance(item, dict):
return item.get(key)
return getattr(item, key, None)
def decide_recommendation(
majors: Iterable[Any],
minors: Iterable[Any] = (),
presentations: Iterable[Any] = (),
tier: int = 2,
) -> dict[str, Any]:
"""规则引擎入口。majors 项可为 dict 或带 hard_rule/fatal 属性的对象。
返回 {"recommendation": ..., "rationale": {...}};
rationale 含 rule/hard_hits/计数/tier/tier_label/explanation(模板拼装)。
"""
del presentations # 呈现类不参与判定(仅归档展示)
majors = list(majors)
minors = list(minors)
if tier not in (1, 2, 3):
tier = 2
hard_hits: list[str] = []
fatal = False
for m in majors:
if bool(_item_field(m, "fatal")):
fatal = True
hr = _item_field(m, "hard_rule")
if hr in HARD_RULE_LABELS:
hard_hits.append(hr)
m_count = len(majors)
h_count = len(hard_hits)
s_count = m_count - h_count # soft major(标签漏打 → 计入 S,只会更严)
minor_count = len(minors)
tier_label = TIER_LABELS[tier]
# tier3 降级通道提示(对作者可见:同稿投不同档结果不同)
tier_note = ""
if h_count == 0 and 1 <= s_count <= TIER3_SOFT_MAJOR_AS_MINOR_MAX and tier != 3:
tier_note = f"当前判定基于 tier {tier} 档;tier 3 入门刊此稿可能判 minor_revision。"
def _result(rec: str, rule: str, explanation: str) -> dict[str, Any]:
return {
"recommendation": rec,
"rationale": {
"rule": rule,
"hard_hits": hard_hits,
"major_count": m_count,
"hard_count": h_count,
"soft_count": s_count,
"minor_count": minor_count,
"tier": tier,
"tier_label": tier_label,
"explanation": explanation + tier_note,
},
}
# R0:fatal → reject(前端须配"建议人工复核")
if fatal:
return _result(
"reject", "R0",
"存在 fatal 级问题(数据可靠性/伦理,须人工复核)→ 建议拒稿。")
# R1:硬性 major 不可协商
if h_count >= 1:
labels = "、".join(HARD_RULE_LABELS.get(t, t) for t in dict.fromkeys(hard_hits))
return _result(
"major_revision", "R1",
f"命中硬性缺陷({labels})→ 大修(不可协商);"
f"另有大修级 {s_count} 条、小修级 {minor_count} 条。")
# R2':入门刊 1-2 条 soft major 可降为小修
if tier == 3 and 1 <= s_count <= TIER3_SOFT_MAJOR_AS_MINOR_MAX:
return _result(
"minor_revision", "R2'",
f"无硬性缺陷,大修级(soft){s_count} 条;"
f"入门刊(tier 3)可将 ≤{TIER3_SOFT_MAJOR_AS_MINOR_MAX} 条 soft 降为小修 → 建议小修。")
# R2/R3:soft major ≥ 1(S≥5 标 severe)
if s_count >= 1:
sev = ",severe" if s_count >= 5 else ""
return _result(
"major_revision", "R2",
f"大修级问题 {s_count} 条(均非硬性{sev})→ 建议大修。")
# R4/R5:无 major
accept_max = TIER_ACCEPT_MAX_MINOR[tier]
if minor_count <= accept_max:
return _result(
"accept", "R4",
f"无大修级问题,小修级 {minor_count} 条(≤{accept_max})→ 建议接收。")
return _result(
"minor_revision", "R5",
f"无大修级问题,小修级 {minor_count} 条 → 建议小修。")
+553
View File
@@ -0,0 +1,553 @@
r"""services/reformat.py —— P1 论文重排版(.tex 源码级规则变换,不编译)。
链路:resolve_rules(三级规则解析)→ reformat_tex(4 变换器 + 结构守卫)
→ 路由层落盘 data/reformat_jobs/{job_id}.tex/.json。
纯规则、零 LLM、零执行用户内容、不碰 docx/pdf(那两个只在 FormatPanel 审核)。
拍板(用户 4 点确认,2026-10-10):
1. changes[] 每条带 rule_key ∈ {font_pt, margin, line_spacing, bib_style}、
action ∈ {modified, inserted, warning}(P1 只产生 modified/warning,
inserted 留给后续阶段);前端按 rule_key 着色、按 action 计数。
2. 保守插入策略:命令/选项缺失一律【不改源码】→ changes 里 action=warning,
reason 附"建议手动添加"的代码片段;warning 不计入"已修改"计数。
(warnings[] 顶层数组只放结构级提示,如多处 \documentclass。)
3. target_journal 必填;"default"= 通用规则(min_font_pt=11, min_margin_mm=20,
min_line_spacing=1.5, refs_style=apa),前端下拉首项即通用。
4. P1 仅 .tex;结构畸形宁拒不猜(PARSER_FAILED)。
铁律:
① 只在违反规则时改(合规零触碰 → 重跑幂等,changes=[])
② 只收紧不放松:字号/行距/边距只调大、绝不调小
③ 每条修改必须能回答"为什么":reason 带原值/目标值/规则
规则解析链(resolve_rules):
"default" → 内置通用规则
journals.json id/name 命中 → data/format_cache/{id}.json ok → fetched
→ 否则 format_rules 非 placeholder → official
→ 否则通用规则 + 占位说明
形如 "en:xxx"/"zh:xxx"(journal_directory)→ 只读查目录拿 name → 回链上一步
其他字符串(期刊名) → 回链 journals.json → 未中 → 通用 + 未匹配说明
"""
from __future__ import annotations
import json
import re
from pathlib import Path
from typing import Any
# review_service/app/services/ → parents[2] = review_service/
_ROOT = Path(__file__).resolve().parents[2]
_SEED_PATH = _ROOT / "data" / "journals" / "journals.json"
_CACHE_DIR = _ROOT / "data" / "format_cache"
_EPS = 1e-9
# 通用规则(拍板 3:与 journals.json format_rules_default 的 9/15/1.15 不同,
# 这是重排版自己的"通用规则"口径,勿混用)
RULES_DEFAULT: dict[str, Any] = {
"rules_source": "default",
"max_pages": 10,
"min_font_pt": 11,
"min_margin_mm": 20.0,
"min_line_spacing": 1.5,
"min_figures": 1,
"max_fonts": 6,
"refs_style": "apa",
"anonymous": None,
}
# 参考文献样式 → 经典 .bst(均为发行版基础件)。
# 修正(2026-10-10):author_year 旧映射 plain 是错的——plain.bst 是编号制 [1];
# author-year 制应映射 apalike.bst(Author, 2020)。apa 同理。
REFS_BST_MAP: dict[str, str] = {
"apa": "apalike",
"author_year": "apalike",
"numbered": "unsrt",
"vancouver": "unsrt",
"gb7714": "gb7714",
}
# biblatex 工作流的 style= 建议名(与 .bst 是两套体系)
BIBLATEX_STYLE_MAP: dict[str, str] = {
"apa": "apa",
"author_year": "authoryear",
"numbered": "numeric",
"vancouver": "numeric",
"gb7714": "gb7714",
}
_DOCCLASS_RE = re.compile(r"(\\documentclass)\s*(\[[^\]]*\])?\s*\{([^}]*)\}")
_PKG_RE = re.compile(r"\\(?:usepackage|RequirePackage)\s*(\[[^\]]*\])?\s*\{([^}]*)\}")
_SPACING_RE = re.compile(r"\\(?:linespread|setstretch)\s*\{\s*(\d+(?:\.\d+)?)\s*\}")
_BIBSTYLE_RE = re.compile(r"\\bibliographystyle\s*\{\s*([^}]+?)\s*\}")
_PT_RE = re.compile(r"(\d+(?:\.\d+)?)\s*pt\b")
_BEGIN_DOC_RE = re.compile(r"\\begin\s*\{\s*document\s*\}")
_BIBLATEX_RE = re.compile(r"\\(?:printbibliography|addbibresource)")
_MM_FACTORS = {"mm": 1.0, "cm": 10.0, "in": 25.4, "inch": 25.4, "pt": 25.4 / 72.0}
_SIDE_KEYS = ("left", "right", "top", "bottom")
_MARGIN_ATTRS = ("margin", "hmargin", "vmargin", "left", "right", "top", "bottom",
"inner", "outer")
class ReformatError(Exception):
"""结构畸形无法安全处理(code: PARSER_FAILED)。"""
def __init__(self, code: str, message: str) -> None:
super().__init__(message)
self.code = code
# ================================================================ 规则解析链
def _seed_entries() -> list[dict[str, Any]]:
try:
data = json.loads(_SEED_PATH.read_text("utf-8"))
entries = data.get("journals")
return [e for e in entries if isinstance(e, dict)] if isinstance(entries, list) else []
except (OSError, ValueError):
return []
def _find_seed(text: str) -> dict[str, Any] | None:
low = text.strip().casefold()
if not low:
return None
for e in _seed_entries():
if str(e.get("id", "")).casefold() == low or str(e.get("name", "")).casefold() == low:
return e
return None
def _cache_rules(journal_id: str) -> dict[str, Any] | None:
"""data/format_cache/{id}.json(抓取+LLM 抽取产物);ok=false/缺失 → None。"""
try:
payload = json.loads((_CACHE_DIR / f"{journal_id}.json").read_text("utf-8"))
except (OSError, ValueError):
return None
if not isinstance(payload, dict) or not payload.get("ok"):
return None
rules = payload.get("format_rules")
return rules if isinstance(rules, dict) and rules.get("rules_source") else None
def _merged(rules: dict[str, Any]) -> dict[str, Any]:
"""专属规则叠加在通用规则上(缺失键/显式 null 保留——fetched 的 null 是诚实未知)。"""
return {**RULES_DEFAULT, **rules}
async def _directory_name(journal_id: str) -> str | None:
"""journal_directory id → name(只读;表未连/不存在 → None,绝不抛错)。"""
try:
from ..db import db # 惰性导入:resolver 可在无 lifespan 的测试中工作
row = await db.fetchone(
"SELECT name FROM journal_directory WHERE id = ?", (journal_id,)
)
return str(row["name"]) if row and row.get("name") else None
except Exception: # noqa: BLE001 —— 查不到/未连接都按未匹配处理
return None
async def resolve_rules(target: str) -> dict[str, Any]:
"""→ {journal_id, journal_name, rules, rules_source, rules_note}(永不失败)。"""
target = (target or "").strip()
if target == "default":
return {
"journal_id": "default",
"journal_name": "通用规则",
"rules": dict(RULES_DEFAULT),
"rules_source": "default",
"rules_note": "通用规则(APA + 通用论文规范)",
}
display_name = target
entry = _find_seed(target)
if entry is None and ":" in target:
# journal_directory id(en:0028-0836 / zh:slug)→ 目录查 name → 再回链种子
name = await _directory_name(target)
if name:
display_name = name
entry = _find_seed(name)
elif entry is None:
display_name = target # 直接当期刊名回链
if entry is not None:
jid = str(entry.get("id") or "")
jname = str(entry.get("name") or display_name)
cached = _cache_rules(jid)
if cached:
return {
"journal_id": jid, "journal_name": jname, "rules": _merged(cached),
"rules_source": "fetched",
"rules_note": "该刊规则来自官网抓取 + LLM 抽取(data/format_cache,待人工核验)",
}
fr = entry.get("format_rules") if isinstance(entry.get("format_rules"), dict) else {}
if fr and fr.get("rules_source") not in (None, "placeholder", "default"):
return {
"journal_id": jid, "journal_name": jname, "rules": _merged(fr),
"rules_source": str(fr.get("rules_source")),
"rules_note": "journals.json 期刊专属规则",
}
return {
"journal_id": jid, "journal_name": jname, "rules": dict(RULES_DEFAULT),
"rules_source": "default",
"rules_note": f"「{jname}」在 journals.json 中仅有占位规则(placeholder),已用通用规则",
}
return {
"journal_id": None,
"journal_name": display_name or target,
"rules": dict(RULES_DEFAULT),
"rules_source": "default",
"rules_note": f"未匹配到「{display_name or target}」的专属格式规则,已用通用规则",
}
# ================================================================ 变换器工具
def _change(line_no: int, original: str, modified: str, reason: str,
rule_key: str, action: str) -> dict[str, Any]:
return {
"line": line_no,
"original": original.rstrip("\n"),
"modified": modified.rstrip("\n"),
"reason": reason,
"rule_key": rule_key,
"action": action,
}
def _warning_change(line_no: int, original: str, reason: str, rule_key: str) -> dict[str, Any]:
return _change(line_no, original, "", reason, rule_key, "warning")
def _parse_mm(raw: str) -> float | None:
"""geometry 长度值 → mm;裸数字按 TeX 惯例 pt(同 format_check 先例);未知 → None。"""
m = re.fullmatch(r"\s*(\d+(?:\.\d+)?)\s*([A-Za-z]*)\s*", raw or "")
if not m:
return None
unit = (m.group(2) or "pt").lower()
factor = _MM_FACTORS.get(unit)
if factor is None:
return None
return float(m.group(1)) * factor
def _fmt(v: float) -> str:
return f"{v:g}"
# ================================================================ ① 字号 font_pt
def _transform_font(lines: list[str], orig: list[str], rules: dict[str, Any],
doc_idx: int) -> list[dict[str, Any]]:
min_pt = rules.get("min_font_pt")
if min_pt is None:
return []
min_pt = float(min_pt)
line = lines[doc_idx]
m = _DOCCLASS_RE.search(line)
if not m: # 守卫已保证,理论不可达
return []
opts = m.group(2) # "[...]" 或 None
cls = m.group(3).strip()
opts_inner = opts[1:-1] if opts else ""
pt_m = _PT_RE.search(opts_inner)
if pt_m is None:
# 拍板 2:选项缺失不自动加 → warning + 建议片段
if opts_inner:
suggestion = f"\\documentclass[{opts_inner}, {_fmt(min_pt)}pt]{{{cls}}}"
else:
suggestion = f"\\documentclass[{_fmt(min_pt)}pt]{{{cls}}}"
return [_warning_change(
doc_idx + 1, orig[doc_idx],
f"未检测到字号选项,无法核验正文字号(目标下限 {_fmt(min_pt)}pt),"
f"建议手动声明:{suggestion}",
"font_pt",
)]
cur = float(pt_m.group(1))
if cur >= min_pt - _EPS:
return []
target = next((s for s in (10, 11, 12) if s >= min_pt - _EPS), min_pt)
new_inner = opts_inner[:pt_m.start(1)] + _fmt(target) + opts_inner[pt_m.end(1):]
new_line = line[:m.start(2) + 1] + new_inner + line[m.start(2) + 1 + len(opts_inner):]
lines[doc_idx] = new_line
return [_change(
doc_idx + 1, orig[doc_idx], new_line,
f"正文字号 {_fmt(cur)}pt 低于目标下限 {_fmt(min_pt)}pt,改为 {_fmt(target)}pt",
"font_pt", "modified",
)]
# ================================================================ ② 页边距 margin
def _find_geometry(lines: list[str]) -> tuple[int, re.Match] | None:
for i, line in enumerate(lines):
for m in _PKG_RE.finditer(line):
pkgs = [p.strip().lower() for p in m.group(2).split(",")]
if "geometry" in pkgs:
return i, m
return None
def _patch_attr(line: str, key: str, new_val: str) -> str:
"""geometry 选项里 key=old → key=new(首个匹配)。
值止于 `,` 或 `]`——绝不能吞掉 `]{geometry}` 尾巴(否则下一轮就找不到
geometry 宏包,破坏幂等)。key 带 \\b 防 hmargin/margin 互撞。
"""
return re.sub(rf"(\b{key}\s*=\s*)([^,\]]+)", lambda m: m.group(1) + new_val,
line, count=1)
def _transform_margin(lines: list[str], orig: list[str], rules: dict[str, Any],
doc_idx: int) -> list[dict[str, Any]]:
min_mm = rules.get("min_margin_mm")
if min_mm is None:
return []
min_mm = float(min_mm)
out: list[dict[str, Any]] = []
found = _find_geometry(lines)
if found is None:
return [_warning_change(
doc_idx + 1, orig[doc_idx],
f"未检测到 geometry 宏包,无法核验页边距(目标下限 {_fmt(min_mm)}mm),"
f"建议手动添加:\\usepackage[margin={_fmt(min_mm)}mm]{{geometry}}"
f"(置于 \\documentclass 之后)",
"margin",
)]
gi, gm = found
opts = gm.group(1)
if opts is None:
# \usepackage{geometry} 裸用 → 建议加选项(拍板 2 不自动改)
return [_warning_change(
gi + 1, orig[gi],
f"geometry 未设置边距选项,无法核验页边距(目标下限 {_fmt(min_mm)}mm),"
f"建议手动改为:\\usepackage[margin={_fmt(min_mm)}mm]{{geometry}}",
"margin",
)]
opts_inner = opts[1:-1]
attrs: dict[str, str] = {}
for part in opts_inner.split(","):
if "=" in part:
k, _, v = part.partition("=")
attrs[k.strip().lower()] = v.strip()
present = [k for k in _MARGIN_ATTRS if k in attrs]
if not present:
return [_warning_change(
gi + 1, orig[gi],
f"geometry 未设置边距相关选项(目标下限 {_fmt(min_mm)}mm),"
f"建议在现有选项中添加:margin={_fmt(min_mm)}mm",
"margin",
)]
# 逐边解析提供者(side > h/vmargin > margin;inner/outer 单独按自身长度评)
def provider_for(side: str) -> str | None:
if side in attrs:
return side
if side in ("left", "right") and "hmargin" in attrs:
return "hmargin"
if side in ("top", "bottom") and "vmargin" in attrs:
return "vmargin"
if "margin" in attrs:
return "margin"
if side in ("left", "right") and "inner" in attrs:
return "inner" # 见下:inner/outer 单独评估,此处不按边处理
if side in ("left", "right") and "outer" in attrs:
return "outer"
return None
patch_keys: dict[str, str] = {} # attr → 新值(同键只抬一次)
reasons: list[str] = []
unresolved: list[str] = []
for side in _SIDE_KEYS:
pkey = provider_for(side)
if pkey in ("inner", "outer"):
continue # 由下方 inner/outer 评估负责
if pkey is None:
unresolved.append(side)
continue
mm = _parse_mm(attrs.get(pkey, ""))
if mm is None:
unresolved.append(side)
continue
if mm < min_mm - _EPS and pkey not in patch_keys:
patch_keys[pkey] = f"{_fmt(min_mm)}mm"
reasons.append(f"页边距 {side}({_fmt(mm)}mm) 低于下限 {_fmt(min_mm)}mm → {_fmt(min_mm)}mm")
for key in ("inner", "outer"):
if key in attrs:
mm = _parse_mm(attrs[key])
if mm is None:
unresolved.append(key)
elif mm < min_mm - _EPS and key not in patch_keys:
patch_keys[key] = f"{_fmt(min_mm)}mm"
reasons.append(f"页边距 {key}({_fmt(mm)}mm) 低于下限 {_fmt(min_mm)}mm → {_fmt(min_mm)}mm")
out: list[dict[str, Any]] = []
if patch_keys:
new_line = lines[gi]
for key, val in patch_keys.items():
new_line = _patch_attr(new_line, key, val)
lines[gi] = new_line
out.append(_change(
gi + 1, orig[gi], new_line, ";".join(reasons), "margin", "modified",
))
if unresolved:
uniq = "、".join(dict.fromkeys(unresolved))
out.append(_warning_change(
gi + 1, orig[gi],
f"geometry 未设置/无法解析 {uniq} 边(沿用类默认,无法核验),"
f"建议显式声明:{uniq}={_fmt(min_mm)}mm",
"margin",
))
return out
# ================================================================ ③ 行距 line_spacing
def _transform_spacing(lines: list[str], orig: list[str], rules: dict[str, Any],
doc_idx: int) -> list[dict[str, Any]]:
min_ls = rules.get("min_line_spacing")
if min_ls is None:
return []
min_ls = float(min_ls)
# 只看导言区(\begin{document} 之前);正文中的 \setstretch 是局部覆盖,不碰
end = len(lines)
for i, line in enumerate(lines):
if _BEGIN_DOC_RE.search(line):
end = i
break
records: list[tuple[int, re.Match]] = []
for i in range(end):
for m in _SPACING_RE.finditer(lines[i]):
records.append((i, m))
if not records:
return [_warning_change(
doc_idx + 1, orig[doc_idx],
f"未在导言区检测到 \\linespread 或 \\setstretch,无法核验行距"
f"(目标下限 {_fmt(min_ls)}),建议手动添加到导言区:"
f"\\linespread{{{_fmt(min_ls)}}}",
"line_spacing",
)]
i, m = records[-1] # 最后一次出现者生效(LaTeX 后设覆盖前设)
cur = float(m.group(1))
if cur >= min_ls - _EPS:
return []
new_line = lines[i][:m.start(1)] + _fmt(min_ls) + lines[i][m.end(1):]
lines[i] = new_line
return [_change(
i + 1, orig[i], new_line,
f"行距 {_fmt(cur)} 低于目标下限 {_fmt(min_ls)},改为 {_fmt(min_ls)}",
"line_spacing", "modified",
)]
# ================================================================ ④ 参考文献 bib_style
def _transform_bib(lines: list[str], orig: list[str], rules: dict[str, Any],
doc_idx: int) -> list[dict[str, Any]]:
style = str(rules.get("refs_style") or "").strip().lower()
if not style:
# 规则未提供已确认的 refs_style(如 Frontiers 两种制式并存待核实):
# 绝不猜测改写用户样式——保持原样 + warning 提示(拍板 2026-10-10)
return [_warning_change(
doc_idx + 1, orig[doc_idx],
"该刊引用风格未确认,未改动 \\bibliographystyle;"
"建议人工核实期刊投稿指南后再调整",
"bib_style",
)]
m = next((mm for line in lines if (mm := _BIBSTYLE_RE.search(line))), None)
if m is not None:
i = next(idx for idx, line in enumerate(lines) if _BIBSTYLE_RE.search(line))
cur = m.group(1).strip()
if style not in REFS_BST_MAP:
return [_warning_change(
i + 1, orig[i],
f"目标参考文献样式 {style} 无对应标准 .bst,未替换"
f"(当前 \\bibliographystyle{{{cur}}}),请按目标期刊模板手动选择样式",
"bib_style",
)]
target = REFS_BST_MAP[style]
if cur.casefold() == target.casefold():
return []
new_line = lines[i][:m.start(1)] + target + lines[i][m.end(1):]
lines[i] = new_line
hint = "(需 gbt7714 宏包)" if target == "gb7714" else ""
return [_change(
i + 1, orig[i], new_line,
f"参考文献样式要求 {style}:\\bibliographystyle{{{cur}}} → {{{target}}}{hint}",
"bib_style", "modified",
)]
has_biblatex = any(_BIBLATEX_RE.search(line) for line in lines)
if has_biblatex:
suggest = BIBLATEX_STYLE_MAP.get(style, style)
return [_warning_change(
doc_idx + 1, orig[doc_idx],
f"检测到 biblatex 工作流(未找到 \\bibliographystyle),"
f"请在 \\printbibliography 选项中手动配置:style={suggest}(对应 {style})",
"bib_style",
)]
if style in REFS_BST_MAP:
target = REFS_BST_MAP[style]
return [_warning_change(
doc_idx + 1, orig[doc_idx],
f"未检测到 \\bibliographystyle,建议手动添加:\\bibliographystyle{{{target}}}"
f"(对应 {style})",
"bib_style",
)]
return [_warning_change(
doc_idx + 1, orig[doc_idx],
f"未检测到 \\bibliographystyle,目标样式 {style} 无标准 .bst 映射,"
f"请按期刊模板手动配置",
"bib_style",
)]
# ================================================================ 入口
def reformat_tex(source: str, rules: dict[str, Any]) -> dict[str, Any]:
"""源码 + 规则 → {modified_tex, changes[], warnings[]}。
结构守卫:0 处 \\documentclass → ReformatError(PARSER_FAILED);
>1 处 → 只处理第一处 + warnings 补 MULTI_DOCUMENTCLASS。
"""
lines = source.splitlines(keepends=True)
doc_idxs = [i for i, line in enumerate(lines) if _DOCCLASS_RE.search(line)]
if not doc_idxs:
raise ReformatError(
"PARSER_FAILED",
"未找到 \\documentclass{...}:无法确定主文档"
"(P1 不支持由 \\input 拆分的多文件工程,请上传完整单文件源码)",
)
warnings: list[dict[str, str]] = []
if len(doc_idxs) > 1:
warnings.append({
"code": "MULTI_DOCUMENTCLASS",
"message": f"检测到 {len(doc_idxs)} 处 \\documentclass,"
f"仅处理第一处(第 {doc_idxs[0] + 1} 行)",
})
doc_idx = doc_idxs[0]
orig = list(lines) # 纯净快照:所有 change.original 取自这里
changes: list[dict[str, Any]] = []
changes += _transform_font(lines, orig, rules, doc_idx)
changes += _transform_margin(lines, orig, rules, doc_idx)
changes += _transform_spacing(lines, orig, rules, doc_idx)
changes += _transform_bib(lines, orig, rules, doc_idx)
changes.sort(key=lambda c: c["line"])
return {"modified_tex": "".join(lines), "changes": changes, "warnings": warnings}
+223
View File
@@ -0,0 +1,223 @@
"""services/self_review.py —— 植物基因组学专属自审稿(System Prompt + 报告模型)。
六大领域维度检查清单硬编码在 SYSTEM_PROMPT(发给 DeepSeek):
1. 基因组组装质量(N50/L50/BUSCO 完整格式/Hi-C 挂载率;硬性缺项打 hard_rule 标签)
2. 基因注释可靠性(MAKER/AUGUSTUS 流程、RNA-seq 证据、基因数与已知范围一致性)
3. 比较基因组学与进化(Bootstrap/后验概率、OrthoFinder 等直系同源策略)
4. 数据可用性合规(SRA/BioProject + 组装/GFF3 Accession,缺失即硬性 major)
5. 统计与实验设计(GWAS/QTL 样本量·多重校正·群体结构;转录组生物学重复)
6. 伦理与合规·植物特异性(凭证标本 voucher、ABS 惠益分享声明——均为硬性 major)
2026-10-12 判定链重构:LLM 不再输出 recommendation(旧配额制 "major 3-8 条" 导致
accept/minor 几乎不可达,见 recommend_engine.py 模块 docstring);只如实列 weakness
并打 hard_rule/fatal 标签,recommendation 由规则引擎计算。Major/Minor 每条必须给
Evidence(论文章节位置或具体指标数值),由 coerce 宽容归一化(缺失补空串,不丢条目)。
"""
from __future__ import annotations
from typing import Any
from pydantic import BaseModel, Field
from .recommend_engine import HARD_RULE_TAGS
SYSTEM_PROMPT = """你是一位植物基因组学领域资深审稿人,长期为 Plant Cell、Nature Plants、
Genome Biology、Molecular Plant、Plant Journal 等期刊审稿。请对用户提供的论文正文做
投稿前自审(pre-submission self review),严格按以下六个植物基因组学专属维度逐项检查,
输出结构化审稿意见。所有条目使用中文撰写(专业术语、指标名、工具名保留英文)。
【维度一:基因组组装质量】必查指标:
- contig N50 / scaffold N50 / L50(报了哪个要写明哪个)
- BUSCO 完整度:必须按完整格式报告——例如
"Complete 95.3% [S:93.1%, D:2.2%], Missing 4.7%, n=1614 (embryophyta_odb10)"
(含 Complete/Single-copy/Duplicated/Missing 四项与数据集版本、n 值)
- Hi-C 挂载率(anchoring rate,chromosome-level 比例)及挂载到染色体的 scaffold 比例
BUSCO 完整度三级判定:
- 完全未提 BUSCO → Major Weakness,hard_rule="busco_missing"
- 提了 BUSCO 但只有总百分比(如 98.57%),缺 Single-copy/Duplicated/Missing
分项或数据集版本(如 n=1614, embryophyta_odb10)→ 列 Minor(不打 hard_rule)
- 完整格式(如 Complete 95.3% [S:93.1%, D:2.2%], Missing 4.7%, n=1614)→ 通过,不列
Hi-C/挂载率报告识别(命中任一且给出数值即视为已报告,不得判缺):
anchoring rate / anchored to chromosome(s) / % of sequences anchored /
pseudo-chromosome(s) / chromosome-level 挂载比例。
判定规则:若组装类论文只报 N50 而未报 BUSCO 且未报 Hi-C 挂载率,列为
Major Weakness 并打对应 hard_rule 标签(BUSCO 缺失→"busco_missing";宣称
chromosome-level/Hi-C 挂载但未报挂载率→"hic_missing")。同时检查组装是否为
pseudo-chromosome 级别、污染评估(如 k-mer/coverage 检查)与 gap 比例。
【维度二:基因注释可靠性】检查:
- 是否使用标准注释流程(MAKER、AUGUSTUS、BRAKER、GeMoMa、EVidenceModeler 等),参数与版本是否交代
- 是否有转录组证据支持:RNA-seq(组织/时期/物种内或近缘种)比对支撑比例,或蛋白同源证据
- 基因数量是否与该物种已知基因数范围一致(如水稻 ~37-40k、拟南芥 ~27k、玉米 ~39-45k、
小麦 ~107k、大豆 ~46k;近缘种偏差过大须说明);有无转座元件基因误注释的排查
- 注释质量评估:BRAKER/AED 分值、BUSCO 在蛋白集上的复核
【维度三:比较基因组学与进化】检查:
- 系统发育树:每个节点建议标注 Bootstrap 支持率(建议 ≥1000 次重复)或贝叶斯后验概率。
分诊:
* 完全未做节点支持率分析(方法与正文均无任何声明)且支撑核心进化结论 → Major
* 方法/正文声明已做 bootstrap 或后验概率,仅图中未标注数值 → presentation_format
(图注补标即可,不需重跑分析)
* 附带性质的树无支持率 → Minor
- 直系同源基因鉴定策略是否说明清楚:OrthoFinder/OrthoMCL/RBX 等工具、版本、参数、
聚类阈值(inflation/coverage)、single-copy 标记基因的筛选方式
- 分子进化分析是否规范:dN/dS 检验方法与多重校正、共线性(synteny)分析参数、
分化时间估算是否校准(化石/二次校准点)
【维度四:数据可用性合规——极其重要】必查(在 Data Availability 节或
Methods 数据声明处核对,不因正文引用他人数据的 accession 而误判):
- 原始测序数据是否上传公共数据库并给出 Accession 号。前缀清单:
PRJNA/PRJEB(NCBI/ENA BioProject)、PRJCA/CRA(中国 NGDC/GSA)、
SRP/ERP/DRP(SRA 项目)、SRR/ERR/DRR(run 级号)——命中任一即视为已有
原始数据 accession
- 基因组组装是否有 GenBank/ENA accession(GCA_/GCF_),GFF3 注释文件、
蛋白/CDS 文件是否有可公开获取的位置(仓库 accession 或补充数据链接)
- 转录组数据是否同样有 SRA accession
判定规则:组装/注释类论文若缺失上述任何一环(含 "will be deposited" 等未给号的
承诺式表述),列为 Major Weakness 并打 hard_rule 标签 "accession_missing"。
【维度五:统计与实验设计】检查:
- GWAS/QTL 定位:样本量/群体大小是否充分;多重检验校正是否明确(Bonferroni/FDR/
permutation 阈值/PCA 显著性水平);群体结构控制(PCA、亲缘关系矩阵 K、分层分析)
是否交代;表型测量描述是否充分
- 转录组分析:生物学重复数量(≥3 为底线)、差异分析工具(DESeq2/edgeR 等)与
校正方法、批次效应处理、|log2FC| 与 padj 阈值
- 其他统计:t 检验/ANOVA 是否满足前提、重复类型(生物学 vs 技术重复)写明与否
【维度六:伦理与合规(植物特异性)】检查:
- 野生植物材料:是否提供凭证标本(voucher specimen)信息——标本馆编号、存放机构、
采集地点(GPS)与采集许可;无凭证标本的野生资源取样 → Major Weakness 并打
hard_rule 标签 "voucher_missing"
- 遗传资源获取与惠益分享(ABS)合规性:是否声明符合《名古屋议定书》/本国遗传资源
获取条例(如中国《生物安全法》/《种子法》相关条款)、是否说明材料来源与授权;
涉及遗传资源但缺 ABS/名古屋合规声明 → Major Weakness 并打 hard_rule 标签
"abs_missing"
- 农业转基因/基因编辑材料的合规声明(若涉及)
- fatal 标签:仅当你发现明确的数据造假或伦理违规证据时,将该条 "fatal" 置 true
(数据内部矛盾、明显编造迹象等;无明确证据绝不可打标——该标签会触发拒稿建议)。
输出要求(必须输出单个 JSON 对象,不要输出其他任何内容;不要输出 recommendation
字段——推荐结论由程序规则引擎根据你列出的问题与标签计算):
{
"summary": "总体评价(3-5 句,须点明论文类型与所适用的维度)",
"major_weaknesses": [{"title": "...", "detail": "...", "evidence": "...", "suggestion": "...",
"hard_rule": "busco_missing|hic_missing|accession_missing|voucher_missing|abs_missing|null",
"fatal": false}],
"minor_weaknesses": [{"title": "...", "detail": "...", "evidence": "...", "suggestion": "..."}],
"presentation_format": [{"title": "...", "detail": "...", "evidence": "...", "suggestion": "..."}],
"questions_for_authors": ["..."]
}
【严重程度分级——据此分类,不设条数配额】
- major_weaknesses:问题的解决需要补充实验/补充数据/补充分析流程/大幅改写论证结构,
或影响论文核心结论的可信度与数据合规性。列在这里意味着"不解决就不能发表"。
- minor_weaknesses:在现有数据与实验范围内即可解决(补一段说明、补一个基于已有数据的
统计、澄清方法描述、局部重写)。列在这里意味着"改了更好,不改也能审"。
- presentation_format:仅呈现层面的问题(图表样式、图注格式、参考文献体例、语法)。
严禁把呈现问题升格为 major。
【负向清单——以下情况严禁列为 major_weaknesses,按对应类别归档】
- 图表未标注统计量(bootstrap 数值/误差棒/显著性标记/P 值),但方法或正文已声明
做过该分析 → presentation_format 或 minor_weaknesses
- 方法描述不够详细,但所用方法是领域标准做法且论证逻辑完整 → minor_weaknesses
- 阈值/参数未给出具体数值,但逻辑完整且结论不依赖精确数值 → minor_weaknesses
- 引用格式/排版/图注体例/语法 → presentation_format
- 标准流程的合理省略(如 IQ-TREE/DESeq2 等工具默认参数未逐一列出)→ 不列
总纲:只有"需要补做实验/补数据/重跑分析/改核心论证"的问题才允许列为 major;
其余一律 minor 或 presentation。与上文各维度冲突时以本节为准。
分级与条数规则:
1. major_weaknesses、minor_weaknesses、presentation_format 均【不设下限,可以为 0 条】。
论文确实完善时输出空数组是正确答案;严禁为凑数而降低分级标准或制造问题。
2. **每条 major_weaknesses 的 evidence 字段必填**:必须引用论文的具体章节位置
(如 "Methods 2.1"、"Table 2"、"Results 第 3 段"、"Data Availability 一句话未见")
或具体指标数值(如 "仅报 scaffold N50=42.6 Mb,未提供 BUSCO 与 Hi-C 挂载率")。
evidence 严禁编造:引用不到具体位置时,写明"正文未见相关报告"。只列有 evidence
的问题:列不出具体章节位置或指标数值的问题,不要列。
3. minor_weaknesses/presentation_format 的 evidence 尽量给出,无法定位时可留空字符串。
4. 论文不涉及的维度(如纯 RNA-seq 论文不谈组装)在 summary 中说明并跳过,不硬凑条目。
5. 宁可把拿不准严重程度的问题放 minor_weaknesses(由作者判断),不要放 major。
硬性规则(命中必须列 major 并打 hard_rule 标签,不论其他方面多完善;规则不可协商):
A. 组装类论文缺 BUSCO 完整格式报告 → hard_rule="busco_missing"
B. 宣称 chromosome-level/Hi-C 挂载但未报挂载率 → hard_rule="hic_missing"
C. 缺数据 Accession(SRA/GenBank/组装/GFF3;"will be deposited" 等承诺式表述视为缺)
→ hard_rule="accession_missing"
D. 野生植物材料缺凭证标本(voucher)→ hard_rule="voucher_missing"
E. 涉及遗传资源但缺 ABS/名古屋合规声明 → hard_rule="abs_missing"
(核心进化结论所依赖的系统发育树若**完全未做**节点支持率分析 → 列 major(非硬性,
不打标签);若方法/正文已声明分析但图中未标数值 → presentation/minor;附带性质
的树无支持率 → minor。GWAS 缺多重校正等统计问题按同样原则判级:阈值/方法完全
缺失且影响结论 → major;已声明校正逻辑仅缺细节 → minor。)
presentation_format 覆盖:图表规范(图注含单位/误差棒说明)、参考文献格式、
字数与结构、英文语法(若投英文刊)。
"""
class WeaknessItem(BaseModel):
title: str
detail: str = ""
evidence: str = ""
suggestion: str = ""
hard_rule: str | None = None # 仅 major 可带;白名单外置 None(见 coerce)
fatal: bool = False # 明确造假/伦理证据才可 true(触发 R0 拒稿)
# 扫描器冲突降级标记(程序层置位,LLM 输出不读/coerce 不透传 → 不可伪造):
# True 表示该条原为 major,因关键词扫描器证伪其 hard_rule 缺项声明被降级至 minor
scanner_downgraded: bool = False
class SelfReviewReport(BaseModel):
summary: str = ""
major_weaknesses: list[WeaknessItem] = Field(default_factory=list)
minor_weaknesses: list[WeaknessItem] = Field(default_factory=list)
presentation_format: list[WeaknessItem] = Field(default_factory=list)
questions_for_authors: list[str] = Field(default_factory=list)
# recommendation 由 recommend_engine 计算后写入;LLM 输出的同名字段一律忽略
recommendation: str = ""
recommendation_rationale: dict[str, Any] = Field(default_factory=dict)
def build_user_prompt(text: str, target_journal: str) -> str:
header = f"目标期刊:{target_journal}\n\n" if target_journal else ""
return f"{header}论文正文:\n\n{text}"
def _coerce_items(raw: object) -> list[WeaknessItem]:
items: list[WeaknessItem] = []
if not isinstance(raw, list):
return items
for entry in raw:
if isinstance(entry, str) and entry.strip():
items.append(WeaknessItem(title=entry.strip()))
elif isinstance(entry, dict):
title = str(entry.get("title") or "").strip()
detail = str(entry.get("detail") or "").strip()
if not title and not detail:
continue
hard_rule = str(entry.get("hard_rule") or "").strip() or None
if hard_rule not in HARD_RULE_TAGS:
hard_rule = None # 白名单外的标签丢弃(防 LLM 编造标签操纵引擎)
items.append(WeaknessItem(
title=title or "(未命名)",
detail=detail,
evidence=str(entry.get("evidence") or "").strip(),
suggestion=str(entry.get("suggestion") or "").strip(),
hard_rule=hard_rule,
fatal=bool(entry.get("fatal")),
))
return items
def coerce_report(payload: dict) -> SelfReviewReport:
"""宽容归一化 LLM 输出。不读 recommendation 字段(引擎唯一来源,防注入操纵)。"""
questions = payload.get("questions_for_authors") or []
if not isinstance(questions, list):
questions = []
return SelfReviewReport(
summary=str(payload.get("summary") or "").strip(),
major_weaknesses=_coerce_items(payload.get("major_weaknesses")),
minor_weaknesses=_coerce_items(payload.get("minor_weaknesses")),
presentation_format=_coerce_items(payload.get("presentation_format")),
questions_for_authors=[str(q).strip() for q in questions if str(q).strip()],
)
+288
View File
@@ -0,0 +1,288 @@
r"""services/zip_safety.py —— LaTeX 项目 zip 安全校验与解压(P4,纯函数模块)。
安全清单(每条攻击 → 防御位置,对应设计 §2):
#1 路径穿越 ../../etc/passwd → sanitize_entry_name:拒绝 .. 段/绝对路径/盘符/空段
(\ 已先归一为 /,Windows 反斜杠变体同规则)
#2 反斜杠变体 ..\\..\\x → 同上(name.replace("\\\\", "/") 后再校验)
#3 符号链接条目 → _is_symlink:external_attr 的 S_IFMT == S_IFLNK → 整包拒绝
#4 可执行扩展名 .exe/.sh/.so → classify_entry:DENY_EXT → 整包拒绝(点名条目)
#5 Unix 可执行位 0o111 → _has_exec_bit:普通文件带 x 位 → 整包拒绝(目录 0o755 例外)
#6 无害非白名单 .docx/.log/.zip → classify_entry:skip(记 skipped[];.zip 跳过=天然防嵌套递归)
#7 zip bomb 压缩比 → 预扫 file_size/compress_size > max_zip_ratio → ZIP_BOMB
#8 zip bomb 总量 → 预扫声明累计 > max_extract_bytes → ZIP_BOMB;
流式写盘按**实际字节**再计数(不信头部声明)超限即中止
#9 zip bomb 单条目 → 预扫 file_size > max_entry_bytes → ZIP_BOMB;实写计数兜底
#10 zip bomb 条目数 → 预扫 len(infolist) > max_zip_entries → ZIP_BOMB(先于一切写盘)
#11 深嵌套/超长路径 → 路径深度 > max_path_depth 或总长 > max_path_len → ZIP_UNSAFE
#12 损坏/加密 zip → zipfile.BadZipFile / RuntimeError → ZIP_INVALID
#13 头部谎报小文件 → 实写计数兜底(#8);CRC 错 → ZIP_INVALID
#14 恶意 .tex shell escape → 不在本模块范围(tectonic --untrusted 防护,P3a 已实证)
#15 解压阻塞事件循环 → 调用方 asyncio.to_thread 包裹;本模块上限 200MB/2000 条封顶
设计要点:
- 两段式:①纯预扫(所有结构性检查,全部通过才开始写)→ ②流式写盘(8KB 块 + 实字节计数)。
任何异常 → 调用方 rmtree(dest),磁盘零残留。
- 绝不 extractall;绝不保留可执行位(写盘一律 0o644)。
- 目录条目只建不校验扩展名;SKIP_DIRS 整目录跳过(补充 4 提示对应)。
纯函数:输入 bytes/路径/Settings,输出 ExtractResult 或抛 ZipSafetyError,无 FastAPI/asyncio 依赖。
"""
from __future__ import annotations
import io
import re
import stat
import zipfile
from dataclasses import dataclass, field
from pathlib import Path, PurePosixPath
from typing import Literal
# 危险类型(deny → 整包拒绝)
DENY_EXT = {
".exe", ".com", ".bat", ".cmd", ".sh", ".bash", ".ps1", ".vbs",
".dll", ".so", ".dylib", ".msi", ".jar", ".py", ".rb", ".pl", ".php", ".js",
}
# LaTeX 项目白名单(allow → 解压)
ALLOW_EXT = {
".tex", ".cls", ".sty", ".bst", ".bib", ".bbl", ".blg", ".def", ".clo",
".fd", ".cfg", ".ist", ".dtx", ".ins",
".png", ".jpg", ".jpeg", ".pdf", ".eps", ".svg",
".txt", ".md", ".csv", ".dat", ".ttf", ".otf",
}
# 无扩展名白名单
ALLOW_BARE = {"README", "LICENSE", "Makefile", ".gitignore"}
# 整目录跳过(不进 skipped 计数之外的拒绝路径,直接 skip)
SKIP_DIRS = {".git", "node_modules", "__MACOSX"}
class ZipSafetyError(Exception):
"""zip 不安全/超限/损坏。code ∈ {ZIP_UNSAFE, ZIP_BOMB, ZIP_INVALID}。"""
def __init__(self, code: str, message: str, entry: str = "") -> None:
super().__init__(message)
self.code = code
self.message = message
self.entry = entry
@dataclass
class SkippedEntry:
name: str
reason: str
@dataclass
class ExtractResult:
files: int = 0
tex: int = 0
images: int = 0
cls: int = 0
bib: int = 0
other: int = 0
bytes: int = 0
skipped: list[SkippedEntry] = field(default_factory=list)
skipped_count: int = 0
_IMG_EXT = {".png", ".jpg", ".jpeg", ".eps", ".svg"}
_BARE_RE = re.compile(r"^[A-Za-z]:") # 盘符
_CTRL_RE = re.compile(r"[\x00-\x1f]") # 控制字符
def sanitize_entry_name(raw: str) -> str:
"""归一 + 校验条目名,返回 posix 相对路径;不安全 → ZIP_UNSAFE。
拒绝:绝对路径(/ 或 \\ 开头)、盘符(C:)、任一段 `..`、空段、NUL/控制字符。
"""
name = raw.replace("\\", "/")
if not name or name in ("/", "."):
raise ZipSafetyError("ZIP_UNSAFE", f"zip 含空条目名:{raw!r}", raw)
if name.startswith("/") or _BARE_RE.match(name):
raise ZipSafetyError("ZIP_UNSAFE", f"zip 含绝对路径条目:{raw}", raw)
if _CTRL_RE.search(name):
raise ZipSafetyError("ZIP_UNSAFE", f"zip 条目名含控制字符:{raw!r}", raw)
segs = name.split("/")
if any(s == ".." for s in segs):
raise ZipSafetyError("ZIP_UNSAFE", f"zip 含路径穿越条目:{raw}", raw)
# 空段(//)拒绝;尾段为 ""(目录 / 结尾)在除末位外的段上已由 split 覆盖
if any(s == "" for s in segs[:-1]) or (segs and segs[0] == ""):
raise ZipSafetyError("ZIP_UNSAFE", f"zip 含非法路径条目:{raw}", raw)
depth = len([s for s in segs if s])
if depth > 16:
raise ZipSafetyError("ZIP_UNSAFE", f"zip 条目路径过深({depth} 层):{raw}", raw)
if len(name) > 200:
raise ZipSafetyError("ZIP_UNSAFE", f"zip 条目路径过长({len(name)} 字符):{raw}", raw)
return "/".join(s for s in segs if s)
def classify_entry(name: str, is_dir: bool) -> Literal["allow", "skip", "deny"]:
"""条目分类:目录 → allow(只建);DENY_EXT → deny(整包拒绝);白名单 → allow;其余 → skip。"""
if is_dir:
return "allow"
segs = name.replace("\\", "/").split("/")
# 中间目录段命中 SKIP_DIRS → skip(.git/node_modules 整树跳过)
if any(seg in SKIP_DIRS for seg in segs[:-1]):
return "skip"
p = PurePosixPath(name)
ext = p.suffix.lower()
# 多重扩展如 .synctex.gz:取最后一段即可(gz 不在白名单 → skip)
if ext in DENY_EXT:
return "deny"
if ext in ALLOW_EXT:
return "allow"
if p.name.upper() in {b.upper() for b in ALLOW_BARE}:
return "allow"
return "skip"
def _is_symlink(info: zipfile.ZipInfo) -> bool:
"""external_attr 高 16 位为 Unix mode;S_IFMT == S_IFLNK(0xA000) → 符号链接。"""
mode = (info.external_attr >> 16) & 0xFFFF
return stat.S_IFMT(mode) == stat.S_IFLNK
def _has_exec_bit(info: zipfile.ZipInfo) -> bool:
mode = (info.external_attr >> 16) & 0xFFFF
# Windows 造的 zip(external_attr 无 Unix mode)mode 可能为 0 → 无 x 位
return bool(mode & 0o111)
def _prescan(zf: zipfile.ZipFile, settings) -> list[tuple[zipfile.ZipInfo, str]]:
"""预扫中央目录:条目数 → 路径 → 符号链接/可执行位 → 分类 → 声明大小/压缩比。
全部通过才允许写盘(两段式第一段)。
"""
infos = zf.infolist()
if len(infos) > settings.max_zip_entries:
raise ZipSafetyError(
"ZIP_BOMB", f"zip 条目数超限({len(infos)} > {settings.max_zip_entries})")
plan: list[tuple[zipfile.ZipInfo, str]] = []
declared_total = 0
for info in infos:
is_dir = info.is_dir()
name = sanitize_entry_name(info.filename)
if is_dir:
continue
# #3 符号链接 → 整包拒绝
if _is_symlink(info):
raise ZipSafetyError("ZIP_UNSAFE", f"zip 含符号链接条目:{info.filename}", info.filename)
# #4/#6 分类
kind = classify_entry(name, is_dir=False)
if kind == "deny":
raise ZipSafetyError("ZIP_UNSAFE", f"zip 含危险条目:{info.filename}", info.filename)
if kind == "skip":
continue
# #5 可执行位 → 整包拒绝(仅普通文件;目录已 continue)
if _has_exec_bit(info):
raise ZipSafetyError(
"ZIP_UNSAFE", f"zip 含可执行权限条目:{info.filename}", info.filename)
# #9 单条目声明大小
if info.file_size > settings.max_zip_entry_bytes:
raise ZipSafetyError(
"ZIP_BOMB",
f"zip 条目过大:{info.filename}({info.file_size} 字节)", info.filename)
# #7 压缩比(compress_size=0 且 file_size>0 视为异常)
if info.file_size > 0:
cs = info.compress_size
if cs == 0 or info.file_size / cs > settings.max_zip_ratio:
raise ZipSafetyError(
"ZIP_BOMB",
f"zip 条目压缩比异常(疑似 zip bomb):{info.filename}", info.filename)
declared_total += info.file_size
# #8 声明累计
if declared_total > settings.max_extract_bytes:
raise ZipSafetyError(
"ZIP_BOMB",
f"zip 解压总大小超限(声明 {declared_total} > "
f"{settings.max_extract_bytes} 字节)")
plan.append((info, name))
return plan
def safe_extract(zip_bytes: bytes, dest: Path, settings) -> ExtractResult:
"""安全解压 zip_bytes → dest(新建目录)。
两段式:①预扫(结构性检查全过)②流式写盘(8KB 块 + 实字节计数)。
任何 ZipSafetyError → 调用方负责 rmtree(dest) 清残留。
"""
try:
zf = zipfile.ZipFile(io.BytesIO(zip_bytes))
except zipfile.BadZipFile as exc:
raise ZipSafetyError("ZIP_INVALID", f"zip 文件损坏或不是有效 zip:{exc}") from exc
result = ExtractResult()
with zf:
# ---- 第一段:纯预扫 ----
plan = _prescan(zf, settings)
# ---- 第二段:流式写盘 ----
dest.mkdir(parents=True, exist_ok=True)
written_total = 0
for info, rel in plan:
target = dest / rel
# #1 双保险:resolve 后必须仍在 dest 内
resolved_parent = target.parent.resolve()
if not str(resolved_parent).startswith(str(dest.resolve())):
raise ZipSafetyError(
"ZIP_UNSAFE", f"zip 条目逃逸目标目录:{info.filename}", info.filename)
target.parent.mkdir(parents=True, exist_ok=True)
try:
src = zf.open(info)
except RuntimeError as exc: # 加密条目
raise ZipSafetyError("ZIP_INVALID", f"zip 条目受密码保护:{info.filename}") from exc
try:
with src, open(target, "wb") as out:
while True:
chunk = src.read(8192)
if not chunk:
break
# #8/#13 实写字节计数(不信头部声明)
written_total += len(chunk)
if written_total > settings.max_extract_bytes:
raise ZipSafetyError(
"ZIP_BOMB",
f"zip 实际解压超限(> {settings.max_extract_bytes} 字节),已中止")
out.write(chunk)
except zipfile.BadZipFile as exc: # CRC 校验失败(#12/#13)
raise ZipSafetyError(
"ZIP_INVALID", f"zip 条目损坏(CRC 校验失败):{info.filename}",
info.filename) from exc
# #5 绝不保留可执行位
target.chmod(0o644)
result.files += 1
_tally(result, rel)
result.bytes = written_total # 实写累计(#8 计数器终值)
# 跳过统计(限 20 条 + 总数)
skipped: list[SkippedEntry] = []
skipped_count = 0
for info in zf.infolist():
if info.is_dir():
continue
try:
name = sanitize_entry_name(info.filename)
except ZipSafetyError:
continue # 预扫已拒绝,不会到这里
if classify_entry(name, is_dir=False) == "skip":
skipped_count += 1
if len(skipped) < 20:
skipped.append(SkippedEntry(name=name, reason="unsupported"))
result.skipped = skipped
result.skipped_count = skipped_count
return result
def _tally(result: ExtractResult, rel: str) -> None:
ext = PurePosixPath(rel).suffix.lower()
if ext == ".tex":
result.tex += 1
elif ext in _IMG_EXT or ext == ".png":
result.images += 1
elif ext == ".cls":
result.cls += 1
elif ext == ".bib":
result.bib += 1
else:
result.other += 1
@@ -0,0 +1,493 @@
{
"version": 2,
"updated": "2026-10-10",
"notes": "会议种子数据 v2。deadline_source=placeholder 表示日期为首版占位数据(按各会议公开周期窗口/历年规律填写,未经官方渠道逐条核验),接入官方数据源前须人工核验;严禁以 AI 推测日期替代核验。deadline_confidence 标注日期置信度:high=官方已公布或历年极稳定;medium=按历年规律区间推算;low=新一届尚未公告或历届波动大,待核验。ccf_rank 按 CCF 推荐目录(第七版,2026-03 发布)标注,非目录内会议为 null(含全部生物信息/植物类会议)。timezone_note 默认 AoE (UTC-12)。首版不做自动同步。",
"conferences": [
{
"id": "naacl-2027",
"name": "NAACL 2027",
"full_name": "North American Chapter of the Association for Computational Linguistics",
"domain_tags": ["AI/ML", "自然语言处理"],
"application_tags": ["交叉学科"],
"ccf_rank": "B",
"deadline_abstract": null,
"deadline_full_paper": "2026-10-12T23:59:59+00:00",
"notification_date": null,
"conference_date": "2027-06-01 ~ 2027-06-05",
"location": "San Francisco, California, USA",
"official_url": "https://www.naacl.org/",
"timezone_note": "AoE (UTC-12)",
"deadline_source": "placeholder",
"last_verified": "2026-10-10",
"deadline_confidence": "high"
},
{
"id": "coling-2027",
"name": "COLING 2027",
"full_name": "International Conference on Computational Linguistics",
"domain_tags": ["AI/ML", "自然语言处理"],
"application_tags": ["交叉学科"],
"ccf_rank": "B",
"deadline_abstract": null,
"deadline_full_paper": "2026-10-12T23:59:59+00:00",
"notification_date": null,
"conference_date": "2027-05-09 ~ 2027-05-14",
"location": "Macau SAR, China",
"official_url": null,
"timezone_note": "AoE (UTC-12)",
"deadline_source": "placeholder",
"last_verified": "2026-10-10",
"deadline_confidence": "medium"
},
{
"id": "www-2027",
"name": "WWW 2027",
"full_name": "The Web Conference (ACM WWW)",
"domain_tags": ["AI/ML", "数据挖掘"],
"application_tags": ["交叉学科"],
"ccf_rank": "A",
"deadline_abstract": "2026-10-18T23:59:59+00:00",
"deadline_full_paper": "2026-10-25T23:59:59+00:00",
"notification_date": "2027-01-04",
"conference_date": "2027-05-10 ~ 2027-05-14",
"location": "Dublin, Ireland",
"official_url": "https://www2027.thewebconf.org/",
"timezone_note": "AoE (UTC-12)",
"deadline_source": "placeholder",
"last_verified": "2026-10-10",
"deadline_confidence": "high"
},
{
"id": "recomb-2027",
"name": "RECOMB 2027",
"full_name": "International Conference on Research in Computational Molecular Biology",
"domain_tags": ["生物信息学"],
"application_tags": ["交叉学科"],
"ccf_rank": null,
"deadline_abstract": "2026-11-06T23:59:59+00:00",
"deadline_full_paper": "2026-11-13T23:59:59+00:00",
"notification_date": "2027-02-01",
"conference_date": "2027-04-25 ~ 2027-04-28",
"location": "TBD(待官方公布)",
"official_url": "https://recomb.org/",
"timezone_note": "AoE (UTC-12)",
"deadline_source": "placeholder",
"last_verified": "2026-10-10",
"deadline_confidence": "medium"
},
{
"id": "cvpr-2027",
"name": "CVPR 2027",
"full_name": "IEEE/CVF Conference on Computer Vision and Pattern Recognition",
"domain_tags": ["AI/ML", "计算机视觉"],
"application_tags": ["交叉学科"],
"ccf_rank": "A",
"deadline_abstract": "2026-11-10T23:59:59+00:00",
"deadline_full_paper": "2026-11-16T23:59:59+00:00",
"notification_date": "2027-02-25",
"conference_date": "2027-06-20 ~ 2027-06-25",
"location": "Seattle, USA",
"official_url": "https://cvpr.thecvf.com/",
"timezone_note": "AoE (UTC-12)",
"deadline_source": "placeholder",
"last_verified": "2026-10-10",
"deadline_confidence": "high"
},
{
"id": "wsdm-2027",
"name": "WSDM 2027",
"full_name": "International Conference on Web Search and Data Mining",
"domain_tags": ["AI/ML", "数据挖掘"],
"application_tags": ["交叉学科"],
"ccf_rank": "B",
"deadline_abstract": null,
"deadline_full_paper": "2026-11-17T23:59:59+00:00",
"notification_date": null,
"conference_date": "2027-02-15 ~ 2027-02-19",
"location": "Hong Kong SAR, China",
"official_url": "https://www.wsdm-conference.org/",
"timezone_note": "AoE (UTC-12)",
"deadline_source": "placeholder",
"last_verified": "2026-10-10",
"deadline_confidence": "high"
},
{
"id": "pag-2027",
"name": "PAG 2027",
"full_name": "Plant & Animal Genome Conference",
"domain_tags": ["植物/农学", "基因组学"],
"application_tags": ["种业", "分子育种"],
"ccf_rank": null,
"deadline_abstract": "2026-11-30T23:59:59+00:00",
"deadline_full_paper": "2026-12-15T23:59:59+00:00",
"notification_date": "2027-01-05",
"conference_date": "2027-01-08 ~ 2027-01-12",
"location": "San Diego, USA",
"official_url": "https://www.intlpag.org/",
"timezone_note": "AoE (UTC-12)",
"deadline_source": "placeholder",
"last_verified": "2026-10-10",
"deadline_confidence": "medium"
},
{
"id": "acl-2027",
"name": "ACL 2027",
"full_name": "Annual Meeting of the Association for Computational Linguistics",
"domain_tags": ["AI/ML", "自然语言处理"],
"application_tags": ["交叉学科"],
"ccf_rank": "A",
"deadline_abstract": null,
"deadline_full_paper": "2027-01-04T23:59:59+00:00",
"notification_date": null,
"conference_date": "2027-08-20 ~ 2027-08-22",
"location": "Kyoto, Japan",
"official_url": "https://2027.aclweb.org/",
"timezone_note": "AoE (UTC-12)",
"deadline_source": "placeholder",
"last_verified": "2026-10-10",
"deadline_confidence": "high"
},
{
"id": "plantbio-2027",
"name": "Plant Biology 2027",
"full_name": "ASPB Annual Meeting — Plant Biology",
"domain_tags": ["植物/农学", "分子生物学"],
"application_tags": ["分子育种"],
"ccf_rank": null,
"deadline_abstract": "2027-01-08T23:59:59+00:00",
"deadline_full_paper": "2027-01-08T23:59:59+00:00",
"notification_date": null,
"conference_date": "2027-07(待官方公布)",
"location": "Albuquerque, New Mexico, USA",
"official_url": "https://plantbiology.aspb.org/",
"timezone_note": "AoE (UTC-12)",
"deadline_source": "placeholder",
"last_verified": "2026-10-10",
"deadline_confidence": "high"
},
{
"id": "ijcai-2027",
"name": "IJCAI 2027",
"full_name": "International Joint Conference on Artificial Intelligence",
"domain_tags": ["AI/ML"],
"application_tags": ["交叉学科"],
"ccf_rank": "B",
"deadline_abstract": "2027-01-11T23:59:59+00:00",
"deadline_full_paper": "2027-01-18T23:59:59+00:00",
"notification_date": null,
"conference_date": "2027-08-07 ~ 2027-08-17",
"location": "Kyoto, Japan / Hengqin, China",
"official_url": "https://www.ijcai.org/",
"timezone_note": "AoE (UTC-12)",
"deadline_source": "placeholder",
"last_verified": "2026-10-10",
"deadline_confidence": "medium"
},
{
"id": "sigir-2027",
"name": "SIGIR 2027",
"full_name": "ACM SIGIR Conference on Research and Development in Information Retrieval",
"domain_tags": ["AI/ML", "信息检索"],
"application_tags": ["交叉学科"],
"ccf_rank": "A",
"deadline_abstract": "2027-01-14T23:59:59+00:00",
"deadline_full_paper": "2027-01-21T23:59:59+00:00",
"notification_date": "2027-04-05",
"conference_date": "2027-07-20 ~ 2027-07-24",
"location": "San Jose, California, USA",
"official_url": "https://sigir2027.org/",
"timezone_note": "AoE (UTC-12)",
"deadline_source": "placeholder",
"last_verified": "2026-10-10",
"deadline_confidence": "high"
},
{
"id": "icml-2027",
"name": "ICML 2027",
"full_name": "International Conference on Machine Learning",
"domain_tags": ["AI/ML", "深度学习"],
"application_tags": ["交叉学科"],
"ccf_rank": "A",
"deadline_abstract": "2027-01-15T23:59:59+00:00",
"deadline_full_paper": "2027-01-22T23:59:59+00:00",
"notification_date": "2027-05-01",
"conference_date": "2027-07-19 ~ 2027-07-25",
"location": "TBD(待官方公布)",
"official_url": "https://icml.cc/",
"timezone_note": "AoE (UTC-12)",
"deadline_source": "placeholder",
"last_verified": "2026-10-10",
"deadline_confidence": "medium"
},
{
"id": "chil-2027",
"name": "CHIL 2027",
"full_name": "ACM Conference on Health, Inference, and Learning",
"domain_tags": ["AI/ML", "健康医疗"],
"application_tags": ["交叉学科"],
"ccf_rank": null,
"deadline_abstract": "2027-01-15T23:59:59+00:00",
"deadline_full_paper": "2027-01-29T23:59:59+00:00",
"notification_date": null,
"conference_date": "2027-06(待官方公布)",
"location": "TBD(待官方公布)",
"official_url": "https://dl.acm.org/conference/chil",
"timezone_note": "AoE (UTC-12)",
"deadline_source": "placeholder",
"last_verified": "2026-10-10",
"deadline_confidence": "low"
},
{
"id": "kdd-2027",
"name": "KDD 2027 (Cycle 2)",
"full_name": "ACM SIGKDD Conference on Knowledge Discovery and Data Mining",
"domain_tags": ["AI/ML", "数据挖掘"],
"application_tags": ["交叉学科"],
"ccf_rank": "A",
"deadline_abstract": "2027-01-31T23:59:59+00:00",
"deadline_full_paper": "2027-02-07T23:59:59+00:00",
"notification_date": null,
"conference_date": "2027-08-01 ~ 2027-08-05",
"location": "San Jose, California, USA",
"official_url": "https://kdd2027.kdd.org/",
"timezone_note": "AoE (UTC-12)",
"deadline_source": "placeholder",
"last_verified": "2026-10-10",
"deadline_confidence": "medium"
},
{
"id": "ismb-eccb-2027",
"name": "ISMB/ECCB 2027",
"full_name": "Intelligent Systems for Molecular Biology / European Conference on Computational Biology",
"domain_tags": ["生物信息学"],
"application_tags": ["交叉学科"],
"ccf_rank": null,
"deadline_abstract": "2027-02-12T23:59:59+00:00",
"deadline_full_paper": "2027-02-19T23:59:59+00:00",
"notification_date": null,
"conference_date": "2027-07-18 ~ 2027-07-22",
"location": "Copenhagen, Denmark",
"official_url": "https://www.iscb.org/ismbeccb2027/home",
"timezone_note": "AoE (UTC-12)",
"deadline_source": "placeholder",
"last_verified": "2026-10-10",
"deadline_confidence": "medium"
},
{
"id": "ipmbc-2027",
"name": "IPMB 2027",
"full_name": "International Congress on Plant Molecular Biology (14th)",
"domain_tags": ["植物/农学", "分子生物学"],
"application_tags": ["分子育种"],
"ccf_rank": null,
"deadline_abstract": "2027-02-15T23:59:59+00:00",
"deadline_full_paper": "2027-02-22T23:59:59+00:00",
"notification_date": null,
"conference_date": "2027-07(待官方公布)",
"location": "Wuhan, China",
"official_url": "https://www.ipmb2027.org/",
"timezone_note": "AoE (UTC-12)",
"deadline_source": "placeholder",
"last_verified": "2026-10-10",
"deadline_confidence": "low"
},
{
"id": "uai-2027",
"name": "UAI 2027",
"full_name": "Conference on Uncertainty in Artificial Intelligence",
"domain_tags": ["AI/ML"],
"application_tags": ["交叉学科"],
"ccf_rank": "B",
"deadline_abstract": null,
"deadline_full_paper": "2027-02-24T23:59:59+00:00",
"notification_date": null,
"conference_date": "2027-08-16 ~ 2027-08-20",
"location": "TBD(待官方公布)",
"official_url": "https://www.auai.org/",
"timezone_note": "AoE (UTC-12)",
"deadline_source": "placeholder",
"last_verified": "2026-10-10",
"deadline_confidence": "medium"
},
{
"id": "miccai-2027",
"name": "MICCAI 2027",
"full_name": "International Conference on Medical Image Computing and Computer-Assisted Intervention",
"domain_tags": ["AI/ML", "医学影像"],
"application_tags": ["交叉学科"],
"ccf_rank": null,
"deadline_abstract": "2027-02-11T23:59:59+00:00",
"deadline_full_paper": "2027-02-25T23:59:59+00:00",
"notification_date": null,
"conference_date": "2027-09-26 ~ 2027-10-01",
"location": "Auckland, New Zealand",
"official_url": "https://miccai.org/",
"timezone_note": "AoE (UTC-12)",
"deadline_source": "placeholder",
"last_verified": "2026-10-10",
"deadline_confidence": "medium"
},
{
"id": "iccv-2027",
"name": "ICCV 2027",
"full_name": "IEEE/CVF International Conference on Computer Vision",
"domain_tags": ["AI/ML", "计算机视觉"],
"application_tags": ["交叉学科"],
"ccf_rank": "A",
"deadline_abstract": "2027-02-26T23:59:59+00:00",
"deadline_full_paper": "2027-03-05T23:59:59+00:00",
"notification_date": null,
"conference_date": "2027-10-02 ~ 2027-10-08",
"location": "Hong Kong SAR, China",
"official_url": null,
"timezone_note": "AoE (UTC-12)",
"deadline_source": "placeholder",
"last_verified": "2026-10-10",
"deadline_confidence": "medium"
},
{
"id": "bosc-2027",
"name": "BOSC 2027",
"full_name": "Bioinformatics Open Source Conference",
"domain_tags": ["生物信息学"],
"application_tags": ["交叉学科"],
"ccf_rank": null,
"deadline_abstract": null,
"deadline_full_paper": "2027-03-26T23:59:59+00:00",
"notification_date": null,
"conference_date": "2027-07-18 ~ 2027-07-22",
"location": "Copenhagen, Denmark",
"official_url": "https://openbioinformatics.org/",
"timezone_note": "AoE (UTC-12)",
"deadline_source": "placeholder",
"last_verified": "2026-10-10",
"deadline_confidence": "low"
},
{
"id": "acm-bcb-2027",
"name": "ACM-BCB 2027",
"full_name": "ACM Conference on Bioinformatics, Computational Biology and Health Informatics",
"domain_tags": ["生物信息学", "AI/ML"],
"application_tags": ["交叉学科"],
"ccf_rank": null,
"deadline_abstract": "2027-04-16T23:59:59+00:00",
"deadline_full_paper": "2027-04-23T23:59:59+00:00",
"notification_date": null,
"conference_date": "2027-08(待官方公布)",
"location": "TBD(待官方公布)",
"official_url": "https://acm-bcb.org/",
"timezone_note": "AoE (UTC-12)",
"deadline_source": "placeholder",
"last_verified": "2026-10-10",
"deadline_confidence": "medium"
},
{
"id": "ieee-bibm-2027",
"name": "IEEE BIBM 2027",
"full_name": "IEEE International Conference on Bioinformatics and Bioengineering",
"domain_tags": ["生物信息学"],
"application_tags": ["交叉学科"],
"ccf_rank": null,
"deadline_abstract": "2027-05-07T23:59:59+00:00",
"deadline_full_paper": "2027-05-14T23:59:59+00:00",
"notification_date": null,
"conference_date": "2027-11(待官方公布)",
"location": "TBD(待官方公布)",
"official_url": null,
"timezone_note": "AoE (UTC-12)",
"deadline_source": "placeholder",
"last_verified": "2026-10-10",
"deadline_confidence": "low"
},
{
"id": "emnlp-2027",
"name": "EMNLP 2027",
"full_name": "Conference on Empirical Methods in Natural Language Processing",
"domain_tags": ["AI/ML", "自然语言处理"],
"application_tags": ["交叉学科"],
"ccf_rank": "B",
"deadline_abstract": "2027-05-14T23:59:59+00:00",
"deadline_full_paper": "2027-05-21T23:59:59+00:00",
"notification_date": null,
"conference_date": "2027-11(待官方公布)",
"location": "TBD(待官方公布)",
"official_url": null,
"timezone_note": "AoE (UTC-12)",
"deadline_source": "placeholder",
"last_verified": "2026-10-10",
"deadline_confidence": "low"
},
{
"id": "neurips-2027",
"name": "NeurIPS 2027",
"full_name": "Conference on Neural Information Processing Systems",
"domain_tags": ["AI/ML", "深度学习"],
"application_tags": ["交叉学科"],
"ccf_rank": "A",
"deadline_abstract": "2027-05-14T23:59:59+00:00",
"deadline_full_paper": "2027-05-21T23:59:59+00:00",
"notification_date": null,
"conference_date": "2027-12(待官方公布)",
"location": "TBD(待官方公布)",
"official_url": "https://neurips.cc/",
"timezone_note": "AoE (UTC-12)",
"deadline_source": "placeholder",
"last_verified": "2026-10-10",
"deadline_confidence": "medium"
},
{
"id": "psb-2028",
"name": "PSB 2028",
"full_name": "Pacific Symposium on Biocomputing",
"domain_tags": ["生物信息学"],
"application_tags": ["交叉学科"],
"ccf_rank": null,
"deadline_abstract": null,
"deadline_full_paper": "2027-07-01T23:59:59+00:00",
"notification_date": null,
"conference_date": "2028-01(待官方公布)",
"location": "TBD(待官方公布)",
"official_url": "https://psb.stanford.edu/",
"timezone_note": "AoE (UTC-12)",
"deadline_source": "placeholder",
"last_verified": "2026-10-10",
"deadline_confidence": "low"
},
{
"id": "pag-europe-2027",
"name": "PAG Europe 2027",
"full_name": "Plant & Animal Genome Conference Europe",
"domain_tags": ["植物/农学", "基因组学"],
"application_tags": ["种业", "分子育种"],
"ccf_rank": null,
"deadline_abstract": null,
"deadline_full_paper": "2027-07-09T23:59:59+00:00",
"notification_date": null,
"conference_date": "2027-10(待官方公布)",
"location": "TBD(待官方公布)",
"official_url": null,
"timezone_note": "AoE (UTC-12)",
"deadline_source": "placeholder",
"last_verified": "2026-10-10",
"deadline_confidence": "low"
},
{
"id": "aaai-2028",
"name": "AAAI 2028",
"full_name": "AAAI Conference on Artificial Intelligence",
"domain_tags": ["AI/ML"],
"application_tags": ["交叉学科"],
"ccf_rank": "A",
"deadline_abstract": "2027-07-20T23:59:59+00:00",
"deadline_full_paper": "2027-07-27T23:59:59+00:00",
"notification_date": null,
"conference_date": "2028-02(待官方公布)",
"location": "TBD(待官方公布)",
"official_url": "https://aaai.org/",
"timezone_note": "AoE (UTC-12)",
"deadline_source": "placeholder",
"last_verified": "2026-10-10",
"deadline_confidence": "medium"
}
]
}
@@ -0,0 +1,61 @@
journals directory 导入对账报告
生成时间: 2026-10-10T15:37:11
源文件: /home/xzq/5090/teamWorkspace/wjq/PlantAI-RAG-new-latest/PlantAI-rag-new/review_service/data/journals/source_v4.xlsx(193386 bytes)
阶段: 完成
=== 计数 ===
读取有效行: 国际 779 / 中文 277 / 合计 1056
成功: 1056 跳过(名称空): 0 失败: 0
写入后 count(*): en=779 zh=277 total=1056
期望: en=779 zh=277 total=1056 → ✓ 相符
=== 分区分布(国际)===
1区 233 / 2区 214 / 3区 181 / 4区 134 / 空白 17
分区空白(→null 无note): 17
分区未检得(→null + note): 0
=== JIF 缺失 13 条(jif=null + note=核对状态)===
- eLife [2025 JIF未检得/未给值]
- Heliyon [2025 JIF未检得/未给值]
- Australian Journal of Crop Science [2025 JIF未检得/未给值]
- International Journal of Agriculture and Biology [2025 JIF未检得/未给值]
- Journal of Agriculture and Rural Development in the Tropics and Subtropics [2025 JIF未检得/未给值]
- Fruits [2025 JIF未检得/未给值]
- RANGELAND JOURNAL [2025 JIF未检得/未给值]
- Science of The Total Environment [2025 JIF未检得/未给值]
- Chemosphere [2025 JIF未检得/未给值]
- Environmental Science and Pollution Research [2025 JIF未检得/未给值]
- Bioengineered [2025 JIF未检得/未给值]
- Cell Biomaterials [2025 JIF未检得/未给值]
- National Science Open [2025 JIF未检得/未给值]
=== 中文复合IF 缺失 0 条 ===
=== 分区未检得 期刊名 ===
(无——源表以空白表示未检得,见上方'分区空白')
=== 重复 id 冲突(应为空)===
(无)
=== id 策略 ===
ISSN 型: 692 条 slug 型: 364 条
=== 来源超链接 ===
国际 JIF来源: 779/779 分区来源: 762/779 中文数据来源: 277/277
=== 结构迁移(ALTER TABLE,幂等)===
本次加列: official_check_status, jcr_release_year
已存在跳过: official_url
=== 官网映射(决策:official_source 不入库)===
识别列: 官网网址
official_url 填充: 1053/1056 official_check_status 填充: 1056/1056
jcr_release_year 填充: 779(仅国际=2026;中文表无此列→null)
官网缺失 3 条(official_url=null,前端显示「—」不生成链接):
- [zh] 中国食用菌
- [zh] 水土保持应用技术
- [zh] 粮食与饲料工业
=== 幂等性验证 ===
第二次 upsert 后 count 不变: ✓ 通过
+177
View File
@@ -0,0 +1,177 @@
{
"version": 1,
"updated": "2026-10-10",
"notes": "植物基因组学领域种子期刊。acceptance_rate 无公开权威数据一律为 null(不编造);impact_factor / review_time_weeks 为公开 JCR/期刊官网常识近似值,以 last_updated 标注刷新时间,接入真实数据源前需人工核验。scope_desc 为英文范围描述,供 vstore 向量匹配使用。 format_rules_default 为通用默认规则(rules_source=default);精选 5 本 format_rules 已于 2026-10-10 按各刊官网投稿指南人工核验填入(rules_source=official,附 source_url / last_verified / notes),官网未规定的字段一律 null 不猜测。 新增标签字段(不进 SQLite,接口按 id 从本文件合并):scope_tags / application_tags / cross_domain 按 scope_desc 归类的标签;cas_partition / jcr_quartile 为占位(partition_source=placeholder),核实不确定的一律 null、不猜测,接入真实分区数据前需人工核验。 精选列表已更换为本环境可访问官网的 5 本(Genome Biology / BMC Plant Biology / Molecular Plant / Frontiers in Plant Science / Rice);原 OUP/Wiley/Springer 4 本(The Plant Cell / The Plant Journal / Theoretical and Applied Genetics / The Plant Genome)移出精选,仍保留在 journal_directory 1056 条全量目录中。 [2026-10-12] 5 本精选期刊新增 review_tier(1=顶刊/2=主流,供 presubmit recommendation 分档判定;匹配失败默认 tier 2)。",
"format_rules_default": {
"rules_source": "default",
"max_pages": 10,
"min_font_pt": 9,
"min_margin_mm": 15,
"min_line_spacing": 1.15,
"min_figures": 1,
"max_fonts": 6,
"refs_style": "apa"
},
"journals": [
{
"id": "genome-biology",
"name": "Genome Biology",
"scope_desc": "High-impact open-access journal for genome-scale research across all organisms, including genome assembly and annotation, comparative and evolutionary genomics, computational methods, single-cell and multi-omics studies, and reproducible bioinformatics.",
"impact_factor": 10.1,
"review_time_weeks": 4.0,
"acceptance_rate": null,
"submission_deadline": null,
"official_url": "https://genomebiology.biomedcentral.com",
"last_updated": "2026-10-09",
"scope_tags": ["基因组学", "生物信息学", "多组学", "计算生物学"],
"application_tags": ["基础研究", "算法与方法"],
"cas_partition": "1区",
"jcr_quartile": "Q1",
"review_tier": 1,
"partition_source": "placeholder",
"cross_domain": ["进化生物学", "单细胞组学"],
"format_rules": {
"max_pages": null,
"min_font_pt": null,
"min_margin_mm": null,
"min_line_spacing": 2.0,
"max_fonts": null,
"min_figures": null,
"refs_style": "vancouver",
"anonymous": false,
"rules_source": "official",
"source_url": "https://genomebiology.biomedcentral.com/submission-guidelines",
"last_verified": "2026-10-10",
"notes": "官网要求双倍行距('Use double-line spacing')、行页码编号;参考文献 'Journal abbreviations follow Index Medicus/MEDLINE'(顺序编号制→vancouver);BMC 出版社 policy 页明确 single-anonymous(审稿人知道作者身份,作者无需匿名);字号/边距/页数上限该页未规定。BMC editorial policy 辅助来源:https://www.biomedcentral.com/getpublished/editorial-policies"
}
},
{
"id": "bmc-plant-biology",
"name": "BMC Plant Biology",
"scope_desc": "Open-access journal covering all aspects of plant biology, from molecular and cellular studies to the physiology and ecology of whole plants and communities, including plant-microbe interactions, biotechnology and applied plant science.",
"impact_factor": null,
"review_time_weeks": null,
"acceptance_rate": null,
"submission_deadline": null,
"official_url": "https://bmcplantbiol.biomedcentral.com",
"last_updated": "2026-10-10",
"scope_tags": ["植物生物学", "分子生物学", "逆境生物学", "植物-微生物互作"],
"application_tags": ["基础研究"],
"cas_partition": null,
"jcr_quartile": null,
"review_tier": 2,
"partition_source": "placeholder",
"cross_domain": ["植物生物技术"],
"format_rules": {
"max_pages": null,
"min_font_pt": null,
"min_margin_mm": null,
"min_line_spacing": 2.0,
"max_fonts": null,
"min_figures": null,
"refs_style": "vancouver",
"anonymous": false,
"rules_source": "official",
"source_url": "https://bmcplantbiol.biomedcentral.com/submission-guidelines",
"last_verified": "2026-10-10",
"notes": "同 BMC 系列模板页:双倍行距+行页码编号;参考文献 MEDLINE 缩写(→vancouver);BMC 系列 editorial policy 为 single-anonymous(作者无需匿名);字号/边距/页数上限该页未规定。"
}
},
{
"id": "molecular-plant",
"name": "Molecular Plant",
"scope_desc": "High-impact journal for fundamental and translational plant science at the molecular level, covering genomics, cell and developmental biology, signal transduction, stress and metabolic responses, and plant biotechnology.",
"impact_factor": null,
"review_time_weeks": null,
"acceptance_rate": null,
"submission_deadline": null,
"official_url": "https://www.cell.com/molecular-plant",
"last_updated": "2026-10-10",
"scope_tags": ["分子生物学", "基因组学", "多组学"],
"application_tags": ["基础研究", "分子育种"],
"cas_partition": null,
"jcr_quartile": null,
"review_tier": 1,
"partition_source": "placeholder",
"cross_domain": ["植物生物技术"],
"format_rules": {
"max_pages": null,
"min_font_pt": 12,
"min_margin_mm": null,
"min_line_spacing": 1.5,
"max_fonts": null,
"min_figures": null,
"refs_style": "author_year",
"anonymous": null,
"rules_source": "official",
"source_url": "https://www.cell.com/molecular-plant/authors",
"last_verified": "2026-10-10",
"notes": "官网作者指南(本环境 cell.com 403,依据作者浏览器核对摘录):正文 12 point 字号、1.5 行距,参考文献 'cited in the text by name and year in parentheses'(作者-年份制→author_year);页数上限/边距/图表下限/匿名审稿政策该摘录未覆盖→null"
}
},
{
"id": "frontiers-in-plant-science",
"name": "Frontiers in Plant Science",
"scope_desc": "Open-access journal spanning fundamental and applied plant sciences: molecular and cellular mechanisms, physiology, ecology, evolution, and applications in agriculture and biotechnology.",
"impact_factor": null,
"review_time_weeks": null,
"acceptance_rate": null,
"submission_deadline": null,
"official_url": "https://www.frontiersin.org/journals/plant-science",
"last_updated": "2026-10-10",
"scope_tags": ["植物生物学", "分子生物学", "生理学", "生态学"],
"application_tags": ["基础研究"],
"cas_partition": null,
"jcr_quartile": null,
"review_tier": 2,
"partition_source": "placeholder",
"cross_domain": ["农业科学"],
"format_rules": {
"max_pages": null,
"min_font_pt": null,
"min_margin_mm": null,
"min_line_spacing": 1.0,
"max_fonts": null,
"min_figures": null,
"refs_style": null,
"anonymous": null,
"rules_source": "official",
"source_url": "https://www.frontiersin.org/journals/plant-science/for-authors/author-guidelines",
"last_verified": "2026-10-10",
"notes": "官网 author-guidelines:'The entire document should be single-spaced and must contain page and line numbers'(单倍行距→1.0);页数按 Article types 页 word count 而非数字页限→max_pages=null;字号/边距/图表下限该页未规定。Frontiers 为 open peer review;官网未明文规定作者是否匿名,建议人工核实 review-guidelines 页。Frontiers 官网明确两种制式并存:Harvard (author-date) 或 Vancouver (numbered),具体到 Plant Science 需查 help center(当前抓取失败),建议人工核实 https://www.frontiersin.org/help/"
}
},
{
"id": "rice",
"name": "Rice",
"scope_desc": "Open-access journal publishing research on all aspects of rice science, from molecular biology and genetics to breeding, physiology, ecology and production systems, with relevance to cereal crop improvement.",
"impact_factor": null,
"review_time_weeks": null,
"acceptance_rate": null,
"submission_deadline": null,
"official_url": "https://thericejournal.springeropen.com",
"last_updated": "2026-10-10",
"scope_tags": ["水稻", "作物基因组学", "遗传育种"],
"application_tags": ["基础研究", "分子育种", "种业"],
"cas_partition": null,
"jcr_quartile": null,
"review_tier": 2,
"partition_source": "placeholder",
"cross_domain": ["作物科学"],
"format_rules": {
"max_pages": null,
"min_font_pt": null,
"min_margin_mm": null,
"min_line_spacing": 2.0,
"max_fonts": null,
"min_figures": null,
"refs_style": "vancouver",
"anonymous": false,
"rules_source": "official",
"source_url": "https://thericejournal.springeropen.com/submission-guidelines",
"last_verified": "2026-10-10",
"notes": "SpringerOpen 系列模板页:'Use double-line spacing'(双倍行距→2.0)、行页码编号;参考文献 'Journal abbreviations follow Index Medicus/MEDLINE'(→vancouver);审稿明文 single-anonymous(审稿人知道作者身份,作者无需匿名);字号/边距/页数上限/图表下限该页未规定。"
}
}
]
}
File diff suppressed because it is too large Load Diff
File diff suppressed because it is too large Load Diff
File diff suppressed because it is too large Load Diff
File diff suppressed because it is too large Load Diff
@@ -0,0 +1,815 @@
{
"ok": true,
"items": [
{
"id": "en:0028-0836",
"lang": "en",
"name": "NATURE",
"research_direction": "综合与交叉",
"cas_partition": "1区",
"cas_partition_note": null,
"cas_partition_year": 2025,
"jif": 48.5,
"jif_year": 2024,
"jif_note": null,
"jif_check_status": "已匹配公开汇编",
"composite_impact_factor": null,
"comprehensive_impact_factor": null,
"metric_year": null,
"metric_report_year": null,
"metric_caliber": null,
"annual_report_page": null,
"top_flag": "是",
"publisher_series": "Nature Portfolio(含合作刊)",
"journal_mark": "经典专业刊",
"article_type": "研究/方法/综合",
"issn": "0028-0836",
"eissn": "1476-4687",
"jcr_disciplines": [
"MULTIDISCIPLINARY SCIENCES(SCIE)"
],
"supplement_note": null,
"evidence_note": null,
"official_url": null,
"partition_source": "official",
"jif_source": "official",
"jif_source_url": "https://github.com/yongqianxiao/share_repo/blob/master/JCR/2024JCR%E5%AE%8C%E6%95%B4%E7%89%88%EF%BC%882025.6.18%E5%8F%91%E5%B8%83%EF%BC%89.xlsx",
"partition_source_url": "https://huaxue.hebtu.edu.cn/a/2025/09/23/A5A5BBD96F6B4410B87B6D4C43BDFD63.html",
"data_source_label": "JIF来源",
"data_source_url": null
},
{
"id": "en:0036-8075",
"lang": "en",
"name": "SCIENCE",
"research_direction": "综合与交叉",
"cas_partition": "1区",
"cas_partition_note": null,
"cas_partition_year": 2025,
"jif": 45.8,
"jif_year": 2024,
"jif_note": null,
"jif_check_status": "已匹配公开汇编",
"composite_impact_factor": null,
"comprehensive_impact_factor": null,
"metric_year": null,
"metric_report_year": null,
"metric_caliber": null,
"annual_report_page": null,
"top_flag": "是",
"publisher_series": "Science / AAAS",
"journal_mark": "经典专业刊",
"article_type": "研究/方法/综合",
"issn": "0036-8075",
"eissn": "1095-9203",
"jcr_disciplines": [
"MULTIDISCIPLINARY SCIENCES(SCIE)"
],
"supplement_note": null,
"evidence_note": null,
"official_url": null,
"partition_source": "official",
"jif_source": "official",
"jif_source_url": "https://github.com/yongqianxiao/share_repo/blob/master/JCR/2024JCR%E5%AE%8C%E6%95%B4%E7%89%88%EF%BC%882025.6.18%E5%8F%91%E5%B8%83%EF%BC%89.xlsx",
"partition_source_url": "https://huaxue.hebtu.edu.cn/a/2025/09/23/A5A5BBD96F6B4410B87B6D4C43BDFD63.html",
"data_source_label": "JIF来源",
"data_source_url": null
},
{
"id": "en:0092-8674",
"lang": "en",
"name": "CELL",
"research_direction": "综合与交叉",
"cas_partition": "1区",
"cas_partition_note": null,
"cas_partition_year": 2025,
"jif": 42.5,
"jif_year": 2024,
"jif_note": null,
"jif_check_status": "已匹配公开汇编",
"composite_impact_factor": null,
"comprehensive_impact_factor": null,
"metric_year": null,
"metric_report_year": null,
"metric_caliber": null,
"annual_report_page": null,
"top_flag": "是",
"publisher_series": "Cell Press(含合作刊)",
"journal_mark": "经典专业刊",
"article_type": "研究/方法/综合",
"issn": "0092-8674",
"eissn": "1097-4172",
"jcr_disciplines": [
"BIOCHEMISTRY & MOLECULAR BIOLOGY(SCIE)",
"CELL BIOLOGY(SCIE)"
],
"supplement_note": null,
"evidence_note": null,
"official_url": null,
"partition_source": "official",
"jif_source": "official",
"jif_source_url": "https://github.com/yongqianxiao/share_repo/blob/master/JCR/2024JCR%E5%AE%8C%E6%95%B4%E7%89%88%EF%BC%882025.6.18%E5%8F%91%E5%B8%83%EF%BC%89.xlsx",
"partition_source_url": "https://huaxue.hebtu.edu.cn/a/2025/09/23/A5A5BBD96F6B4410B87B6D4C43BDFD63.html",
"data_source_label": "JIF来源",
"data_source_url": null
},
{
"id": "en:2666-6758",
"lang": "en",
"name": "Innovation",
"research_direction": "综合与交叉",
"cas_partition": "1区",
"cas_partition_note": null,
"cas_partition_year": 2025,
"jif": 25.7,
"jif_year": 2024,
"jif_note": null,
"jif_check_status": "已匹配公开汇编",
"composite_impact_factor": null,
"comprehensive_impact_factor": null,
"metric_year": null,
"metric_report_year": null,
"metric_caliber": null,
"annual_report_page": null,
"top_flag": "是",
"publisher_series": "其他",
"journal_mark": "领域期刊/新兴刊",
"article_type": "研究/方法/综合",
"issn": "2666-6758",
"eissn": "2666-6758",
"jcr_disciplines": [
"MULTIDISCIPLINARY SCIENCES(ESCI)"
],
"supplement_note": null,
"evidence_note": null,
"official_url": null,
"partition_source": "official",
"jif_source": "official",
"jif_source_url": "https://github.com/yongqianxiao/share_repo/blob/master/JCR/2024JCR%E5%AE%8C%E6%95%B4%E7%89%88%EF%BC%882025.6.18%E5%8F%91%E5%B8%83%EF%BC%89.xlsx",
"partition_source_url": "https://huaxue.hebtu.edu.cn/a/2025/09/23/A5A5BBD96F6B4410B87B6D4C43BDFD63.html",
"data_source_label": "JIF来源",
"data_source_url": null
},
{
"id": "en:2095-9273",
"lang": "en",
"name": "Science Bulletin",
"research_direction": "综合与交叉",
"cas_partition": "1区",
"cas_partition_note": null,
"cas_partition_year": 2025,
"jif": 21.1,
"jif_year": 2024,
"jif_note": null,
"jif_check_status": "已匹配公开汇编",
"composite_impact_factor": null,
"comprehensive_impact_factor": null,
"metric_year": null,
"metric_report_year": null,
"metric_caliber": null,
"annual_report_page": null,
"top_flag": "是",
"publisher_series": "其他",
"journal_mark": "领域期刊/新兴刊",
"article_type": "研究/方法/综合",
"issn": "2095-9273",
"eissn": "2095-9281",
"jcr_disciplines": [
"MULTIDISCIPLINARY SCIENCES(SCIE)"
],
"supplement_note": null,
"evidence_note": null,
"official_url": null,
"partition_source": "official",
"jif_source": "official",
"jif_source_url": "https://github.com/yongqianxiao/share_repo/blob/master/JCR/2024JCR%E5%AE%8C%E6%95%B4%E7%89%88%EF%BC%882025.6.18%E5%8F%91%E5%B8%83%EF%BC%89.xlsx",
"partition_source_url": "https://huaxue.hebtu.edu.cn/a/2025/09/23/A5A5BBD96F6B4410B87B6D4C43BDFD63.html",
"data_source_label": "JIF来源",
"data_source_url": null
},
{
"id": "en:2095-5138",
"lang": "en",
"name": "National Science Review",
"research_direction": "综合与交叉",
"cas_partition": "1区",
"cas_partition_note": null,
"cas_partition_year": 2025,
"jif": 17.1,
"jif_year": 2024,
"jif_note": null,
"jif_check_status": "已匹配公开汇编",
"composite_impact_factor": null,
"comprehensive_impact_factor": null,
"metric_year": null,
"metric_report_year": null,
"metric_caliber": null,
"annual_report_page": null,
"top_flag": "是",
"publisher_series": "其他",
"journal_mark": "领域期刊/新兴刊",
"article_type": "研究/方法/综合",
"issn": "2095-5138",
"eissn": "2053-714X",
"jcr_disciplines": [
"MULTIDISCIPLINARY SCIENCES(SCIE)"
],
"supplement_note": null,
"evidence_note": null,
"official_url": null,
"partition_source": "official",
"jif_source": "official",
"jif_source_url": "https://github.com/yongqianxiao/share_repo/blob/master/JCR/2024JCR%E5%AE%8C%E6%95%B4%E7%89%88%EF%BC%882025.6.18%E5%8F%91%E5%B8%83%EF%BC%89.xlsx",
"partition_source_url": "https://huaxue.hebtu.edu.cn/a/2025/09/23/A5A5BBD96F6B4410B87B6D4C43BDFD63.html",
"data_source_label": "JIF来源",
"data_source_url": null
},
{
"id": "en:nature-communications",
"lang": "en",
"name": "Nature Communications",
"research_direction": "综合与交叉",
"cas_partition": "1区",
"cas_partition_note": null,
"cas_partition_year": 2025,
"jif": 15.7,
"jif_year": 2024,
"jif_note": null,
"jif_check_status": "已匹配公开汇编",
"composite_impact_factor": null,
"comprehensive_impact_factor": null,
"metric_year": null,
"metric_report_year": null,
"metric_caliber": null,
"annual_report_page": null,
"top_flag": "是",
"publisher_series": "Nature Portfolio(含合作刊)",
"journal_mark": "领域期刊/新兴刊",
"article_type": "研究/方法/综合",
"issn": null,
"eissn": "2041-1723",
"jcr_disciplines": [
"MULTIDISCIPLINARY SCIENCES(SCIE)"
],
"supplement_note": null,
"evidence_note": null,
"official_url": null,
"partition_source": "official",
"jif_source": "official",
"jif_source_url": "https://github.com/yongqianxiao/share_repo/blob/master/JCR/2024JCR%E5%AE%8C%E6%95%B4%E7%89%88%EF%BC%882025.6.18%E5%8F%91%E5%B8%83%EF%BC%89.xlsx",
"partition_source_url": "https://huaxue.hebtu.edu.cn/a/2025/09/23/A5A5BBD96F6B4410B87B6D4C43BDFD63.html",
"data_source_label": "JIF来源",
"data_source_url": null
},
{
"id": "en:advanced-science",
"lang": "en",
"name": "Advanced Science",
"research_direction": "综合与交叉",
"cas_partition": "1区",
"cas_partition_note": null,
"cas_partition_year": 2025,
"jif": 14.1,
"jif_year": 2024,
"jif_note": null,
"jif_check_status": "已匹配公开汇编",
"composite_impact_factor": null,
"comprehensive_impact_factor": null,
"metric_year": null,
"metric_report_year": null,
"metric_caliber": null,
"annual_report_page": null,
"top_flag": "是",
"publisher_series": "其他",
"journal_mark": "领域期刊/新兴刊",
"article_type": "研究/方法/综合",
"issn": null,
"eissn": "2198-3844",
"jcr_disciplines": [
"CHEMISTRY, MULTIDISCIPLINARY(SCIE)",
"MATERIALS SCIENCE, MULTIDISCIPLINARY(SCIE)",
"NANOSCIENCE & NANOTECHNOLOGY(SCIE)"
],
"supplement_note": null,
"evidence_note": null,
"official_url": null,
"partition_source": "official",
"jif_source": "official",
"jif_source_url": "https://github.com/yongqianxiao/share_repo/blob/master/JCR/2024JCR%E5%AE%8C%E6%95%B4%E7%89%88%EF%BC%882025.6.18%E5%8F%91%E5%B8%83%EF%BC%89.xlsx",
"partition_source_url": "https://huaxue.hebtu.edu.cn/a/2025/09/23/A5A5BBD96F6B4410B87B6D4C43BDFD63.html",
"data_source_label": "JIF来源",
"data_source_url": null
},
{
"id": "en:2375-2548",
"lang": "en",
"name": "Science Advances",
"research_direction": "综合与交叉",
"cas_partition": "1区",
"cas_partition_note": null,
"cas_partition_year": 2025,
"jif": 12.5,
"jif_year": 2024,
"jif_note": null,
"jif_check_status": "已匹配公开汇编",
"composite_impact_factor": null,
"comprehensive_impact_factor": null,
"metric_year": null,
"metric_report_year": null,
"metric_caliber": null,
"annual_report_page": null,
"top_flag": "是",
"publisher_series": "Science / AAAS",
"journal_mark": "领域期刊/新兴刊",
"article_type": "研究/方法/综合",
"issn": "2375-2548",
"eissn": "2375-2548",
"jcr_disciplines": [
"MULTIDISCIPLINARY SCIENCES(SCIE)"
],
"supplement_note": null,
"evidence_note": null,
"official_url": null,
"partition_source": "official",
"jif_source": "official",
"jif_source_url": "https://github.com/yongqianxiao/share_repo/blob/master/JCR/2024JCR%E5%AE%8C%E6%95%B4%E7%89%88%EF%BC%882025.6.18%E5%8F%91%E5%B8%83%EF%BC%89.xlsx",
"partition_source_url": "https://huaxue.hebtu.edu.cn/a/2025/09/23/A5A5BBD96F6B4410B87B6D4C43BDFD63.html",
"data_source_label": "JIF来源",
"data_source_url": null
},
{
"id": "en:2096-5168",
"lang": "en",
"name": "Research",
"research_direction": "综合与交叉",
"cas_partition": "1区",
"cas_partition_note": null,
"cas_partition_year": 2025,
"jif": 10.9,
"jif_year": 2024,
"jif_note": null,
"jif_check_status": "已按Clarivate勘误更新",
"composite_impact_factor": null,
"comprehensive_impact_factor": null,
"metric_year": null,
"metric_report_year": null,
"metric_caliber": null,
"annual_report_page": null,
"top_flag": "是",
"publisher_series": "Science Partner Journals(合作刊)",
"journal_mark": "领域期刊/新兴刊",
"article_type": "研究/方法/综合",
"issn": "2096-5168",
"eissn": "2639-5274",
"jcr_disciplines": [
"MULTIDISCIPLINARY SCIENCES(SCIE)"
],
"supplement_note": "2024 JIF采用2025-10-15官方重载修订值。",
"evidence_note": null,
"official_url": null,
"partition_source": "official",
"jif_source": "official",
"jif_source_url": "https://journalcitationreports.zendesk.com/hc/en-gb/articles/36310787349521-2025",
"partition_source_url": "https://huaxue.hebtu.edu.cn/a/2025/09/23/A5A5BBD96F6B4410B87B6D4C43BDFD63.html",
"data_source_label": "JIF来源",
"data_source_url": null
},
{
"id": "en:0027-8424",
"lang": "en",
"name": "PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA",
"research_direction": "综合与交叉",
"cas_partition": "1区",
"cas_partition_note": null,
"cas_partition_year": 2025,
"jif": 9.1,
"jif_year": 2024,
"jif_note": null,
"jif_check_status": "已匹配公开汇编",
"composite_impact_factor": null,
"comprehensive_impact_factor": null,
"metric_year": null,
"metric_report_year": null,
"metric_caliber": null,
"annual_report_page": null,
"top_flag": "是",
"publisher_series": "其他",
"journal_mark": "经典专业刊",
"article_type": "研究/方法/综合",
"issn": "0027-8424",
"eissn": "1091-6490",
"jcr_disciplines": [
"MULTIDISCIPLINARY SCIENCES(SCIE)"
],
"supplement_note": null,
"evidence_note": null,
"official_url": null,
"partition_source": "official",
"jif_source": "official",
"jif_source_url": "https://github.com/yongqianxiao/share_repo/blob/master/JCR/2024JCR%E5%AE%8C%E6%95%B4%E7%89%88%EF%BC%882025.6.18%E5%8F%91%E5%B8%83%EF%BC%89.xlsx",
"partition_source_url": "https://huaxue.hebtu.edu.cn/a/2025/09/23/A5A5BBD96F6B4410B87B6D4C43BDFD63.html",
"data_source_label": "JIF来源",
"data_source_url": null
},
{
"id": "en:scientific-data",
"lang": "en",
"name": "Scientific Data",
"research_direction": "综合与交叉",
"cas_partition": "2区",
"cas_partition_note": null,
"cas_partition_year": 2025,
"jif": 6.9,
"jif_year": 2024,
"jif_note": null,
"jif_check_status": "已匹配公开汇编",
"composite_impact_factor": null,
"comprehensive_impact_factor": null,
"metric_year": null,
"metric_report_year": null,
"metric_caliber": null,
"annual_report_page": null,
"top_flag": "否",
"publisher_series": "Nature Portfolio(含合作刊)",
"journal_mark": "领域期刊/新兴刊",
"article_type": "研究/方法/综合",
"issn": null,
"eissn": "2052-4463",
"jcr_disciplines": [
"MULTIDISCIPLINARY SCIENCES(SCIE)"
],
"supplement_note": null,
"evidence_note": null,
"official_url": null,
"partition_source": "official",
"jif_source": "official",
"jif_source_url": "https://github.com/yongqianxiao/share_repo/blob/master/JCR/2024JCR%E5%AE%8C%E6%95%B4%E7%89%88%EF%BC%882025.6.18%E5%8F%91%E5%B8%83%EF%BC%89.xlsx",
"partition_source_url": "https://huaxue.hebtu.edu.cn/a/2025/09/23/A5A5BBD96F6B4410B87B6D4C43BDFD63.html",
"data_source_label": "JIF来源",
"data_source_url": null
},
{
"id": "en:iscience",
"lang": "en",
"name": "iScience",
"research_direction": "综合与交叉",
"cas_partition": "2区",
"cas_partition_note": null,
"cas_partition_year": 2025,
"jif": 4.1,
"jif_year": 2024,
"jif_note": null,
"jif_check_status": "已匹配公开汇编",
"composite_impact_factor": null,
"comprehensive_impact_factor": null,
"metric_year": null,
"metric_report_year": null,
"metric_caliber": null,
"annual_report_page": null,
"top_flag": "否",
"publisher_series": "Cell Press(含合作刊)",
"journal_mark": "领域期刊/新兴刊",
"article_type": "研究/方法/综合",
"issn": null,
"eissn": "2589-0042",
"jcr_disciplines": [
"MULTIDISCIPLINARY SCIENCES(SCIE)"
],
"supplement_note": null,
"evidence_note": null,
"official_url": null,
"partition_source": "official",
"jif_source": "official",
"jif_source_url": "https://github.com/yongqianxiao/share_repo/blob/master/JCR/2024JCR%E5%AE%8C%E6%95%B4%E7%89%88%EF%BC%882025.6.18%E5%8F%91%E5%B8%83%EF%BC%89.xlsx",
"partition_source_url": "https://huaxue.hebtu.edu.cn/a/2025/09/23/A5A5BBD96F6B4410B87B6D4C43BDFD63.html",
"data_source_label": "JIF来源",
"data_source_url": null
},
{
"id": "en:2047-217X",
"lang": "en",
"name": "GigaScience",
"research_direction": "综合与交叉",
"cas_partition": "2区",
"cas_partition_note": null,
"cas_partition_year": 2025,
"jif": 3.9,
"jif_year": 2024,
"jif_note": null,
"jif_check_status": "已匹配公开汇编",
"composite_impact_factor": null,
"comprehensive_impact_factor": null,
"metric_year": null,
"metric_report_year": null,
"metric_caliber": null,
"annual_report_page": null,
"top_flag": "否",
"publisher_series": "其他",
"journal_mark": "领域期刊/新兴刊",
"article_type": "研究/方法/综合",
"issn": "2047-217X",
"eissn": "2047-217X",
"jcr_disciplines": [
"MULTIDISCIPLINARY SCIENCES(SCIE)"
],
"supplement_note": null,
"evidence_note": null,
"official_url": null,
"partition_source": "official",
"jif_source": "official",
"jif_source_url": "https://github.com/yongqianxiao/share_repo/blob/master/JCR/2024JCR%E5%AE%8C%E6%95%B4%E7%89%88%EF%BC%882025.6.18%E5%8F%91%E5%B8%83%EF%BC%89.xlsx",
"partition_source_url": "https://huaxue.hebtu.edu.cn/a/2025/09/23/A5A5BBD96F6B4410B87B6D4C43BDFD63.html",
"data_source_label": "JIF来源",
"data_source_url": null
},
{
"id": "en:2045-2322",
"lang": "en",
"name": "Scientific Reports",
"research_direction": "综合与交叉",
"cas_partition": "3区",
"cas_partition_note": null,
"cas_partition_year": 2025,
"jif": 3.9,
"jif_year": 2024,
"jif_note": null,
"jif_check_status": "已匹配公开汇编",
"composite_impact_factor": null,
"comprehensive_impact_factor": null,
"metric_year": null,
"metric_report_year": null,
"metric_caliber": null,
"annual_report_page": null,
"top_flag": "否",
"publisher_series": "Nature Portfolio(含合作刊)",
"journal_mark": "领域期刊/新兴刊",
"article_type": "研究/方法/综合",
"issn": "2045-2322",
"eissn": "2045-2322",
"jcr_disciplines": [
"MULTIDISCIPLINARY SCIENCES(SCIE)"
],
"supplement_note": null,
"evidence_note": null,
"official_url": null,
"partition_source": "official",
"jif_source": "official",
"jif_source_url": "https://github.com/yongqianxiao/share_repo/blob/master/JCR/2024JCR%E5%AE%8C%E6%95%B4%E7%89%88%EF%BC%882025.6.18%E5%8F%91%E5%B8%83%EF%BC%89.xlsx",
"partition_source_url": "https://huaxue.hebtu.edu.cn/a/2025/09/23/A5A5BBD96F6B4410B87B6D4C43BDFD63.html",
"data_source_label": "JIF来源",
"data_source_url": null
},
{
"id": "en:pnas-nexus",
"lang": "en",
"name": "PNAS Nexus",
"research_direction": "综合与交叉",
"cas_partition": "3区",
"cas_partition_note": null,
"cas_partition_year": 2025,
"jif": 3.8,
"jif_year": 2024,
"jif_note": null,
"jif_check_status": "已匹配公开汇编",
"composite_impact_factor": null,
"comprehensive_impact_factor": null,
"metric_year": null,
"metric_report_year": null,
"metric_caliber": null,
"annual_report_page": null,
"top_flag": "否",
"publisher_series": "其他",
"journal_mark": "领域期刊/新兴刊",
"article_type": "研究/方法/综合",
"issn": null,
"eissn": "2752-6542",
"jcr_disciplines": [
"MULTIDISCIPLINARY SCIENCES(ESCI)",
"SOCIAL SCIENCES, INTERDISCIPLINARY(ESCI)"
],
"supplement_note": null,
"evidence_note": null,
"official_url": null,
"partition_source": "official",
"jif_source": "official",
"jif_source_url": "https://github.com/yongqianxiao/share_repo/blob/master/JCR/2024JCR%E5%AE%8C%E6%95%B4%E7%89%88%EF%BC%882025.6.18%E5%8F%91%E5%B8%83%EF%BC%89.xlsx",
"partition_source_url": "https://huaxue.hebtu.edu.cn/a/2025/09/23/A5A5BBD96F6B4410B87B6D4C43BDFD63.html",
"data_source_label": "JIF来源",
"data_source_url": null
},
{
"id": "en:heliyon",
"lang": "en",
"name": "Heliyon",
"research_direction": "综合与交叉",
"cas_partition": "4区",
"cas_partition_note": null,
"cas_partition_year": 2025,
"jif": 3.6,
"jif_year": 2024,
"jif_note": null,
"jif_check_status": "已匹配公开汇编",
"composite_impact_factor": null,
"comprehensive_impact_factor": null,
"metric_year": null,
"metric_report_year": null,
"metric_caliber": null,
"annual_report_page": null,
"top_flag": "否",
"publisher_series": "其他",
"journal_mark": "领域期刊/新兴刊",
"article_type": "研究/方法/综合",
"issn": null,
"eissn": "2405-8440",
"jcr_disciplines": [
"MULTIDISCIPLINARY SCIENCES(SCIE)"
],
"supplement_note": null,
"evidence_note": null,
"official_url": null,
"partition_source": "official",
"jif_source": "official",
"jif_source_url": "https://github.com/yongqianxiao/share_repo/blob/master/JCR/2024JCR%E5%AE%8C%E6%95%B4%E7%89%88%EF%BC%882025.6.18%E5%8F%91%E5%B8%83%EF%BC%89.xlsx",
"partition_source_url": "https://huaxue.hebtu.edu.cn/a/2025/09/23/A5A5BBD96F6B4410B87B6D4C43BDFD63.html",
"data_source_label": "JIF来源",
"data_source_url": null
},
{
"id": "en:2054-5703",
"lang": "en",
"name": "Royal Society Open Science",
"research_direction": "综合与交叉",
"cas_partition": "3区",
"cas_partition_note": null,
"cas_partition_year": 2025,
"jif": 2.9,
"jif_year": 2024,
"jif_note": null,
"jif_check_status": "已匹配公开汇编",
"composite_impact_factor": null,
"comprehensive_impact_factor": null,
"metric_year": null,
"metric_report_year": null,
"metric_caliber": null,
"annual_report_page": null,
"top_flag": "否",
"publisher_series": "其他",
"journal_mark": "领域期刊/新兴刊",
"article_type": "研究/方法/综合",
"issn": "2054-5703",
"eissn": "2054-5703",
"jcr_disciplines": [
"MULTIDISCIPLINARY SCIENCES(SCIE)"
],
"supplement_note": null,
"evidence_note": null,
"official_url": null,
"partition_source": "official",
"jif_source": "official",
"jif_source_url": "https://github.com/yongqianxiao/share_repo/blob/master/JCR/2024JCR%E5%AE%8C%E6%95%B4%E7%89%88%EF%BC%882025.6.18%E5%8F%91%E5%B8%83%EF%BC%89.xlsx",
"partition_source_url": "https://huaxue.hebtu.edu.cn/a/2025/09/23/A5A5BBD96F6B4410B87B6D4C43BDFD63.html",
"data_source_label": "JIF来源",
"data_source_url": null
},
{
"id": "en:1932-6203",
"lang": "en",
"name": "PLoS One",
"research_direction": "综合与交叉",
"cas_partition": "3区",
"cas_partition_note": null,
"cas_partition_year": 2025,
"jif": 2.6,
"jif_year": 2024,
"jif_note": null,
"jif_check_status": "已匹配公开汇编",
"composite_impact_factor": null,
"comprehensive_impact_factor": null,
"metric_year": null,
"metric_report_year": null,
"metric_caliber": null,
"annual_report_page": null,
"top_flag": "否",
"publisher_series": "其他",
"journal_mark": "领域期刊/新兴刊",
"article_type": "研究/方法/综合",
"issn": "1932-6203",
"eissn": "1932-6203",
"jcr_disciplines": [
"MULTIDISCIPLINARY SCIENCES(SCIE)"
],
"supplement_note": null,
"evidence_note": null,
"official_url": null,
"partition_source": "official",
"jif_source": "official",
"jif_source_url": "https://github.com/yongqianxiao/share_repo/blob/master/JCR/2024JCR%E5%AE%8C%E6%95%B4%E7%89%88%EF%BC%882025.6.18%E5%8F%91%E5%B8%83%EF%BC%89.xlsx",
"partition_source_url": "https://huaxue.hebtu.edu.cn/a/2025/09/23/A5A5BBD96F6B4410B87B6D4C43BDFD63.html",
"data_source_label": "JIF来源",
"data_source_url": null
},
{
"id": "en:2167-8359",
"lang": "en",
"name": "PeerJ",
"research_direction": "综合与交叉",
"cas_partition": "3区",
"cas_partition_note": null,
"cas_partition_year": 2025,
"jif": 2.4,
"jif_year": 2024,
"jif_note": null,
"jif_check_status": "已匹配公开汇编",
"composite_impact_factor": null,
"comprehensive_impact_factor": null,
"metric_year": null,
"metric_report_year": null,
"metric_caliber": null,
"annual_report_page": null,
"top_flag": "否",
"publisher_series": "其他",
"journal_mark": "领域期刊/新兴刊",
"article_type": "研究/方法/综合",
"issn": "2167-8359",
"eissn": "2167-8359",
"jcr_disciplines": [
"MULTIDISCIPLINARY SCIENCES(SCIE)"
],
"supplement_note": null,
"evidence_note": null,
"official_url": null,
"partition_source": "official",
"jif_source": "official",
"jif_source_url": "https://github.com/yongqianxiao/share_repo/blob/master/JCR/2024JCR%E5%AE%8C%E6%95%B4%E7%89%88%EF%BC%882025.6.18%E5%8F%91%E5%B8%83%EF%BC%89.xlsx",
"partition_source_url": "https://huaxue.hebtu.edu.cn/a/2025/09/23/A5A5BBD96F6B4410B87B6D4C43BDFD63.html",
"data_source_label": "JIF来源",
"data_source_url": null
},
{
"id": "en:2050-084X",
"lang": "en",
"name": "eLife",
"research_direction": "综合与交叉",
"cas_partition": "1区",
"cas_partition_note": null,
"cas_partition_year": 2025,
"jif": null,
"jif_year": 2024,
"jif_note": "未被2024 JCR收录",
"jif_check_status": "源表标N/A",
"composite_impact_factor": null,
"comprehensive_impact_factor": null,
"metric_year": null,
"metric_report_year": null,
"metric_caliber": null,
"annual_report_page": null,
"top_flag": "是",
"publisher_series": "其他",
"journal_mark": "领域期刊/新兴刊",
"article_type": "研究/方法/综合",
"issn": "2050-084X",
"eissn": "2050-084X",
"jcr_disciplines": [
"BIOLOGY(ESCI)"
],
"supplement_note": "源表2024 JIF为N/A;不可用历史IF代填。",
"evidence_note": null,
"official_url": null,
"partition_source": "official",
"jif_source": null,
"jif_source_url": null,
"partition_source_url": "https://huaxue.hebtu.edu.cn/a/2025/09/23/A5A5BBD96F6B4410B87B6D4C43BDFD63.html",
"data_source_label": "JIF来源",
"data_source_url": null
}
],
"meta": {
"total": 21,
"page": 1,
"size": 50,
"lang": "en",
"domain": "综合与交叉",
"cas_partition": "",
"q": "",
"domains": [
"细胞分子发育与生理",
"生态环境与保护",
"微生物真菌与生物技术",
"农学作物与种质",
"遗传组学与计算生物",
"植物科学与分子育种",
"水产渔业与海洋生物",
"食品营养与安全",
"植物保护与昆虫",
"畜牧动物营养与繁殖",
"土壤肥料与地球生物化学",
"林业木材与草业",
"兽医与寄生虫",
"综合与交叉",
"园艺果树与采后"
],
"data_source_note": "分区:2025年中科院公开表(official);JIF:2024 JCR,由2025版JCR发布(official);整理日期2026-10-10。空白=来源未给值≠0;研究方向/期刊标记/文章类型为导航标签,非官方评级。",
"data_imported": true
},
"error": null
}
File diff suppressed because it is too large Load Diff
@@ -0,0 +1,10 @@
{
"ok": false,
"items": [],
"meta": null,
"error": {
"code": "VALIDATION",
"message": "size 必须在 1-200,收到 500",
"degraded": false
}
}
@@ -0,0 +1,10 @@
{
"ok": false,
"items": [],
"meta": null,
"error": {
"code": "VALIDATION",
"message": "不支持的 lang='xx',可选:en / zh",
"degraded": false
}
}
Binary file not shown.
Binary file not shown.
+6
View File
@@ -0,0 +1,6 @@
[pytest]
python_files = test_*.py
pythonpath = .
markers =
review_unit: 审稿服务单元测试
asyncio_mode = auto
+36
View File
@@ -0,0 +1,36 @@
#!/usr/bin/env bash
# restart.sh —— REVIEW 服务重启脚本(8100;不触碰生产服务 8090/8091/8092/8093/8094/8097/8098)。
# 用法: restart.sh [python] [port]
set -euo pipefail
SCRIPT_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)"
# 默认 venv:本机统一 venv 固定路径(原先 $REPO_ROOT/../ 推导在本工作区不存在)
PYTHON="${1:-/home/xzq/5090/teamWorkspace/zh/plantai-rag-new-venv/bin/python}"
PORT="${2:-8100}"
HOST="${REVIEW_BIND_HOST:-127.0.0.1}"
[[ -x "$PYTHON" ]] || { echo "Python not found: $PYTHON" >&2; exit 2; }
APP_MODULE="app.main:app"
if command -v lsof >/dev/null 2>&1; then
PID="$(lsof -ti tcp:"$PORT" -sTCP:LISTEN 2>/dev/null || true)"
if [[ -n "$PID" ]]; then
echo "[restart] 停止 $PORT 旧进程 pid=$PID"
kill $PID 2>/dev/null || true
sleep 2
fi
fi
cd "$SCRIPT_DIR"
# 加载运行时配置(.env 不入 git):services/llm.py 直接读 REVIEW_LLM_*/DOCGEN_LLM_*
# 裸键,paper_parse.py 读 REVIEW_*——需 set -a 显式导出(同 paper_writer_service 先例)。
set -a
[ -f .env ] && source .env
set +a
echo "[restart] 启动审稿服务 :$PORT($PYTHON)"
nohup "$PYTHON" -m uvicorn "$APP_MODULE" --host "$HOST" --port "$PORT" \
> "$SCRIPT_DIR/review.log" 2>&1 &
# P3b:后台预热 tectonic TeX bundle(非阻塞;仅首次需 1-3 分钟,失败不影响服务)
nohup bash "$SCRIPT_DIR/scripts/prewarm_tectonic.sh" \
> "$SCRIPT_DIR/prewarm.log" 2>&1 &
echo "[restart] 完成;日志 review_service/review.log(预热 prewarm.log)"
+17
View File
@@ -0,0 +1,17 @@
# scripts/ —— 离线工具(不被 app/ 服务代码引用,独立 CLI)
## fetch_format_rules.py —— 投稿指南自动抓取(探索性,第一批)
- 依赖:venv 已装的 httpx + beautifulsoup4 4.15.0(用户拍板 2026-10-10);
解析器 lxml 6.1.2 在 `tooling/requirements.lock` 内。
- 用法与流程见 `fetch_format_rules.py` 模块 docstring(CLI 一次一本期刊)。
- 产物:`data/format_cache/{journal_id}.json`(运行产物,已 gitignore,不入库)。
### 现状(2026-10-10)
OUP / Wiley / Cell 官网对本运行环境返回 403,自动抓取路线失败;
Genome Biology / BMC Plant Biology / Frontiers / Rice 可抓但 LLM 抽取结果
仍需人工对照官网。当前 `journals.json` 中 5 本精选期刊的 `format_rules`
为**人工核验官网原文后写入**(`rules_source=official` + `source_url` +
`last_verified`),**不是**本脚本产物。本工具保留作为后续换网络环境 /
换可达站点后的重跑手段。
@@ -0,0 +1,122 @@
#!/usr/bin/env python3
"""scripts/fetch_format_rules.py —— 格式规则自动获取(第一批,人工核验用 CLI)。
用法(在 review_service/ 下):
/home/xzq/5090/teamWorkspace/zh/plantai-rag-new-venv/bin/python \
scripts/fetch_format_rules.py <journal_id> <guidelines_url>
流程:
1. fetch_submission_guidelines(url) # robots.txt + 同域 ≥2s 限速 + 正文转 Markdown
2. extract_format_rules(markdown, journal_name) # DeepSeek 抽取(llm.py)
3. 存 data/format_cache/{journal_id}.json(失败也存,便于批量对账)
4. 打印完整结果 JSON 供人工核验
凭证:结果文件顶层 source_url(步骤 1 的实际抓取地址)+ source_quotes(LLM
逐字引证,按字段分组);非 null 字段缺引证 → 抽取判失败(ok=false)。
约束(第一批):只跑指定 3 本;不触 API / 前端 / journals.json(format_rules 只读
查名,不写回)。journal_name 优先取 data/journals/journals.json 的 name(只读)。
"""
from __future__ import annotations
import asyncio
import json
import os
import re
import sys
from datetime import datetime, timezone
from pathlib import Path
_ROOT = Path(__file__).resolve().parents[1] # review_service/
sys.path.insert(0, str(_ROOT))
_JOURNALS_JSON = _ROOT / "data" / "journals" / "journals.json"
_CACHE_DIR = _ROOT / "data" / "format_cache"
def _load_env() -> None:
"""镜像 restart.sh 的 `set -a; source .env`:REVIEW_LLM_*/DOCGEN_LLM_* 裸键
由 services/llm.py 在每次调用时读 os.environ(不缓存),故调用前灌入即可。"""
env_path = _ROOT / ".env"
if not env_path.is_file():
return
for raw in env_path.read_text("utf-8").splitlines():
line = raw.strip()
if not line or line.startswith("#") or "=" not in line:
continue
if line.startswith("export "):
line = line[7:].strip()
key, _, val = line.partition("=")
os.environ.setdefault(key.strip(), val.strip().strip("\"'"))
def _journal_name(journal_id: str) -> str:
"""journals.json 只读查名;查不到 → id 连字符转空格并首字母大写(LLM 上下文可读)。"""
try:
data = json.loads(_JOURNALS_JSON.read_text("utf-8"))
for j in data.get("journals") or []:
if j.get("id") == journal_id:
return str(j.get("name") or journal_id)
except Exception: # noqa: BLE001
pass
return journal_id.replace("-", " ").title()
def main() -> int:
if len(sys.argv) != 3:
print("用法: fetch_format_rules.py <journal_id> <guidelines_url>", file=sys.stderr)
return 2
journal_id = re.sub(r"[^\w.-]", "_", sys.argv[1].strip())
url = sys.argv[2].strip()
_load_env()
from app.services.format_extractor import extract_format_rules
from app.services.format_fetcher import fetch_submission_guidelines
async def run() -> tuple[dict, dict]:
fetched = await fetch_submission_guidelines(url)
print(f"[1/2] 抓取 {url} → ok={fetched['ok']}"
+ (f",markdown={len(fetched['markdown'])} 字符"
if fetched["ok"] else f",error={fetched['error']}"))
if not fetched["ok"]:
return fetched, {"ok": False, "error": f"抓取失败:{fetched['error']}",
"rules": None, "source_quotes": None,
"confidence": None, "notes": None, "raw": None}
extracted = await extract_format_rules(fetched["markdown"], _journal_name(journal_id))
if extracted["ok"]:
filled = sum(1 for v in extracted["rules"].values() if v is not None)
print(f"[2/2] LLM 抽取 → ok=True,8 字段中 {filled} 个非 null")
else:
print(f"[2/2] LLM 抽取 → ok=False,error={extracted['error']}")
return fetched, extracted
fetched, extracted = asyncio.run(run())
result = {
"journal_id": journal_id,
"journal_name": _journal_name(journal_id),
"source_url": url,
"fetched_at": fetched.get("fetched_at"),
"extracted_at": datetime.now(timezone.utc).isoformat(timespec="seconds"),
"markdown_chars": len(fetched.get("markdown") or ""),
"ok": bool(extracted.get("ok")),
"error": extracted.get("error"),
"format_rules": ({**extracted["rules"], "rules_source": "fetched"}
if extracted.get("ok") else None),
"source_quotes": extracted.get("source_quotes"),
"confidence": extracted.get("confidence"),
"notes": extracted.get("notes"),
"raw_llm": extracted.get("raw"),
}
_CACHE_DIR.mkdir(parents=True, exist_ok=True)
out_path = _CACHE_DIR / f"{journal_id}.json"
out_path.write_text(json.dumps(result, ensure_ascii=False, indent=2) + "\n", "utf-8")
print(f"[save] {out_path.relative_to(_ROOT)}")
print("===== 完整结果(人工核验)=====")
print(json.dumps(result, ensure_ascii=False, indent=2))
return 0 if result["ok"] else 1
if __name__ == "__main__":
sys.exit(main())
+208
View File
@@ -0,0 +1,208 @@
#!/usr/bin/env python3
"""scripts/import_journals.py —— 期刊目录导入 CLI(source_v4.xlsx → SQLite journal_directory)。
核心解析/upsert/schema 在 app/services/journal_seed.py(与启动自动 seed 共享);
本 CLI 仅 import 该模块(sys.path bootstrap),零网络零 BFF,仍不碰 db.py。
职责:口径校验 → 幂等 upsert → 对账报告 data/journals/import_report.txt。
数据流:
openpyxl 非 read_only 加载(需要读 cell.hyperlink.target 来源链接)
→ 「国际期刊」「中文期刊」两 sheet 按【列名】映射(不按索引,防列序漂移)
→ 行级清洗(空→None 绝不填 0;分区数字→"N区";JCR学科→JSON 数组)
→ 按 id 幂等 upsert(ON CONFLICT DO UPDATE,重跑 count 不变)
→ 对账报告 data/journals/import_report.txt
v4 源(2026-10-10):JIF=2025 统计年/2026 JCR 发布;中文 IF=2024 统计年/
年报 2025 版;新增官网三列 + JCR发布年;JCR学科列改名「JCR学科(2024源表)」。
旧文件 source.xlsx(v2)原样保留为回退点,勿覆盖。
schema 迁移(幂等 + 备份):既有表缺列 → PRAGMA table_info 探测后 ALTER TABLE
ADD COLUMN,缺哪加哪、重复跑不报错;跑前先 cp review.db review.db.bak-<日期>。
id 策略:有 ISSN → "{lang}:{ISSN原样(strip)}";无 ISSN → "{lang}:{slug(name)}";
同 lang 内 id 冲突 → 报告冲突列表并【中止导入】(非零退出,不写库)。
用法:python scripts/import_journals.py (cwd 任意;路径按本文件位置推导)
退出码:0 成功;1 id 冲突中止;2 源数据行数与口径不符;3 结构/文件错误。
"""
from __future__ import annotations
import os
import sqlite3
import sys
import time
from collections import Counter
from datetime import datetime
from pathlib import Path
from typing import Any
# ---- 路径(review_service/scripts/ → parents[1] = review_service)----
ROOT = Path(__file__).resolve().parents[1]
if str(ROOT) not in sys.path:
sys.path.insert(0, str(ROOT)) # 供 app.services.journal_seed import
from app.services.journal_seed import ( # noqa: E402
UPSERT_SQL,
EXPECT_INTL,
EXPECT_ZH,
SHEET_INTL,
SHEET_ZH,
JournalSeedError,
extract_rows_from_xlsx,
new_stats,
upsert_to_db,
)
SOURCE_XLSX = ROOT / "data" / "journals" / "source_v4.xlsx" # v4;v2=source.xlsx 保留回退
REPORT_TXT = ROOT / "data" / "journals" / "import_report.txt"
def build_report(
stage: str,
stats: dict,
counts: dict[str, int] | None,
conflicts: list[str],
idempotent_ok: bool | None,
exit_note: str = "",
) -> str:
L: list[str] = []
L.append("journals directory 导入对账报告")
L.append(f"生成时间: {datetime.now().isoformat(timespec='seconds')}")
L.append(f"源文件: {SOURCE_XLSX}({SOURCE_XLSX.stat().st_size if SOURCE_XLSX.exists() else 0} bytes)")
L.append(f"阶段: {stage}")
L.append("")
L.append("=== 计数 ===")
L.append(f"读取有效行: 国际 {stats['read_intl']} / 中文 {stats['read_zh']} / 合计 {stats['read_intl'] + stats['read_zh']}")
L.append(f"成功: {stats['success']} 跳过(名称空): {stats['skipped']} 失败: {stats['failed']}")
if counts is not None:
L.append(f"写入后 count(*): en={counts.get('en', 0)} zh={counts.get('zh', 0)} total={counts.get('total', 0)}")
L.append(f"期望: en={EXPECT_INTL} zh={EXPECT_ZH} total={EXPECT_INTL + EXPECT_ZH} → {'✓ 相符' if counts.get('total') == EXPECT_INTL + EXPECT_ZH else '✗ 不符'}")
L.append("")
L.append("=== 分区分布(国际)===")
L.append(" / ".join(f"{k} {v}" for k, v in sorted(stats["part_dist"].items())))
L.append(f"分区空白(→null 无note): {len(stats['part_blank'])}")
L.append(f"分区未检得(→null + note): {len(stats['part_notfound'])}")
L.append("")
L.append(f"=== JIF 缺失 {len(stats['jif_missing'])} 条(jif=null + note=核对状态)===")
for n, s in stats["jif_missing"]:
L.append(f" - {n} [{s}]")
L.append("")
L.append(f"=== 中文复合IF 缺失 {len(stats['cif_missing'])} 条 ===")
for n, s in stats["cif_missing"]:
L.append(f" - {n} [{s}]")
L.append("")
L.append("=== 分区未检得 期刊名 ===")
if stats["part_notfound"]:
for n in stats["part_notfound"]:
L.append(f" - {n}")
else:
L.append(" (无——源表以空白表示未检得,见上方'分区空白')")
L.append("")
L.append("=== 重复 id 冲突(应为空)===")
if conflicts:
for c in conflicts:
L.append(f" !! {c}")
else:
L.append(" (无)")
L.append("")
L.append("=== id 策略 ===")
L.append(f"ISSN 型: {stats['id_issn']} 条 slug 型: {stats['id_slug']} 条")
L.append("")
L.append("=== 来源超链接 ===")
L.append(f"国际 JIF来源: {stats['hl_jif']}/{stats['read_intl']} 分区来源: {stats['hl_part']}/{stats['read_intl']} 中文数据来源: {stats['hl_zh']}/{stats['read_zh']}")
L.append("")
L.append("=== 结构迁移(ALTER TABLE,幂等)===")
added = stats.get("migrated_cols") or []
skipped = stats.get("migrated_skipped") or []
L.append(f" 本次加列: {', '.join(added) if added else '无(列已齐)'}")
L.append(f" 已存在跳过: {', '.join(skipped) if skipped else '无'}")
L.append("")
L.append("=== 官网映射(决策:official_source 不入库)===")
L.append(f" 识别列: {stats.get('official_url_headers', '未识别')}")
tot = stats.get("official_total", 0)
L.append(f" official_url 填充: {stats.get('official_filled', 0)}/{tot}"
f" official_check_status 填充: {stats.get('official_check_filled', 0)}/{tot}")
L.append(f" jcr_release_year 填充: {stats.get('jcr_filled', 0)}(仅国际=2026;中文表无此列→null)")
missing = stats.get("official_missing") or []
if missing:
L.append(f" 官网缺失 {len(missing)} 条(official_url=null,前端显示「—」不生成链接):")
for lg, n in missing:
L.append(f" - [{lg}] {n}")
else:
L.append(" 官网缺失: (无)")
L.append("")
L.append("=== 幂等性验证 ===")
if idempotent_ok is None:
L.append(" 未执行")
else:
L.append(f" 第二次 upsert 后 count 不变: {'✓ 通过' if idempotent_ok else '✗ 失败'}")
L.append("")
if exit_note:
L.append(f"!!! {exit_note}")
return "\n".join(L) + "\n"
def main() -> int:
if not SOURCE_XLSX.exists():
print(f"[错误] 源文件不存在: {SOURCE_XLSX}", file=sys.stderr)
return 3
stats: dict[str, Any] = new_stats()
imported_at = datetime.now().isoformat(timespec="seconds")
t0 = time.time()
# 1) 读 Excel + 解析 + 口径/id 校验(journal_seed 共享;失败不写库)
try:
rows_en, rows_zh, stats = extract_rows_from_xlsx(
SOURCE_XLSX, imported_at=imported_at, stats=stats)
except JournalSeedError as exc:
REPORT_TXT.write_text(
build_report(exc.stage, stats, None, exc.conflicts, None, str(exc)),
encoding="utf-8")
if exc.exit_code == 1:
print(f"[中止] {exc}", file=sys.stderr)
for c in exc.conflicts:
print(f" !! {c}", file=sys.stderr)
elif exc.exit_code == 2:
print(f"[中止] {exc}", file=sys.stderr)
else:
print(f"[错误] {exc}", file=sys.stderr)
return exc.exit_code
all_rows = rows_en + rows_zh
# 2) 写 SQLite(独立 stdlib 连接;表由 journal_seed 创建,db.py 零触碰)
db_path = Path(os.environ.get("REVIEW_DB_PATH") or (ROOT / "review.db"))
if not db_path.is_absolute():
db_path = ROOT / db_path
counts = upsert_to_db(db_path, rows_en, rows_zh)
stats["success"] = len(all_rows)
# 3) 幂等验证:同数据第二次 upsert → count 不变
conn = sqlite3.connect(str(db_path))
try:
conn.executemany(UPSERT_SQL, all_rows)
conn.commit()
cur = conn.execute(
"SELECT lang, COUNT(*) FROM journal_directory GROUP BY lang")
d = {lang: n for lang, n in cur.fetchall()}
idempotent_ok = {"en": d.get("en", 0), "zh": d.get("zh", 0),
"total": sum(d.values())} == counts
# 分区分布来自实际库(防统计与写入脱节;未检得 note 单列)
stats["part_dist"] = Counter(dict(conn.execute(
"SELECT COALESCE(cas_partition, "
"CASE WHEN cas_partition_note='未检得' THEN '未检得' ELSE '空白' END), COUNT(*) "
"FROM journal_directory WHERE lang='en' GROUP BY 1").fetchall()))
finally:
conn.close()
report = build_report("完成", stats, counts, [], idempotent_ok)
REPORT_TXT.write_text(report, encoding="utf-8")
print(report)
print(f"[完成] 耗时 {time.time() - t0:.2f}s db={db_path} 报告={REPORT_TXT}")
return 0
if __name__ == "__main__":
sys.exit(main())
@@ -0,0 +1,34 @@
#!/usr/bin/env bash
# prewarm_tectonic.sh —— P3b:预下载 tectonic TeX bundle(宏包缓存)
# 目的:服务启动时预热 data/tectonic-cache/,用户首次编译不必等 1-3 分钟下载。
# 用法: bash scripts/prewarm_tectonic.sh (后台跑,非阻塞;restart.sh 自动调起)
# 注:tectonic v0.17.0 无 `download` 子命令——预热 = 用最小 hello.tex 实编译一次,
# 让 bundle/宏包落进 TECTONIC_CACHE_DIR(同 tools/README.md 预热法)。
set -uo pipefail
SCRIPT_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")/.." && pwd)"
cd "$SCRIPT_DIR"
TECTONIC="$SCRIPT_DIR/tools/tectonic"
[[ -x "$TECTONIC" ]] || { echo "[prewarm] tectonic 不存在,跳过:$TECTONIC"; exit 0; }
export TECTONIC_CACHE_DIR="${REVIEW_TECTONIC_CACHE_DIR:-$SCRIPT_DIR/data/tectonic-cache}"
mkdir -p "$TECTONIC_CACHE_DIR"
TMPDIR_PREWARM="$(mktemp -d)"
trap 'rm -rf "$TMPDIR_PREWARM"' EXIT
cat > "$TMPDIR_PREWARM/hello.tex" <<'EOF'
\documentclass{article}
\begin{document}
prewarm
\end{document}
EOF
echo "[prewarm] 预下载 TeX bundle 至 $TECTONIC_CACHE_DIR(首次 1-3 分钟,仅一次)"
if "$TECTONIC" -X compile "$TMPDIR_PREWARM/hello.tex" --untrusted \
--outdir "$TMPDIR_PREWARM" >/dev/null 2>&1; then
echo "[prewarm] OK:宏包缓存就绪,用户首编可秒级命中"
else
echo "[prewarm] 预热失败(网络/磁盘):不影响服务启动,首编时仍会现场拉取" >&2
exit 0
fi
+11
View File
@@ -0,0 +1,11 @@
"""tests/conftest.py —— 全局测试环境(不 import app,须先于测试模块执行)。
- REVIEW_SEED_ON_STARTUP=false:默认关闭启动自动 seed,防止单测触碰真实
review.db、并避免每个 TestClient 都导入 1056 行 xlsx(开关自身由
test_seed.py 显式覆盖验证)。
"""
from __future__ import annotations
import os
os.environ.setdefault("REVIEW_SEED_ON_STARTUP", "false")
+228
View File
@@ -0,0 +1,228 @@
"""tests/test_compile.py —— P3a LaTeX 编译单元/集成测试。
真实调用 tools/tectonic(宏包已预热缓存);二进制缺失时集成用例 skipif 跳过,
校验/队列/清扫等纯逻辑用例照常运行。
运行: cd review_service && <venv>/bin/python -m pytest -q
"""
from __future__ import annotations
import os
import time
from pathlib import Path
import pytest
from fastapi.testclient import TestClient
from app.config import get_settings
from app.main import app
from app.services import latex_compile as lc
MINIMAL = "\\documentclass[11pt]{article}\n\\begin{document}\nhello p3\n\\end{document}\n"
_TECTONIC_OK = get_settings().tectonic_abs.is_file()
needs_tectonic = pytest.mark.skipif(
not _TECTONIC_OK, reason="tools/tectonic 未安装(bash tools/install_tectonic.sh)"
)
@pytest.fixture()
def client(tmp_path, monkeypatch):
settings = get_settings()
monkeypatch.setattr(settings, "reformat_dir", str(tmp_path / "jobs"))
# 缓存目录不注入 tmp:用部署预热好的 data/tectonic-cache(否则每次测试重拉 bundle)
monkeypatch.setattr(settings, "compile_timeout_s", 60.0)
monkeypatch.setattr(lc, "_pending", 0)
with TestClient(app) as c:
yield c
# ================================================================ 校验(无需 tectonic)
def test_validation_no_input(client: TestClient):
r = client.post("/api/review/compile", data={})
body = r.json()
assert r.status_code == 200 and body["ok"] is False
assert body["error"]["code"] == "VALIDATION"
def test_validation_bad_job_id(client: TestClient):
r = client.post("/api/review/compile", data={"job_id": "../evil"})
assert r.json()["error"]["code"] == "VALIDATION"
def test_validation_job_not_found(client: TestClient):
r = client.post("/api/review/compile", data={"job_id": "0123456789ab"})
assert r.json()["error"]["code"] == "VALIDATION"
def test_validation_path_traversal_filename(client: TestClient):
r = client.post(
"/api/review/compile",
files={"file": ("../evil.tex", b"x", "application/x-tex")},
)
assert r.json()["error"]["code"] == "VALIDATION"
def test_validation_non_tex(client: TestClient):
r = client.post(
"/api/review/compile",
files={"file": ("paper.pdf", b"x", "application/pdf")},
)
assert r.json()["error"]["code"] == "VALIDATION"
def test_validation_oversize(client: TestClient, monkeypatch):
monkeypatch.setattr(get_settings(), "max_tex_bytes", 10)
r = client.post(
"/api/review/compile",
files={"file": ("paper.tex", b"01234567890", "application/x-tex")},
)
assert r.json()["error"]["code"] == "VALIDATION"
# ================================================================ 编译(真实 tectonic)
@needs_tectonic
def test_compile_happy_path(client: TestClient):
r = client.post(
"/api/review/compile",
files={"file": ("paper.tex", MINIMAL.encode(), "application/x-tex")},
)
body = r.json()
assert r.status_code == 200 and body["ok"] is True, body
cid = body["compile_id"]
assert len(cid) == 12
pdf = client.get(body["pdf_url"])
assert pdf.status_code == 200
assert pdf.headers["content-type"].startswith("application/pdf")
assert pdf.content[:5] == b"%PDF-"
log = client.get(body["log_url"])
assert log.status_code == 200
assert "LaTeX2e" in log.text and "Output written" in log.text
meta = client.get(f"/api/review/compile/{cid}")
assert meta.json()["ok"] is True
assert meta.json()["meta"]["pdf_bytes"] > 0
@needs_tectonic
def test_compile_by_job_id(client: TestClient):
tex = (
"\\documentclass[11pt]{article}\n\\begin{document}\nvia job\n\\end{document}\n"
)
rf = client.post(
"/api/review/reformat",
files={"file": ("paper.tex", tex.encode(), "application/x-tex")},
data={"target_journal": "default"},
).json()
assert rf["ok"] is True
r = client.post("/api/review/compile", data={"job_id": rf["job_id"]})
body = r.json()
assert body["ok"] is True and body["compile_id"] == rf["job_id"]
pdf = client.get(body["pdf_url"])
assert pdf.content[:5] == b"%PDF-"
@needs_tectonic
def test_compile_malicious_write18(client: TestClient, tmp_path):
canary = tmp_path / "canary_p3"
evil = (
"\\documentclass{article}\n"
f"\\write18{{touch {canary}}}\n"
"\\begin{document}\nno shell please\n\\end{document}\n"
)
r = client.post(
"/api/review/compile",
files={"file": ("evil.tex", evil.encode(), "application/x-tex")},
)
body = r.json()
# 系统无损即通过(信封 ok 与否均可):canary 绝不能出现
assert not canary.exists(), r"\write18 竟然执行了!"
if body["ok"]:
pdf = client.get(body["pdf_url"])
assert pdf.content[:5] == b"%PDF-"
else:
assert body["error"]["code"] in ("COMPILE_FAILED", "TIMEOUT")
@needs_tectonic
def test_compile_failed_returns_log_tail(client: TestClient):
bad = "\\documentclass{article}\n\\begin{document}\n\\undefinedcommandxyz\n"
r = client.post(
"/api/review/compile",
files={"file": ("bad.tex", bad.encode(), "application/x-tex")},
)
body = r.json()
assert body["ok"] is False
assert body["error"]["code"] == "COMPILE_FAILED"
assert "log" in body["error"]["message"].lower() or body["error"].get("detail")
@needs_tectonic
def test_compile_timeout(client: TestClient, monkeypatch):
monkeypatch.setattr(get_settings(), "compile_timeout_s", 5.0)
loop_tex = (
"\\documentclass{article}\n\\begin{document}\n"
"\\count255=0\n\\loop\\iftrue\\advance\\count255 by 1\\repeat\n"
"\\end{document}\n"
)
started = time.monotonic()
r = client.post(
"/api/review/compile",
files={"file": ("loop.tex", loop_tex.encode(), "application/x-tex")},
)
elapsed = time.monotonic() - started
body = r.json()
assert body["ok"] is False
assert body["error"]["code"] == "TIMEOUT"
assert elapsed < 15.0, f"超时回收过慢:{elapsed:.1f}s"
# ================================================================ 队列 / 清扫
def test_queue_full(client: TestClient, monkeypatch):
monkeypatch.setattr(lc, "_pending", 5)
monkeypatch.setattr(get_settings(), "compile_queue_limit", 5)
r = client.post(
"/api/review/compile",
files={"file": ("paper.tex", MINIMAL.encode(), "application/x-tex")},
)
assert r.status_code == 429
body = r.json()
assert body["ok"] is False and body["error"]["code"] == "QUEUE_FULL"
def test_tool_unavailable(client: TestClient, monkeypatch):
monkeypatch.setattr(get_settings(), "tectonic_path", "tools/definitely-missing")
r = client.post(
"/api/review/compile",
files={"file": ("paper.tex", MINIMAL.encode(), "application/x-tex")},
)
assert r.status_code == 200
assert r.json()["error"]["code"] == "TOOL_UNAVAILABLE"
assert "install_tectonic" in r.json()["error"]["message"]
def test_sweep_expired(tmp_path, monkeypatch):
settings = get_settings()
monkeypatch.setattr(settings, "reformat_dir", str(tmp_path / "jobs"))
base = tmp_path / "jobs"
stale = base / "aabbccddeeff"
stale.mkdir(parents=True)
(stale / "output.pdf").write_bytes(b"%PDF-fake")
old = time.time() - 8 * 86400
os.utime(stale, (old, old))
fresh = base / "112233445566"
fresh.mkdir()
noise = base / "not-a-job"
noise.mkdir()
removed = lc.sweep_expired()
assert removed == 1
assert not stale.exists()
assert fresh.exists()
assert noise.exists()
+639
View File
@@ -0,0 +1,639 @@
"""tests/test_compile_zip.py —— P4 项目 zip 两段式编译集成测试。
真实调用 tools/tectonic(宏包已预热缓存);二进制缺失时集成用例 skipif 跳过,
校验/消费/清扫等纯逻辑用例照常运行。
运行: cd review_service && <venv>/bin/python -m pytest -q
"""
from __future__ import annotations
import io
import json
import os
import shutil
import time
import zipfile
from pathlib import Path
import pytest
from fastapi.testclient import TestClient
from app.config import get_settings
from app.main import app
from app.services import latex_compile as lc
MINIMAL = "\\documentclass[11pt]{article}\n\\begin{document}\nhello p4\n\\end{document}\n"
_TECTONIC_OK = get_settings().tectonic_abs.is_file()
needs_tectonic = pytest.mark.skipif(
not _TECTONIC_OK, reason="tools/tectonic 未安装(bash tools/install_tectonic.sh)"
)
def _zip_bytes(entries: dict[str, str | bytes]) -> bytes:
buf = io.BytesIO()
with zipfile.ZipFile(buf, "w", zipfile.ZIP_DEFLATED) as zf:
for name, data in entries.items():
zf.writestr(name, data)
return buf.getvalue()
def _upload(client: TestClient, payload: bytes, name: str = "project.zip"):
return client.post(
"/api/review/compile/inspect",
files={"file": (name, payload, "application/zip")},
)
def _tiny_pdf() -> bytes:
"""极小合法 PDF(1 页 20x20 蓝色方块),供图片内嵌集成用例。"""
stream = b"0 0 1 rg 2 2 10 10 re f\n"
objs = [
b"<< /Type /Catalog /Pages 2 0 R >>",
b"<< /Type /Pages /Kids [3 0 R] /Count 1 >>",
b"<< /Type /Page /Parent 2 0 R /MediaBox [0 0 20 20]"
b" /Contents 4 0 R /Resources << >> >>",
b"<< /Length " + str(len(stream)).encode() + b" >>\nstream\n"
+ stream + b"endstream",
]
out = bytearray(b"%PDF-1.4\n")
offsets = []
for i, body in enumerate(objs, 1):
offsets.append(len(out))
out += f"{i} 0 obj\n".encode() + body + b"\nendobj\n"
xref_pos = len(out)
out += f"xref\n0 {len(objs) + 1}\n".encode()
out += b"0000000000 65535 f \n"
for off in offsets:
out += f"{off:010d} 00000 n \n".encode()
out += (f"trailer\n<< /Size {len(objs) + 1} /Root 1 0 R >>\n"
f"startxref\n{xref_pos}\n%%EOF\n").encode()
return bytes(out)
@pytest.fixture()
def client(tmp_path, monkeypatch):
settings = get_settings()
monkeypatch.setattr(settings, "reformat_dir", str(tmp_path / "jobs"))
monkeypatch.setattr(settings, "inspect_dir", str(tmp_path / "inspect"))
monkeypatch.setattr(settings, "compile_jobs_dir", str(tmp_path / "compile_jobs"))
monkeypatch.setattr(settings, "compile_timeout_s", 60.0)
monkeypatch.setattr(settings, "compile_project_timeout_s", 60.0)
monkeypatch.setattr(lc, "_pending", 0)
with TestClient(app) as c:
yield c
# ================================================================ inspect 校验
def test_inspect_not_zip(client: TestClient):
r = client.post(
"/api/review/compile/inspect",
files={"file": ("x.zip", b"notazip", "application/zip")},
)
assert r.status_code == 200 and r.json()["error"]["code"] == "ZIP_INVALID"
def test_inspect_empty(client: TestClient):
r = _upload(client, b"")
assert r.json()["error"]["code"] == "VALIDATION"
def test_inspect_oversize(client: TestClient, monkeypatch):
monkeypatch.setattr(get_settings(), "max_zip_bytes", 10)
r = _upload(client, _zip_bytes({"main.tex": MINIMAL}))
assert r.json()["error"]["code"] == "VALIDATION"
assert "上限" in r.json()["error"]["message"]
def test_inspect_bad_filename(client: TestClient):
r = _upload(client, _zip_bytes({"main.tex": MINIMAL}), name="../evil.zip")
assert r.json()["error"]["code"] == "VALIDATION"
def test_inspect_path_traversal(client: TestClient):
buf = io.BytesIO()
with zipfile.ZipFile(buf, "w") as zf:
zf.writestr("main.tex", MINIMAL)
info = zipfile.ZipInfo("../../evil.txt")
zf.writestr(info, "x")
r = _upload(client, buf.getvalue())
assert r.json()["error"]["code"] == "ZIP_UNSAFE"
def test_inspect_denied_ext(client: TestClient):
r = _upload(client, _zip_bytes({"main.tex": MINIMAL, "evil.sh": "#!/bin/sh\n"}))
assert r.json()["error"]["code"] == "ZIP_UNSAFE"
assert "evil.sh" in r.json()["error"]["message"]
def test_inspect_ratio_bomb(client: TestClient, monkeypatch):
monkeypatch.setattr(get_settings(), "max_zip_ratio", 1.5)
r = _upload(client, _zip_bytes({"main.tex": "a" * 100_000}))
assert r.json()["error"]["code"] == "ZIP_BOMB"
def test_inspect_no_tex(client: TestClient):
r = _upload(client, _zip_bytes({"readme.txt": "hi"}))
assert r.json()["error"]["code"] == "VALIDATION"
assert "没有 .tex" in r.json()["error"]["message"]
def test_inspect_no_documentclass(client: TestClient):
r = _upload(client, _zip_bytes({"chapters/a.tex": "just text\n"}))
assert r.json()["error"]["code"] == "VALIDATION"
assert "documentclass" in r.json()["error"]["message"]
def test_inspect_multiple_mains(client: TestClient):
r = _upload(client, _zip_bytes({
"main.tex": MINIMAL, "appendix.tex": MINIMAL}))
body = r.json()
assert body["error"]["code"] == "VALIDATION"
assert "多个主文件" in body["error"]["message"]
# ================================================================ inspect 正常 + 卫生
def test_inspect_happy_path(client: TestClient):
payload = _zip_bytes({
"main.tex": MINIMAL,
"figs/fig1.png": b"\x89PNG\r\n\x1a\nfake",
"refs.bib": "@article{a,\n title={t}\n}\n",
"journal.cls": "% fake cls\n",
"notes.docx": "skip me",
".DS_Store": "junk",
"__MACOSX/._main.tex": "resource fork junk",
})
r = _upload(client, payload)
body = r.json()
assert body["ok"] is True, body
meta = body["meta"]
assert meta["main"] == "main.tex"
stats = meta["stats"]
assert stats["tex"] == 1 and stats["images"] == 1
assert stats["cls"] == 1 and stats["bib"] == 1
assert meta["skipped_count"] >= 2
names = {s["name"] for s in meta["skipped"]}
assert any("notes.docx" in n for n in names)
job_id = meta["job_id"]
assert len(job_id) == 12
jdir = get_settings().inspect_dir_abs / job_id
assert (jdir / "inspect.json").is_file()
assert (jdir / "project" / "main.tex").is_file()
def test_inspect_fail_leaves_no_residue(client: TestClient):
r = _upload(client, _zip_bytes({"main.tex": MINIMAL, "evil.sh": "x"}))
assert r.json()["ok"] is False
base = get_settings().inspect_dir_abs
if base.is_dir():
assert not any(base.iterdir()), "inspect 失败后磁盘有残留"
# ================================================================ run:校验 / 原子消费
def test_run_bad_job_id(client: TestClient):
r = client.post("/api/review/compile/run", json={"job_id": "zz"})
assert r.json()["error"]["code"] == "VALIDATION"
def test_run_unknown_job(client: TestClient):
r = client.post("/api/review/compile/run", json={"job_id": "0123456789ab"})
assert r.json()["error"]["code"] == "VALIDATION"
def test_run_double_consume_rejected(client: TestClient):
"""补充:原子消费——同一 job 第二次 run 必须 VALIDATION(防并发双跑)。"""
job_id = _upload(client, _zip_bytes({"main.tex": MINIMAL})).json()["meta"]["job_id"]
first = client.post("/api/review/compile/run", json={"job_id": job_id}).json()
first_err = first.get("error") or {}
if first_err.get("code") == "TOOL_UNAVAILABLE":
pytest.skip("tectonic 未安装,消费逻辑未触达")
# 首次无论编译成败(消费已发生),二次必失败
assert first["ok"] is True or first["error"]["code"] in (
"COMPILE_FAILED", "TIMEOUT")
second = client.post("/api/review/compile/run", json={"job_id": job_id}).json()
assert second["ok"] is False
assert second["error"]["code"] == "VALIDATION"
# inspect 残壳也不应存在
assert not (get_settings().inspect_dir_abs / job_id / "project").exists()
def test_run_tool_unavailable_keeps_job(client: TestClient, monkeypatch):
"""队列/工具检查先于消费 → TOOL_UNAVAILABLE 时 inspect 保留可重试。"""
job_id = _upload(client, _zip_bytes({"main.tex": MINIMAL})).json()["meta"]["job_id"]
with monkeypatch.context() as m:
m.setattr(get_settings(), "tectonic_path", "tools/definitely-missing")
r = client.post("/api/review/compile/run", json={"job_id": job_id}).json()
assert r["error"]["code"] == "TOOL_UNAVAILABLE"
assert (get_settings().inspect_dir_abs / job_id / "inspect.json").is_file()
def test_run_queue_full_keeps_job(client: TestClient, monkeypatch):
job_id = _upload(client, _zip_bytes({"main.tex": MINIMAL})).json()["meta"]["job_id"]
monkeypatch.setattr(lc, "_pending", 5)
monkeypatch.setattr(get_settings(), "compile_queue_limit", 5)
r = client.post("/api/review/compile/run", json={"job_id": job_id})
assert r.status_code == 429
assert r.json()["error"]["code"] == "QUEUE_FULL"
assert (get_settings().inspect_dir_abs / job_id / "inspect.json").is_file()
# ================================================================ run:真实 tectonic
@needs_tectonic
def test_run_project_happy_path(client: TestClient):
payload = _zip_bytes({"main.tex": MINIMAL})
job_id = _upload(client, payload).json()["meta"]["job_id"]
r = client.post("/api/review/compile/run", json={"job_id": job_id})
body = r.json()
assert body["ok"] is True, body
cid = body["compile_id"]
assert len(cid) == 12
pdf = client.get(body["pdf_url"])
assert pdf.status_code == 200
assert pdf.headers["content-type"].startswith("application/pdf")
assert pdf.content[:5] == b"%PDF-"
log = client.get(body["log_url"])
assert log.status_code == 200
assert "LaTeX2e" in log.text and "Output written" in log.text
meta = client.get(f"/api/review/compile/zip/{cid}")
m = meta.json()
assert m["ok"] is True
assert m["meta"]["project"] is True
assert m["meta"]["main"] == "main.tex"
assert m["meta"]["pdf_bytes"] > 0
# project 树已删,只留产物
cdir = get_settings().compile_jobs_dir_abs / cid
assert not (cdir / "project").exists()
assert (cdir / "output.pdf").is_file()
@needs_tectonic
def test_run_failed_envelope_has_log_url(client: TestClient):
"""补充 3:编译失败信封带 compile_id + log_url,且 log 可下载。"""
bad = "\\documentclass{article}\n\\begin{document}\n\\undefinedcommandxyz\n"
job_id = _upload(client, _zip_bytes({"main.tex": bad})).json()["meta"]["job_id"]
body = client.post("/api/review/compile/run", json={"job_id": job_id}).json()
assert body["ok"] is False
assert body["error"]["code"] == "COMPILE_FAILED"
cid = body.get("compile_id")
assert cid and len(cid) == 12
assert body["log_url"] == f"/api/review/compile/zip/{cid}/log"
log = client.get(body["log_url"])
assert log.status_code == 200 and log.text.strip()
@needs_tectonic
def test_run_failed_keeps_project_scene(client: TestClient):
"""失败保留现场(诊断):COMPILE_FAILED → compile_jobs/{cid}/project/ 不删。"""
bad = "\\documentclass{article}\n\\begin{document}\n\\undefinedcommandxyz\n"
job_id = _upload(client, _zip_bytes({"main.tex": bad})).json()["meta"]["job_id"]
body = client.post("/api/review/compile/run", json={"job_id": job_id}).json()
assert body["ok"] is False and body["error"]["code"] == "COMPILE_FAILED"
cid = body["compile_id"]
cdir = get_settings().compile_jobs_dir_abs / cid
assert (cdir / "project" / "main.tex").is_file() # 现场保留
assert (cdir / "output.log").is_file()
@needs_tectonic
def test_run_missing_cls_friendly_message(client: TestClient):
"""classify_compile_error:缺 .cls → 期刊模板提示(Q4/§4.4)。"""
tex = "\\documentclass{noexist-cls}\n\\begin{document}\nx\n"
job_id = _upload(client, _zip_bytes({"main.tex": tex})).json()["meta"]["job_id"]
body = client.post("/api/review/compile/run", json={"job_id": job_id}).json()
assert body["ok"] is False and body["error"]["code"] == "COMPILE_FAILED"
assert "noexist-cls" in body["error"]["message"]
@needs_tectonic
def test_run_project_malicious_write18(client: TestClient, tmp_path):
canary = tmp_path / "canary_p4"
evil = (
"\\documentclass{article}\n"
f"\\write18{{touch {canary}}}\n"
"\\begin{document}\nno shell please\n\\end{document}\n"
)
job_id = _upload(client, _zip_bytes({"main.tex": evil})).json()["meta"]["job_id"]
client.post("/api/review/compile/run", json={"job_id": job_id})
assert not canary.exists(), r"\write18 竟然执行了!"
@needs_tectonic
def test_run_project_timeout(client: TestClient, monkeypatch):
monkeypatch.setattr(get_settings(), "compile_project_timeout_s", 5.0)
loop_tex = (
"\\documentclass{article}\n\\begin{document}\n"
"\\count255=0\n\\loop\\iftrue\\advance\\count255 by 1\\repeat\n"
"\\end{document}\n"
)
job_id = _upload(client, _zip_bytes({"main.tex": loop_tex})).json()["meta"]["job_id"]
started = time.monotonic()
body = client.post("/api/review/compile/run", json={"job_id": job_id}).json()
elapsed = time.monotonic() - started
assert body["ok"] is False and body["error"]["code"] == "TIMEOUT"
assert elapsed < 15.0, f"超时回收过慢:{elapsed:.1f}s"
# 超时也必落 log(补充 3)
log = client.get(body["log_url"])
assert log.status_code == 200
assert "[timeout]" in log.text
# ================================================================ EPS 兼容 v2(批量现场转换)
_MIN_EPS = (
b"%!PS-Adobe-3.0 EPSF-3.0\n%%BoundingBox: 0 0 10 10\n"
b"0 0 1 setrgbcolor 0 0 10 10 rectfill\nshowpage\n%%EOF\n"
)
def _eps_project(tmp_path, tex_body: str = "") -> Path:
proj = tmp_path / "p"
proj.mkdir()
(proj / "fig.eps").write_bytes(_MIN_EPS)
(proj / "main.tex").write_text(
"\\documentclass{article}\n\\usepackage{graphicx}\n"
"\\begin{document}\n" + tex_body + "\n\\end{document}\n",
encoding="utf-8")
return proj
def test_eps_v2_preset_converted(tmp_path, monkeypatch):
"""zip 自带 *-eps-converted-to.pdf → 免转换复制为 X.pdf + 显式引用改写。"""
# other.eps 无转换版 → mock 工具为空使其失败,隔离 preset 逻辑(不真跑 gs)
monkeypatch.setattr(lc, "_eps_tool_commands", lambda eps, pdf: [])
proj = _eps_project(tmp_path)
defs = proj / "Definitions"
defs.mkdir()
(defs / "logo-mdpi.eps").write_bytes(_MIN_EPS)
(defs / "logo-mdpi-eps-converted-to.pdf").write_bytes(_tiny_pdf())
(defs / "other.eps").write_bytes(b"%!PS\n") # 无转换版 → 走现场转换(被 mock 挡下)
(defs / "mdpi.cls").write_text(
"\\includegraphics{Definitions/logo-mdpi.eps}\n"
"\\includegraphics{Definitions/other.eps}\n", encoding="utf-8")
lines = lc.process_eps_images(proj)
cls = (defs / "mdpi.cls").read_text(encoding="utf-8")
assert "Definitions/logo-mdpi.pdf" in cls # 显式引用已改写为 .pdf
assert "Definitions/other.eps" in cls # 转换失败的保持原样
assert (defs / "logo-mdpi.eps").is_file() # 原文件保留
assert (defs / "logo-mdpi.pdf").is_file() # 免转换复制
assert not (defs / "other.pdf").exists()
assert any(", preset)" in l for l in lines), lines
assert any("全部工具失败,图片 Definitions/other.eps 未转换" in l
for l in lines), lines
def test_eps_v2_real_gs_convert(tmp_path):
"""无预转换版 → 现场 gs 转换(真实工具链;测试点:显式 + 缺省扩展名引用都就位)。"""
if not shutil.which("gs"):
pytest.skip("gs 未安装")
proj = _eps_project(tmp_path, "\\includegraphics{fig.eps}\n\\includegraphics{fig}")
lines = lc.process_eps_images(proj)
assert any("[eps-convert] fig.eps → fig.pdf" in l and ", gs)" in l for l in lines)
pdf = proj / "fig.pdf"
assert pdf.is_file() and pdf.read_bytes()[:5] == b"%PDF-"
tex = (proj / "main.tex").read_text(encoding="utf-8")
assert "{fig.pdf}" in tex # 显式 .eps 引用已改写
assert "{fig}" in tex # 缺省扩展名引用由 X.pdf 命中
assert (proj / "fig.eps").is_file() # 原文件保留
def test_eps_v2_tool_fallback(tmp_path, monkeypatch):
"""工具优先级 gs → epstopdf → ps2pdf:gs 失败 → epstopdf 成功。"""
def fake_tools(eps: Path, pdf: Path):
return [
("gs", ["sh", "-c", "exit 1"]),
("epstopdf", ["sh", "-c", f"echo %PDF-fake > {pdf}"]),
]
monkeypatch.setattr(lc, "_eps_tool_commands", fake_tools)
proj = _eps_project(tmp_path, "\\includegraphics{fig.eps}")
lines = lc.process_eps_images(proj)
assert any(l.startswith("[eps-convert] fig.eps → fig.pdf") and ", epstopdf)" in l
for l in lines), lines
assert (proj / "fig.pdf").is_file()
assert "{fig.pdf}" in (proj / "main.tex").read_text(encoding="utf-8")
def test_eps_v2_all_tools_fail(tmp_path, monkeypatch):
"""全工具失败 → log 行「全部工具失败…未转换」,引用保持 .eps。"""
monkeypatch.setattr(
lc, "_eps_tool_commands",
lambda eps, pdf: [("gs", ["sh", "-c", "exit 1"])])
proj = _eps_project(tmp_path, "\\includegraphics{fig.eps}")
lines = lc.process_eps_images(proj)
assert "[eps-convert] 全部工具失败,图片 fig.eps 未转换" in lines
assert not (proj / "fig.pdf").exists()
assert "{fig.eps}" in (proj / "main.tex").read_text(encoding="utf-8")
def test_eps_v2_timeout_warns(tmp_path, monkeypatch):
"""约束2:单文件转换 15s 超时 → warning 行,放弃该文件继续。"""
monkeypatch.setattr(lc, "_EPS_CONVERT_TIMEOUT_S", 1)
monkeypatch.setattr(
lc, "_eps_tool_commands",
lambda eps, pdf: [("gs", ["sh", "-c", "sleep 5"])])
proj = _eps_project(tmp_path)
lines = lc.process_eps_images(proj)
assert "[eps-convert] fig.eps 转换超时" in lines
assert not (proj / "fig.pdf").exists()
def test_eps_v2_file_size_warning(tmp_path, monkeypatch):
"""约束3a:单文件转换后超上限 → warning 行(不中止)。"""
monkeypatch.setattr(lc, "_EPS_CONVERT_MAX_FILE", 10)
monkeypatch.setattr(
lc, "_eps_tool_commands",
lambda eps, pdf: [("gs", ["sh", "-c", f"head -c 1024 /dev/zero > {pdf}"])])
proj = _eps_project(tmp_path)
lines = lc.process_eps_images(proj)
assert any("警告" in l and "超过" in l for l in lines), lines
def test_eps_v2_total_size_aborts(tmp_path, monkeypatch):
"""约束3b:转换产物累计超上限 → InspectError(ZIP_TOO_LARGE) 中止。"""
monkeypatch.setattr(lc, "_EPS_CONVERT_MAX_TOTAL", 100)
monkeypatch.setattr(
lc, "_eps_tool_commands",
lambda eps, pdf: [("gs", ["sh", "-c", f"head -c 1024 /dev/zero > {pdf}"])])
proj = _eps_project(tmp_path)
with pytest.raises(lc.InspectError) as ei:
lc.process_eps_images(proj)
assert ei.value.code == "ZIP_TOO_LARGE"
assert "MB" in ei.value.message
@needs_tectonic
def test_run_eps_with_converted_pdf_succeeds(client: TestClient):
"""EPS + 预转换 PDF(preset 路径)→ 显式与缺省扩展名引用都编译成功。"""
tex = (
"\\documentclass{article}\n\\usepackage{graphicx}\n"
"\\begin{document}\n"
"\\includegraphics[width=1cm]{fig.eps}\n" # 显式 .eps → 文本替换
"\\includegraphics[width=1cm]{fig}\n" # 缺省扩展名 → X.pdf 命中
"\\end{document}\n"
)
payload = _zip_bytes({
"main.tex": tex,
"fig.eps": _MIN_EPS,
"fig-eps-converted-to.pdf": _tiny_pdf(),
})
job_id = _upload(client, payload).json()["meta"]["job_id"]
body = client.post("/api/review/compile/run", json={"job_id": job_id}).json()
assert body["ok"] is True, body
pdf = client.get(body["pdf_url"])
assert pdf.content[:5] == b"%PDF-"
@needs_tectonic
def test_run_eps_real_gs_conversion_succeeds(client: TestClient):
"""核心 v2 场景:真实 EPS 无预转换版 → 服务器现场转换 → 端到端编译成功。"""
if not shutil.which("gs"):
pytest.skip("gs 未安装")
tex = (
"\\documentclass{article}\n\\usepackage{graphicx}\n"
"\\begin{document}\n"
"\\includegraphics[width=1cm]{fig.eps}\n"
"\\includegraphics[width=1cm]{fig}\n"
"\\end{document}\n"
)
payload = _zip_bytes({"main.tex": tex, "fig.eps": _MIN_EPS})
job_id = _upload(client, payload).json()["meta"]["job_id"]
body = client.post("/api/review/compile/run", json={"job_id": job_id}).json()
assert body["ok"] is True, body
assert client.get(body["pdf_url"]).content[:5] == b"%PDF-"
# 约束4:转换日志落 output.log
log = client.get(body["log_url"]).text
assert "[eps-convert] fig.eps → fig.pdf" in log and ", gs)" in log
@needs_tectonic
def test_run_eps_all_tools_fail_friendly_message(
client: TestClient, monkeypatch):
"""测试点2+3:全工具失败 → log 记「全部工具失败」→ 编译失败 → 前端友好提示。"""
monkeypatch.setattr(lc, "_eps_tool_commands", lambda eps, pdf: [])
tex = (
"\\documentclass{article}\n\\usepackage{graphicx}\n"
"\\begin{document}\n\\includegraphics[width=1cm]{fig.eps}\n\\end{document}\n"
)
payload = _zip_bytes({"main.tex": tex, "fig.eps": _MIN_EPS})
job_id = _upload(client, payload).json()["meta"]["job_id"]
body = client.post("/api/review/compile/run", json={"job_id": job_id}).json()
assert body["ok"] is False and body["error"]["code"] == "COMPILE_FAILED"
assert body["error"]["message"] == \
"项目包含 EPS 图片,服务器转换失败,请转成 PDF/PNG 后重试"
log = client.get(body["log_url"]).text
assert "[eps-convert] 全部工具失败,图片 fig.eps 未转换" in log
# ================================================================ zip 只读端点 404
def test_zip_meta_404(client: TestClient):
r = client.get("/api/review/compile/zip/0123456789ab")
assert r.json()["error"]["code"] == "NOT_FOUND"
def test_zip_pdf_404(client: TestClient):
r = client.get("/api/review/compile/zip/0123456789ab/pdf")
assert r.json()["error"]["code"] == "NOT_FOUND"
def test_zip_log_404(client: TestClient):
r = client.get("/api/review/compile/zip/0123456789ab/log")
assert r.json()["error"]["code"] == "NOT_FOUND"
# ================================================================ 清扫
def test_sweep_inspect_expired(tmp_path, monkeypatch):
settings = get_settings()
monkeypatch.setattr(settings, "inspect_dir", str(tmp_path / "inspect"))
base = tmp_path / "inspect"
stale = base / "aabbccddeeff"
stale.mkdir(parents=True)
(stale / "inspect.json").write_text("{}", encoding="utf-8")
(stale / "project").mkdir()
old = time.time() - 2 * 3600
os.utime(stale, (old, old))
fresh = base / "112233445566"
fresh.mkdir()
noise = base / "not-a-job"
noise.mkdir()
removed = lc.sweep_inspect_expired()
assert removed == 1
assert not stale.exists()
assert fresh.exists()
assert noise.exists()
def test_sweep_compile_jobs_expired(tmp_path, monkeypatch):
settings = get_settings()
monkeypatch.setattr(settings, "compile_jobs_dir", str(tmp_path / "cj"))
base = tmp_path / "cj"
stale = base / "aabbccddeeff"
stale.mkdir(parents=True)
(stale / "output.pdf").write_bytes(b"%PDF-fake")
old = time.time() - 8 * 86400
os.utime(stale, (old, old))
fresh = base / "112233445566"
fresh.mkdir()
(fresh / "output.pdf").write_bytes(b"%PDF-fake")
noise = base / "not-a-job"
noise.mkdir()
removed = lc.sweep_compile_jobs_expired()
assert removed == 1
assert not stale.exists()
assert fresh.exists()
assert noise.exists()
def test_sweep_failed_project_ttl(tmp_path, monkeypatch):
"""两级清扫①:失败现场 project/ 超 failed_project_ttl_s → 只删子目录,log 保留。"""
settings = get_settings()
monkeypatch.setattr(settings, "compile_jobs_dir", str(tmp_path / "cj"))
monkeypatch.delenv("KEEP_FAILED_PROJECTS", raising=False)
base = tmp_path / "cj"
stale = base / "aabbccddeeff"
(stale / "project").mkdir(parents=True)
(stale / "output.log").write_text("log", encoding="utf-8")
old = time.time() - settings.failed_project_ttl_s - 3600
os.utime(stale / "project", (old, old))
os.utime(stale, (old, old)) # 整目录也旧,但未超 7 天 → ② 不触发
fresh = base / "112233445566"
(fresh / "project").mkdir(parents=True)
(fresh / "output.log").write_text("log", encoding="utf-8")
removed = lc.sweep_compile_jobs_expired()
assert removed == 1
assert not (stale / "project").exists() # 现场删
assert (stale / "output.log").is_file() # log 留(完整 log 下载)
assert (fresh / "project").exists()
def test_sweep_failed_project_kept_when_flag(tmp_path, monkeypatch):
"""KEEP_FAILED_PROJECTS=1:失败现场永久保留(跳过①)。"""
settings = get_settings()
monkeypatch.setattr(settings, "compile_jobs_dir", str(tmp_path / "cj"))
monkeypatch.setenv("KEEP_FAILED_PROJECTS", "1")
base = tmp_path / "cj"
stale = base / "aabbccddeeff"
(stale / "project").mkdir(parents=True)
old = time.time() - settings.failed_project_ttl_s - 3600
os.utime(stale / "project", (old, old))
removed = lc.sweep_compile_jobs_expired()
assert removed == 0
assert (stale / "project").exists()
+597
View File
@@ -0,0 +1,597 @@
"""tests/test_presubmit.py —— presubmit 离线单元测试(mock 解析与 LLM,不依赖上游)。
覆盖:非 PDF 校验 / 报告归一化 / LLM 失败降级 / 解析失败降级 / recommendation 规则
引擎(R0-R5 + tier 分档 + rationale 可解释 + LLM recommendation 注入被忽略)。
运行: cd review_service && <venv>/bin/python -m pytest -q
"""
from __future__ import annotations
import pytest
from fastapi.testclient import TestClient
from app.main import app
from app.services import llm, paper_parse
from app.services.recommend_engine import decide_recommendation
FAKE_PDF = b"%PDF-1.4 fake-bytes-for-test"
LLM_PAYLOAD = {
"summary": "研究问题清晰,但统计与证据链存在重大缺口。",
"major_weaknesses": [
{
"title": "统计方法不当",
"detail": "未做多重检验校正",
"evidence": "Methods 2.1 仅报 p<0.05,未见 FDR/Bonferroni",
"suggestion": "补充 FDR 校正",
"hard_rule": None,
"fatal": False,
},
"纯字符串条目", # 宽容归一化:字符串 → WeaknessItem(title=...)
],
# minor 故意不带 evidence 字段 → 归一化应补空串
"minor_weaknesses": [{"detail": "缺少缩写表", "title": "缩写"}],
"presentation_format": [{"title": "图注不完整", "detail": "Fig.2 无单位", "suggestion": "补单位"}],
"questions_for_authors": ["群体结构如何校正?", ""],
"recommendation": "MAJOR_REVISION", # 引擎忽略此字段(防注入);归一化不再读取
}
@pytest.fixture()
def client() -> TestClient:
return TestClient(app)
@pytest.fixture(autouse=True)
def _mock_upstreams(monkeypatch):
async def fake_parse(file_bytes: bytes, filename: str = "paper.pdf") -> str:
assert file_bytes == FAKE_PDF
return "论文正文……" * 10
async def fake_llm_json(system: str, user: str, **kwargs):
assert "论文正文" in user
return dict(LLM_PAYLOAD)
async def boom_llm(*args, **kwargs):
raise llm.LLMError("余额不足")
async def boom_parse(*args, **kwargs):
raise paper_parse.ParseError("PDF 解析结果为空")
monkeypatch.setattr(paper_parse, "parse_pdf_bytes", fake_parse)
monkeypatch.setattr(llm, "complete_json", fake_llm_json)
yield
# monkeypatch 自动还原
def _post(client: TestClient, filename: str, content: bytes, journal: str = ""):
data = {"target_journal": journal} if journal else {}
return client.post(
"/api/review/presubmit",
files={"file": (filename, content, "application/pdf")},
data=data,
)
def test_non_pdf_rejected(client: TestClient):
r = client.post(
"/api/review/presubmit",
files={"file": ("a.txt", b"x", "text/plain")},
)
body = r.json()
assert body["ok"] is False
assert body["error"]["code"] == "VALIDATION"
def test_empty_file_rejected(client: TestClient):
body = _post(client, "p.pdf", b"").json()
assert body["ok"] is False
assert body["error"]["code"] == "VALIDATION"
def test_normal_report_normalized(client: TestClient):
body = _post(client, "p.pdf", FAKE_PDF, journal="Plant Cell").json()
assert body["ok"] is True
report = body["report"]
# 2 条 soft major(无硬性标签)→ 引擎 R2 → major_revision(与 LLM 是否输出无关)
assert report["recommendation"] == "major_revision"
# rationale:规则依据 + tier 字段 + explanation(用例 10)
rat = report["recommendation_rationale"]
assert rat["rule"] == "R2"
assert rat["major_count"] == 2 and rat["hard_count"] == 0 and rat["soft_count"] == 2
assert rat["tier"] == 1 and rat["tier_label"] == "顶刊"
assert rat["explanation"]
# 字符串条目宽容归一化
assert len(report["major_weaknesses"]) == 2
assert report["major_weaknesses"][1]["title"] == "纯字符串条目"
# Evidence 字段:有则透传,字符串条目/缺失则为空串
assert report["major_weaknesses"][0]["evidence"] == "Methods 2.1 仅报 p<0.05,未见 FDR/Bonferroni"
assert report["major_weaknesses"][1]["evidence"] == ""
assert report["minor_weaknesses"][0]["evidence"] == ""
# 空问题剔除
assert report["questions_for_authors"] == ["群体结构如何校正?"]
assert report["minor_weaknesses"] and report["presentation_format"] and report["summary"]
# meta 透传 + tier 信息(The Plant Cell 在 13 本 override 名单 → tier 1)
assert body["meta"]["target_journal"] == "Plant Cell"
assert body["meta"]["text_chars"] > 0
assert body["meta"]["truncated"] is False
assert body["meta"]["tier"] == 1
assert body["meta"]["tier_source"] == "override"
def test_llm_failure_degrades(client: TestClient, monkeypatch):
async def boom(*args, **kwargs):
raise llm.LLMError("余额不足")
monkeypatch.setattr(llm, "complete_json", boom)
body = _post(client, "p.pdf", FAKE_PDF).json()
assert body["ok"] is False
assert body["error"]["code"] == "UPSTREAM_DOWN"
assert body["error"]["degraded"] is True
def test_parse_failure_degrades(client: TestClient, monkeypatch):
async def boom(*args, **kwargs):
raise paper_parse.ParseError("PDF 解析结果为空")
monkeypatch.setattr(paper_parse, "parse_pdf_bytes", boom)
body = _post(client, "p.pdf", FAKE_PDF).json()
assert body["ok"] is False
assert body["error"]["code"] == "PARSE_FAILED"
assert body["error"]["degraded"] is True
def test_llm_recommendation_injection_ignored(client: TestClient, monkeypatch):
"""LLM 擅自输出 recommendation:"accept" → 引擎不读该字段,按条数判定(用例 8)。"""
async def evil(*args, **kwargs):
return {
"summary": "x",
"recommendation": "accept", # 注入企图
"major_weaknesses": [
{"title": "M1", "evidence": "Methods"},
{"title": "M2", "evidence": "Results"},
],
"minor_weaknesses": [],
}
monkeypatch.setattr(llm, "complete_json", evil)
body = _post(client, "p.pdf", FAKE_PDF).json()
assert body["ok"] is True
assert body["report"]["recommendation"] == "major_revision" # 2 soft → R2
def test_empty_llm_payload_engine_accept(client: TestClient, monkeypatch):
"""LLM 漏输出各 weakness 字段 → 不崩,引擎按 0/0/0 给 accept(用例 9)。"""
async def bare(*args, **kwargs):
return {"summary": "x"}
monkeypatch.setattr(llm, "complete_json", bare)
body = _post(client, "p.pdf", FAKE_PDF).json()
assert body["ok"] is True
assert body["report"]["recommendation"] == "accept"
assert body["report"]["recommendation_rationale"]["rule"] == "R4"
# ================================================================
# recommendation 规则引擎(离线:mock LLM payload / 直调引擎)
# ================================================================
def _post_payload(client: TestClient, monkeypatch, payload: dict, journal: str = ""):
async def fake(*args, **kwargs):
return dict(payload)
monkeypatch.setattr(llm, "complete_json", fake)
return _post(client, "p.pdf", FAKE_PDF, journal=journal).json()
def test_strong_payload_not_major(client: TestClient, monkeypatch):
"""用例 1:强稿形态 0 major / 4 minor → minor_revision(诊断回归:不得再判大修)。"""
body = _post_payload(client, monkeypatch, {
"summary": "完备稿",
"major_weaknesses": [],
"minor_weaknesses": [{"title": f"m{i}"} for i in range(4)],
})
assert body["ok"] is True
assert body["report"]["recommendation"] == "minor_revision"
assert body["report"]["recommendation_rationale"]["rule"] == "R5"
def test_weak_payload_major(client: TestClient, monkeypatch):
"""用例 2:弱稿形态 7 major(含 2 硬性标签)→ major_revision + hard_hits。"""
body = _post_payload(client, monkeypatch, {
"summary": "缺项稿",
"major_weaknesses": [
{"title": "缺 BUSCO", "evidence": "Results 仅 N50", "hard_rule": "busco_missing"},
{"title": "缺 Accession", "evidence": "Data Availability 未见", "hard_rule": "accession_missing"},
*[{"title": f"s{i}", "evidence": "Methods"} for i in range(5)],
],
"minor_weaknesses": [{"title": "m1"}],
})
report = body["report"]
assert report["recommendation"] == "major_revision"
rat = report["recommendation_rationale"]
assert rat["rule"] == "R1"
assert set(rat["hard_hits"]) == {"busco_missing", "accession_missing"}
assert rat["hard_count"] == 2 and rat["soft_count"] == 5
def test_hard_rule_whitelist_stripped(client: TestClient, monkeypatch):
"""LLM 编造白名单外 hard_rule 标签 → coerce 丢弃,不得操纵引擎。"""
body = _post_payload(client, monkeypatch, {
"summary": "x",
"major_weaknesses": [
{"title": "m1", "evidence": "Methods", "hard_rule": "made_up_tag"},
],
"minor_weaknesses": [],
})
report = body["report"]
assert report["major_weaknesses"][0]["hard_rule"] is None
assert report["recommendation"] == "major_revision" # 按 soft 计 → R2
assert report["recommendation_rationale"]["hard_hits"] == []
def test_fatal_reject(client: TestClient, monkeypatch):
"""用例 6:fatal=true → reject(R0),rationale 提示人工复核。"""
body = _post_payload(client, monkeypatch, {
"summary": "疑似造假",
"major_weaknesses": [{"title": "数据矛盾", "evidence": "Table 2 vs Fig.3", "fatal": True}],
})
assert body["report"]["recommendation"] == "reject"
assert body["report"]["recommendation_rationale"]["rule"] == "R0"
assert "人工复核" in body["report"]["recommendation_rationale"]["explanation"]
def test_tier_matching_journals_json(client: TestClient, monkeypatch):
"""Genome Biology 在 13 本 override 名单 → tier 1(override 优先于 featured)。"""
body = _post_payload(client, monkeypatch, {
"summary": "x",
"major_weaknesses": [],
"minor_weaknesses": [{"title": "a"}],
}, journal="Genome Biology")
assert body["meta"]["tier"] == 1
assert body["meta"]["tier_label"] == "顶刊"
assert body["meta"]["tier_source"] == "override"
# tier1 accept 门槛更紧:1 minor 仍 accept(≤1)
assert body["report"]["recommendation"] == "accept"
def test_tier_featured_fallback(client: TestClient, monkeypatch):
"""不在 override 名单的精选刊走 journals.json review_tier(featured)。"""
body = _post_payload(client, monkeypatch, {
"summary": "x", "major_weaknesses": [], "minor_weaknesses": [],
}, journal="BMC Plant Biology")
assert body["meta"]["tier"] == 2
assert body["meta"]["tier_source"] == "featured"
# ---- 引擎直调(tier 分档与 rationale 分支)----
def test_engine_tier3_soft_major_downgrade():
"""用例 7:2 条 soft major——tier3 降级 minor_revision;tier2 仍 major_revision。"""
majors = [{"title": "m", "hard_rule": None, "fatal": False}] * 2
d3 = decide_recommendation(majors, [], [], tier=3)
assert d3["recommendation"] == "minor_revision"
assert d3["rationale"]["rule"] == "R2'"
d2 = decide_recommendation(majors, [], [], tier=2)
assert d2["recommendation"] == "major_revision"
assert d2["rationale"]["rule"] == "R2"
def test_engine_tier_note_and_accept_thresholds():
"""用例 10:rationale 含 tier 说明句;tier1 accept 门槛 minor≤1。"""
one_soft = [{"title": "m"}]
d = decide_recommendation(one_soft, [], [], tier=2)
assert "tier 3 入门刊此稿可能判 minor_revision" in d["rationale"]["explanation"]
assert d["rationale"]["tier"] == 2
# tier1:1 minor → accept;2 minor → minor_revision
assert decide_recommendation([], [{"title": "a"}], [], tier=1)["recommendation"] == "accept"
assert decide_recommendation([], [{"title": "a"}, {"title": "b"}], [], tier=1)["recommendation"] == "minor_revision"
# tier3:3 minor 仍 accept(≤3)
assert decide_recommendation([], [{"title": "a"}, {"title": "b"}, {"title": "c"}], [], tier=3)["recommendation"] == "accept"
def test_engine_hard_never_downgraded_by_tier():
"""硬性 major 不因 tier3 降级(不可协商)。"""
d = decide_recommendation(
[{"title": "缺 accession", "hard_rule": "accession_missing", "fatal": False}],
[], [], tier=3)
assert d["recommendation"] == "major_revision"
assert d["rationale"]["rule"] == "R1"
def test_domain_system_prompt_wired(client: TestClient, monkeypatch):
"""植物基因组学六维清单 + Evidence 规则必须注入 System Prompt。"""
captured: dict[str, str] = {}
async def spy(system: str, user: str, **kwargs):
captured["system"] = system
return dict(LLM_PAYLOAD)
monkeypatch.setattr(llm, "complete_json", spy)
body = _post(client, "p.pdf", FAKE_PDF, journal="Plant Cell").json()
assert body["ok"] is True
system = captured["system"]
for marker in (
"BUSCO", "N50", "L50", "Hi-C", "挂载率", # 维度1 组装质量
"MAKER", "AUGUSTUS", "RNA-seq", # 维度2 注释可靠性
"Bootstrap", "OrthoFinder", # 维度3 比较基因组
"SRA", "BioProject", "GFF3", "accession", # 维度4 数据合规
"GWAS", "多重检验校正", "生物学重复", # 维度5 统计设计
"凭证标本", "ABS", "惠益分享", # 维度6 伦理合规
"evidence", "章节", # Evidence 硬性要求
"负向清单", "严禁列为 major", "以本节为准", # 2026-10-12 负向清单(soft major 收紧)
"需要补做实验/补数据/重跑分析/改核心论证", # major 总纲
"仅图中未标注数值", # 系统发育树图注级降级
):
assert marker in system, f"System Prompt 缺少领域标记: {marker}"
# ================================================================
# 2026-10-12 四 Bug 修复:截断装箱 / 扫描器 / tier 分档(离线单测)
# ================================================================
from app.routers.presubmit import ( # noqa: E402
_fit_feed_text, estimate_tokens, pack_feed_text,
)
from app.services import paper_scanner # noqa: E402
from app.services.recommend_engine import resolve_tier # noqa: E402
# ---- Bug 1:段落感知装箱 + token 估算 ----
_SECTIONED = (
"Abstract\n本研究组装了黄瓜泛基因组。\n"
"Introduction\n引言内容。\n"
"Results\n主要结果。\n"
"Methods\n" + ("方法细节。" * 4000) + "\n"
"Data Availability\nAll data are available under PRJCA038097.\n"
"Discussion\n讨论内容。\n"
"References\n[1] Someone 2020.\n"
)
def test_estimate_tokens():
assert estimate_tokens("a" * 3000) == 2000
def test_pack_under_budget_untouched():
feed, dropped = pack_feed_text("short text", 1000)
assert feed == "short text" and dropped == []
def test_pack_keeps_data_availability_when_over_budget():
"""超预算时 Data Availability 必须保留(bug:30 页论文 DA 在 Page 17 被截)。"""
budget = 8000
assert len(_SECTIONED) > budget
feed, dropped = pack_feed_text(_SECTIONED, budget)
assert "PRJCA038097" in feed
assert "Abstract" in feed
assert len(feed) <= budget
# Methods 超出 60% 预算上限被截;预算仍有余量时低优先级节(introduction)
# 照常保留,dropped 只记真正被丢弃的段
assert "引言内容" in feed # introduction 标题在文中原序保留
assert dropped == []
# 预算极紧时:低优先级段被丢弃并记入 dropped
feed2, dropped2 = pack_feed_text(_SECTIONED, 100)
assert len(feed2) <= 100
assert "references" in dropped2 and "discussion" in dropped2
def test_pack_fallback_without_sections():
text = "x" * 20000 + "y" * 4000 + "\nDATA AVAILABILITY PRJNA12345"
feed, dropped = pack_feed_text(text, 10000)
assert "PRJNA12345" in feed # 尾窗捞回
assert dropped and dropped[0].startswith("[无节标题回退")
def test_fit_feed_text_token_guard():
"""第一层保护:估算超 48K token → 自动降到 100K 字符重装箱。"""
huge = "A" * 300000 # 估算 200K token
feed, _ = _fit_feed_text(huge, 150000)
assert len(feed) <= 100000
# 150K 字符内(估算 100K token? 150000/1.5=100000 > 48000 → 也会降)
# 60K 字符(40K token)不触发
mid = "B" * 60000
feed2, _ = _fit_feed_text(mid, 150000)
assert len(feed2) == 60000
# ---- Bug 4:关键词扫描器 + 冲突降级 ----
_SCANNER_TEXT = (
"Abstract\nCucumber pan-genome.\n"
"Results\nBUSCO completeness was 98.57%. "
"94.18% of sequences anchored to chromosomes.\n"
"Data Availability\nThe raw data have been deposited under "
"PRJCA038097, PRJCA043228 and CRA002855 in GSA.\n"
"Discussion\nDone.\n"
)
def test_scanner_signals():
s = paper_scanner.scan_paper_signals(_SCANNER_TEXT)
assert s["accession"]["found"] is True
assert "PRJCA038097" in s["accession"]["hits"]
assert "CRA002855" in s["accession"]["hits"]
assert s["busco"]["level"] == "partial" # 只有百分比,无 S/D 分项
assert s["hic"]["found"] is True
def test_scanner_accession_only_in_da_section():
"""正文引用他人的 PRJNA 出现在非 DA 段 → 不得算"已有 accession"。"""
text = (
"Introduction\nWe reused PRJNA9999999 from a prior study.\n"
"Results\nAssembly OK.\n"
# 无 Data Availability 节
)
s = paper_scanner.scan_paper_signals(text)
assert s["accession"]["found"] is False
def test_scanner_busco_levels():
assert paper_scanner.scan_paper_signals("")["busco"]["level"] == "none"
partial = "BUSCO completeness was 98.57% compared with embryophyta."
assert paper_scanner.scan_paper_signals(partial)["busco"]["level"] == "partial"
full = "BUSCO analysis: Complete 95.3% [S:93.1%, D:2.2%], Missing 4.7%, n=1614."
assert paper_scanner.scan_paper_signals(full)["busco"]["level"] == "full"
def test_reconcile_downgrades_conflicting_hard_rules():
majors = [
{"title": "缺 BUSCO", "hard_rule": "busco_missing", "fatal": False},
{"title": "缺 accession", "hard_rule": "accession_missing", "fatal": False},
{"title": "缺 Hi-C", "hard_rule": "hic_missing", "fatal": False},
{"title": "其他硬性", "hard_rule": "voucher_missing", "fatal": False},
]
signals = paper_scanner.scan_paper_signals(_SCANNER_TEXT)
kept, demoted, conflicts = paper_scanner.reconcile_hard_rules(majors, signals)
# 三项被证伪的硬性 major 真降级移出 kept,进入 demoted(A2)
assert [m["title"] for m in kept] == ["其他硬性"]
assert kept[0]["hard_rule"] == "voucher_missing"
assert [m["title"] for m in demoted] == ["缺 BUSCO", "缺 accession", "缺 Hi-C"]
# 降级项:剥标签 + 打 scanner_downgraded + 保留 title/detail
assert all(m["hard_rule"] is None for m in demoted)
assert all(m["scanner_downgraded"] is True for m in demoted)
assert demoted[0]["title"] == "缺 BUSCO"
assert {c["hard_rule"] for c in conflicts} == {
"busco_missing", "accession_missing", "hic_missing"}
def test_reconcile_fatal_not_demoted():
"""fatal 条目即使冲突也只记冲突、不降级(须人工过目)。"""
majors = [{
"title": "疑似数据造假", "hard_rule": "accession_missing", "fatal": True,
}]
signals = paper_scanner.scan_paper_signals(_SCANNER_TEXT)
kept, demoted, conflicts = paper_scanner.reconcile_hard_rules(majors, signals)
assert len(kept) == 1 and kept[0]["hard_rule"] == "accession_missing"
assert demoted == []
assert len(conflicts) == 1 # 冲突仍记录(透明)
def test_reconcile_no_conflict_untouched():
majors = [{"title": "真缺", "hard_rule": "accession_missing", "fatal": False}]
signals = paper_scanner.scan_paper_signals("只有正文,没有 DA 段。")
kept, demoted, conflicts = paper_scanner.reconcile_hard_rules(majors, signals)
assert kept[0]["hard_rule"] == "accession_missing"
assert demoted == [] and conflicts == []
def test_http_scanner_conflict_downgrades(client: TestClient, monkeypatch):
"""端到端:LLM 报三项缺失 + 正文实有 → 冲突记录、hard_count=0。"""
async def fake_parse(file_bytes: bytes, filename: str = "paper.pdf") -> str:
return _SCANNER_TEXT
async def fake_llm(*args, **kwargs):
return {
"summary": "x",
"major_weaknesses": [
{"title": "缺 BUSCO 完整格式", "evidence": "Results",
"hard_rule": "busco_missing", "fatal": False},
{"title": "缺数据 accession", "evidence": "全文未见",
"hard_rule": "accession_missing", "fatal": False},
{"title": "缺 Hi-C 挂载率", "evidence": "Results",
"hard_rule": "hic_missing", "fatal": False},
],
"minor_weaknesses": [],
}
monkeypatch.setattr(paper_parse, "parse_pdf_bytes", fake_parse)
monkeypatch.setattr(llm, "complete_json", fake_llm)
body = _post(client, "p.pdf", FAKE_PDF, journal="Genome Biology").json()
assert body["ok"] is True
report = body["report"]
rat = report["recommendation_rationale"]
# A2:3 条冲突 major 全部真降级移出 major → 0 major(非"剥标签留原地")
assert rat["major_count"] == 0 and rat["hard_count"] == 0 and rat["soft_count"] == 0
assert report["major_weaknesses"] == []
# 降级项落到 minor,带 scanner_downgraded 标记(前端黄徽标)
downgraded = [m for m in report["minor_weaknesses"] if m.get("scanner_downgraded")]
assert len(downgraded) == 3
assert all(m["hard_rule"] is None for m in downgraded)
# 0 major + 3 minor(tier1 门槛≤1)→ R5 minor_revision(不是 R2 大修)
assert rat["rule"] == "R5"
assert report["recommendation"] == "minor_revision"
assert len(rat["scanner_conflicts"]) == 3
assert "冲突" in rat["explanation"] and "小修级" in rat["explanation"]
assert body["meta"]["scanner"]["accession_found"] is True
assert body["meta"]["scanner"]["hic_found"] is True
assert rat["hard_hits"] == []
def test_http_partial_conflict_leaves_residual_soft(client: TestClient, monkeypatch):
"""1 条冲突降级 + 1 条真 soft 残留 → major_count=1、仍 R2(引擎语义不变的对照)。"""
async def fake_parse(file_bytes: bytes, filename: str = "paper.pdf") -> str:
return _SCANNER_TEXT
async def fake_llm(*args, **kwargs):
return {
"summary": "x",
"major_weaknesses": [
{"title": "缺数据 accession", "evidence": "全文未见",
"hard_rule": "accession_missing", "fatal": False},
{"title": "GWAS 校正描述不完整", "evidence": "Methods",
"hard_rule": None, "fatal": False},
],
"minor_weaknesses": [],
}
monkeypatch.setattr(paper_parse, "parse_pdf_bytes", fake_parse)
monkeypatch.setattr(llm, "complete_json", fake_llm)
body = _post(client, "p.pdf", FAKE_PDF, journal="Genome Biology").json()
rat = body["report"]["recommendation_rationale"]
assert rat["major_count"] == 1 and rat["soft_count"] == 1
assert rat["rule"] == "R2"
assert body["report"]["recommendation"] == "major_revision"
assert len(rat["scanner_conflicts"]) == 1
def test_llm_400_retry_with_smaller_feed(client: TestClient, monkeypatch):
"""第二层保护:LLM 报 HTTP 400 → 降 80K 重试一次成功。"""
long_text = "Introduction\n" + ("word " * 40000) # 200K 字符
calls: list[int] = []
async def fake_parse(file_bytes: bytes, filename: str = "paper.pdf") -> str:
return long_text
async def flaky(system: str, user: str, **kwargs):
calls.append(len(user))
if len(calls) == 1:
raise llm.LLMError("LLM 调用失败(HTTP 400):Request Entity Too Large")
return {"summary": "x", "major_weaknesses": [], "minor_weaknesses": []}
monkeypatch.setattr(paper_parse, "parse_pdf_bytes", fake_parse)
monkeypatch.setattr(llm, "complete_json", flaky)
body = _post(client, "p.pdf", FAKE_PDF).json()
assert body["ok"] is True
assert len(calls) == 2 # 重试恰好一次
assert body["meta"]["truncated"] is True
# ---- Bug 2:tier 分档优先级 ----
def test_resolve_tier_priority():
# ① override:13 本顶刊 + "The " 前缀互认
assert resolve_tier("Nature Genetics") == (1, "override")
assert resolve_tier("NATURE GENETICS") == (1, "override")
assert resolve_tier("The Plant Cell") == (1, "override")
assert resolve_tier("Plant Cell") == (1, "override")
assert resolve_tier("Nature Communications") == (1, "override")
# ② featured:journals.json review_tier
assert resolve_tier("BMC Plant Biology") == (2, "featured")
assert resolve_tier("Rice") == (2, "featured")
# ③ jif 启发式(directory 实数据)
assert resolve_tier("Nucleic Acids Research") == (1, "jif") # jif=15.0
assert resolve_tier("Euphytica") == (2, "jif") # jif=1.8
# 综述刊即便 jif=26.4 也不升 tier1
assert resolve_tier("Annual Review of Plant Biology") == (2, "默认")
# ④ 未命中 → 默认
assert resolve_tier("Totally Fake Journal") == (2, "默认")
assert resolve_tier("") == (2, "默认")
def test_prompt_has_new_vocab():
"""Bug 3:SYSTEM_PROMPT 词表扩充(PRJCA/CRA + BUSCO 三级 + anchored 同义词)。"""
from app.services.self_review import SYSTEM_PROMPT
assert "PRJCA" in SYSTEM_PROMPT and "CRA" in SYSTEM_PROMPT
assert "anchored to chromosome" in SYSTEM_PROMPT
assert "98.57%" in SYSTEM_PROMPT # BUSCO 仅百分比 → minor 示例
+198
View File
@@ -0,0 +1,198 @@
"""tests/test_rebuttal.py —— Rebuttal Phase 1 离线单测(mock LLM 与 PDF 解析)。
覆盖(对齐任务清单 9 条):单/多 Reviewer 归属、子条拆分(0.7 阈值)、
location/rebuttal 反幻觉校验、MISSING_RESPONSE 防 LLM 空转、交叉引用、
信封错误、human_ack 下载门槛。
运行: cd review_service && <venv>/bin/python -m pytest tests/test_rebuttal.py -q
"""
from __future__ import annotations
import pytest
from fastapi.testclient import TestClient
import app.db as db_mod
from app import main as app_main
from app.config import get_settings
from app.services import llm, paper_parse
BASE = "/api/review/rebuttal"
REVIEW_TEXT = """Reviewer 1:
1. The statistical methods are inappropriate; multiple-testing correction is missing.
2. Figure 3 is blurry and the legends are incomplete. See comment 1 for related concern.
Reviewer 2:
1. The novelty is limited. 2. The writing needs improvement. 3. Please clarify the sampling site.
"""
SEG_LLMA = {
"title": "Statistical methods inappropriate",
"severity": "major",
"sub_items": [{"title": "Missing correction", "body": "Multiple-testing correction is missing.", "confidence": 0.9}],
}
SEG_LLM_MULTI = {
"title": "Multiple issues",
"severity": "minor",
"sub_items": [
{"title": "Blurry figure", "body": "Figure 3 is blurry.", "confidence": 0.95},
{"title": "Incomplete legends", "body": "Legends are incomplete.", "confidence": 0.9},
{"title": "Related", "body": "See comment 1 for related concern.", "confidence": 0.5},
],
}
@pytest.fixture()
def client(tmp_path, monkeypatch):
db_path = tmp_path / "rebuttal_test.db"
settings = get_settings()
monkeypatch.setattr(settings, "db_path", str(db_path))
db_mod.set_path(db_path) # 进 lifespan 前注入
# LLM 打桩:按输入返回预置结构(计数供 MISSING_RESPONSE 用例断言)
calls = {"n": 0}
async def fake_complete_json(system: str, user: str, **kwargs):
calls["n"] += 1
if "Multiple issues" in user or "Figure 3" in user:
return dict(SEG_LLM_MULTI)
return dict(SEG_LLMA)
async def fake_parse_pdf(file_bytes: bytes, filename: str = "paper.pdf") -> str:
return REVIEW_TEXT
monkeypatch.setattr(llm, "complete_json", fake_complete_json)
monkeypatch.setattr(paper_parse, "parse_pdf_bytes", fake_parse_pdf)
monkeypatch.setattr(app_main, "_REBUTTAL_TEST_CALLS", calls, raising=False)
with TestClient(app_main.app) as c:
c.state_llm_calls = calls # type: ignore[attr-defined]
yield c
def _create(client, text=REVIEW_TEXT):
r = client.post(f"{BASE}/jobs", json={"text": text})
assert r.status_code == 200
payload = r.json()
assert payload["ok"] is True, payload
return payload
def _all_comments(job):
return [c for rev in job["reviewers"] for c in rev["comments"]]
def test_single_reviewer_single_comment(client):
payload = _create(client, "Reviewer 1:\n1. Please add FDR correction.")
job = payload["job"]
assert len(job["reviewers"]) == 1
assert len(job["reviewers"][0]["comments"]) == 1
assert job["reviewers"][0]["comments"][0]["severity"] == "major"
def test_multi_reviewer_attribution(client):
payload = _create(client)
job = payload["job"]
labels = [r["label"] for r in job["reviewers"]]
assert labels == ["Reviewer 1", "Reviewer 2"]
# 无编号段落不被误切:Reviewer 2 段内三个编号 → ≥2 条
assert len(job["reviewers"][1]["comments"]) >= 2
def test_subitem_split_shares_group_id(client):
payload = _create(client)
job = payload["job"]
split_group = [c for c in _all_comments(job) if c.get("group_id")]
assert len(split_group) >= 2 # LLM confidence ≥0.7 拆出多条
assert len({c["group_id"] for c in split_group}) == 1 # 同组
def test_location_validation_fail_and_pass(client):
payload = _create(client, "Reviewer 1:\n1. Where is the data?\n2. Where is the code?")
job = payload["job"]
c0, c1 = _all_comments(job)[:2]
# FAIL:shows that 无 added
r = client.patch(f"{BASE}/jobs/{job['id']}/comments/{c0['id']}/response",
json={"parts": [{"type": "location", "content": "S3 shows that the data supports our claim."}]})
assert r.json()["ok"] is True
r = client.post(f"{BASE}/jobs/{job['id']}/comments/{c0['id']}/draft")
body = r.json()
assert body["ok"] is False and body["error"]["code"] == "VALIDATION_FAILED"
assert any(f["code"] == "LOCATION_EVIDENCE_WEAK" for f in body["meta"]["validation"]["findings"])
# PASS:we have added ... in S3
client.patch(f"{BASE}/jobs/{job['id']}/comments/{c1['id']}/response",
json={"parts": [{"type": "location", "content": "We have added the table in S3."}]})
r = client.post(f"{BASE}/jobs/{job['id']}/comments/{c1['id']}/draft")
assert r.json()["ok"] is True
def test_rebuttal_validation(client):
payload = _create(client, "Reviewer 1:\n1. The claim is unsupported.\n2. The design is weak.\n3. The model is wrong.")
job = payload["job"]
cs = _all_comments(job)[:3]
# 负向词 FAIL
client.patch(f"{BASE}/jobs/{job['id']}/comments/{cs[0]['id']}/response",
json={"parts": [{"type": "rebuttal", "content": "We agree with the reviewer on this point."}]})
r = client.post(f"{BASE}/jobs/{job['id']}/comments/{cs[0]['id']}/draft")
assert r.json()["error"]["code"] == "VALIDATION_FAILED"
# 缺立场词 FAIL
client.patch(f"{BASE}/jobs/{job['id']}/comments/{cs[1]['id']}/response",
json={"parts": [{"type": "rebuttal", "content": "The method follows standard practice in the field."}]})
r = client.post(f"{BASE}/jobs/{job['id']}/comments/{cs[1]['id']}/draft")
assert r.json()["error"]["code"] == "VALIDATION_FAILED"
# respectfully maintain 过
client.patch(f"{BASE}/jobs/{job['id']}/comments/{cs[2]['id']}/response",
json={"parts": [{"type": "rebuttal", "content": "We respectfully maintain our conclusion based on the updated analysis."}]})
r = client.post(f"{BASE}/jobs/{job['id']}/comments/{cs[2]['id']}/draft")
assert r.json()["ok"] is True
def test_missing_response_no_llm_call(client):
payload = _create(client, "Reviewer 1:\n1. Please clarify.")
job = payload["job"]
c = _all_comments(job)[0]
before = client.state_llm_calls["n"]
r = client.post(f"{BASE}/jobs/{job['id']}/comments/{c['id']}/draft")
body = r.json()
assert body["ok"] is False and body["error"]["code"] == "MISSING_RESPONSE"
assert client.state_llm_calls["n"] == before # 未空转 LLM
def test_cross_ref_unresolved_keeps_raw(client):
payload = _create(client, "Reviewer 1:\n1. First issue here.\n2. Related concern, see comment 9.")
job = payload["job"]
cs = _all_comments(job)
refs = cs[1].get("cross_refs") or []
assert refs and refs[0]["raw"] # raw 保留
assert refs[0]["target_id"] is None # 解析不到 → null(不猜)
def test_envelope_errors(client):
# job 不存在
r = client.get(f"{BASE}/jobs/rbt_nope")
assert r.status_code == 200 and r.json()["error"]["code"] == "NOT_FOUND"
# 非 PDF
r = client.post(f"{BASE}/jobs/pdf", files={"file": ("a.txt", b"hello", "text/plain")})
assert r.json()["error"]["code"] == "VALIDATION"
# PDF 超限(> max_pdf_bytes)——用超限字节直接触发大小校验(mock 解析不会被调)
settings = get_settings()
big = b"%PDF" + b"0" * (settings.max_pdf_bytes + 1)
r = client.post(f"{BASE}/jobs/pdf", files={"file": ("a.pdf", big, "application/pdf")})
assert r.json()["error"]["code"] == "VALIDATION"
assert "上限" in r.json()["error"]["message"]
def test_human_ack_gate_on_letter_download(client):
payload = _create(client, "Reviewer 1:\n1. Issue A.\n2. Issue B.")
job = payload["job"]
cs = _all_comments(job)
for c in cs:
client.patch(f"{BASE}/jobs/{job['id']}/comments/{c['id']}/response",
json={"parts": [{"type": "clarification", "content": "We clarified in the revised Methods."}]})
client.post(f"{BASE}/jobs/{job['id']}/comments/{c['id']}/draft")
# 未全勾 → human_ack=false → 下载 400
r = client.get(f"{BASE}/jobs/{job['id']}/letter.md")
assert r.status_code == 400 and "HUMAN_ACK_REQUIRED" in r.text
# 全勾 → human_ack=true → 200
for c in cs:
client.patch(f"{BASE}/jobs/{job['id']}/comments/{c['id']}/confirm", json={"confirmed": True})
r = client.get(f"{BASE}/jobs/{job['id']}/letter.md")
assert r.status_code == 200
assert "Response to Reviewers" in r.text
+271
View File
@@ -0,0 +1,271 @@
"""tests/test_recommend.py —— /api/review/recommend 离线单元测试。
mock vstore 向量匹配(journal_kb.match)与 LLM(llm.complete_json),不依赖上游。
核心回归:LLM 幻觉期刊名绝不进输出(白名单 id 硬校验 + 名称一律取 DB)。
运行: cd review_service && <venv>/bin/python -m pytest -q
"""
from __future__ import annotations
import asyncio
import pytest
from fastapi.testclient import TestClient
from app import db as db_mod
from app.main import app
from app.services import journal_kb, journal_rank, llm
ABSTRACT = (
"We report a chromosome-level genome assembly of wild rice Oryza rufipogon "
"using PacBio HiFi and Hi-C sequencing, annotate 38,412 protein-coding genes "
"with RNA-seq evidence, and perform comparative genomics and GWAS analyses "
"to reveal the evolutionary basis of agronomic traits in rice."
)
SEED_NAMES = {
"Genome Biology",
"BMC Plant Biology",
"Molecular Plant",
"Frontiers in Plant Science",
"Rice",
}
# 覆盖全部 5 本种子期刊的合法重排结果
ALL_RANKINGS = [
{"id": "genome-biology", "tier": "challenge", "match_reason": "组装与比较基因组学范围契合", "risk_note": "IF 门槛高"},
{"id": "molecular-plant", "tier": "challenge", "match_reason": "分子机制研究契合", "risk_note": "竞争激烈"},
{"id": "frontiers-in-plant-science", "tier": "fit", "match_reason": "植物生物学范围契合", "risk_note": "无"},
{"id": "rice", "tier": "fit", "match_reason": "水稻基因组学契合", "risk_note": "无"},
{"id": "bmc-plant-biology", "tier": "safe", "match_reason": "植物生物学全领域契合", "risk_note": "无"},
]
def make_fake_match(scores: dict[str, float] | None = None, fail: bool = False):
async def fake(abstract: str, journals: list[dict]):
if fail:
raise journal_kb.MatchError("vstore 不可达(mock)")
out = [
{"journal": j, "similarity": (scores or {}).get(str(j["id"]), 0.5)}
for j in journals
]
return out, True
return fake
def make_fake_llm(rankings: list[dict] | None = None, fail: bool = False, payload=None):
async def fake(system: str, user: str, **kwargs):
if fail:
raise llm.LLMError("余额不足(mock)")
if payload is not None:
return payload
return {"rankings": rankings if rankings is not None else []}
return fake
@pytest.fixture()
def client(tmp_path, monkeypatch):
db_mod.set_path(tmp_path / "review_test.db") # 进 lifespan 前注入 tmp 路径
monkeypatch.setattr(journal_kb, "match", make_fake_match())
monkeypatch.setattr(llm, "complete_json", make_fake_llm(ALL_RANKINGS))
with TestClient(app) as c: # CM 触发 lifespan:init_db(注入路径) + 收尾 close
yield c
def _all_items(body: dict) -> list[dict]:
items: list[dict] = []
for tier in ("challenge", "fit", "safe"):
items.extend(body["tiers"][tier]["items"])
return items
def test_recommend_happy_path(client: TestClient):
r = client.post("/api/review/recommend", json={"abstract": ABSTRACT})
assert r.status_code == 200
body = r.json()
assert body["ok"] is True
assert set(body["tiers"]) == {"challenge", "fit", "safe"}
assert "挑战型" in body["tiers"]["challenge"]["label"]
assert "适配型" in body["tiers"]["fit"]["label"]
assert "稳妥型" in body["tiers"]["safe"]["label"]
items = _all_items(body)
assert len(items) == 5
assert {it["name"] for it in items} == SEED_NAMES
for it in items:
assert it["match_reason"], f"缺少匹配理由:{it['name']}"
assert it["risk_note"], f"缺少风险提示:{it['name']}"
assert it["similarity"] == 0.5
# 三档内容与 LLM 输出一致
assert [it["name"] for it in body["tiers"]["challenge"]["items"]][0] == "Genome Biology"
assert body["tiers"]["safe"]["items"][0]["name"] == "BMC Plant Biology"
meta = body["meta"]
assert meta["llm_ok"] is True and meta["vector_ok"] is True
assert meta["dropped_hallucinated"] == 0
assert meta["seed_count"] == 5
def test_seed_has_no_fabricated_acceptance_rate(client: TestClient):
"""种子诚实性:无公开数据的 acceptance_rate 必须为 null。"""
body = client.post("/api/review/recommend", json={"abstract": ABSTRACT}).json()
for it in _all_items(body):
assert it["acceptance_rate"] is None, f"编造了录用率:{it['name']}"
def test_hallucinated_journal_dropped(client: TestClient, monkeypatch):
"""LLM 幻觉期刊(白名单外 id)绝不进输出;缺漏期刊规则补位。"""
hallucinated = {
"id": "nature-genetics",
"tier": "challenge",
"match_reason": "幻觉期刊,输入列表中并不存在",
"risk_note": "x",
}
monkeypatch.setattr(
llm,
"complete_json",
make_fake_llm([hallucinated, ALL_RANKINGS[1]]), # 1 幻觉 + 1 真实,其余缺漏
)
body = client.post("/api/review/recommend", json={"abstract": ABSTRACT}).json()
assert body["ok"] is True
items = _all_items(body)
raw = str(body)
assert "nature-genetics" not in raw and "Nature Genetics" not in raw
assert "幻觉期刊" not in raw # 幻觉条目的理由同样被丢弃
assert {it["name"] for it in items} <= SEED_NAMES
assert len(items) == 5 # 4 本缺漏由规则补位,不丢候选
assert body["meta"]["dropped_hallucinated"] == 1
assert body["meta"]["repaired"] == 4
def test_llm_name_tamper_ignored(client: TestClient, monkeypatch):
"""LLM 篡改期刊名不采信:输出名称一律取 DB。"""
tampered = [
{"id": "genome-biology", "tier": "fit", "name": "Fake Journal X",
"match_reason": "被篡改的名称", "risk_note": "无"}
]
monkeypatch.setattr(llm, "complete_json", make_fake_llm(tampered))
body = client.post("/api/review/recommend", json={"abstract": ABSTRACT}).json()
assert body["ok"] is True
raw = str(body)
assert "Fake Journal X" not in raw
gb = [it for it in _all_items(body) if it["id"] == "genome-biology"]
assert gb and gb[0]["name"] == "Genome Biology"
def test_llm_failure_fallback(client: TestClient, monkeypatch):
"""LLM 失败 → 规则分档,推荐仍可用(永不 5xx)。"""
monkeypatch.setattr(llm, "complete_json", make_fake_llm(fail=True))
body = client.post("/api/review/recommend", json={"abstract": ABSTRACT}).json()
assert body["ok"] is True
assert body["meta"]["llm_ok"] is False
items = _all_items(body)
assert len(items) == 5
assert {it["name"] for it in items} == SEED_NAMES
# 规则分档:IF≥9 → challenge(仅 Genome Biology 10.1 有公开 IF)
challenge = {it["name"] for it in body["tiers"]["challenge"]["items"]}
assert challenge == {"Genome Biology"}
for it in items:
assert it["match_reason"] and it["risk_note"]
def test_vector_failure_degrades(client: TestClient, monkeypatch):
"""向量匹配失败 → 全量候选 + similarity 为 null,不报错。"""
monkeypatch.setattr(journal_kb, "match", make_fake_match(fail=True))
body = client.post("/api/review/recommend", json={"abstract": ABSTRACT}).json()
assert body["ok"] is True
assert body["meta"]["vector_ok"] is False
assert body["meta"]["candidate_count"] == 5
items = _all_items(body)
assert len(items) == 5
assert all(it["similarity"] is None for it in items)
def test_invalid_tier_repaired(client: TestClient, monkeypatch):
"""非法 tier 按规则补位,不丢期刊。"""
bad = [
{"id": "rice", "tier": "超越顶刊", "match_reason": "tier 非法", "risk_note": "无"},
{"id": "genome-biology", "tier": "challenge", "match_reason": "合法", "risk_note": "无"},
]
monkeypatch.setattr(llm, "complete_json", make_fake_llm(bad))
body = client.post("/api/review/recommend", json={"abstract": ABSTRACT}).json()
assert body["ok"] is True
assert len(_all_items(body)) == 5
# rice 无公开 IF/周期 → 规则分档 fit
fit_ids = [it["id"] for it in body["tiers"]["fit"]["items"]]
assert "rice" in fit_ids
assert body["meta"]["repaired"] >= 1
def test_short_abstract_validation(client: TestClient):
body = client.post("/api/review/recommend", json={"abstract": "too short"}).json()
assert body["ok"] is False
assert body["error"]["code"] == "VALIDATION"
assert body["tiers"] is None
def test_tier_focus_filters_other_tiers(client: TestClient):
body = client.post(
"/api/review/recommend",
json={"abstract": ABSTRACT, "preferences": {"tier_focus": "safe"}},
).json()
assert body["ok"] is True
assert body["tiers"]["challenge"]["items"] == []
assert body["tiers"]["fit"]["items"] == []
assert body["tiers"]["safe"]["items"] # 聚焦档保留
assert body["meta"]["preferences"]["tier_focus"] == "safe"
def test_soft_preference_risk_note(client: TestClient):
"""软偏好:超周期偏好只加风险提示,不删条目。"""
body = client.post(
"/api/review/recommend",
json={"abstract": ABSTRACT, "preferences": {"max_review_weeks": 3}},
).json()
assert body["ok"] is True
items = _all_items(body)
assert len(items) == 5 # 不删
# Genome Biology 审稿约 4 周 > 3 周 → 带 ⚠ 提示
gb = next(it for it in items if it["id"] == "genome-biology")
assert "超出你 3 周" in gb["risk_note"]
def test_seed_idempotent(tmp_path):
"""种子装载幂等:连跑两次仍恰好 5 行,且不编造 acceptance_rate。"""
async def work():
await db_mod.init_db(tmp_path / "seed.db")
try:
await db_mod.ensure_journals_seeded()
await db_mod.ensure_journals_seeded()
return await db_mod.list_journals()
finally:
await db_mod.close_db()
rows = asyncio.run(work())
assert len(rows) == 5
assert {r["id"] for r in rows} == {
"genome-biology", "bmc-plant-biology", "molecular-plant",
"frontiers-in-plant-science", "rice",
}
assert all(r["acceptance_rate"] is None for r in rows)
assert all(r["scope_desc"] for r in rows)
assert all(r["official_url"] for r in rows)
def test_rule_fallback_covers_all_tiers():
"""纯规则分档覆盖三档(不依赖 LLM 与网络)。"""
candidates = [
{"journal": {"id": "plant-cell", "impact_factor": 11.6, "review_time_weeks": 6.0}, "similarity": None},
{"journal": {"id": "plant-journal", "impact_factor": 7.2, "review_time_weeks": 5.0}, "similarity": None},
{"journal": {"id": "plant-genome", "impact_factor": 3.3, "review_time_weeks": 4.0}, "similarity": None},
]
rankings = journal_rank.fallback_rankings(candidates)
assert {r.journal_id for r in rankings} == {"plant-cell", "plant-journal", "plant-genome"}
by_id = {r.journal_id: r.tier for r in rankings}
assert by_id["plant-cell"] == "challenge"
assert by_id["plant-journal"] == "fit"
assert by_id["plant-genome"] == "safe"
+407
View File
@@ -0,0 +1,407 @@
"""tests/test_reformat.py —— P1 论文重排版单元测试(离线,零 LLM/零网络/零磁盘污染)。
覆盖:规则解析链(default/种子占位/目录回链/抓取缓存/未匹配)+ 4 变换器
(改/不改/保守 warning)+ 结构守卫 + 幂等 + API 信封(校验/落盘/GET/404)。
运行: cd review_service && <venv>/bin/python -m pytest -q
"""
from __future__ import annotations
import asyncio
import re
import pytest
from fastapi.testclient import TestClient
from app.main import app
from app.services import reformat as rf
from app.services.reformat import RULES_DEFAULT, ReformatError, reformat_tex, resolve_rules
# 金样例:4 处违规(字号/边距/行距/样式),全部命令齐备 → 0 warning
GOLDEN = r"""\documentclass[10pt]{article}
\usepackage[margin=1in,top=10mm]{geometry}
\linespread{1.0}
\bibliographystyle{plain}
\begin{document}
Hello.
\end{document}
"""
MINIMAL = "\\documentclass[11pt]{article}\n\\begin{document}\nx\n\\end{document}\n"
def _run(source: str, **rule_overrides):
rules = {**RULES_DEFAULT, **rule_overrides}
return reformat_tex(source, rules)
def _modified(changes):
return [c for c in changes if c["action"] == "modified"]
def _warnings(changes):
return [c for c in changes if c["action"] == "warning"]
def _by_key(changes, rule_key, action=None):
out = [c for c in changes if c["rule_key"] == rule_key
and (action is None or c["action"] == action)]
return out
# ================================================================ 规则解析链
def test_resolve_default():
r = asyncio.run(resolve_rules("default"))
assert r["rules_source"] == "default"
assert r["rules"] == RULES_DEFAULT
assert r["rules"]["min_font_pt"] == 11
assert r["rules"]["min_margin_mm"] == 20
assert r["rules"]["min_line_spacing"] == 1.5
assert r["rules"]["refs_style"] == "apa"
assert r["journal_id"] == "default"
def test_resolve_seed_name_official():
r = asyncio.run(resolve_rules("Genome Biology"))
assert r["journal_id"] == "genome-biology"
assert r["rules_source"] == "official"
assert r["rules"]["min_line_spacing"] == 2.0
assert r["rules"]["refs_style"] == "vancouver"
def test_resolve_seed_id():
r = asyncio.run(resolve_rules("genome-biology"))
assert r["journal_id"] == "genome-biology"
assert r["rules_source"] == "official"
def test_resolve_unknown_name():
r = asyncio.run(resolve_rules("Nonexistent Journal of Nowhere"))
assert r["rules_source"] == "default"
assert r["journal_id"] is None
assert "未匹配" in r["rules_note"]
def test_resolve_directory_id_backlink(monkeypatch):
async def fake_dir_name(journal_id: str):
return "Genome Biology" if journal_id.startswith("zh:") else None
monkeypatch.setattr(rf, "_directory_name", fake_dir_name)
r = asyncio.run(resolve_rules("zh:some-slug"))
assert r["journal_id"] == "genome-biology"
def test_resolve_fetched_cache(monkeypatch):
monkeypatch.setattr(rf, "_cache_rules", lambda jid: {
"rules_source": "fetched", "min_font_pt": 10, "refs_style": "gb7714"})
r = asyncio.run(resolve_rules("genome-biology"))
assert r["rules_source"] == "fetched" # 抓取缓存优先于 official
assert r["rules"]["min_font_pt"] == 10 # 专属覆盖通用
assert r["rules"]["min_margin_mm"] == 20 # 缺失键保留通用
assert r["rules"]["refs_style"] == "gb7714"
def test_resolve_official_format_rules(monkeypatch):
monkeypatch.setattr(rf, "_find_seed", lambda text: {
"id": "x-journal", "name": "X Journal",
"format_rules": {"rules_source": "official", "min_line_spacing": 1.3}})
r = asyncio.run(resolve_rules("X Journal"))
assert r["rules_source"] == "official"
assert r["rules"]["min_line_spacing"] == 1.3
# ================================================================ ① 字号 font_pt
def test_font_modify_below_min():
src = "\\documentclass[10pt]{article}\n\\begin{document}\nx\n\\end{document}\n"
res = _run(src)
font = _by_key(res["changes"], "font_pt")
assert len(font) == 1
c = font[0]
assert c["action"] == "modified"
assert "[11pt]" in res["modified_tex"] and "[10pt]" not in res["modified_tex"]
assert "10pt" in c["original"] and "11pt" in c["modified"]
def test_font_compliant_untouched():
res = _run(MINIMAL)
assert res["modified_tex"] == MINIMAL # warning 不改源码(拍板 2)
assert _by_key(res["changes"], "font_pt") == []
def test_font_missing_option_is_warning():
src = "\\documentclass[a4paper]{article}\n\\begin{document}\nx\n\\end{document}\n"
res = _run(src)
assert res["modified_tex"] == src # 拍板 2:绝不自动插入选项
(c,) = _by_key(res["changes"], "font_pt")
assert c["action"] == "warning"
assert "\\documentclass[a4paper, 11pt]{article}" in c["reason"]
def test_font_min_above_standard_uses_min():
src = "\\documentclass[12pt]{article}\n\\begin{document}\nx\n\\end{document}\n"
res = _run(src, min_font_pt=14)
assert "[14pt]" in res["modified_tex"]
# ================================================================ ② 页边距 margin
def test_margin_bumps_hmargin_vmargin():
src = "\\documentclass[11pt]{article}\n\\usepackage[hmargin=10mm,vmargin=15mm]{geometry}\n\\begin{document}\nx\n\\end{document}\n"
res = _run(src)
assert "hmargin=20mm" in res["modified_tex"]
assert "vmargin=20mm" in res["modified_tex"]
assert "]{geometry}" in res["modified_tex"] # 值替换不得吞掉包名尾巴
margin = _by_key(res["changes"], "margin")
assert len(margin) == 1 # 同行多键合并一条
assert "left" in margin[0]["reason"] and "top" in margin[0]["reason"]
def test_margin_per_side_only_bumps_violations():
res = _run(GOLDEN)
(c,) = [x for x in res["changes"] if x["rule_key"] == "margin"]
assert c["action"] == "modified"
assert "top=20mm" in c["modified"] # top 10mm 违规
assert "margin=1in" in c["modified"] # 1in=25.4mm 合规,不动
def test_margin_compliant_untouched():
src = "\\documentclass[11pt]{article}\n\\usepackage[margin=25mm]{geometry}\n\\begin{document}\nx\n\\end{document}\n"
res = _run(src)
assert res["modified_tex"] == src
def test_margin_no_geometry_is_warning():
src = "\\documentclass[11pt]{article}\n\\begin{document}\nx\n\\end{document}\n"
res = _run(src)
assert res["modified_tex"] == src
(c,) = [x for x in res["changes"] if x["rule_key"] == "margin"]
assert c["action"] == "warning"
assert "\\usepackage[margin=20mm]{geometry}" in c["reason"]
def test_margin_geometry_without_margin_attrs_is_warning():
src = "\\documentclass[11pt]{article}\n\\usepackage[scale=0.7]{geometry}\n\\begin{document}\nx\n\\end{document}\n"
res = _run(src)
assert res["modified_tex"] == src
(c,) = [x for x in res["changes"] if x["rule_key"] == "margin"]
assert c["action"] == "warning"
assert "margin=20mm" in c["reason"]
def test_margin_partial_sides_bump_and_warn():
src = "\\documentclass[11pt]{article}\n\\usepackage[left=10mm]{geometry}\n\\begin{document}\nx\n\\end{document}\n"
res = _run(src)
assert "left=20mm" in res["modified_tex"]
assert "]{geometry}" in res["modified_tex"]
mod = _by_key(res["changes"], "margin", "modified")
warn = _by_key(res["changes"], "margin", "warning")
assert len(mod) == 1 and len(warn) == 1
assert "right" in warn[0]["reason"]
# ================================================================ ③ 行距 line_spacing
def test_spacing_modify():
res = _run(GOLDEN)
(c,) = [x for x in res["changes"] if x["rule_key"] == "line_spacing"]
assert c["action"] == "modified"
assert "\\linespread{1.5}" in res["modified_tex"]
def test_spacing_ignores_body_override():
src = ("\\documentclass[11pt]{article}\n\\linespread{1.5}\n\\begin{document}\n"
"\\setstretch{1.0}\nx\n\\end{document}\n")
res = _run(src)
assert res["modified_tex"] == src # 正文局部覆盖不碰(导言区已合规)
def test_spacing_missing_is_warning():
src = "\\documentclass[11pt]{article}\n\\begin{document}\nx\n\\end{document}\n"
res = _run(src)
(c,) = [x for x in res["changes"] if x["rule_key"] == "line_spacing"]
assert c["action"] == "warning"
assert "\\linespread{1.5}" in c["reason"]
# ================================================================ ④ 参考文献 bib_style
def test_bib_plain_to_apalike():
res = _run(GOLDEN)
(c,) = [x for x in res["changes"] if x["rule_key"] == "bib_style"]
assert c["action"] == "modified"
assert "\\bibliographystyle{apalike}" in res["modified_tex"]
def test_bib_author_year_maps_apalike_not_plain():
"""回归(2026-10-10 修正):author_year 是姓名-年份制 → apalike,绝不映射编号制 plain。"""
src = "\\documentclass[11pt]{article}\n\\bibliographystyle{unsrt}\n\\begin{document}\nx\n\\end{document}\n"
res = _run(src, refs_style="author_year")
assert "\\bibliographystyle{apalike}" in res["modified_tex"]
assert "unsrt" not in res["modified_tex"].split("bibliographystyle")[1]
def test_bib_null_refs_style_warns_without_touching_source():
"""拍板(2026-10-10):refs_style=null(如 Frontiers 两种制式并存)→ 保持原样 + warning。"""
src = "\\documentclass[11pt]{article}\n\\bibliographystyle{unsrt}\n\\begin{document}\nx\n\\end{document}\n"
res = _run(src, refs_style=None)
assert res["modified_tex"] == src # 绝不猜测改写用户样式
(c,) = _by_key(res["changes"], "bib_style")
assert c["action"] == "warning"
assert "未确认" in c["reason"] and "bibliographystyle" in c["reason"]
def test_bib_gb7714_hint():
src = "\\documentclass[11pt]{article}\n\\bibliographystyle{plain}\n\\begin{document}\nx\n\\end{document}\n"
res = _run(src, refs_style="gb7714")
assert "\\bibliographystyle{gb7714}" in res["modified_tex"]
(c,) = _by_key(res["changes"], "bib_style")
assert "gbt7714" in c["reason"]
def test_bib_unmapped_style_is_warning():
src = "\\documentclass[11pt]{article}\n\\bibliographystyle{plain}\n\\begin{document}\nx\n\\end{document}\n"
res = _run(src, refs_style="mla")
assert res["modified_tex"] == src
(c,) = _by_key(res["changes"], "bib_style")
assert c["action"] == "warning" and "mla" in c["reason"]
def test_bib_missing_is_warning():
src = "\\documentclass[11pt]{article}\n\\begin{document}\nx\n\\end{document}\n"
res = _run(src)
(c,) = [x for x in res["changes"] if x["rule_key"] == "bib_style"]
assert c["action"] == "warning"
assert "\\bibliographystyle{apalike}" in c["reason"]
def test_bib_biblatex_workflow_is_warning():
src = ("\\documentclass[11pt]{article}\n\\usepackage{biblatex}\n"
"\\begin{document}\n\\printbibliography\n\\end{document}\n")
res = _run(src)
(c,) = [x for x in res["changes"] if x["rule_key"] == "bib_style"]
assert c["action"] == "warning"
assert "style=apa" in c["reason"]
# ================================================================ 结构守卫 + 幂等
def test_parser_failed_without_documentclass():
with pytest.raises(ReformatError) as ei:
_run("% just a fragment\n")
assert ei.value.code == "PARSER_FAILED"
def test_multi_documentclass_first_wins():
src = ("\\documentclass[10pt]{article}\n\\begin{document}\n"
"\\documentclass[9pt]{book}\n\\end{document}\n")
res = _run(src)
assert [w["code"] for w in res["warnings"]] == ["MULTI_DOCUMENTCLASS"]
assert "[11pt]" in res["modified_tex"]
assert res["modified_tex"].count("\\documentclass") == 2 # 第二处不碰
def test_idempotent_second_run_clean():
first = _run(GOLDEN)
assert len(_modified(first["changes"])) == 4
assert first["warnings"] == []
second = _run(first["modified_tex"])
assert second["changes"] == []
assert second["modified_tex"] == first["modified_tex"]
def test_changes_sorted_and_fields_complete():
res = _run(GOLDEN)
lines = [c["line"] for c in res["changes"]]
assert lines == sorted(lines)
for c in res["changes"]:
assert set(c) == {"line", "original", "modified", "reason", "rule_key", "action"}
# ================================================================ API(信封/落盘)
def _post(client: TestClient, content: bytes, journal: str = "default",
filename: str = "paper.tex", **data):
if journal is not None:
data.setdefault("target_journal", journal)
return client.post("/api/review/reformat",
files={"file": (filename, content, "text/plain")}, data=data)
@pytest.fixture()
def client(tmp_path, monkeypatch):
jobs = tmp_path / "jobs"
def fake_dir():
jobs.mkdir(parents=True, exist_ok=True)
return jobs
monkeypatch.setattr("app.routers.reformat._jobs_dir", fake_dir)
return TestClient(app)
def test_api_non_tex_rejected(client: TestClient):
body = _post(client, b"x", filename="a.pdf").json()
assert body["ok"] is False
assert body["error"]["code"] == "VALIDATION"
assert body["error"]["degraded"] is False
def test_api_missing_target_rejected(client: TestClient):
body = _post(client, GOLDEN.encode(), journal=None).json()
assert body["ok"] is False and body["error"]["code"] == "VALIDATION"
def test_api_empty_file_rejected(client: TestClient):
body = _post(client, b"").json()
assert body["ok"] is False and body["error"]["code"] == "VALIDATION"
def test_api_non_utf8_rejected(client: TestClient):
body = _post(client, b"\xff\xfe\x00bad").json()
assert body["ok"] is False and body["error"]["code"] == "VALIDATION"
def test_api_parser_failed_envelope(client: TestClient):
body = _post(client, b"% fragment, no documentclass").json()
assert body["ok"] is False and body["error"]["code"] == "PARSER_FAILED"
assert "documentclass" in body["error"]["message"]
def test_api_success_and_persist(client: TestClient):
body = _post(client, GOLDEN.encode()).json()
assert body["ok"] is True
assert re.fullmatch(r"[0-9a-f]{12}", body["job_id"])
mod = _modified(body["changes"])
assert len(mod) == 4 and body["warnings"] == []
assert "\\documentclass[11pt]" in body["modified_tex"]
meta = body["meta"]
assert meta["rules_source"] == "default"
assert meta["rules"]["min_font_pt"] == 11
assert meta["engine"] == "reformat-p1/1.0"
assert len(meta["original_sha256"]) == 64
# 持久化:重启语义的 GET 回读同一 job
got = client.get(f"/api/review/reformat/{body['job_id']}").json()
assert got["ok"] and got["job_id"] == body["job_id"]
assert len(_modified(got["changes"])) == 4
f = client.get(f"/api/review/reformat/{body['job_id']}/file")
assert f.status_code == 200
assert "x-tex" in f.headers["content-type"]
assert "\\documentclass[11pt]" in f.text
def test_api_job_not_found(client: TestClient):
for path in ("/api/review/reformat/000000000000",
"/api/review/reformat/zzzz"):
body = client.get(path).json()
assert body["ok"] is False and body["error"]["code"] == "NOT_FOUND"
f = client.get("/api/review/reformat/000000000000/file")
assert f.status_code == 200 and f.json()["error"]["code"] == "NOT_FOUND"
def test_api_idempotent_reupload(client: TestClient):
first = _post(client, GOLDEN.encode()).json()
assert first["ok"] and len(_modified(first["changes"])) == 4
second = _post(client, first["modified_tex"].encode()).json()
assert second["ok"] and second["changes"] == []
assert second["modified_tex"] == first["modified_tex"]
+96
View File
@@ -0,0 +1,96 @@
"""tests/test_seed.py —— journal_directory 启动自动 seed 单元测试。
不依赖上游;直接调 ensure_journal_directory_seeded(参数注入 tmp 路径,
真实 xlsx 只读)。经 TestClient lifespan 的用例验证 main.py 接线与开关。
运行: cd review_service && <venv>/bin/python -m pytest -q
"""
from __future__ import annotations
import sqlite3
from pathlib import Path
import pytest
from fastapi.testclient import TestClient
from app import db as db_mod
from app.config import get_settings
from app.main import app
from app.services.journal_seed import ensure_journal_directory_seeded
SOURCE = Path(__file__).resolve().parents[1] / "data" / "journals" / "source_v4.xlsx"
def _count(db_path: Path) -> int:
"""journal_directory 行数;库/表不存在 → 0。"""
if not db_path.exists():
return 0
conn = sqlite3.connect(str(db_path))
try:
try:
return int(conn.execute("SELECT COUNT(*) FROM journal_directory").fetchone()[0])
except sqlite3.OperationalError:
return 0
finally:
conn.close()
def test_seed_empty_db(tmp_path: Path):
db = tmp_path / "review_test.db"
r = ensure_journal_directory_seeded(db_path=db, source_xlsx=SOURCE)
assert r["seeded"] is True
assert r["rows"] == 1056
assert r["error"] is None and r["reason"] is None
assert r["counts"]["en"] == 779 and r["counts"]["zh"] == 277
assert _count(db) == 1056
def test_seed_skips_nonempty(tmp_path: Path):
db = tmp_path / "review_test.db"
conn = sqlite3.connect(str(db))
try:
conn.executescript("CREATE TABLE journal_directory (id TEXT PRIMARY KEY)")
conn.execute("INSERT INTO journal_directory VALUES ('x')")
conn.commit()
finally:
conn.close()
r = ensure_journal_directory_seeded(db_path=db, source_xlsx=SOURCE)
assert r["seeded"] is False
assert "already has 1 rows" in r["reason"]
assert r["error"] is None
assert _count(db) == 1 # 计数不变,未被覆盖/补差
def test_seed_missing_xlsx_no_raise(tmp_path: Path):
r = ensure_journal_directory_seeded(
db_path=tmp_path / "x.db", source_xlsx=tmp_path / "nope.xlsx")
assert r["seeded"] is False
assert r["error"] # 有 error 文案
assert r["rows"] is None
assert not (tmp_path / "x.db").exists() # 不写库
def test_seed_idempotent(tmp_path: Path):
db = tmp_path / "review_test.db"
r1 = ensure_journal_directory_seeded(db_path=db, source_xlsx=SOURCE)
r2 = ensure_journal_directory_seeded(db_path=db, source_xlsx=SOURCE)
assert r1["seeded"] is True and r1["rows"] == 1056
assert r2["seeded"] is False
assert "already has 1056 rows" in r2["reason"]
assert _count(db) == 1056
def test_startup_toggle_off_keeps_table_absent(tmp_path: Path):
"""conftest 全局 REVIEW_SEED_ON_STARTUP=false:lifespan 不 seed。"""
db_mod.set_path(tmp_path / "review_test.db")
with TestClient(app):
pass
assert _count(tmp_path / "review_test.db") == 0
def test_startup_toggle_on_seeds_via_lifespan(tmp_path: Path, monkeypatch):
"""显式打开开关:lifespan 经 db.path 注入路径完成 seed。"""
monkeypatch.setattr(get_settings(), "seed_on_startup", True)
db_mod.set_path(tmp_path / "review_test.db")
with TestClient(app):
pass
assert _count(tmp_path / "review_test.db") == 1056
+195
View File
@@ -0,0 +1,195 @@
"""tests/test_zip_safety.py —— P4 zip 安全模块纯逻辑测试(无需 tectonic)。
覆盖设计 §2 安全清单 #1-#13(#14 tectonic --untrusted 归 test_compile.py,
#15 由调用方 to_thread 承担,模块本身只测上限封顶行为)。
运行: cd review_service && <venv>/bin/python -m pytest -q tests/test_zip_safety.py
"""
from __future__ import annotations
import io
import stat
import zipfile
from pathlib import Path
import pytest
from app.config import get_settings
from app.services.zip_safety import (
ExtractResult,
ZipSafetyError,
classify_entry,
safe_extract,
sanitize_entry_name,
)
def _settings(**over):
"""取真实 settings 并覆盖上限(dataclass 风格 monkeypatch)。"""
s = get_settings()
for k, v in over.items():
setattr(s, k, v)
return s
def _make_zip(entries: dict[str, bytes], exec_bits: dict[str, int] | None = None) -> bytes:
"""entries: name → content;exec_bits: name → unix mode(如 0o100755)。
必须显式 ZIP_DEFLATED:手动构造的 ZipInfo 默认 ZIP_STORED(ratio=1,测不出压缩比炸弹)。
"""
buf = io.BytesIO()
with zipfile.ZipFile(buf, "w", zipfile.ZIP_DEFLATED) as zf:
for name, data in entries.items():
info = zipfile.ZipInfo(name)
info.compress_type = zipfile.ZIP_DEFLATED
if exec_bits and name in exec_bits:
info.external_attr = exec_bits[name] << 16
zf.writestr(info, data)
return buf.getvalue()
def _symlink_zip(name: str = "link") -> bytes:
buf = io.BytesIO()
with zipfile.ZipFile(buf, "w") as zf:
info = zipfile.ZipInfo(name)
info.external_attr = (stat.S_IFLNK | 0o777) << 16 # 0xA1FF
zf.writestr(info, "../../etc/passwd")
return buf.getvalue()
# ================================================================ sanitize(#1/#2/#11)
class TestSanitize:
def test_normal_path_ok(self):
assert sanitize_entry_name("main.tex") == "main.tex"
assert sanitize_entry_name("figs/a.png") == "figs/a.png"
assert sanitize_entry_name("a/b/c/") == "a/b/c" # 目录尾斜杠归一
def test_path_traversal_rejected(self): # #1
with pytest.raises(ZipSafetyError) as e:
sanitize_entry_name("../../etc/passwd")
assert e.value.code == "ZIP_UNSAFE"
def test_backslash_traversal_rejected(self): # #2 Windows 变体
with pytest.raises(ZipSafetyError) as e:
sanitize_entry_name("..\\..\\evil.sh")
assert e.value.code == "ZIP_UNSAFE"
def test_absolute_path_rejected(self):
with pytest.raises(ZipSafetyError):
sanitize_entry_name("/etc/passwd")
with pytest.raises(ZipSafetyError):
sanitize_entry_name("C:\\Windows\\evil")
def test_control_char_rejected(self):
with pytest.raises(ZipSafetyError):
sanitize_entry_name("ma\x00in.tex")
def test_depth_limit(self): # #11
deep = "/".join(f"d{i}" for i in range(20)) + "/x.tex"
with pytest.raises(ZipSafetyError) as e:
sanitize_entry_name(deep)
assert e.value.code == "ZIP_UNSAFE"
def test_length_limit(self):
with pytest.raises(ZipSafetyError):
sanitize_entry_name("a" * 250 + ".tex")
# ================================================================ classify(#4/#6)
class TestClassify:
def test_allow(self):
for n in ("main.tex", "journal.cls", "refs.bib", "figs/a.png", "x.sty"):
assert classify_entry(n, False) == "allow"
assert classify_entry("figs/", True) == "allow"
def test_deny_dangerous(self): # #4
for n in ("run.sh", "evil.exe", "x.so", "x.dll", "a.py", "b.js"):
assert classify_entry(n, False) == "deny"
def test_skip_harmless_non_whitelist(self): # #6
for n in ("notes.docx", "old.log", "archive.zip", "img.gif"):
assert classify_entry(n, False) == "skip"
def test_skip_dirs(self): # #6 附属
assert classify_entry("node_modules/x.js", False) == "skip"
assert classify_entry(".git/config", False) == "skip"
assert classify_entry("__MACOSX/._a.tex", False) == "skip"
# ================================================================ safe_extract(#3/#5/#7-#10/#12/#13)
class TestSafeExtract:
def test_happy_path(self, tmp_path: Path):
zb = _make_zip({"main.tex": b"hi", "figs/a.png": b"\x89PNG"})
r = safe_extract(zb, tmp_path / "p", _settings())
assert isinstance(r, ExtractResult)
assert r.files == 2 and r.tex == 1 and r.images == 1
assert (tmp_path / "p" / "main.tex").read_text() == "hi"
assert (tmp_path / "p" / "figs" / "a.png").exists()
def test_symlink_rejected(self, tmp_path: Path): # #3
with pytest.raises(ZipSafetyError) as e:
safe_extract(_symlink_zip(), tmp_path / "p", _settings())
assert e.value.code == "ZIP_UNSAFE"
assert not (tmp_path / "p").exists() # 预扫拒绝 → 未写盘
def test_deny_ext_rejects_whole_zip(self, tmp_path: Path): # #4
zb = _make_zip({"main.tex": b"x", "run.sh": b"#!/bin/sh"})
with pytest.raises(ZipSafetyError) as e:
safe_extract(zb, tmp_path / "p", _settings())
assert e.value.code == "ZIP_UNSAFE" and "run.sh" in e.value.message
assert not (tmp_path / "p").exists()
def test_exec_bit_rejects(self, tmp_path: Path): # #5
zb = _make_zip({"main.tex": b"x"}, exec_bits={"main.tex": 0o100755})
with pytest.raises(ZipSafetyError) as e:
safe_extract(zb, tmp_path / "p", _settings())
assert e.value.code == "ZIP_UNSAFE"
def test_harmless_skipped_not_rejected(self, tmp_path: Path): # #6 决策1
zb = _make_zip({"main.tex": b"x", "notes.docx": b"DOC", "old.zip": b"PK"})
r = safe_extract(zb, tmp_path / "p", _settings())
assert r.files == 1
assert r.skipped_count == 2
assert {s.name for s in r.skipped} == {"notes.docx", "old.zip"}
assert not (tmp_path / "p" / "notes.docx").exists()
def test_ratio_bomb_rejected(self, tmp_path: Path): # #7
zb = _make_zip({"big.txt": b"\x00" * (2 * 1024 * 1024)}) # 全零 → ratio ≫100
with pytest.raises(ZipSafetyError) as e:
safe_extract(zb, tmp_path / "p", _settings())
assert e.value.code == "ZIP_BOMB"
def test_total_bytes_rejected_runtime(self, tmp_path: Path): # #8 声明上限
zb = _make_zip({"a.txt": b"x" * 5000, "b.txt": b"y" * 5000})
with pytest.raises(ZipSafetyError) as e:
safe_extract(zb, tmp_path / "p", _settings(max_extract_bytes=6000))
assert e.value.code == "ZIP_BOMB"
def test_entry_bytes_rejected(self, tmp_path: Path): # #9
zb = _make_zip({"a.txt": b"x" * 10000})
with pytest.raises(ZipSafetyError) as e:
safe_extract(zb, tmp_path / "p", _settings(max_zip_entry_bytes=1000))
assert e.value.code == "ZIP_BOMB"
def test_entry_count_rejected(self, tmp_path: Path): # #10
zb = _make_zip({f"f{i}.txt": b"x" for i in range(30)})
with pytest.raises(ZipSafetyError) as e:
safe_extract(zb, tmp_path / "p", _settings(max_zip_entries=10))
assert e.value.code == "ZIP_BOMB"
assert not (tmp_path / "p").exists() # 预扫先于写盘
def test_corrupt_zip(self, tmp_path: Path):
with pytest.raises(ZipSafetyError) as e:
safe_extract(b"not a zip at all", tmp_path / "p", _settings())
assert e.value.code == "ZIP_INVALID"
def test_traversal_entry_rejected_end_to_end(self, tmp_path: Path): # #1 端到端
zb = _make_zip({"../evil.txt": b"pwned"})
with pytest.raises(ZipSafetyError) as e:
safe_extract(zb, tmp_path / "p", _settings())
assert e.value.code == "ZIP_UNSAFE"
assert not (tmp_path / "evil.txt").exists() # 磁盘无残留
assert not (tmp_path / "p").exists()
+13
View File
@@ -0,0 +1,13 @@
# tools/ —— 编译器工具链(P3)
## tectonic(LaTeX → PDF)
- 单文件 musl 静态二进制,无 root、无系统 TeX Live 依赖;版本与 sha256 钉死在
`install_tectonic.sh`(本目录二进制不入 git)。
- 安装:`cd review_service && bash tools/install_tectonic.sh`
部署树(zh)同一条命令;或直接 scp `tools/tectonic` + `data/tectonic-cache/`。
- 宏包缓存:`data/tectonic-cache/`(环境变量 `REVIEW_TECTONIC_CACHE_DIR` 覆盖)。
首次编译会联网拉 bundle(~200MB),建议部署时用 hello.tex 预热:
`TECTONIC_CACHE_DIR=$PWD/data/tectonic-cache tools/tectonic -X compile hello.tex --untrusted`
- 安全:编译一律 `--untrusted`(tectonic 官方旗标,禁用已知不安全特性)+
运行于隔离工作目录 + 60s 超时整组 kill + 禁 shell escape。
+36
View File
@@ -0,0 +1,36 @@
#!/usr/bin/env bash
# install_tectonic.sh —— 一键安装/校验 tectonic 编译器(P3a)。
# 幂等:已装且 sha256 匹配则直接退出 0。部署树(zh)同一条命令。
# 用法:cd review_service && bash tools/install_tectonic.sh
set -euo pipefail
TECTONIC_VERSION="0.17.0"
TECTONIC_TARBALL_SHA256="8533d07f9ccbd7a65824b9e0459041bca34af1eb33daba48f59215593753a3b7"
TECTONIC_BIN_SHA256="a98aa59ad5c1df39a6c9e56cbfc5088f2b11d6c179c0130b97998e4bd46a46da"
URL="https://github.com/tectonic-typesetting/tectonic/releases/download/tectonic%40${TECTONIC_VERSION}/tectonic-${TECTONIC_VERSION}-x86_64-unknown-linux-musl.tar.gz"
HERE="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)"
BIN="${HERE}/tectonic"
if [[ -x "$BIN" ]] && echo "$(sha256sum "$BIN" | cut -d' ' -f1)" = "$TECTONIC_BIN_SHA256"; then
echo "[install_tectonic] 已安装且校验通过:$BIN ($("$BIN" --version))"
exit 0
fi
tmp="$(mktemp -d)"
trap 'rm -rf "$tmp"' EXIT
echo "[install_tectonic] 下载 tectonic ${TECTONIC_VERSION}(musl 静态版)…"
curl -fL --retry 3 -o "$tmp/tectonic.tar.gz" "$URL"
echo "[install_tectonic] 校验 tarball sha256…"
echo "${TECTONIC_TARBALL_SHA256} $tmp/tectonic.tar.gz" | sha256sum -c -
tar -xzf "$tmp/tectonic.tar.gz" -C "$tmp" tectonic
echo "[install_tectonic] 校验二进制 sha256…"
echo "${TECTONIC_BIN_SHA256} $tmp/tectonic" | sha256sum -c -
install -m 0755 "$tmp/tectonic" "$BIN"
echo "[install_tectonic] 完成:$BIN ($("$BIN" --version))"
echo "[install_tectonic] 提示:首次真实编译会联网拉宏包 bundle(约 200MB),"
echo " 服务端 TECTONIC_CACHE_DIR 默认 data/tectonic-cache,建议部署时预热。"
+5
View File
@@ -81,6 +81,11 @@ class Settings(BaseSettings):
paper_writer_url: str = "http://127.0.0.1:8097"
paper_writer_read_timeout: float = 360.0 # write_paper_section 同步长调用读超时(秒)
# ---- 科研审稿服务(review_service 8100;REVIEW_ENABLED 为假时路由不注册)----
review_enabled: bool = False
review_service_url: str = "http://127.0.0.1:8100"
review_read_timeout: float = 360.0 # presubmit 上传+LLM 长调用读超时(秒)
# ---- 生产形态:BFF 静态托管 ui/dist(ARCHITECTURE.md §3,M6 挂载)----
frontend_dist_dir: str = "ui/dist" # 生产形态:静态托管 ui/dist
+3
View File
@@ -26,6 +26,7 @@ from .routers import capabilities, docgen, extraction, figures, health, kg, lega
from .routers import bioflow_proxy
from .routers import paper
from .routers import private_docs
from .routers import review_proxy
from .upstream import close_client
logging.basicConfig(level=logging.INFO)
@@ -62,6 +63,8 @@ def create_app() -> FastAPI:
app.include_router(bioflow_proxy.router) # 生信反代(BIOFLOW_ENABLED 开关,FR-BIO-028)
if get_settings().paper_writer_enabled:
app.include_router(paper.router) # 论文撰写(PAPER_WRITER_ENABLED 开关)
if get_settings().review_enabled:
app.include_router(review_proxy.router) # 科研审稿反代(REVIEW_ENABLED 开关)
@app.exception_handler(RequestValidationError)
async def _validation_handler(_: Request, exc: RequestValidationError) -> JSONResponse:
+85
View File
@@ -0,0 +1,85 @@
"""routers/review_proxy.py —— BFF 科研审稿反代(REVIEW_ENABLED 条件注册)。
- GET /api/review/health → 探活 review 服务 /health(离线返回 offline 标记,
前端据此隐藏审稿入口;模式同 routers/paper.py)。
- /api/review/{path:path} → 透明反代 review_service(8100);presubmit 为
上传+LLM 长调用,读超时取 settings.review_read_timeout。
- REVIEW_ENABLED 为假时路由不注册(main.py 按开关 include,三形态部署)。
约束:本文件是 BFF 层对审稿模块的唯一新增面(新文件,不改既有路由逻辑)。
review_service 失败统一 503 UPSTREAM_DOWN 信封(经 app.upstream.envelope)。
"""
from __future__ import annotations
import logging
from typing import Any
import httpx
from fastapi import APIRouter, Request
from fastapi.responses import JSONResponse, Response
from ..config import get_settings
from ..upstream import envelope
logger = logging.getLogger(__name__)
router = APIRouter(prefix="/api/review", tags=["review-proxy"])
PROXY_CONNECT_TIMEOUT = 5.0
def _service_base() -> str:
return get_settings().review_service_url.rstrip("/")
@router.get("/health")
async def review_health() -> dict[str, Any]:
"""探活反代 8100 /health;离线返回 offline 标记。"""
s = get_settings()
try:
async with httpx.AsyncClient(timeout=10.0) as client:
resp = await client.get(f"{s.review_service_url.rstrip('/')}/health")
resp.raise_for_status()
return resp.json()
except Exception: # noqa: BLE001
return {"ok": False, "status": "offline"}
async def _proxy(request: Request, path: str) -> Any:
"""httpx 透传反代(非 SSE;presubmit 长读超时);失败→503 信封。"""
s = get_settings()
base = _service_base()
url = f"{base}/api/review/{path.lstrip('/')}"
if request.url.query:
url = f"{url}?{request.url.query}"
body = await request.body()
headers = {k: v for k, v in request.headers.items()
if k.lower() not in ("host", "content-length", "connection")}
timeout = httpx.Timeout(
connect=PROXY_CONNECT_TIMEOUT,
read=s.review_read_timeout,
write=s.review_read_timeout,
pool=5.0,
)
async with httpx.AsyncClient(timeout=timeout) as client:
try:
upstream = client.build_request( # build_request 是同步方法,返回 httpx.Request,不可 await
request.method, url, content=body, headers=headers
)
resp = await client.send(upstream)
except httpx.HTTPError as exc:
logger.warning("review_proxy: 审稿服务不可达 %s: %s", url, exc)
payload, status = envelope(
"UPSTREAM_DOWN", message="审稿服务当前不可用,请稍后重试",
degraded=True, status=503,
)
return JSONResponse(status_code=status, content=payload)
content = await resp.aread()
media_type = resp.headers.get("content-type", "") or "application/json"
return Response(status_code=resp.status_code, content=content, media_type=media_type)
@router.api_route("/{path:path}", methods=["GET", "POST", "PUT", "PATCH", "DELETE"])
async def proxy_all(path: str, request: Request) -> Any:
return await _proxy(request, path)
@@ -0,0 +1,206 @@
// tests/frontend/unit/edu/presubmit.rationale.test.js —— PresubmitPanel 判定 rationale/档位/fatal 展示(Dev-E 判定链重构配套)
// 2026-10-12:recommendation 改由规则引擎计算后新增展示——
// 1) rationale.explanation + 硬性 hard_hits chips
// 2) 判定档位徽标(tier + 期刊名;同稿投不同 tier 结果不同须显式告知)
// 3) reject → "建议人工复核"红标 + 顶部 AI 免责行(fatal 展示克制)
import { describe, it, expect, vi, beforeEach } from 'vitest';
import { mount } from '@vue/test-utils';
import { createPinia, setActivePinia } from 'pinia';
import PresubmitPanel from '../../../../ui/src/components/edu/panels/PresubmitPanel.vue';
vi.mock('../../../../ui/src/api/review.js', () => ({
getJournals: vi.fn(),
getDirectory: vi.fn(),
getConferences: vi.fn(),
presubmit: vi.fn(),
recommend: vi.fn(),
formatCheck: vi.fn(),
formatErrorMessage: vi.fn(),
reformatTex: vi.fn(),
compileTex: vi.fn(),
reviewErrorMessage: vi.fn((e) => (e && e.message) || 'err'),
}));
import { useEduStore } from '../../../../ui/src/stores/edu.js';
function makeReportPayload(over = {}) {
return {
ok: true,
report: {
summary: '总体尚可。',
major_weaknesses: [
{
title: '缺 BUSCO 完整度',
detail: '仅报 N50',
evidence: 'Results',
suggestion: '补 BUSCO',
hard_rule: 'busco_missing',
fatal: false,
},
],
minor_weaknesses: [{ title: '缩写表', detail: '', evidence: '', suggestion: '' }],
presentation_format: [],
questions_for_authors: [],
recommendation: 'major_revision',
recommendation_rationale: {
rule: 'R1',
hard_hits: ['busco_missing'],
major_count: 1, hard_count: 1, soft_count: 0, minor_count: 1,
tier: 1, tier_label: '顶刊',
explanation: '命中硬性缺陷(BUSCO 完整度缺失)→ 大修(不可协商);另有大修级 0 条、小修级 1 条。',
},
...over.report,
},
meta: {
filename: 'paper.pdf', target_journal: 'Genome Biology',
text_chars: 100, truncated: false, model: 'deepseek',
tier: 1, tier_label: '顶刊', tier_source: 'genome biology',
...over.meta,
},
};
}
describe('PresubmitPanel 判定 rationale / 档位 / fatal 克制展示', () => {
let store;
let pinia;
beforeEach(() => {
pinia = createPinia();
setActivePinia(pinia);
store = useEduStore();
});
it('展示 rationale.explanation 与硬性 hard_hits chips', () => {
store.report = makeReportPayload();
const wrapper = mount(PresubmitPanel, { global: { plugins: [pinia] } });
expect(wrapper.find('.pp-rationale-text').text()).toContain('命中硬性缺陷');
expect(wrapper.find('.pp-rationale-text').text()).toContain('BUSCO 完整度缺失');
const chips = wrapper.findAll('.pp-hard-chip');
expect(chips.length).toBe(1);
expect(chips[0].text()).toBe('BUSCO 完整度缺失');
// major 卡片上的"硬性"徽标
expect(wrapper.find('.pp-hard-badge').exists()).toBe(true);
expect(wrapper.find('.pp-hard-badge').text()).toBe('硬性');
});
it('判定档位徽标:期刊名 + tier + 档位名', () => {
store.report = makeReportPayload();
const wrapper = mount(PresubmitPanel, { global: { plugins: [pinia] } });
expect(wrapper.find('.pp-tier').text()).toBe('判定档位:Genome Biology(tier 1 顶刊)');
});
it('reject:红标"建议人工复核" + 顶部 AI 免责行(fatal 克制展示)', () => {
store.report = makeReportPayload({
report: {
recommendation: 'reject',
recommendation_rationale: {
rule: 'R0', hard_hits: [], major_count: 1, hard_count: 0, soft_count: 1,
minor_count: 0, tier: 2, tier_label: '主流期刊',
explanation: '存在 fatal 级问题(数据可靠性/伦理,须人工复核)→ 建议拒稿。',
},
},
});
const wrapper = mount(PresubmitPanel, { global: { plugins: [pinia] } });
expect(wrapper.find('.pp-rec').text()).toBe('拒稿');
expect(wrapper.find('.pp-rec-warn').text()).toBe('建议人工复核');
expect(wrapper.find('.pp-ai-note').text()).toContain('fatal 级判定请务必人工核对');
});
it('无 reject 时不显示"建议人工复核"红标', () => {
store.report = makeReportPayload();
const wrapper = mount(PresubmitPanel, { global: { plugins: [pinia] } });
expect(wrapper.find('.pp-rec-warn').exists()).toBe(false);
// AI 免责行始终展示
expect(wrapper.find('.pp-ai-note').exists()).toBe(true);
});
it('扫描器冲突黄标:展示降级提示与原因', () => {
store.report = makeReportPayload({
report: {
recommendation_rationale: {
rule: 'R2', hard_hits: [], major_count: 2, hard_count: 0, soft_count: 2,
minor_count: 0, tier: 1, tier_label: '顶刊',
explanation: '大修级问题 2 条。关键词扫描器与审稿意见存在 2 处冲突,已降级为非硬性问题,请人工核对。',
scanner_conflicts: [
{ hard_rule: 'accession_missing', title: '缺 accession', reason: 'Data Availability 段已检出 accession(PRJCA038097)' },
{ hard_rule: 'busco_missing', title: '缺 BUSCO', reason: '正文已提及 BUSCO(partial 格式)' },
],
},
},
});
const wrapper = mount(PresubmitPanel, { global: { plugins: [pinia] } });
expect(wrapper.find('.pp-conflict-title').text()).toContain('人工核对');
const items = wrapper.findAll('.pp-conflict-item');
expect(items.length).toBe(2);
expect(items[0].text()).toContain('PRJCA038097');
expect(items[1].text()).toContain('BUSCO');
});
it('扫描器冲突降级项在 minor 卡片显示"冲突降级"黄徽标(A2 真降级)', () => {
store.report = makeReportPayload({
report: {
major_weaknesses: [],
minor_weaknesses: [
{
title: '缺数据 accession', detail: '全文未见', evidence: 'Data Availability',
suggestion: '补 accession', hard_rule: null, scanner_downgraded: true,
},
{ title: '缩写表', detail: '', evidence: '', suggestion: '' },
],
recommendation: 'minor_revision',
recommendation_rationale: {
rule: 'R5', hard_hits: [], major_count: 0, hard_count: 0, soft_count: 0,
minor_count: 2, tier: 1, tier_label: '顶刊',
explanation: '无大修级问题,小修级 2 条 → 建议小修。关键词扫描器与审稿意见存在 1 处冲突,已降级为小修级问题,请人工核对。',
},
},
});
const wrapper = mount(PresubmitPanel, { global: { plugins: [pinia] } });
// 只有被降级那条有徽标
const badges = wrapper.findAll('.pp-down-badge');
expect(badges.length).toBe(1);
expect(badges[0].text()).toBe('冲突降级');
expect(wrapper.findAll('.pp-card.minor').length).toBe(2);
});
it('截断提示:dropped_sections 美化展示', () => {
store.report = makeReportPayload({
meta: { dropped_sections: ['references', 'acknowledgements'] },
});
const wrapper = mount(PresubmitPanel, { global: { plugins: [pinia] } });
expect(wrapper.find('.pp-dropped').text()).toContain('参考文献');
expect(wrapper.find('.pp-dropped').text()).toContain('非论文缺失');
});
it('已选 PDF 进 store:面板卸载重建后不退回空上传区(切菜单保留)', async () => {
// 首次挂载:无报告 → 上传区;选一个 PDF
const w1 = mount(PresubmitPanel, { global: { plugins: [pinia] } });
const f = new File(['pdf-bytes'], 'paper.pdf', { type: 'application/pdf' });
const input = w1.find('input.pp-file-input');
Object.defineProperty(input.element, 'files', { value: [f], configurable: true });
await input.trigger('change');
expect(store.presubmitFile).toBe(f);
expect(w1.find('.pp-file-name').text()).toContain('paper.pdf');
w1.unmount(); // 模拟切走菜单(<component :is> 卸载面板)
// 重建:file 从 store 恢复,文件名仍显示、drop 区呈 filled 态
const w2 = mount(PresubmitPanel, { global: { plugins: [pinia] } });
expect(w2.find('.pp-file-name').text()).toContain('paper.pdf');
expect(w2.find('.pp-drop').classes()).toContain('filled');
// 有报告时优先报告区(regression:hasReport 仍最高优先)
store.report = makeReportPayload();
await w2.vm.$nextTick();
expect(w2.find('.pp-upload').exists()).toBe(false);
expect(w2.find('.pp-rationale').exists()).toBe(true);
});
it('重新上传清空文件:store.presubmitFile 一并清空', async () => {
store.presubmitFile = new File(['x'], 'a.pdf', { type: 'application/pdf' });
store.report = makeReportPayload();
const wrapper = mount(PresubmitPanel, { global: { plugins: [pinia] } });
await wrapper.find('.pp-again').trigger('click');
expect(store.presubmitFile).toBeNull();
expect(store.report).toBeNull();
expect(wrapper.find('.pp-upload').exists()).toBe(true);
});
});
@@ -0,0 +1,209 @@
// tests/frontend/unit/edu/rebuttal.panel.test.js —— RebuttalPanel 交互约束(Phase 1 决策锁定项)
// 1) 5 类下拉(无 auto)
// 2) location 类选中才显示 hint 输入框
// 3) 未填 user_response → 生成按钮禁用
// 4) 未全确认 → 下载禁用 + "X 条未确认"横幅;全勾后启用
// 5) merge/split 按钮只在 active comment 表单出现(树区无)
import { describe, it, expect, vi, beforeEach } from 'vitest';
import { mount } from '@vue/test-utils';
import { createPinia, setActivePinia } from 'pinia';
import RebuttalPanel from '../../../../ui/src/components/edu/panels/RebuttalPanel.vue';
vi.mock('../../../../ui/src/api/review.js', () => ({
getJournals: vi.fn(),
getDirectory: vi.fn(),
getConferences: vi.fn(),
presubmit: vi.fn(),
recommend: vi.fn(),
formatCheck: vi.fn(),
formatErrorMessage: vi.fn(),
reformatTex: vi.fn(),
compileTex: vi.fn(),
reviewErrorMessage: vi.fn((e) => (e && e.message) || 'err'),
rebuttalCreateJob: vi.fn(),
rebuttalCreateFromPdf: vi.fn(),
rebuttalGetJob: vi.fn(),
rebuttalSaveResponse: vi.fn(),
rebuttalDraft: vi.fn(),
rebuttalStructure: vi.fn(),
rebuttalConfirm: vi.fn(),
rebuttalLetter: vi.fn(),
rebuttalDownloadLetterMd: vi.fn(),
rebuttalDeleteJob: vi.fn(),
}));
import { useEduStore } from '../../../../ui/src/stores/edu.js';
function makeJob(over = {}) {
return {
id: 'rbt_test01',
status: 'ready',
source: { kind: 'text', filename: null, raw_text: 'x' },
template: 'generic',
reviewers: [
{
id: 'r1', label: 'Reviewer 1', ordinal: 1,
comments: [
{
id: 'c0001', group_id: null, severity: 'major', title: 'Missing data',
body: 'Please provide the raw data.', sub_items: [], cross_refs: [],
response: { parts: [] }, draft: null, validation: null, human_confirmed: false,
},
{
id: 'c0002', group_id: null, severity: 'minor', title: 'Minor typo',
body: 'Typo in abstract.', sub_items: [], cross_refs: [],
response: { parts: [] }, draft: null, validation: null, human_confirmed: false,
},
],
},
],
letter_md: null,
validation: null,
human_ack: false,
created_at: '2026-10-12T00:00:00+00:00',
updated_at: '2026-10-12T00:00:00+00:00',
...over,
};
}
function mountWith(job) {
const pinia = createPinia();
setActivePinia(pinia);
const edu = useEduStore();
edu.rebuttal.job = job;
edu.rebuttal.status = 'ready';
edu.rebuttal.activeCid = job.reviewers[0].comments[0].id;
const wrapper = mount(RebuttalPanel, { global: { plugins: [pinia] } });
return { wrapper, edu };
}
describe('RebuttalPanel', () => {
let wrapper;
let edu;
beforeEach(() => {
({ wrapper, edu } = mountWith(makeJob()));
});
it('1) part 类型下拉只有 5 类、无 auto', () => {
const options = wrapper.findAll('select.rb-select option');
expect(options.length).toBe(5);
const values = options.map((o) => o.element.value);
expect(values).toEqual(['new_data', 'reanalysis', 'location', 'clarification', 'rebuttal']);
expect(values).not.toContain('auto');
});
it('2) location 选中才显示 hint 输入框;非 location 隐藏', async () => {
// 默认 clarification → 无 hint
expect(wrapper.find('[data-testid="rb-location-hint"]').exists()).toBe(false);
// 切 location → 出现
const form = edu.rebuttal.job.reviewers[0].comments[0];
void form;
await wrapper.find('select.rb-select').setValue('location');
expect(wrapper.find('[data-testid="rb-location-hint"]').exists()).toBe(true);
// 切回 → 消失
await wrapper.find('select.rb-select').setValue('clarification');
expect(wrapper.find('[data-testid="rb-location-hint"]').exists()).toBe(false);
});
it('3) 未填 user_response 时生成按钮禁用;填后启用', async () => {
const draftBtn = wrapper.find('[data-testid="rb-draft"]');
expect(draftBtn.attributes('disabled')).toBeDefined();
await wrapper.find('[data-testid="rb-content-0"]').setValue('We have added the table in S3.');
await wrapper.vm.$nextTick();
expect(draftBtn.attributes('disabled')).toBeUndefined();
});
it('3b) 礼貌反驳未含立场词 → 输入框下方红字提示(不阻止编辑/生成)', async () => {
await wrapper.find('select.rb-select').setValue('rebuttal');
const content = wrapper.find('[data-testid="rb-content-0"]');
// 填无立场词内容 → 红字提示出现
await content.setValue('The reviewer misunderstood our experimental design.');
await wrapper.vm.$nextTick();
const hint = wrapper.find('[data-testid="rb-stance-hint-0"]');
expect(hint.exists()).toBe(true);
expect(hint.text()).toContain('maintain');
expect(hint.text()).toContain('respectfully');
// 提示不阻止生成按钮(不 disabled)
expect(wrapper.find('[data-testid="rb-draft"]').attributes('disabled')).toBeUndefined();
// 补立场词 → 提示消失
await content.setValue('We respectfully maintain that the design was appropriate.');
await wrapper.vm.$nextTick();
expect(wrapper.find('[data-testid="rb-stance-hint-0"]').exists()).toBe(false);
// 其他类型不做立场词检查
await wrapper.find('select.rb-select').setValue('clarification');
await wrapper.vm.$nextTick();
expect(wrapper.find('[data-testid="rb-stance-hint-0"]').exists()).toBe(false);
});
it('4) 未全确认 → 下载禁用 + 横幅;全部确认后启用', async () => {
const gate = wrapper.find('[data-testid="rb-gate"]');
expect(gate.text()).toContain('2 条未确认');
const dl = wrapper.find('[data-testid="rb-download"]');
expect(dl.attributes('disabled')).toBeDefined();
// 逐条勾(直接改 store 模拟后端确认回包;human_ack 由后端重算置位)
for (const c of edu.rebuttal.job.reviewers[0].comments) {
c.human_confirmed = true;
}
edu.rebuttal.job.human_ack = true;
edu.rebuttal.job.letter_md = '# Response';
await wrapper.vm.$nextTick();
expect(wrapper.find('[data-testid="rb-gate"]').exists()).toBe(false);
expect(dl.attributes('disabled')).toBeUndefined();
});
it('5) Phase 1 已砍手工合并/拆分与独立保存按钮(B 方案)', () => {
// merge/split 图标与区域不存在
expect(wrapper.find('[data-testid="rb-merge"]').exists()).toBe(false);
expect(wrapper.find('[data-testid="rb-split"]').exists()).toBe(false);
expect(wrapper.text()).not.toContain('选择要合并');
// 无独立"保存要点"按钮——生成 draft 前自动保存
expect(wrapper.find('[data-testid="rb-save"]').exists()).toBe(false);
expect(wrapper.find('[data-testid="rb-draft"]').exists()).toBe(true);
});
/* —— UI v2(2026-10-12)—— */
it('6) 步骤条 4 步,有 job 时高亮第 3 步', () => {
const steps = wrapper.findAll('[data-testid="rb-steps"] li');
expect(steps.length).toBe(4);
expect(steps[2].classes()).toContain('on');
});
it('7) 无 job → 粘贴区;填充示例按钮填入 Reviewer 分节文本', async () => {
const pinia = createPinia();
setActivePinia(pinia);
const edu2 = useEduStore();
const w = mount(RebuttalPanel, { global: { plugins: [pinia] } });
expect(w.find('#rb-text').exists()).toBe(true);
await w.find('[data-testid="rb-sample"]').trigger('click');
expect(w.find('#rb-text').element.value).toContain('Reviewer #1');
expect(w.find('#rb-text').element.value).toContain('Reviewer #2');
});
it('8) loading → 拆条动画;expired → 任务过期提示', async () => {
const pinia = createPinia();
setActivePinia(pinia);
const edu3 = useEduStore();
edu3.rebuttal.status = 'loading';
const w1 = mount(RebuttalPanel, { global: { plugins: [pinia] } });
expect(w1.find('[data-testid="rb-parsing"]').exists()).toBe(true);
expect(w1.text()).toContain('正在拆条');
edu3.rebuttal.status = 'error';
edu3.rebuttal.expired = true;
await w1.vm.$nextTick();
expect(w1.text()).toContain('任务已过期');
});
it('9) Letter 预览栏:X/Y 已确认 + 只列已填 draft 条目', async () => {
const job = makeJob();
job.reviewers[0].comments[0].draft = 'We have added FDR in S3.';
const { wrapper: w } = mountWith(job);
const count = w.find('[data-testid="rb-letter-count"]');
expect(count.text()).toContain('0/2 条已确认');
expect(w.text()).toContain('We have added FDR in S3.');
// 无 draft 的第二条不出现在 letter 栏
const letter = w.find('.rb-letter');
expect(letter.text()).not.toContain('Typo in abstract');
});
});
@@ -0,0 +1,178 @@
// tests/frontend/unit/edu/reformat.compile.test.js —— ReformatPanel 编译 PDF Tab(P3b)
// 1) 无 job_id → "请先完成重排版再编译" 引导
// 2) 有 job_id → "编译 PDF" 按钮可点
// 3) 点击后按钮变 "编译中…"(loading 期间禁用;store 状态驱动,切面板不中断)
// 4) 成功状态:iframe 预览 + 下载按钮 + 耗时
// 5) 失败状态:错误摘要 + log 尾折叠 <pre> + 查看完整 log
// 6) QUEUE_FULL → 固定文案"编译队列已满(最多 5 个任务)"
import { describe, it, expect, vi, beforeEach } from 'vitest';
import { mount } from '@vue/test-utils';
import { createPinia, setActivePinia } from 'pinia';
import ReformatPanel from '../../../../ui/src/components/edu/panels/ReformatPanel.vue';
const compileTexMock = vi.fn();
vi.mock('../../../../ui/src/api/review.js', async (importOriginal) => {
const actual = await importOriginal(); // 保留真实 reviewErrorMessage(QUEUE_FULL 文案走 CODE_HINTS)
return {
...actual,
getJournals: vi.fn().mockResolvedValue({ ok: true, items: [] }),
getDirectory: vi.fn(),
reformatTex: vi.fn(),
compileTex: (...args) => compileTexMock(...args),
};
});
import { useEduStore } from '../../../../ui/src/stores/edu.js';
import { ApiError } from '../../../../ui/src/api/http.js';
function seedResult(edu, job_id = 'abc123def456') {
edu.reformatResult = {
ok: true,
job_id,
modified_tex: '\\documentclass{article}\\begin{document}Hi\\end{document}',
changes: [],
warnings: [],
meta: { filename: 'paper.tex', journal_name: 'Plant Cell', rules_source: 'official' },
};
edu.reformatStatus = 'ready';
}
async function mountPdfTab(edu) {
const pinia = createPinia();
setActivePinia(pinia);
edu = useEduStore();
const wrapper = mount(ReformatPanel, { global: { plugins: [pinia] } });
// 切到"编译 PDF" Tab
const tabs = wrapper.findAll('.rf-tab');
const pdfTab = tabs.find((t) => t.text() === '编译 PDF');
await pdfTab.trigger('click');
return { wrapper, edu };
}
describe('ReformatPanel 编译 PDF Tab(P3b)', () => {
beforeEach(() => {
compileTexMock.mockReset();
// jsdom 无 URL.createObjectURL:store blob 加载走 catch 回退,不致挂
if (!URL.createObjectURL) URL.createObjectURL = vi.fn(() => 'blob:mock');
if (!URL.revokeObjectURL) URL.revokeObjectURL = vi.fn();
global.fetch = vi.fn().mockRejectedValue(new Error('no network'));
});
it('1) 无 job_id → "请先完成重排版再编译" 引导', async () => {
const pinia = createPinia();
setActivePinia(pinia);
const edu = useEduStore();
edu.reformatResult = { ok: true, job_id: null, changes: [], meta: {} };
edu.reformatStatus = 'ready';
const wrapper = mount(ReformatPanel, { global: { plugins: [pinia] } });
await wrapper.findAll('.rf-tab').find((t) => t.text() === '编译 PDF').trigger('click');
const guide = wrapper.find('[data-testid="rf-compile-guide"]');
expect(guide.exists()).toBe(true);
expect(guide.text()).toContain('请先完成重排版再编译');
expect(wrapper.find('[data-testid="rf-compile-btn"]').exists()).toBe(false);
});
it('2) 有 job_id → "编译 PDF" 按钮可点', async () => {
const pinia = createPinia();
setActivePinia(pinia);
const edu = useEduStore();
seedResult(edu);
const wrapper = mount(ReformatPanel, { global: { plugins: [pinia] } });
await wrapper.findAll('.rf-tab').find((t) => t.text() === '编译 PDF').trigger('click');
const btn = wrapper.find('[data-testid="rf-compile-btn"]');
expect(btn.exists()).toBe(true);
expect(btn.text()).toBe('编译 PDF');
expect(btn.attributes('disabled')).toBeUndefined();
});
it('3) 点击后按钮变"编译中…"并禁用;首次编译黄条出现', async () => {
const pinia = createPinia();
setActivePinia(pinia);
const edu = useEduStore();
seedResult(edu);
compileTexMock.mockReturnValue(new Promise(() => {})); // 挂起,模拟编译中
const wrapper = mount(ReformatPanel, { global: { plugins: [pinia] } });
await wrapper.findAll('.rf-tab').find((t) => t.text() === '编译 PDF').trigger('click');
await wrapper.find('[data-testid="rf-compile-btn"]').trigger('click');
await wrapper.vm.$nextTick();
const btn = wrapper.find('[data-testid="rf-compile-btn"]');
expect(btn.text()).toContain('编译中');
expect(btn.attributes('disabled')).toBeDefined();
expect(wrapper.find('[data-testid="rf-compile-loading"]').exists()).toBe(true);
expect(wrapper.find('[data-testid="rf-first-hint"]').exists()).toBe(true);
expect(compileTexMock).toHaveBeenCalledTimes(1);
// loading 期间再点不重复提交
await wrapper.find('[data-testid="rf-compile-btn"]').trigger('click');
expect(compileTexMock).toHaveBeenCalledTimes(1);
});
it('4) 成功状态:iframe 预览 + 下载按钮 + 耗时', async () => {
const pinia = createPinia();
setActivePinia(pinia);
const edu = useEduStore();
seedResult(edu);
edu.compileResult = {
ok: true, compile_id: 'abc123def456',
pdf_url: '/api/review/compile/abc123def456/pdf',
log_url: '/api/review/compile/abc123def456/log',
meta: { seconds: 12.34, pdf_bytes: 1048576, engine: 'tectonic' },
};
edu.compileStatus = 'ready';
edu.compilePdfUrl = ''; // blob 失败回退直链
const wrapper = mount(ReformatPanel, { global: { plugins: [pinia] } });
await wrapper.findAll('.rf-tab').find((t) => t.text() === '编译 PDF').trigger('click');
await wrapper.vm.$nextTick();
const frame = wrapper.find('[data-testid="rf-pdf-frame"]');
expect(frame.exists()).toBe(true);
expect(frame.attributes('src')).toContain('/pdf');
expect(wrapper.find('[data-testid="rf-download-pdf"]').exists()).toBe(true);
expect(wrapper.find('[data-testid="rf-pdf-size"]').text()).toContain('MB');
expect(wrapper.find('[data-testid="rf-compile-secs"]').text()).toContain('12.3 秒');
expect(wrapper.find('[data-testid="rf-recompile"]').exists()).toBe(true);
expect(wrapper.find('[data-testid="rf-compile-btn"]').exists()).toBe(false); // 操作行换成下载/重编
});
it('5) 失败状态:错误摘要 + log 尾折叠区 + 完整 log 按钮', async () => {
const pinia = createPinia();
setActivePinia(pinia);
const edu = useEduStore();
seedResult(edu);
edu.compileStatus = 'error';
edu.compileError = 'LaTeX 编译失败:缺少宏包';
edu.compileLogTail = 'This is tectonic\n! LaTeX Error: File `foo.sty\' not found.\n68 lines omitted...';
const wrapper = mount(ReformatPanel, { global: { plugins: [pinia] } });
await wrapper.findAll('.rf-tab').find((t) => t.text() === '编译 PDF').trigger('click');
await wrapper.vm.$nextTick();
const err = wrapper.find('[data-testid="rf-compile-error"]');
expect(err.exists()).toBe(true);
expect(err.text()).toContain('缺少宏包');
const details = wrapper.find('[data-testid="rf-log-details"]');
expect(details.exists()).toBe(true);
expect(wrapper.find('[data-testid="rf-log-body"]').text()).toContain('foo.sty');
expect(wrapper.find('[data-testid="rf-download-log"]').exists()).toBe(true);
expect(wrapper.find('[data-testid="rf-recompile"]').exists()).toBe(true);
expect(wrapper.find('[data-testid="rf-pdf-frame"]').exists()).toBe(false);
});
it('6) QUEUE_FULL → 固定文案"编译队列已满(最多 5 个任务)"', async () => {
const pinia = createPinia();
setActivePinia(pinia);
const edu = useEduStore();
seedResult(edu);
compileTexMock.mockRejectedValue(new ApiError('编译队列已满(7 个任务排队),请稍后重试', {
code: 'QUEUE_FULL', status: 429,
}));
const wrapper = mount(ReformatPanel, { global: { plugins: [pinia] } });
await wrapper.findAll('.rf-tab').find((t) => t.text() === '编译 PDF').trigger('click');
await wrapper.find('[data-testid="rf-compile-btn"]').trigger('click');
await wrapper.vm.$nextTick();
await wrapper.vm.$nextTick();
const err = wrapper.find('[data-testid="rf-compile-error"]');
expect(err.exists()).toBe(true);
expect(err.text()).toContain('编译队列已满(最多 5 个任务),请稍后重试');
// 报错后按钮立即恢复可点(重新编译)
const retry = wrapper.find('[data-testid="rf-recompile"]');
expect(retry.exists()).toBe(true);
expect(retry.attributes('disabled')).toBeUndefined();
});
});
@@ -0,0 +1,99 @@
// tests/frontend/unit/edu/reformat.file.test.js —— ReformatPanel 文件持久化(P3b 修复)
// bug:上传 .tex → 重排版 → 点"重新排版"换期刊 → 本地 file 被清空 → 要求重传。
// 修复:File 进 store(reformatFile,同 presubmitFile 模式);reset() 不清 file;
// 仅"×" removeFile 清空。
// 1) store 有 reformatFile → 挂载即回显文件名
// 2) 选择文件 → 切换目标期刊 → 文件仍在(store + DOM)
// 3) 有结果时点"重新排版"(reset)→ 回上传区且文件保留
// 4) "×" 移除 → store + 本地都清空
import { describe, it, expect, vi, beforeEach } from 'vitest';
import { mount } from '@vue/test-utils';
import { createPinia, setActivePinia } from 'pinia';
import ReformatPanel from '../../../../ui/src/components/edu/panels/ReformatPanel.vue';
vi.mock('../../../../ui/src/api/review.js', async (importOriginal) => {
const actual = await importOriginal();
return {
...actual,
getJournals: vi.fn().mockResolvedValue({
ok: true,
items: [{ id: 'gb', name: 'Genome Biology' }, { id: 'mp', name: 'Molecular Plant' }],
}),
getDirectory: vi.fn(),
reformatTex: vi.fn(),
compileTex: vi.fn(),
};
});
import { useEduStore } from '../../../../ui/src/stores/edu.js';
const TEX = new File(['\\documentclass{article}\\begin{document}Hi\\end{document}'], 'paper.tex', {
type: 'application/x-tex',
});
/** 先建 pinia → seed store → 再挂载(保证 mount 时读到 store 初值) */
function setup(seedFn) {
const pinia = createPinia();
setActivePinia(pinia);
const edu = useEduStore();
if (seedFn) seedFn(edu);
const wrapper = mount(ReformatPanel, { global: { plugins: [pinia] } });
return { wrapper, edu };
}
describe('ReformatPanel 文件持久化(换期刊不丢文件)', () => {
beforeEach(() => {
global.fetch = vi.fn().mockRejectedValue(new Error('no network'));
if (!URL.createObjectURL) URL.createObjectURL = vi.fn(() => 'blob:mock');
if (!URL.revokeObjectURL) URL.revokeObjectURL = vi.fn();
});
it('1) store 有 reformatFile → 挂载即回显文件名', async () => {
const { wrapper } = setup((edu) => { edu.reformatFile = TEX; });
await wrapper.vm.$nextTick();
expect(wrapper.find('.rf-file-name').text()).toContain('paper.tex');
});
it('2) 选择文件后切目标期刊 → 文件仍在(store + DOM)', async () => {
const { wrapper, edu } = setup();
const input = wrapper.find('input.rf-file-input');
Object.defineProperty(input.element, 'files', { value: [TEX], configurable: true });
await input.trigger('change');
await wrapper.vm.$nextTick();
expect(edu.reformatFile).toBe(TEX);
expect(wrapper.find('.rf-file-name').text()).toContain('paper.tex');
// 切换目标期刊(watch 只写 drafts,不清 file)
await wrapper.find('#rf-target').setValue('mp');
await wrapper.vm.$nextTick();
expect(edu.reformatFile).toBe(TEX);
expect(wrapper.find('.rf-file-name').text()).toContain('paper.tex');
expect(edu.drafts.reformatTarget).toBe('mp');
});
it('3) 有结果时点"重新排版" → 回上传区且文件保留', async () => {
const { wrapper, edu } = setup((e) => {
e.reformatFile = TEX;
e.reformatResult = {
ok: true, job_id: 'abc123def456', modified_tex: 'x', changes: [], warnings: [],
meta: { filename: 'paper.tex' },
};
e.reformatStatus = 'ready';
});
await wrapper.vm.$nextTick();
const again = wrapper.findAll('button').find((b) => b.text() === '重新排版');
expect(again).toBeTruthy();
await again.trigger('click');
await wrapper.vm.$nextTick();
expect(edu.reformatResult).toBeNull();
expect(edu.reformatFile).toBe(TEX); // store 保留
expect(wrapper.find('.rf-file-name').text()).toContain('paper.tex'); // DOM 回显
});
it('4) "×" 移除 → store + 本地都清空', async () => {
const { wrapper, edu } = setup((e) => { e.reformatFile = TEX; });
await wrapper.vm.$nextTick();
await wrapper.find('.rf-remove').trigger('click');
expect(edu.reformatFile).toBeNull();
expect(wrapper.find('.rf-file-name').exists()).toBe(false);
});
});
@@ -0,0 +1,123 @@
// tests/frontend/unit/edu/reformat.rules-summary.test.js
// 目标期刊规则摘要行(data-testid="rf-rules-summary"):
// 1) 有规则字段 + 有 diff → 摘要 + "已修改 N 处"
// 2) 规则全 null + diff=0 → "无强制约束" + "样本已满足该刊要求,无需修改"
// 背景:GB/BMC PB/Rice 规则相同、Frontiers 几乎无规则,用户切换期刊看不到 diff 差异,
// 即使 diff=0 也要展示"该刊要求什么",消除"没生效"错觉。
import { describe, it, expect, vi, beforeEach } from 'vitest';
import { mount } from '@vue/test-utils';
import { createPinia, setActivePinia } from 'pinia';
import ReformatPanel from '../../../../ui/src/components/edu/panels/ReformatPanel.vue';
vi.mock('../../../../ui/src/api/review.js', async (importOriginal) => {
const actual = await importOriginal();
return {
...actual,
getJournals: vi.fn().mockResolvedValue({ ok: true, items: [] }),
getDirectory: vi.fn(),
reformatTex: vi.fn(),
compileTex: vi.fn(),
};
});
import { useEduStore } from '../../../../ui/src/stores/edu.js';
function mountWithResult(eduSeed) {
const pinia = createPinia();
setActivePinia(pinia);
const edu = useEduStore();
Object.assign(edu, eduSeed);
const wrapper = mount(ReformatPanel, { global: { plugins: [pinia] } });
return { wrapper, edu };
}
function resultWith(rules, changes) {
return {
ok: true,
job_id: 'abc123def456',
modified_tex: 'x',
changes,
warnings: [],
meta: {
filename: 'paper.tex',
journal_name: 'Molecular Plant',
rules_source: 'official',
rules_note: 'journals.json 期刊专属规则',
rules,
},
};
}
describe('ReformatPanel 目标期刊规则摘要', () => {
beforeEach(() => {
global.fetch = vi.fn().mockRejectedValue(new Error('no network'));
if (!URL.createObjectURL) URL.createObjectURL = vi.fn(() => 'blob:mock');
if (!URL.revokeObjectURL) URL.revokeObjectURL = vi.fn();
});
it('1) 有规则字段 + 有 diff → 摘要列出字段且标注"已修改 N 处"', async () => {
// Molecular Plant 真实规则形态:12pt / 1.5 / author_year(font/margin null 不显示)
const { wrapper } = mountWithResult({
reformatStatus: 'ready',
reformatResult: resultWith(
{
min_font_pt: 12, min_margin_mm: null, min_line_spacing: 1.5,
refs_style: 'author_year', max_pages: null, min_figures: null, max_fonts: null,
},
[
{ line: 1, original: 'a', modified: 'b', reason: 'r', rule_key: 'font_pt', action: 'modified' },
{ line: 3, original: 'a', modified: 'b', reason: 'r', rule_key: 'line_spacing', action: 'modified' },
{ line: 4, original: 'a', modified: 'b', reason: 'r', rule_key: 'bib_style', action: 'modified' },
],
),
});
await wrapper.vm.$nextTick();
const el = wrapper.find('[data-testid="rf-rules-summary"]');
expect(el.exists()).toBe(true);
const text = el.text();
expect(text).toContain('1.5 倍行距');
expect(text).toContain('作者-年份引用');
expect(text).toContain('字号 ≥12pt');
expect(text).not.toContain('null');
expect(text).not.toContain('边距'); // min_margin_mm=null → 不显示
expect(text).toContain('已修改 3 处');
});
it('2) 规则全 null + diff=0 → "无强制约束" + "样本已满足该刊要求,无需修改"', async () => {
const { wrapper } = mountWithResult({
reformatStatus: 'ready',
reformatResult: resultWith(
{
min_font_pt: null, min_margin_mm: null, min_line_spacing: null,
refs_style: null, max_pages: null, min_figures: null, max_fonts: null,
},
[],
),
});
await wrapper.vm.$nextTick();
const el = wrapper.find('[data-testid="rf-rules-summary"]');
expect(el.exists()).toBe(true);
const text = el.text();
expect(text).toContain('该刊官网未规定明确格式要求,无强制约束');
expect(text).toContain('样本已满足该刊要求,无需修改');
expect(text).not.toContain('已修改');
});
it('3) 双倍行距 + Vancouver(GB/BMC/Rice 形态)→ 正确映射中文标签', async () => {
const { wrapper } = mountWithResult({
reformatStatus: 'ready',
reformatResult: resultWith(
{
min_font_pt: null, min_margin_mm: null, min_line_spacing: 2.0,
refs_style: 'vancouver', max_pages: null, min_figures: null, max_fonts: null,
},
[{ line: 3, original: 'a', modified: 'b', reason: 'r', rule_key: 'line_spacing', action: 'modified' }],
),
});
await wrapper.vm.$nextTick();
const text = wrapper.find('[data-testid="rf-rules-summary"]').text();
expect(text).toContain('双倍行距');
expect(text).toContain('Vancouver 引用');
expect(text).toContain('已修改 1 处');
});
});
@@ -0,0 +1,188 @@
// tests/frontend/unit/edu/reformat.zip.test.js —— ReformatPanel 项目 zip 两段式(P4)
// 1) 默认 .tex 模式;切"项目 .zip"→ zip 上传区 + 打包建议文案 + inspect 按钮
// 2) 选 .zip → inspect 成功 → 摘要(main/统计/跳过)+ 编译按钮
// 3) inspect 失败(ZIP_UNSAFE 后端原话)→ 错误展示
// 4) 点编译 → loading → 成功:iframe 预览 + 耗时
// 5) 编译失败:错误摘要 + log 折叠区 + 查看完整 log(失败信封带 log_url)
// 6) 模式互斥:切回 .tex 清 zip 状态
import { describe, it, expect, vi, beforeEach } from 'vitest';
import { mount } from '@vue/test-utils';
import { createPinia, setActivePinia } from 'pinia';
import ReformatPanel from '../../../../ui/src/components/edu/panels/ReformatPanel.vue';
const inspectZipMock = vi.fn();
const runZipCompileMock = vi.fn();
vi.mock('../../../../ui/src/api/review.js', async (importOriginal) => {
const actual = await importOriginal();
return {
...actual,
getJournals: vi.fn().mockResolvedValue({ ok: true, items: [] }),
getDirectory: vi.fn(),
reformatTex: vi.fn(),
compileTex: vi.fn(),
inspectZip: (...args) => inspectZipMock(...args),
runZipCompile: (...args) => runZipCompileMock(...args),
};
});
import { useEduStore } from '../../../../ui/src/stores/edu.js';
import { ApiError } from '../../../../ui/src/api/http.js';
const INSPECT_OK = {
ok: true,
meta: {
job_id: 'abc123def456',
main: 'main.tex',
stats: { files: 5, tex: 1, images: 1, cls: 1, bib: 1, other: 1, bytes: 4096 },
skipped: [{ name: '__MACOSX/._main.tex', reason: 'skip_dir' }],
skipped_count: 1,
created_at: '2026-10-13T00:00:00+00:00',
},
};
function zipFile(name = 'project.zip') {
return new File([new Uint8Array([0x50, 0x4b, 0x03, 0x04])], name, {
type: 'application/zip',
});
}
async function mountZipPanel(edu) {
const pinia = createPinia();
setActivePinia(pinia);
edu = useEduStore();
const wrapper = mount(ReformatPanel, { global: { plugins: [pinia] } });
await wrapper.find('[data-testid="rf-mode-zip"]').trigger('click');
return { wrapper, edu };
}
async function pickZip(wrapper, edu, file = zipFile()) {
const input = wrapper.find('input[type="file"]');
Object.defineProperty(input.element, 'files', { value: [file], configurable: true });
await input.trigger('change');
await wrapper.vm.$nextTick();
}
describe('ReformatPanel 项目 zip 两段式(P4)', () => {
beforeEach(() => {
inspectZipMock.mockReset();
runZipCompileMock.mockReset();
if (!URL.createObjectURL) URL.createObjectURL = vi.fn(() => 'blob:mock');
if (!URL.revokeObjectURL) URL.revokeObjectURL = vi.fn();
global.fetch = vi.fn().mockRejectedValue(new Error('no network'));
});
it('1) 默认 .tex 模式;切 zip → zip 上传区 + 打包建议 + inspect 按钮', async () => {
const pinia = createPinia();
setActivePinia(pinia);
const wrapper = mount(ReformatPanel, { global: { plugins: [pinia] } });
expect(wrapper.find('[data-testid="rf-mode-tex"]').classes()).toContain('active');
expect(wrapper.find('[data-testid="rf-zip-inspect-btn"]').exists()).toBe(false);
// tex 提交按钮仍在
expect(wrapper.findAll('button').some((b) => b.text() === '开始自动重排版')).toBe(true);
await wrapper.find('[data-testid="rf-mode-zip"]').trigger('click');
const zipBtn = wrapper.find('[data-testid="rf-zip-inspect-btn"]');
expect(zipBtn.exists()).toBe(true);
expect(zipBtn.attributes('disabled')).toBeDefined(); // 未选文件不可点
expect(wrapper.text()).toContain('打包建议:main.tex 放 zip 根目录');
// tex 提交按钮消失(互斥)
expect(wrapper.findAll('button').some((b) => b.text() === '开始自动重排版')).toBe(false);
});
it('2) 选 .zip → inspect 成功 → 摘要 + 编译按钮', async () => {
inspectZipMock.mockResolvedValue(INSPECT_OK);
const { wrapper, edu } = await mountZipPanel(null);
await pickZip(wrapper, edu);
await wrapper.find('[data-testid="rf-zip-inspect-btn"]').trigger('click');
await vi.waitFor(() => {
expect(wrapper.find('[data-testid="rf-zip-meta"]').exists()).toBe(true);
});
expect(inspectZipMock).toHaveBeenCalledTimes(1);
const meta = wrapper.find('[data-testid="rf-zip-meta"]');
expect(meta.text()).toContain('main.tex');
expect(meta.text()).toContain('文件 5 个');
expect(meta.text()).toContain('1 个文件已跳过');
expect(wrapper.find('[data-testid="rf-zip-skipped"]').text()).toContain('__MACOSX');
expect(wrapper.find('[data-testid="rf-zip-compile-btn"]').exists()).toBe(true);
});
it('3) inspect 失败(ZIP_UNSAFE)→ 错误展示', async () => {
inspectZipMock.mockRejectedValue(
new ApiError('zip 含危险条目:evil.sh', { code: 'ZIP_UNSAFE', status: 200 }),
);
const { wrapper, edu } = await mountZipPanel(null);
await pickZip(wrapper, edu);
await wrapper.find('[data-testid="rf-zip-inspect-btn"]').trigger('click');
await vi.waitFor(() => {
expect(wrapper.find('[data-testid="rf-zip-error"]').exists()).toBe(true);
});
expect(wrapper.find('[data-testid="rf-zip-error"]').text()).toContain('evil.sh');
expect(wrapper.find('[data-testid="rf-zip-meta"]').exists()).toBe(false);
});
it('4) 编译 → loading → 成功:iframe 预览 + 耗时', async () => {
inspectZipMock.mockResolvedValue(INSPECT_OK);
let resolveRun;
runZipCompileMock.mockReturnValue(new Promise((r) => { resolveRun = r; }));
const { wrapper, edu } = await mountZipPanel(null);
await pickZip(wrapper, edu);
await wrapper.find('[data-testid="rf-zip-inspect-btn"]').trigger('click');
await vi.waitFor(() => {
expect(wrapper.find('[data-testid="rf-zip-compile-btn"]').exists()).toBe(true);
});
await wrapper.find('[data-testid="rf-zip-compile-btn"]').trigger('click');
await wrapper.vm.$nextTick();
expect(wrapper.find('[data-testid="rf-compile-loading"]').exists()).toBe(true);
resolveRun({
ok: true,
compile_id: 'aabbccddeeff',
pdf_url: '/api/review/compile/zip/aabbccddeeff/pdf',
log_url: '/api/review/compile/zip/aabbccddeeff/log',
meta: { seconds: 3.2, pdf_bytes: 2048, project: true },
});
await vi.waitFor(() => {
expect(wrapper.find('[data-testid="rf-pdf-frame"]').exists()).toBe(true);
});
expect(wrapper.find('[data-testid="rf-compile-secs"]').text()).toContain('3.2 秒');
expect(wrapper.find('[data-testid="rf-download-pdf"]').exists()).toBe(true);
});
it('5) 编译失败:错误摘要 + log 折叠区 + 查看完整 log', async () => {
inspectZipMock.mockResolvedValue(INSPECT_OK);
const compileErr = new ApiError('LaTeX 源码有语法错误', {
code: 'COMPILE_FAILED', status: 200,
});
compileErr.detail = 'l.12 \\badcmd'; // unwrap 从 error.detail 挂载(log 尾)
runZipCompileMock.mockRejectedValue(compileErr);
const { wrapper, edu } = await mountZipPanel(null);
await pickZip(wrapper, edu);
await wrapper.find('[data-testid="rf-zip-inspect-btn"]').trigger('click');
await vi.waitFor(() => {
expect(wrapper.find('[data-testid="rf-zip-compile-btn"]').exists()).toBe(true);
});
await wrapper.find('[data-testid="rf-zip-compile-btn"]').trigger('click');
await vi.waitFor(() => {
expect(wrapper.find('[data-testid="rf-compile-error"]').exists()).toBe(true);
});
expect(wrapper.find('[data-testid="rf-compile-error"]').text()).toContain('语法错误');
expect(wrapper.find('[data-testid="rf-log-body"]').text()).toContain('l.12');
expect(wrapper.find('[data-testid="rf-download-log"]').exists()).toBe(true);
});
it('6) 模式互斥:切回 .tex 清 zip 状态(inspect 摘要消失)', async () => {
inspectZipMock.mockResolvedValue(INSPECT_OK);
const { wrapper, edu } = await mountZipPanel(null);
await pickZip(wrapper, edu);
await wrapper.find('[data-testid="rf-zip-inspect-btn"]').trigger('click');
await vi.waitFor(() => {
expect(wrapper.find('[data-testid="rf-zip-meta"]').exists()).toBe(true);
});
await wrapper.find('[data-testid="rf-mode-tex"]').trigger('click');
expect(wrapper.find('[data-testid="rf-zip-meta"]').exists()).toBe(false);
expect(edu.zipInspect).toBeNull();
expect(edu.zipFile).toBeNull();
// tex 上传区回来了
expect(wrapper.findAll('button').some((b) => b.text() === '开始自动重排版')).toBe(true);
});
});
@@ -0,0 +1,109 @@
// tests/frontend/unit/edu/tracker.panel.test.js —— TrackerPanel v3(方案 A 极简台账)
// 1) 统计条 5 项计数
// 2) 表单含返修截止日/返修轮次字段
// 3) 卡片显示返修轮次+截止倒计时;无"已开启/未开始返修"联动徽章
// 4) "去写返修"仅 under_review/revision 显示;点击 → section 切 rebuttal + 期刊预填(无 linkSid 回写)
// 5) 空态文案
import { describe, it, expect, vi, beforeEach } from 'vitest';
import { mount } from '@vue/test-utils';
import { createPinia, setActivePinia } from 'pinia';
import TrackerPanel from '../../../../ui/src/components/edu/panels/TrackerPanel.vue';
vi.mock('../../../../ui/src/api/review.js', () => ({
getJournals: vi.fn(),
getDirectory: vi.fn(),
getConferences: vi.fn(),
presubmit: vi.fn(),
recommend: vi.fn(),
formatCheck: vi.fn(),
formatErrorMessage: vi.fn(),
reformatTex: vi.fn(),
compileTex: vi.fn(),
reviewErrorMessage: vi.fn((e) => (e && e.message) || 'err'),
rebuttalCreateJob: vi.fn(),
rebuttalCreateFromPdf: vi.fn(),
rebuttalGetJob: vi.fn(),
rebuttalSaveResponse: vi.fn(),
rebuttalDraft: vi.fn(),
rebuttalStructure: vi.fn(),
rebuttalConfirm: vi.fn(),
rebuttalLetter: vi.fn(),
rebuttalDownloadLetterMd: vi.fn(),
rebuttalDeleteJob: vi.fn(),
}));
import { useEduStore } from '../../../../ui/src/stores/edu.js';
function seed(edu) {
edu.submissions = [
{ id: 's1', journal: 'Plant Cell', status: 'revision', submittedAt: '2026-09-01', updatedAt: '2026-10-01', notes: '', revisionDue: '2026-11-01', revisionRound: 2, rebuttalJobId: null },
{ id: 's2', journal: 'Mol Plant', status: 'accepted', submittedAt: '2026-08-01', updatedAt: '2026-09-15', notes: '' },
{ id: 's3', journal: 'GB', status: 'under_review', submittedAt: '2026-09-10', updatedAt: '2026-09-20', notes: '', rebuttalJobId: 'rbt_x1' },
{ id: 's4', journal: 'New Phytol', status: 'rejected', submittedAt: '2026-07-01', updatedAt: '2026-08-01', notes: '' },
];
}
describe('TrackerPanel v3', () => {
let wrapper;
let edu;
beforeEach(() => {
const pinia = createPinia();
setActivePinia(pinia);
edu = useEduStore();
seed(edu);
wrapper = mount(TrackerPanel, { global: { plugins: [pinia] } });
});
it('1) 统计条计数正确', () => {
const stats = wrapper.find('[data-testid="tk-stats"]');
expect(stats.text()).toContain('总投稿');
const b = stats.findAll('b').map((x) => x.text());
expect(b).toEqual(['4', '1', '1', '1', '1']); // total/active/revision/accepted/rejected
});
it('2) 表单含返修截止日与返修轮次字段', async () => {
await wrapper.find('.tk-add').trigger('click');
expect(wrapper.find('[data-testid="tk-revision-due"]').exists()).toBe(true);
expect(wrapper.find('[data-testid="tk-revision-round"]').exists()).toBe(true);
});
it('3) 卡片显示返修轮次+截止信息;无联动徽章', () => {
const rows = wrapper.findAll('[data-testid="tk-row"]');
expect(rows.length).toBe(4);
const rev = wrapper.find('[data-testid="tk-rev-info"]');
expect(rev.text()).toContain('第 2 轮返修');
expect(rev.text()).toContain('due 2026-11-01');
// 倒计时文案(今天 2026-10-12,due 2026-11-01 → 还剩 N 天)
expect(rev.text()).toMatch(/还剩 \d+ 天|今天截止|已逾期/);
// 方案 A:不再显示"已开启/未开始返修"联动徽章
expect(wrapper.find('[data-testid="tk-rebuttal-status"]').exists()).toBe(false);
expect(wrapper.text()).not.toContain('已开启返修任务');
expect(wrapper.text()).not.toContain('未开始返修');
});
it('4) 「去写返修」仅审稿中/返修中显示;点击只跳转+预填期刊(无回写)', () => {
// 按 updatedAt 倒序:s1(revision) → s3(under_review) → s2(accepted) → s4(rejected)
const btns = wrapper.findAll('[data-testid="tk-start-rebuttal"]');
expect(btns.length).toBe(2); // 仅 s1/s3
const rows = wrapper.findAll('[data-testid="tk-row"]');
expect(rows[2].text()).not.toContain('去写返修'); // s2 accepted
expect(rows[3].text()).not.toContain('去写返修'); // s4 rejected
btns[0].trigger('click');
return Promise.resolve().then(() => {
expect(edu.section).toBe('rebuttal');
expect(edu.rebuttal.prefillJournal).toBe('Plant Cell');
expect(edu.rebuttal.linkSid == null).toBe(true); // 方案 A:无回写联动
});
});
it('5) 空态文案', () => {
const pinia = createPinia();
setActivePinia(pinia);
const edu2 = useEduStore();
edu2.submissions = [];
const w = mount(TrackerPanel, { global: { plugins: [pinia] } });
expect(w.find('.tk-empty').text()).toContain('暂无投稿记录');
expect(w.find('.tk-empty').text()).toContain('新增投稿');
});
});
+2 -1
View File
@@ -31,12 +31,13 @@ rsync -a --exclude '__pycache__' --exclude 'test_*.py' --exclude 'data' --exclud
"$SOURCE_ROOT/" "$OUTPUT_DIR/"
# 白名单明文:main.py + config.py + __init__.py(编译前从发现集排除)
WHITELIST_PY=("app/main.py" "app/config.py" "app/schemas.py" "app/db.py" "app/routers/qa.py" "app/services/sse_relay.py" "app/routers/bioflow_proxy.py" "app/routers/paper.py" "app/services/paper/agent.py" "app/services/paper/mcp_client.py")
WHITELIST_PY=("app/main.py" "app/config.py" "app/schemas.py" "app/db.py" "app/routers/qa.py" "app/services/sse_relay.py" "app/routers/bioflow_proxy.py" "app/routers/paper.py" "app/routers/review_proxy.py" "app/services/paper/agent.py" "app/services/paper/mcp_client.py")
# 白名单理由:main.py=uvicorn 入口;config.py=运维可读面;
# schemas.py=pydantic v2 模型(validator 方法被 Cython 转 cyfunction 触发
# PydanticUserError,实测编译后无法导入——纯数据契约面,无敏感逻辑,明文保留);
# db.py=2026-09-03 断流崩溃根治:客户端中途断开流时 Cython 协程
# bioflow_proxy.py=2026-09-06 生信流式反代(SSE 逐块 yield,同型断流高危点,TL 补)
# review_proxy.py=2026-10-11 科研审稿反代(上传+LLM 长调用反代,同类断流高危点)
# db.py=2026-09-03 断流崩溃根治:客户端中途断开流时 Cython 协程
# __Pyx_Coroutine_SendEx 断言 abort 整个 BFF(Cython 3.2.8/3.3.0 均复现,
# A/B 证据见 docs/team/deploy_plan.md 附档)。db 是崩溃协程热点,
+1 -3
View File
@@ -1,3 +1 @@
# frontend/.gitignore(最小版,B1 可扩展)
node_modules/
dist/
.env.local
+1
View File
@@ -0,0 +1 @@
export default {}
+7 -2
View File
@@ -1,11 +1,14 @@
<!-- App.vue —— B1 归属。挂载三栏 AppShell。 -->
<!-- App.vue —— B1 归属。挂载三栏 AppShell + 教育科研覆盖层(步骤5;v-show 切换不卸载)。 -->
<script setup>
import { onMounted, onUnmounted } from 'vue';
import AppShell from './components/layout/AppShell.vue';
import EduWorkspace from './components/edu/EduWorkspace.vue';
import { useHealthStore } from './stores/health.js';
import { useAppStore } from './stores/app.js';
// FR-SHELL-007 首屏初始化:并行请求健康与 QA 元信息(失败不阻塞渲染)
const health = useHealthStore();
const appStore = useAppStore();
onMounted(() => {
health.start();
health.fetchQaInfo();
@@ -16,5 +19,7 @@ onUnmounted(() => {
</script>
<template>
<AppShell />
<!-- 覆盖层语义(D1):两者始终挂载,仅 display 切换——RAG 会话/上传/滚动零丢失 -->
<AppShell v-show="appStore.isChat" />
<EduWorkspace v-show="appStore.isEdu" />
</template>
+225
View File
@@ -0,0 +1,225 @@
// api/review.js —— 科研审稿端点封装(BFF 8090 → review_service 8100)
// 相对路径 /api/review/* → vite proxy(vite.config.js bffTarget)→ BFF 反代(须 REVIEW_ENABLED=1)。
//
// 错误契约适配:review_service 业务错误是 **HTTP 200 + {ok:false,error:{...}}**
// (VALIDATION/PARSE_FAILED/UPSTREAM_DOWN/SEED_UNAVAILABLE 均实测 200),
// 而 http.js 只对非 2xx 抛 ApiError —— 200 信封会正常 resolve。
// unwrap() 把两条错误路径(200 信封 / 非 2xx http.js 抛出)归一成 ApiError,
// 调用方只需 catch + reviewErrorMessage(err) 一个口径。
import { get, post, patch, del, ApiError } from './http.js';
const BASE = '/api/review';
function unwrap(promise) {
return promise.then((payload) => {
if (payload && payload.ok === false && payload.error) {
const err = new ApiError(payload.error.message || '服务错误', {
code: payload.error.code || 'INTERNAL',
status: 200,
degraded: !!payload.error.degraded,
});
if (payload.error.detail) err.detail = payload.error.detail; // 编译失败的 log 尾等
// P4:项目编译失败信封带 compile_id + log_url(补充 3,前端"查看完整 log"用)
if (payload.compile_id) err.compileId = payload.compile_id;
if (payload.log_url) err.logUrl = payload.log_url;
throw err;
}
return payload;
});
}
/** ① GET /api/review/journals?field=&order=
* → {ok, items:[{id,name,scope_desc,impact_factor,review_time_weeks,acceptance_rate,
* submission_deadline,official_url,last_updated}],
* meta:{count,last_updated,data_source_note}} */
export function getJournals(params = {}) {
return unwrap(get(`${BASE}/journals`, params));
}
/** ①' GET /api/review/journals/directory?lang=&domain=&cas_partition=&q=&page=&size=&field=&order=
* → {ok, items[{id,lang,name,research_direction,cas_partition,cas_partition_note,
* cas_partition_year,jif,jif_year,jif_note,jif_check_status,composite_impact_factor,
* comprehensive_impact_factor,metric_year,metric_report_year,metric_caliber,
* annual_report_page,top_flag,publisher_series,journal_mark,article_type,issn,eissn,
* jcr_disciplines[],supplement_note,evidence_note,official_url,partition_source,
* jif_source,jif_source_url,partition_source_url,data_source_label,data_source_url}],
* meta:{total,page,size,lang,domain,cas_partition,q,domains[],
* data_source_note,data_imported}}
* 1056 本目录(779 国际 + 277 中文);只读分页,lang 强制单语(en/zh 永不混排);
* cas_partition 仅 lang=en 过滤;field 排序白名单 name/jif/composite_impact_factor/
* comprehensive_impact_factor/research_direction/cas_partition;缺值 source 已归零。 */
export function getDirectory(params = {}) {
return unwrap(get(`${BASE}/journals/directory`, params));
}
/** ⑦' GET /api/review/conferences?domain=&ccf=&upcoming_days=
* → {ok, items:[{id,name,full_name,domain_tags,application_tags,ccf_rank,
* deadline_abstract,deadline_full_paper,notification_date,conference_date,
* location,official_url,timezone_note,deadline_source,last_verified}],
* meta:{count,last_verified,data_source_note,query}}
* 只读静态种子(全 placeholder);排序/过滤由后端做,upcoming_days=0 表示不过滤。 */
export function getConferences(params = {}) {
return unwrap(get(`${BASE}/conferences`, params));
}
/** ③ POST /api/review/presubmit(multipart PDF)→ {ok, report, meta}
* FormData 自动 multipart(http.js 不设 Content-Type,浏览器带 boundary);
* opts 可传 {onUploadProgress, signal, timeout}(FormData+进度走 XHR 分支)。
* 读超时沿用默认 600s(> BFF 360s),不先于上游自断。 */
export function presubmit(formData, opts = {}) {
return unwrap(post(`${BASE}/presubmit`, formData, opts));
}
/** ② POST /api/review/recommend → {ok, tiers:[{tier,journals:[...]}], meta} */
export function recommend(payload, opts = {}) {
return unwrap(post(`${BASE}/recommend`, payload, opts));
}
/** ⑤ POST /api/review/format-check(multipart PDF/Word)
* → {ok, checks:[{key,name,status,detail,suggestion}], summary:{pass,warn,fail},
* meta:{filename,file_type,pages,ruleset_source,rules_source,journal_*,
* refs_style_expected,refs_style_detected}}
* 纯规则引擎,无 LLM,同步秒回(无需 onUploadProgress)。 */
export function formatCheck(formData, opts = {}) {
return unwrap(post(`${BASE}/format-check`, formData, opts));
}
/** ⑥ POST /api/review/reformat(multipart .tex + target_journal)
* → {ok, job_id, modified_tex,
* changes:[{line,original,modified,reason,rule_key,action}],
* warnings:[{code,message}], // 仅结构级(如多处 \documentclass)
* meta:{journal_id,journal_name,rules,rules_source,rules_note,filename,
* original_sha256,engine,generated_at}}
* rule_key ∈ {font_pt,margin,line_spacing,bib_style};
* action ∈ {modified,warning}(warning=缺插入点的保守建议,不计入已修改)。
* 纯规则引擎,同步秒回;job 落盘 → GET `${BASE}/reformat/{id}` 可回读。 */
export function reformatTex(formData, opts = {}) {
return unwrap(post(`${BASE}/reformat`, formData, opts));
}
/** P3a POST /api/review/compile(multipart:job_id 或 file 二选一,前端走 job_id)
* → {ok, compile_id, pdf_url, log_url, meta:{seconds,pdf_bytes,engine,compiled_at}}
* 错误信封:VALIDATION / TOOL_UNAVAILABLE / COMPILE_FAILED / TIMEOUT / OUTPUT_TOO_LARGE
* 为 HTTP 200 信封;QUEUE_FULL 为 HTTP 429 + 同款信封(http.js 抛非 2xx ApiError,
* 两者都归一成 ApiError)。COMPILE_FAILED/TIMEOUT 的 err.detail = log 尾 200 行。
* 编译为单槽队列,耗时约 10-30 秒(默认 60s 上限)。 */
export function compileTex(formData, opts = {}) {
return unwrap(post(`${BASE}/compile`, formData, opts));
}
/** P4 POST /api/review/compile/inspect(multipart .zip ≤50MB,两段式之①)
* → {ok, meta:{job_id, main, stats:{files,tex,images,cls,bib,other,bytes},
* skipped:[{name,reason}], skipped_count, created_at}}
* 错误信封:VALIDATION / ZIP_UNSAFE / ZIP_BOMB / ZIP_INVALID(HTTP 200)。
* job_id 1 小时 TTL;run 前不占编译队列。 */
export function inspectZip(formData, opts = {}) {
return unwrap(post(`${BASE}/compile/inspect`, formData, opts));
}
/** P4 POST /api/review/compile/run(JSON {job_id},两段式之②)
* → 与 compileTex 同构信封 {ok, compile_id, pdf_url, log_url, meta};
* pdf/log 路径带 /zip/ 前缀。失败(COMPILE_FAILED/TIMEOUT)也带 compile_id+log_url。
* QUEUE_FULL → HTTP 429(此时 job 未消费,可直接重试)。 */
export function runZipCompile(payload, opts = {}) {
return unwrap(post(`${BASE}/compile/run`, payload, opts));
}
/** ⑤ format-check 专用错误文案:解档/校验类 PARSE_FAILED/VALIDATION 用后端原话
* (与 presubmit 的"扫描件"提示是不同语境,不能复用 CODE_HINTS),其余走统一口径。 */
export function formatErrorMessage(err) {
if (err instanceof ApiError && (err.code === 'PARSE_FAILED' || err.code === 'VALIDATION') && err.message) {
return err.message;
}
return reviewErrorMessage(err);
}
/** 后端 error.code → 用户可读提示。
* null = 不覆盖、直接用后端 message(VALIDATION 入参问题后端原话更具体)。 */
const CODE_HINTS = {
VALIDATION: null,
PARSE_FAILED: '论文解析失败:可能是扫描件/图片型 PDF,请换文本型 PDF。',
UPSTREAM_DOWN: '审稿模型暂时不可用,请稍后重试。',
SEED_UNAVAILABLE: '期刊库就绪中(种子数据缺失),请稍后再试。',
TIMEOUT: '请求超时,请稍后重试。',
NETWORK: '网络异常,请检查连接后重试。',
// P3b 编译:固定口径(后端 message 带动态 pending 数,此处按规范统一为"最多 5 个")
QUEUE_FULL: '编译队列已满(最多 5 个任务),请稍后重试',
};
/** ApiError(或任意错误)→ 用户可读文案。degraded 由调用方读 err.degraded 走降级横幅样式。 */
export function reviewErrorMessage(err) {
if (err instanceof ApiError) {
const hint = CODE_HINTS[err.code];
if (hint) return hint;
if (err.message) return err.message; // VALIDATION 等:后端原话
}
return '服务异常,请稍后重试';
}
/* —— Rebuttal Phase 1(审稿回复助手,10 端点)—— */
const RB = `${BASE}/rebuttal`;
/** POST /rebuttal/jobs {text} → {ok, job, meta:{reviewers,comments}} 文本粘贴主入口 */
export function rebuttalCreateJob(text, opts = {}) {
return unwrap(post(`${RB}/jobs`, { text }, opts));
}
/** POST /rebuttal/jobs/pdf(multipart)→ 同上;PDF 次要入口(批注版审稿 PDF) */
export function rebuttalCreateFromPdf(formData, opts = {}) {
return unwrap(post(`${RB}/jobs/pdf`, formData, opts));
}
/** GET /rebuttal/jobs/{id} → {ok, job} 全量还原 */
export function rebuttalGetJob(id, opts = {}) {
return unwrap(get(`${RB}/jobs/${id}`, {}, opts));
}
/** PATCH /rebuttal/jobs/{id}/comments/{cid}/response {parts} → {ok, job} */
export function rebuttalSaveResponse(id, cid, parts, opts = {}) {
return unwrap(patch(`${RB}/jobs/${id}/comments/${cid}/response`, { parts }, opts));
}
/** POST /rebuttal/jobs/{id}/comments/{cid}/draft → {ok, job} 或校验失败
* {ok:false, error:{code:'VALIDATION_FAILED'}, job, meta:{validation}}(校验C前置)。
* 不走 unwrap:校验失败信封里 job/meta 也是有效载荷,需原样返回给面板。 */
export function rebuttalDraft(id, cid, opts = {}) {
return post(`${RB}/jobs/${id}/comments/${cid}/draft`, {}, opts).then((payload) => {
if (payload && payload.ok === false && payload.error) {
const err = new ApiError(payload.error.message || '草稿生成失败', {
code: payload.error.code || 'INTERNAL',
status: 200,
degraded: !!payload.error.degraded,
});
err.payload = payload; // 信封全量(含 job + meta.validation)
throw err;
}
return payload;
});
}
/** PATCH /rebuttal/jobs/{id}/comments/{cid}/confirm {confirmed} → {ok, job, meta.human_ack} */
export function rebuttalConfirm(id, cid, confirmed, opts = {}) {
return unwrap(patch(`${RB}/jobs/${id}/comments/${cid}/confirm`, { confirmed }, opts));
}
/** POST /rebuttal/jobs/{id}/letter → {ok, job}(job.letter_md 已拼装) */
export function rebuttalLetter(id, opts = {}) {
return unwrap(post(`${RB}/jobs/${id}/letter`, {}, opts));
}
/** GET /rebuttal/jobs/{id}/letter.md —— 纯文本下载(human_ack 门槛,非信封)。
* 返回 Promise<string>;400 时抛 ApiError(code 取自响应文本前缀)。 */
export async function rebuttalDownloadLetterMd(id) {
const resp = await fetch(`${RB}/jobs/${id}/letter.md`);
if (!resp.ok) {
const text = await resp.text().catch(() => '');
const code = text.startsWith('HUMAN_ACK_REQUIRED') ? 'HUMAN_ACK_REQUIRED' : 'DOWNLOAD_FAILED';
throw new ApiError(text || `下载失败(HTTP ${resp.status})`, { code, status: resp.status });
}
return resp.text();
}
/** DELETE /rebuttal/jobs/{id} → {ok:true, meta:{deleted}} 手动清(无 TTL) */
export function rebuttalDeleteJob(id, opts = {}) {
return unwrap(del(`${RB}/jobs/${id}`, opts));
}
+119
View File
@@ -0,0 +1,119 @@
<!-- EduSideNav.vue —— 教育科研左侧菜单(步骤4)。
7 项与 edu store SECTIONS 一致;顶部「← 返回问答」回 chat 视图
(AppShell 含 TopBar 在 edu 视图整体 display:none,此为唯一显式返回入口)。
高亮仅用现成 --pa-* 变量;无 icon 组件 → emoji。 -->
<script setup>
import { useAppStore } from '../../stores/app.js';
import { useEduStore } from '../../stores/edu.js';
const app = useAppStore();
const edu = useEduStore();
const ITEMS = [
{ key: 'journals', label: '学术期刊情报', icon: '📰' },
{ key: 'recommend', label: '智能投稿推荐', icon: '🎯' },
{ key: 'presubmit', label: 'AI 预审稿系统', icon: '🔍' },
{ key: 'report', label: '专业审稿意见报告', icon: '📝' },
{ key: 'format', label: '论文排版与规范', icon: '📐' },
{ key: 'reformat', label: '论文自动重排版', icon: '🧩' },
// SVG 内联(U+1F4AC/U+2709 在用户 Ubuntu 浏览器均无字形 → 方框;SVG 不依赖字体)
{ key: 'rebuttal', label: '审稿回复助手', icon: '<svg viewBox="0 0 16 16" width="15" height="15" fill="currentColor"><path d="M2 2h12v9H6l-4 3z"/></svg>' },
{ key: 'calendar', label: '会议与投稿日历', icon: '📅' },
];
</script>
<template>
<nav class="edu-sidenav">
<button class="back-btn" type="button" title="返回问答" @click="app.gotoChat()">
← 返回问答
</button>
<ul class="edu-menu">
<li v-for="it in ITEMS" :key="it.key">
<button
class="edu-item"
:class="{ active: edu.section === it.key }"
type="button"
:title="it.label"
@click="edu.setSection(it.key)"
>
<!-- icon 为静态白名单字符串(本文件 ITEMS 常量),SVG 项用 v-html,emoji 项纯文本 -->
<span v-if="it.icon.startsWith('<svg')" class="edu-icon" aria-hidden="true" v-html="it.icon" />
<span v-else class="edu-icon" aria-hidden="true">{{ it.icon }}</span>
<span class="edu-label">{{ it.label }}</span>
</button>
</li>
</ul>
</nav>
</template>
<style scoped>
.edu-sidenav {
display: flex;
flex-direction: column;
gap: 10px;
height: 100%;
padding: 14px 10px;
background: var(--pa-surface-1);
border-right: 1px solid var(--pa-hairline);
}
.back-btn {
display: flex;
align-items: center;
padding: 6px 10px;
border: none;
border-radius: var(--pa-r-md);
background: transparent;
color: var(--pa-ink-muted);
font-size: 12px;
cursor: pointer;
transition: color .15s var(--pa-ease), background .15s var(--pa-ease);
}
.back-btn:hover {
color: var(--pa-ink);
background: var(--pa-surface-2);
}
.edu-menu {
list-style: none;
margin: 0;
padding: 0;
display: flex;
flex-direction: column;
gap: 2px;
}
.edu-item {
width: 100%;
display: flex;
align-items: center;
gap: 8px;
padding: 8px 10px;
border: none;
border-radius: var(--pa-r-md);
background: transparent;
color: var(--pa-ink-muted);
font-size: 12.5px;
text-align: left;
cursor: pointer;
transition: color .15s var(--pa-ease), background .15s var(--pa-ease);
}
.edu-item:hover {
color: var(--pa-ink);
background: var(--pa-surface-2);
}
.edu-item.active {
color: var(--pa-ink);
font-weight: 600;
background: var(--pa-surface-2);
box-shadow: inset 2px 0 0 var(--pa-g-from);
}
.edu-icon {
flex: none;
font-size: 14px;
line-height: 1;
display: inline-flex;
align-items: center;
}
.edu-label {
min-width: 0;
line-height: 1.35;
}
</style>
+62
View File
@@ -0,0 +1,62 @@
<!-- EduWorkspace.vue —— 教育科研全屏工作台(步骤4;覆盖层语义 D1)。
App.vue 中用 v-show 挂载(始终存活,仅 display 切换):
左 200px EduSideNav + 右侧 <component :is> 按 edu.section 动态切面板。
面板进行中请求/草稿存于 edu store(面板卸载不中断、切菜单不丢)。 -->
<script setup>
import { computed } from 'vue';
import { useEduStore } from '../../stores/edu.js';
import EduSideNav from './EduSideNav.vue';
import JournalsPanel from './panels/JournalsPanel.vue';
import RecommendPanel from './panels/RecommendPanel.vue';
import PresubmitPanel from './panels/PresubmitPanel.vue';
import ReportPanel from './panels/ReportPanel.vue';
import FormatPanel from './panels/FormatPanel.vue';
import ReformatPanel from './panels/ReformatPanel.vue';
import CalendarPanel from './panels/CalendarPanel.vue';
import RebuttalPanel from './panels/RebuttalPanel.vue';
const edu = useEduStore();
/** section → 面板组件映射(与 edu store SECTIONS 一致;
* training → calendar、tracker 已解除映射(面板文件保留在 panels/ 下未删除) */
const panelMap = {
journals: JournalsPanel,
recommend: RecommendPanel,
presubmit: PresubmitPanel,
report: ReportPanel,
format: FormatPanel,
reformat: ReformatPanel,
calendar: CalendarPanel,
rebuttal: RebuttalPanel,
};
const currentPanel = computed(() => panelMap[edu.section] || JournalsPanel);
</script>
<template>
<div class="edu-workspace">
<EduSideNav class="edu-nav" />
<main class="edu-panel">
<component :is="currentPanel" />
</main>
</div>
</template>
<style scoped>
.edu-workspace {
display: flex;
height: 100vh;
background: var(--pa-canvas);
color: var(--pa-ink);
}
.edu-nav {
width: 200px;
flex: none;
}
.edu-panel {
flex: 1;
min-width: 0;
overflow: auto;
padding: 24px 28px;
}
</style>
@@ -0,0 +1,418 @@
<!-- CalendarPanel.vue —— ⑦' 会议与投稿日历(会议时间线;步骤 3.1)。
数据链:onMounted → edu.fetchConferences({domain, ccf, upcoming_days}) →
review.js getConferences() → GET /api/review/conferences
(过滤/排序在后端:domain 对 domain_tags 精确匹配、ccf ∈ A/B/C、
upcoming_days=180 窗口 / 0=不过滤;按 deadline_full_paper 升序)。
数据诚实性铁律:deadline_source=placeholder 的会议挂「⚠ 日期待核验」黄徽章,
并附 deadline_confidence 置信度(high=官方已公布/历年极稳定,medium=按历年
规律推算,low=待核验);领域标签按族着色:AI/ML 蓝 / 生物信息学 绿 /
植物·农学 黄 / 交叉·健康医疗 紫。面板不生成任何日期,倒计时仅由种子 ISO
时间与本机时钟相减得出。
倒计时色阶:≤0 灰「已结束」/ ≤7 红 / 8–30 橙 / >30 绿。
筛选为 panel-local refs(不进 store/drafts);每次进面板按当前筛选重查
(27 条静态种子,成本可忽略,保证筛选 UI 与列表一致)。
空态文案:「暂无可投会议,或数据待核验」。样式 cl- 前缀。 -->
<script setup>
import { computed, onMounted, ref } from 'vue';
import { useEduStore } from '../../../stores/edu.js';
const edu = useEduStore();
/* —— 筛选(panel-local)—— */
const domain = ref('');
const ccf = ref('');
const upcomingOnly = ref(true); // 默认开 → upcoming_days=180;关 → 0(含已过期)
const CCF_OPTIONS = ['A', 'B', 'C'];
/* 领域下拉从已加载条目累积(切筛选不清空,避免选项随过滤缩水) */
const domainOptions = ref([]);
function noteDomains(items) {
for (const c of items || []) {
for (const t of (c.domain_tags || [])) {
if (!domainOptions.value.includes(t)) domainOptions.value.push(t);
}
}
}
function reload() {
edu
.fetchConferences({
domain: domain.value,
ccf: ccf.value,
upcoming_days: upcomingOnly.value ? 180 : 0,
})
.then(noteDomains);
}
onMounted(() => {
// loading = 切菜单期间请求在飞(store 持有,不重发);其余状态按当前筛选重查
if (edu.conferencesStatus !== 'loading') reload();
else noteDomains(edu.conferences);
});
/* —— 倒计时(本机时钟计算;后端只负责窗口过滤)—— */
function countdown(iso) {
if (!iso) return { cls: 'ended', text: '日期缺失' };
const t = Date.parse(iso);
if (Number.isNaN(t)) return { cls: 'ended', text: '日期缺失' };
const d = Math.ceil((t - Date.now()) / 86400000);
if (d <= 0) return { cls: 'ended', text: '已结束' };
if (d <= 7) return { cls: 'red', text: `还有 ${d} 天` };
if (d <= 30) return { cls: 'orange', text: `还有 ${d} 天` };
return { cls: 'green', text: `还有 ${d} 天` };
}
const day = (iso) => (iso ? String(iso).slice(0, 10) : '—');
const isPlaceholder = (c) => c.deadline_source === 'placeholder';
/* —— 置信度:deadline_confidence → 中文(徽章文案/悬浮提示)—— */
const CONF_LABEL = { high: '高', medium: '中', low: '低' };
const confLabel = (v) => CONF_LABEL[String(v || '').toLowerCase()] || '—';
const confTitle = (v) =>
`deadline_source=placeholder,日期未经官方核验;置信度:${v || '—'}` +
'(high=官方已公布/历年极稳定,medium=按历年规律推算,low=待核验)';
/* —— 领域标签族着色:ai=蓝 / bio=绿 / plant=黄 / cross=紫 —— */
const DOMAIN_FAMILY = {
'AI/ML': 'ai', '深度学习': 'ai', '计算机视觉': 'ai', '自然语言处理': 'ai',
'数据挖掘': 'ai', '信息检索': 'ai',
'生物信息学': 'bio', '医学影像': 'bio',
'植物/农学': 'plant', '基因组学': 'plant', '分子生物学': 'plant',
'健康医疗': 'cross',
};
const famClass = (t) => `cl-chip--${DOMAIN_FAMILY[t] || 'ai'}`;
const appClass = (t) => (t === '交叉学科' ? 'cl-chip--cross' : 'cl-chip--app');
const count = computed(() => edu.conferences.length);
</script>
<template>
<section class="cl">
<!-- 头部 -->
<header class="cl-head">
<h1 class="cl-title">会议与投稿日历</h1>
<span v-if="edu.conferencesStatus === 'ready'" class="cl-count">共 {{ count }} 个会议</span>
</header>
<!-- 时区说明(固定一行)+ 诚实性提示 -->
<p class="cl-tz">所有时间按 AoE (UTC-12) 时区 · 未经核验的日期以 ⚠ 标注并附置信度</p>
<!-- 筛选栏 -->
<div class="cl-filters">
<label class="cl-field">
<span class="cl-field-label">领域</span>
<select v-model="domain" class="cl-select" @change="reload">
<option value="">全部领域</option>
<option v-for="d in domainOptions" :key="d" :value="d">{{ d }}</option>
</select>
</label>
<label class="cl-field">
<span class="cl-field-label">CCF</span>
<select v-model="ccf" class="cl-select" @change="reload">
<option value="">全部等级</option>
<option v-for="r in CCF_OPTIONS" :key="r" :value="r">CCF-{{ r }}</option>
</select>
</label>
<label class="cl-check">
<input v-model="upcomingOnly" type="checkbox" @change="reload" />
仅显示最近可投
</label>
</div>
<!-- ERROR -->
<div v-if="edu.conferencesStatus === 'error'" class="cl-state" role="alert">
<p class="cl-state-msg">{{ edu.conferencesError }}</p>
<button class="cl-retry" type="button" @click="reload">重试</button>
</div>
<!-- LOADING -->
<div v-else-if="edu.conferencesStatus === 'loading'" class="cl-state" aria-busy="true">
<div v-for="n in 3" :key="n" class="cl-skel"></div>
<p class="cl-state-msg">会议数据加载中…</p>
</div>
<!-- READY + 空态 -->
<div v-else-if="!edu.conferences.length" class="cl-state">
<p class="cl-state-msg">暂无可投会议,或数据待核验</p>
</div>
<!-- READY + 列表(后端已按 deadline_full_paper 升序) -->
<ul v-else class="cl-list">
<li v-for="c in edu.conferences" :key="c.id" class="cl-card">
<div class="cl-row1">
<span class="cl-name">{{ c.name }}</span>
<span v-if="c.ccf_rank" class="cl-chip cl-chip--ccf">CCF-{{ c.ccf_rank }}</span>
<span class="cl-cd" :class="`cl-cd--${countdown(c.deadline_full_paper).cls}`">
{{ countdown(c.deadline_full_paper).text }}
</span>
<span v-if="isPlaceholder(c)" class="cl-chip cl-chip--warn" :title="confTitle(c.deadline_confidence)">
⚠ 日期待核验(置信度:{{ confLabel(c.deadline_confidence) }})
</span>
</div>
<p class="cl-full">{{ c.full_name }}</p>
<div class="cl-tags">
<span v-for="t in c.domain_tags" :key="`d-${t}`" class="cl-chip cl-chip--tag" :class="famClass(t)">{{ t }}</span>
<span v-for="t in c.application_tags" :key="`a-${t}`" class="cl-chip cl-chip--tag" :class="appClass(t)">{{ t }}</span>
</div>
<dl class="cl-meta">
<div class="cl-meta-item">
<dt>截稿(摘要)</dt>
<dd>{{ day(c.deadline_abstract) }}</dd>
</div>
<div class="cl-meta-item">
<dt>截稿(全文)</dt>
<dd class="cl-deadline">{{ day(c.deadline_full_paper) }}</dd>
</div>
<div class="cl-meta-item">
<dt>通知日</dt>
<dd>{{ day(c.notification_date) }}</dd>
</div>
<div class="cl-meta-item">
<dt>会期</dt>
<dd>{{ c.conference_date || '—' }}</dd>
</div>
<div class="cl-meta-item">
<dt>地点</dt>
<dd>{{ c.location || '—' }}</dd>
</div>
<div class="cl-meta-item">
<dt>官网</dt>
<dd>
<a v-if="c.official_url" class="cl-link" :href="c.official_url" target="_blank" rel="noopener">
{{ String(c.official_url).replace(/^https?:\/\//, '').replace(/\/$/, '') }}
</a>
<span v-else>—</span>
</dd>
</div>
</dl>
</li>
</ul>
</section>
</template>
<style scoped>
.cl {
display: flex;
flex-direction: column;
gap: 10px;
}
.cl-head {
display: flex;
align-items: baseline;
gap: 10px;
}
.cl-title {
margin: 0;
font-size: 16px;
font-weight: 600;
color: var(--pa-ink);
}
.cl-count {
font-size: 12px;
color: var(--pa-ink-muted);
}
.cl-tz {
margin: 0;
font-size: 12px;
color: var(--pa-ink-subtle);
}
/* 筛选栏 */
.cl-filters {
display: flex;
flex-wrap: wrap;
align-items: center;
gap: 14px;
padding: 10px 12px;
background: var(--pa-surface-1);
border: 1px solid var(--pa-hairline);
border-radius: var(--pa-r-md);
}
.cl-field {
display: flex;
align-items: center;
gap: 6px;
}
.cl-field-label {
font-size: 12px;
color: var(--pa-ink-muted);
}
.cl-select {
padding: 4px 8px;
border: 1px solid var(--pa-hairline-strong);
border-radius: var(--pa-r-sm);
background: var(--pa-surface-2);
color: var(--pa-ink);
font-size: 12px;
}
.cl-check {
display: flex;
align-items: center;
gap: 6px;
font-size: 12px;
color: var(--pa-ink);
cursor: pointer;
user-select: none;
}
/* 状态区 */
.cl-state {
display: flex;
flex-direction: column;
gap: 8px;
padding: 14px 0;
}
.cl-state-msg {
margin: 0;
font-size: 13px;
color: var(--pa-ink-muted);
}
.cl-retry {
align-self: flex-start;
padding: 5px 14px;
border: none;
border-radius: var(--pa-r-md);
background: var(--pa-surface-2);
color: var(--pa-ink);
font-size: 12px;
cursor: pointer;
transition: background .15s var(--pa-ease);
}
.cl-retry:hover {
background: var(--pa-surface-3);
}
.cl-skel {
height: 72px;
border-radius: var(--pa-r-sm);
background: var(--pa-surface-2);
animation: cl-pulse 1.2s var(--pa-ease) infinite alternate;
}
@keyframes cl-pulse {
from { opacity: .55; }
to { opacity: 1; }
}
/* 卡片列表 */
.cl-list {
list-style: none;
margin: 0;
padding: 0;
display: flex;
flex-direction: column;
gap: 10px;
}
.cl-card {
display: flex;
flex-direction: column;
gap: 8px;
padding: 12px 14px;
background: var(--pa-surface-1);
border: 1px solid var(--pa-hairline);
border-radius: var(--pa-r-md);
}
.cl-row1 {
display: flex;
flex-wrap: wrap;
align-items: center;
gap: 8px;
}
.cl-name {
font-size: 14px;
font-weight: 600;
color: var(--pa-ink);
}
.cl-full {
margin: 0;
font-size: 12px;
color: var(--pa-ink-muted);
}
/* 徽章 */
.cl-chip {
display: inline-flex;
align-items: center;
padding: 2px 8px;
border-radius: var(--pa-r-pill);
font-size: 11px;
line-height: 1.5;
}
.cl-chip--ccf {
background: var(--pa-surface-3);
color: var(--pa-ink);
border: 1px solid var(--pa-hairline-strong);
}
.cl-chip--warn {
background: color-mix(in srgb, var(--pa-warning) 14%, transparent);
color: var(--pa-warning);
border: 1px solid color-mix(in srgb, var(--pa-warning) 45%, transparent);
font-weight: 500;
}
.cl-chip--tag {
background: var(--pa-surface-2);
color: var(--pa-ink-muted);
border: 1px solid var(--pa-hairline);
}
.cl-chip--app {
background: color-mix(in srgb, var(--pa-info) 10%, transparent);
color: var(--pa-info);
border-color: color-mix(in srgb, var(--pa-info) 35%, transparent);
}
/* 领域标签族色:ai 蓝 / bio 绿 / plant 黄 / cross 紫(置于 app 之后,交叉优先) */
.cl-chip--ai {
background: color-mix(in srgb, var(--pa-info) 12%, transparent);
color: var(--pa-info);
border-color: color-mix(in srgb, var(--pa-info) 35%, transparent);
}
.cl-chip--bio {
background: color-mix(in srgb, var(--pa-success) 14%, transparent);
color: var(--pa-success);
border-color: color-mix(in srgb, var(--pa-success) 40%, transparent);
}
.cl-chip--plant {
background: color-mix(in srgb, var(--pa-warning) 14%, transparent);
color: var(--pa-warning);
border-color: color-mix(in srgb, var(--pa-warning) 40%, transparent);
}
.cl-chip--cross {
background: color-mix(in srgb, #7c5cbf 14%, transparent);
color: #7c5cbf;
border-color: color-mix(in srgb, #7c5cbf 40%, transparent);
}
/* 倒计时色阶:≤0 灰 / ≤7 红 / 8–30 橙 / >30 绿 */
.cl-cd {
font-family: var(--pa-font-mono);
font-size: 12.5px;
font-weight: 600;
}
.cl-cd--red { color: var(--pa-error); }
.cl-cd--orange { color: var(--pa-warning); }
.cl-cd--green { color: var(--pa-success); }
.cl-cd--ended { color: var(--pa-ink-muted); }
/* 元信息网格 */
.cl-meta {
margin: 0;
display: grid;
grid-template-columns: repeat(auto-fit, minmax(140px, 1fr));
gap: 6px 14px;
}
.cl-meta-item dt {
font-size: 11px;
color: var(--pa-ink-subtle);
}
.cl-meta-item dd {
margin: 0;
font-size: 12.5px;
color: var(--pa-ink);
}
.cl-deadline {
font-family: var(--pa-font-mono);
font-weight: 600;
}
.cl-link {
color: var(--pa-g-from);
text-decoration: none;
}
.cl-link:hover {
text-decoration: underline;
}
</style>
@@ -0,0 +1,495 @@
<!-- FormatPanel.vue —— ⑤ 论文排版与规范(④ 后端规则引擎前端)。
链路:本地 PDF/Word/LaTeX(form-data)→ edu.submitFormatCheck →
POST /api/review/format-check(file + target_journal=期刊id,纯规则 <1s)
→ {ok, checks[{key,name,status,detail,suggestion}], summary{pass,warn,fail},
meta{filename,file_type,pages,ruleset_source,rules_source,journal_*,
refs_style_*,tex{class,fontsize_pt,paper,packages,cites,macros}}}
(真实响应结构写入前已 curl 8100 实测:PDF/Word/LaTeX 三类型 + 错误信封)。
LaTeX:detail 中含 "\n建议:\n" 标记时拆分为 正文 + <pre class="fc-code"> 代码块
(只展示建议片段,不自动改写)。
优先级:formatReport 存在 → 结果区(不退回上传区);否则 loading > error > 上传区。
rules_source="placeholder" → 结果区顶部黄字提示(诚实展示占位规则)。
结果跨菜单保留(store formatReport);期刊下拉草稿 drafts.formatJournalId;
文件为面板本地 ref。样式 fc- 前缀。 -->
<script setup>
import { computed, onMounted, ref } from 'vue';
import { useEduStore } from '../../../stores/edu.js';
const edu = useEduStore();
const MAX_SIZE = 50 * 1024 * 1024;
const STATUS_LABEL = { pass: '通过', warn: '警告', fail: '不通过' };
const FILE_LABEL = { pdf: 'PDF', docx: 'Word', tex: 'LaTeX' };
const DETAIL_CODE_MARKER = '\n建议:\n'; // 后端 LaTeX 建议片段统一标记
const fileInput = ref(null);
const file = ref(null);
const fileError = ref('');
const dragging = ref(false);
const hasReport = computed(() => !!(edu.formatReport && edu.formatReport.ok));
const loading = computed(() => edu.formatStatus === 'loading');
const errored = computed(() => edu.formatStatus === 'error');
const report = computed(() => edu.formatReport || null);
const meta = computed(() => edu.formatReport?.meta || null);
const summary = computed(() => edu.formatReport?.summary || { pass: 0, warn: 0, fail: 0 });
const checks = computed(() => edu.formatReport?.checks || []);
const placeholderRules = computed(() => meta.value?.rules_source === 'placeholder');
const fmtSize = (b) => (b / 1048576).toFixed(1) + ' MB';
/** detail 按 "\n建议:\n" 拆成 正文 + LaTeX 代码片段(无标记则整段为正文) */
function splitDetail(detail) {
const text = String(detail || '');
const i = text.indexOf(DETAIL_CODE_MARKER);
if (i < 0) return { text, code: '' };
return { text: text.slice(0, i), code: text.slice(i + DETAIL_CODE_MARKER.length) };
}
onMounted(() => {
if (edu.journalsStatus === 'idle') edu.fetchJournals(); // 目标期刊下拉数据源
});
function acceptFile(f) {
fileError.value = '';
if (!f) return;
const name = String(f.name || '').toLowerCase();
if (!name.endsWith('.pdf') && !name.endsWith('.docx') && !name.endsWith('.tex')) {
fileError.value = '仅支持 PDF / Word(.docx)/ LaTeX(.tex)文件';
return;
}
if (!f.size) {
fileError.value = '上传文件为空';
return;
}
if (f.size > MAX_SIZE) {
fileError.value = '上传文件超过 50MB 上限';
return;
}
file.value = f;
}
function onPick(e) {
acceptFile(e.target.files?.[0]);
e.target.value = '';
}
function onDrop(e) {
dragging.value = false;
acceptFile(e.dataTransfer?.files?.[0]);
}
function removeFile() {
file.value = null;
}
async function submit() {
if (!file.value || loading.value) return;
const fd = new FormData();
fd.append('file', file.value);
fd.append('target_journal', edu.drafts.formatJournalId || ''); // 期刊 id;空=通用规则
await edu.submitFormatCheck(fd);
}
function reset() {
edu.clearFormatReport();
file.value = null;
fileError.value = '';
}
</script>
<template>
<section class="fc">
<header class="fc-head">
<h1 class="fc-title">论文排版与规范</h1>
<span class="fc-sub">PDF / Word / LaTeX · 页数·字体·边距·行距·图表·参考文献</span>
</header>
<!-- ========== ① 有结果 → 结果区(最高优先级) ========== -->
<template v-if="hasReport">
<p v-if="placeholderRules" class="fc-placeholder" role="note">
⚠ 格式规则基于占位数据,建议核对期刊官网投稿指南
</p>
<div class="fc-meta">
📄 {{ meta?.filename || '—' }} · {{ FILE_LABEL[meta?.file_type] || meta?.file_type }} ·
{{ meta?.ruleset_source === 'journal' ? meta?.journal_name : '通用规则' }} ·
{{ meta?.pages != null ? `共 ${meta?.pages} 页` : '页数未记录' }}
<span class="fc-meta-sub">
· 参考文献要求 {{ meta?.refs_style_expected }} / 检出 {{ meta?.refs_style_detected }}
</span>
</div>
<!-- 汇总条 -->
<div class="fc-summary">
<span class="fc-count pass">{{ summary.pass }} 项通过</span>
<span class="fc-count warn">{{ summary.warn }} 项警告</span>
<span class="fc-count fail">{{ summary.fail }} 项不通过</span>
<button class="fc-again" type="button" @click="reset">重新检查</button>
</div>
<!-- 逐项检查卡 -->
<article v-for="c in checks" :key="c.key" class="fc-card" :class="c.status">
<span class="fc-badge" :class="c.status">{{ STATUS_LABEL[c.status] || c.status }}</span>
<div class="fc-card-body">
<div class="fc-card-name">{{ c.name }}</div>
<p class="fc-card-detail">{{ splitDetail(c.detail).text }}</p>
<pre v-if="splitDetail(c.detail).code" class="fc-code">{{ splitDetail(c.detail).code }}</pre>
<p v-if="c.suggestion" class="fc-card-sug">建议:{{ c.suggestion }}</p>
</div>
</article>
</template>
<!-- ========== ② loading ========== -->
<div v-else-if="loading" class="fc-state" aria-busy="true">
<div class="fc-skel"></div>
<div class="fc-skel fc-skel-mid"></div>
<p class="fc-state-msg">版式检查中…(纯规则,通常 &lt;1 秒)</p>
</div>
<!-- ========== ③ error ========== -->
<div v-else-if="errored" class="fc-state" role="alert">
<p class="fc-state-msg fc-state-error">{{ edu.formatError }}</p>
<div class="fc-err-btns">
<button v-if="file" class="fc-retry" type="button" @click="submit">重试</button>
<button class="fc-retry" type="button" @click="reset">重新选择文件</button>
</div>
</div>
<!-- ========== ④ 上传区 ========== -->
<div v-else class="fc-upload">
<div
class="fc-drop"
:class="{ dragging, filled: !!file }"
role="button"
tabindex="0"
@click="fileInput.click()"
@keydown.enter="fileInput.click()"
@dragover.prevent="dragging = true"
@dragleave.prevent="dragging = false"
@drop.prevent="onDrop"
>
<input
ref="fileInput"
class="fc-file-input"
type="file"
accept=".pdf,.docx,.tex,application/pdf,application/vnd.openxmlformats-officedocument.wordprocessingml.document"
@click.stop
@change="onPick"
/>
<template v-if="file">
<span class="fc-file-name">📄 {{ file.name }} · {{ fmtSize(file.size) }}</span>
<button class="fc-remove" type="button" title="移除文件" @click.stop="removeFile">×</button>
</template>
<template v-else>
<span class="fc-drop-main">拖拽 PDF / Word(.docx) / LaTeX(.tex) 到此处,或点击选择</span>
<span class="fc-hint">仅支持 PDF / Word(.docx) / LaTeX(.tex) · ≤ 50MB · 纯本地规则检查</span>
</template>
</div>
<p v-if="fileError" class="fc-file-error">{{ fileError }}</p>
<label class="fc-label" for="fc-journal">目标期刊(选填,决定规则集)</label>
<select
id="fc-journal"
v-model="edu.drafts.formatJournalId"
class="fc-input fc-select"
:disabled="loading"
>
<option value="">不指定(通用规则)</option>
<option v-for="j in edu.journals" :key="j.id" :value="j.id">{{ j.name }}</option>
</select>
<button class="fc-submit" type="button" :disabled="!file || loading" @click="submit">
开始版式检查
</button>
</div>
</section>
</template>
<style scoped>
.fc {
display: flex;
flex-direction: column;
gap: 12px;
}
.fc-head {
display: flex;
align-items: baseline;
gap: 10px;
}
.fc-title {
margin: 0;
font-size: 16px;
font-weight: 600;
color: var(--pa-ink);
}
.fc-sub {
font-size: 12px;
color: var(--pa-ink-subtle);
}
/* 占位规则黄字提示(仅 rules_source=placeholder 时渲染) */
.fc-placeholder {
margin: 0;
padding: 8px 12px;
border: 1px solid var(--pa-warning);
border-radius: var(--pa-r-md);
background: transparent;
color: var(--pa-warning);
font-size: 12.5px;
}
.fc-meta {
font-size: 12.5px;
color: var(--pa-ink-muted);
}
.fc-meta-sub {
color: var(--pa-ink-subtle);
}
/* 汇总条 */
.fc-summary {
display: flex;
align-items: center;
gap: 10px;
flex-wrap: wrap;
}
.fc-count {
padding: 3px 12px;
border: 1px solid currentColor;
border-radius: var(--pa-r-pill);
font-size: 12.5px;
font-weight: 600;
}
.fc-count.pass { color: var(--pa-success); }
.fc-count.warn { color: var(--pa-warning); }
.fc-count.fail { color: var(--pa-error); }
.fc-again {
margin-left: auto;
padding: 5px 14px;
border: 1px solid var(--pa-hairline);
border-radius: var(--pa-r-md);
background: transparent;
color: var(--pa-ink-muted);
font-size: 12px;
cursor: pointer;
}
.fc-again:hover {
color: var(--pa-ink);
background: var(--pa-surface-2);
}
/* 检查卡 */
.fc-card {
display: flex;
gap: 12px;
padding: 12px 14px;
background: var(--pa-surface-1);
border: 1px solid var(--pa-hairline);
border-left-width: 3px;
border-radius: var(--pa-r-md);
}
.fc-card.pass { border-left-color: var(--pa-success); }
.fc-card.warn { border-left-color: var(--pa-warning); }
.fc-card.fail { border-left-color: var(--pa-error); }
.fc-badge {
flex: none;
align-self: flex-start;
min-width: 52px;
text-align: center;
padding: 2px 9px;
border: 1px solid currentColor;
border-radius: var(--pa-r-pill);
font-size: 11.5px;
font-weight: 700;
}
.fc-badge.pass { color: var(--pa-success); }
.fc-badge.warn { color: var(--pa-warning); }
.fc-badge.fail { color: var(--pa-error); }
.fc-card-body {
display: flex;
flex-direction: column;
gap: 5px;
min-width: 0;
}
.fc-card-name {
font-size: 13.5px;
font-weight: 600;
color: var(--pa-ink);
}
.fc-card-detail {
margin: 0;
font-family: var(--pa-font-mono);
font-size: 12.5px;
line-height: 1.65;
color: var(--pa-ink-muted);
word-break: break-word;
}
.fc-card-sug {
margin: 0;
font-size: 12.5px;
line-height: 1.6;
color: var(--pa-ink);
}
/* LaTeX 建议代码片段(detail 中 "建议:" 标记后的部分):等宽 + 灰底块 */
.fc-code {
margin: 0;
padding: 8px 12px;
background: var(--pa-code-bg);
border: 1px solid var(--pa-hairline);
border-radius: var(--pa-r-sm);
font-family: var(--pa-font-mono);
font-size: 12.5px;
line-height: 1.65;
color: var(--pa-ink);
white-space: pre-wrap;
word-break: break-word;
overflow-x: auto;
}
/* 状态区 */
.fc-state {
display: flex;
flex-direction: column;
gap: 10px;
}
.fc-skel {
height: 64px;
border-radius: var(--pa-r-md);
background: var(--pa-surface-2);
animation: fc-pulse 1.2s var(--pa-ease) infinite alternate;
}
.fc-skel-mid {
height: 96px;
}
@keyframes fc-pulse {
from { opacity: .55; }
to { opacity: 1; }
}
.fc-state-msg {
margin: 0;
font-size: 13px;
color: var(--pa-ink-muted);
}
.fc-state-error {
color: var(--pa-error);
}
.fc-err-btns {
display: flex;
gap: 10px;
}
.fc-retry {
padding: 5px 14px;
border: none;
border-radius: var(--pa-r-md);
background: var(--pa-surface-2);
color: var(--pa-ink);
font-size: 12px;
cursor: pointer;
}
.fc-retry:hover {
background: var(--pa-surface-3);
}
/* 上传区 */
.fc-upload {
display: flex;
flex-direction: column;
gap: 10px;
}
.fc-drop {
position: relative;
display: flex;
flex-direction: column;
align-items: center;
justify-content: center;
gap: 6px;
min-height: 130px;
padding: 18px;
border: 1.5px dashed var(--pa-hairline-strong);
border-radius: var(--pa-r-lg);
background: var(--pa-surface-1);
cursor: pointer;
transition: border-color .15s var(--pa-ease), background .15s var(--pa-ease);
}
.fc-drop:hover,
.fc-drop.dragging {
border-color: var(--pa-g-from);
background: var(--pa-surface-2);
}
.fc-drop.filled {
border-style: solid;
}
.fc-file-input {
display: none;
}
.fc-drop-main {
font-size: 13.5px;
color: var(--pa-ink);
}
.fc-hint {
font-size: 12px;
color: var(--pa-ink-subtle);
}
.fc-file-name {
font-size: 13.5px;
color: var(--pa-ink);
word-break: break-all;
}
.fc-remove {
position: absolute;
top: 8px;
right: 10px;
width: 22px;
height: 22px;
border: none;
border-radius: 50%;
background: var(--pa-surface-3);
color: var(--pa-ink-muted);
font-size: 15px;
line-height: 1;
cursor: pointer;
}
.fc-remove:hover {
color: var(--pa-ink);
}
.fc-file-error {
margin: 0;
font-size: 12.5px;
color: var(--pa-error);
}
.fc-label {
font-size: 12px;
font-weight: 500;
color: var(--pa-ink-muted);
}
.fc-input {
width: 320px;
max-width: 100%;
box-sizing: border-box;
padding: 7px 11px;
border: 1px solid var(--pa-hairline);
border-radius: var(--pa-r-md);
background: var(--pa-surface-2);
color: var(--pa-ink);
font-size: 13px;
font-family: inherit;
}
.fc-input:focus {
outline: none;
border-color: var(--pa-g-from);
}
.fc-select:disabled {
opacity: .6;
}
.fc-submit {
align-self: flex-start;
padding: 8px 22px;
border: none;
border-radius: var(--pa-r-md);
background: var(--pa-gradient);
color: #fff;
font-size: 13px;
font-weight: 600;
cursor: pointer;
}
.fc-submit:disabled {
opacity: .45;
cursor: not-allowed;
}
</style>
@@ -0,0 +1,779 @@
<!-- JournalsPanel.vue —— ① 学术期刊情报(步骤5 目录化改造,D2 严格只读)。
数据链:onMounted → edu.fetchDirectory() → review.js getDirectory()
→ GET /api/review/journals/directory(相对路径 → vite proxy → BFF → 8100)。
双 Tab 强制单语(🌍 en 779 本 / 🇨🇳 zh 277 本,后端 lang 过滤保证永不混排);
搜索/研究方向/分区筛选 + 后端分页(每页 50)+ 行展开详情 + 四态
(loading 骨架 / error 重试 / 未导入 / 无匹配)。
v4 改造(决策2):主视图「来源」列移除,末列为「官网」列——official_url 有值
→ <a>短域名(去协议+去尾斜杠)</a>,null → 「—」纯文本不生成链接;
展开行承载凭证 4 项:JIF核对状态 / 官网核对状态(可靠=绿、未逐站复核=浅绿、
未检得·待核实=橙)/ JIF数据来源链接 / 分区数据来源链接;zh 展开行无 JCR 字段
(jcr_release_year 恒 null,年报版本年 metric_report_year 单独展示)。
底部固定表C长版数据源声明;顶部黄字按 Tab 切换(en/zh 两套口径)。
三态与 journals(FormatPanel 下拉的 5 本精选)完全隔离,edu.journals 链路零改动。
读时归一化由后端承担:zh cas_partition 恒 null + note、jif_note 两类文案、
缺值 source 归零(前端只管展示 tooltip/链接)。 -->
<script setup>
import { computed, onMounted, onUnmounted, ref } from 'vue';
import { useEduStore } from '../../../stores/edu.js';
const edu = useEduStore();
/* —— panel-local 纯视图态(丢弃无妨;查询条件在 store)—— */
const searchInput = ref(''); // 输入框即时值(300ms 防抖后才进 store)
const expandedId = ref(''); // 展开详情的期刊 id('' = 无)
const jumpInput = ref(''); // 跳页输入
let searchTimer = null;
const tab = computed(() => edu.journalsTab);
const q = computed(() => edu.directoryQuery);
/* 数据源声明:meta 到达且 lang 匹配 → 服务端文案;否则本地兜底(切 Tab 即时切换)。
顶部黄字按 Tab 切换;底部另有表C长版统一声明(FOOT_NOTE,双 Tab 相同)。 */
const LOCAL_NOTE = {
en: '分区:2025年中科院公开表(多表比对,2026年起停更);JIF:2025年度指标(2026年JCR发布,两份公开汇编一致或已核对出版社官方指标);整理日期2026-10-10;空白=来源未给值≠0',
zh: '指标:国内自然科学期刊年报2025版(统计年2024,与JIF统计源不同、不混排);中文期刊不按中科院分区口径列示',
};
/* 底部数据源声明(表C 长版,拍板决策3;末尾补来源口径说明) */
const FOOT_NOTE =
'JIF 取自 2025 年度指标(2026 年 JCR 发布)并经两份公开汇编交叉一致或出版社官方指标核对,' +
'中科院分区采用 2025 版公开表(多表比对、2026 年起停更),' +
'中文期刊复合/综合影响因子取自国内年报 2025 版(统计年 2024,与 JIF 统计源不同、不混排),' +
'期刊官网均附核对状态(3 本中文刊未检得可靠官网留空待核实)。' +
'分区为高校转载版,官方入口需机构登录;JIF/中文数据为公开汇编镜像,仅供参考核对。';
/* —— 凭证状态配色:可靠=绿 / 未逐站复核=浅绿 / 未检得·待核实=橙 —— */
const JIF_OK = new Set(['两份公开汇编一致', '已核对出版社2025指标']);
const URL_OK = new Set([
'出版社/期刊主页匹配',
'期刊/主办方官方入口匹配',
'期刊/出版平台页面检索核对',
]);
const URL_SOFT = 'ISSN匹配公开元数据;未逐站复核';
function checkCls(v, okSet) {
if (!v) return '';
if (okSet.has(v)) return 'jp-ok';
if (v === URL_SOFT) return 'jp-ok-soft';
if (v.includes('未检得') || v.includes('待核实')) return 'jp-warn';
return '';
}
const sourceNote = computed(() =>
edu.directoryMeta && edu.directoryMeta.lang === tab.value
? edu.directoryMeta.data_source_note
: LOCAL_NOTE[tab.value]
);
const countText = computed(() =>
edu.directoryMeta && edu.directoryMeta.lang === tab.value
? edu.directoryMeta.total
: '—'
);
/* 研究方向 options(只认当前 lang 的 meta,防切 Tab 后旧词表残留) */
const domains = computed(() =>
edu.directoryMeta && edu.directoryMeta.lang === tab.value ? edu.directoryMeta.domains : []
);
const total = computed(() => edu.directoryMeta?.total ?? 0);
const totalPages = computed(() => Math.ceil(total.value / q.value.size) || 1);
const hasFilter = computed(
() => !!(q.value.q || q.value.domain || q.value.cas_partition)
);
/* 排序游标:后端默认(en=jif desc / zh=复合IF desc)在 field='' 时生效,箭头如实回显 */
const activeSort = computed(() => ({
field: q.value.field || (tab.value === 'en' ? 'jif' : 'composite_impact_factor'),
order: q.value.order || 'desc',
}));
const CAS_OPTIONS = ['1', '2', '3', '4'];
/* —— 交互 —— */
function onTab(next) {
if (next === tab.value) return;
clearTimeout(searchTimer);
searchInput.value = '';
jumpInput.value = '';
expandedId.value = '';
edu.switchDirectoryTab(next);
}
function onSearchInput() {
clearTimeout(searchTimer);
searchTimer = setTimeout(() => {
edu.fetchDirectory({ q: searchInput.value.trim(), page: 1 });
expandedId.value = '';
}, 300);
}
function onDomainChange(e) {
edu.fetchDirectory({ domain: e.target.value, page: 1 });
expandedId.value = '';
}
function onCasChange(e) {
edu.fetchDirectory({ cas_partition: e.target.value, page: 1 });
expandedId.value = '';
}
function clearFilters() {
clearTimeout(searchTimer);
searchInput.value = '';
edu.fetchDirectory({ q: '', domain: '', cas_partition: '', page: 1 });
expandedId.value = '';
}
function gotoPage(p) {
const n = Math.min(Math.max(1, p), totalPages.value);
if (n === q.value.page) return;
expandedId.value = '';
edu.fetchDirectory({ page: n });
}
function jumpPage() {
const n = parseInt(jumpInput.value, 10);
jumpInput.value = '';
if (Number.isNaN(n)) return;
gotoPage(n);
}
function retry() {
edu.fetchDirectory();
}
function toggleExpand(id) {
expandedId.value = expandedId.value === id ? '' : id;
}
function toggleSort(field) {
const cur = activeSort.value;
if (cur.field === field) {
// 同列切换升/降(不重置页码:total 不变,当前页仍有效)
edu.fetchDirectory({ field, order: cur.order === 'asc' ? 'desc' : 'asc' });
} else {
edu.fetchDirectory({ field, order: field === 'name' ? 'asc' : 'desc' });
}
}
const arrow = (f) => (activeSort.value.field === f ? (activeSort.value.order === 'asc' ? '▲' : '▼') : '');
const fmt = (v) => (v === null || v === undefined ? '—' : v);
const fmtIf = (v, year) => (v === null || v === undefined ? '—' : year ? `${v} (${year})` : `${v}`);
const shortUrl = (u) => String(u || '').replace(/^https?:\/\//, '').replace(/\/$/, '') || '—';
onMounted(() => {
// idle 才查:ready 复用 store 缓存(切菜单回来筛选仍在);error 不自动重试防循环
if (edu.directoryStatus === 'idle') edu.fetchDirectory();
});
onUnmounted(() => clearTimeout(searchTimer));
</script>
<template>
<section class="jp">
<!-- 头部:标题 + 共 N 本(meta 与当前 Tab 匹配才回显,防切 Tab 瞬间旧计数) -->
<header class="jp-head">
<h1 class="jp-title">学术期刊情报</h1>
<span class="jp-count">共 {{ countText }} 本</span>
</header>
<!-- 诚实性声明(黄字;两套口径按 Tab 切换) -->
<p class="jp-note jp-note--warn">{{ sourceNote }}</p>
<!-- Tab:🌍 国际 / 🇨🇳 中文(切换全清筛选) -->
<nav class="jp-tabs" role="tablist">
<button
class="jp-tab"
:class="{ on: tab === 'en' }"
type="button"
role="tab"
:aria-selected="tab === 'en'"
@click="onTab('en')"
>🌍 国际期刊</button>
<button
class="jp-tab"
:class="{ on: tab === 'zh' }"
type="button"
role="tab"
:aria-selected="tab === 'zh'"
@click="onTab('zh')"
>🇨🇳 中文期刊</button>
</nav>
<!-- 搜索(防抖 300ms → q + page=1) -->
<div class="jp-tools">
<input
v-model="searchInput"
class="jp-search"
type="search"
placeholder="搜索期刊名(如 Nature、Plant Cell)"
@input="onSearchInput"
>
</div>
<!-- 筛选栏(domains 来自当前 lang 的 meta;分区下拉仅 en) -->
<div v-if="domains.length" class="jp-filters">
<div class="jp-fgroup">
<span class="jp-flabel">研究方向</span>
<select class="jp-select" :value="q.domain" @change="onDomainChange">
<option value="">全部</option>
<option v-for="d in domains" :key="d" :value="d">{{ d }}</option>
</select>
</div>
<div v-if="tab === 'en'" class="jp-fgroup">
<span class="jp-flabel">分区</span>
<select class="jp-select" :value="q.cas_partition" @change="onCasChange">
<option value="">全部</option>
<option v-for="p in CAS_OPTIONS" :key="p" :value="p">{{ p }}区</option>
</select>
</div>
<button v-if="hasFilter" class="jp-clear" type="button" @click="clearFilters">清除筛选</button>
</div>
<!-- ERROR:directory 三态独立于 journals;reviewErrorMessage 已映射 -->
<div v-if="edu.directoryStatus === 'error'" class="jp-state" role="alert">
<p class="jp-state-msg">{{ edu.directoryError }}</p>
<button class="jp-retry" type="button" @click="retry">重试</button>
</div>
<!-- LOADING:骨架行 -->
<div v-else-if="edu.directoryStatus === 'loading'" class="jp-state" aria-busy="true">
<div class="jp-skel-head"></div>
<div v-for="n in 6" :key="n" class="jp-skel-row"></div>
<p class="jp-state-msg">期刊目录加载中…</p>
</div>
<!-- 空态 A:未导入(data_imported=false,HTTP 200 优雅降级路径) -->
<div v-else-if="edu.directoryMeta && edu.directoryMeta.data_imported === false" class="jp-state">
<p class="jp-state-msg">目录数据未导入(需先运行 review_service/scripts/import_journals.py)</p>
</div>
<!-- 空态 B:有筛选 → 无匹配(≠ 无数据) -->
<div v-else-if="!edu.directory.length && hasFilter" class="jp-state">
<p class="jp-state-msg">无匹配结果,可清除筛选后重试</p>
<button class="jp-retry" type="button" @click="clearFilters">清除筛选</button>
</div>
<!-- 空态 C:兜底(已导入但整表为空) -->
<div v-else-if="!edu.directory.length" class="jp-state">
<p class="jp-state-msg">暂无期刊数据</p>
</div>
<!-- READY + 表格(写交互 = 筛选/排序重查 + 分页 + 行展开;en/zh 各 5 列,末列官网) -->
<table v-else class="jp-table">
<thead>
<tr v-if="tab === 'en'">
<th class="jp-th-sort jp-c-name" :class="{ on: activeSort.field === 'name' }" @click="toggleSort('name')">
期刊名 <span class="jp-arrow">{{ arrow('name') }}</span>
</th>
<th class="jp-th-sort jp-c-dir" :class="{ on: activeSort.field === 'research_direction' }" @click="toggleSort('research_direction')">
研究方向 <span class="jp-arrow">{{ arrow('research_direction') }}</span>
</th>
<th class="jp-th-sort jp-c-part" :class="{ on: activeSort.field === 'cas_partition' }" @click="toggleSort('cas_partition')">
分区 <span class="jp-arrow">{{ arrow('cas_partition') }}</span>
</th>
<th class="jp-th-sort jp-c-jif" :class="{ on: activeSort.field === 'jif' }" @click="toggleSort('jif')">
JIF <span class="jp-arrow">{{ arrow('jif') }}</span>
</th>
<th class="jp-c-url">官网</th>
</tr>
<tr v-else>
<th class="jp-th-sort jp-c-name" :class="{ on: activeSort.field === 'name' }" @click="toggleSort('name')">
期刊名 <span class="jp-arrow">{{ arrow('name') }}</span>
</th>
<th class="jp-th-sort jp-c-dir" :class="{ on: activeSort.field === 'research_direction' }" @click="toggleSort('research_direction')">
研究方向 <span class="jp-arrow">{{ arrow('research_direction') }}</span>
</th>
<th class="jp-th-sort jp-c-comp" :class="{ on: activeSort.field === 'composite_impact_factor' }" @click="toggleSort('composite_impact_factor')">
复合IF <span class="jp-arrow">{{ arrow('composite_impact_factor') }}</span>
</th>
<th class="jp-th-sort jp-c-compr" :class="{ on: activeSort.field === 'comprehensive_impact_factor' }" @click="toggleSort('comprehensive_impact_factor')">
综合IF <span class="jp-arrow">{{ arrow('comprehensive_impact_factor') }}</span>
</th>
<th class="jp-c-url">官网</th>
</tr>
</thead>
<tbody>
<template v-for="j in edu.directory" :key="j.id">
<tr class="jp-row" :class="{ open: expandedId === j.id }" @click="toggleExpand(j.id)">
<!-- en:期刊名 / 研究方向 / 分区 / JIF(年) / 官网 -->
<template v-if="tab === 'en'">
<td class="jp-name jp-c-name">{{ j.name }}</td>
<td class="jp-c-dir">{{ j.research_direction || '—' }}</td>
<td class="jp-part jp-c-part">{{ j.cas_partition || '—' }}</td>
<td class="jp-num jp-c-jif" :title="j.jif_note || ''">
{{ fmtIf(j.jif, j.jif_year) }}
</td>
<td class="jp-c-url">
<a v-if="j.official_url" class="jp-link" :href="j.official_url" target="_blank" rel="noopener" @click.stop>{{ shortUrl(j.official_url) }}</a>
<span v-else class="jp-dash">—</span>
</td>
</template>
<!-- zh:期刊名 / 研究方向 / 复合IF(统计年) / 综合IF / 官网 -->
<template v-else>
<td class="jp-name jp-c-name">{{ j.name }}</td>
<td class="jp-c-dir">{{ j.research_direction || '—' }}</td>
<td class="jp-num jp-c-comp" :title="j.jif_note || ''">{{ fmtIf(j.composite_impact_factor, j.metric_year) }}</td>
<td class="jp-num jp-c-compr">{{ fmt(j.comprehensive_impact_factor) }}</td>
<td class="jp-c-url">
<a v-if="j.official_url" class="jp-link" :href="j.official_url" target="_blank" rel="noopener" @click.stop>{{ shortUrl(j.official_url) }}</a>
<span v-else class="jp-dash">—</span>
</td>
</template>
</tr>
<!-- 展开行(两 Tab 均 5 列) -->
<tr v-if="expandedId === j.id" class="jp-xp-row">
<td colspan="5">
<!-- en 详情:年份/状态/凭证链接 -->
<div v-if="tab === 'en'" class="jp-xp">
<div class="jp-xp-group">
<span class="jp-xp-label">分区年</span><span class="jp-xp-val">{{ fmt(j.cas_partition_year) }}</span>
<span class="jp-xp-label">JIF年</span><span class="jp-xp-val">{{ fmt(j.jif_year) }}</span>
<span class="jp-xp-label">JIF核对状态</span><span class="jp-xp-val" :class="checkCls(j.jif_check_status, JIF_OK)">{{ j.jif_check_status || '—' }}</span>
<span class="jp-xp-label">Top</span><span class="jp-xp-val">{{ j.top_flag || '—' }}</span>
</div>
<div class="jp-xp-group">
<span class="jp-xp-label">官网核对</span><span class="jp-xp-val" :class="checkCls(j.official_check_status, URL_OK)">{{ j.official_check_status || '—' }}</span>
<span class="jp-xp-label">JCR发布年</span><span class="jp-xp-val">{{ fmt(j.jcr_release_year) }}</span>
</div>
<div class="jp-xp-group">
<span class="jp-xp-label">出版系列</span><span class="jp-xp-val">{{ j.publisher_series || '—' }}</span>
<span class="jp-xp-label">期刊标记</span><span class="jp-xp-val">{{ j.journal_mark || '—' }}</span>
<span class="jp-xp-label">文章类型</span><span class="jp-xp-val">{{ j.article_type || '—' }}</span>
</div>
<div class="jp-xp-group">
<span class="jp-xp-label">ISSN</span>
<span class="jp-xp-val jp-mono">{{ j.issn || '—' }}<template v-if="j.eissn"> · eISSN {{ j.eissn }}</template></span>
</div>
<div class="jp-xp-group">
<span class="jp-xp-label">JCR学科</span>
<span v-for="d in j.jcr_disciplines || []" :key="d" class="jp-chip on">{{ d }}</span>
<span v-if="!(j.jcr_disciplines || []).length" class="jp-dash">—</span>
</div>
<div class="jp-xp-group">
<span class="jp-xp-label">来源</span>
<template v-if="j.jif_source_url">
<a class="jp-link" :href="j.jif_source_url" target="_blank" rel="noopener" @click.stop>
JIF来源:{{ shortUrl(j.jif_source_url) }}
</a>
<span class="jp-src-note">(汇编镜像,官方入口需机构订阅)</span>
</template>
<span v-else class="jp-dash">JIF来源:无</span>
<span class="jp-src-note">分区来源:{{ j.partition_source_note }}</span>
</div>
</div>
<!-- zh 详情:年报口径指标 + 不可混排黄字 -->
<div v-else class="jp-xp">
<div class="jp-xp-group">
<span class="jp-xp-label">复合IF</span><span class="jp-xp-val jp-mono">{{ fmt(j.composite_impact_factor) }}</span>
<span class="jp-xp-label">综合IF</span><span class="jp-xp-val jp-mono">{{ fmt(j.comprehensive_impact_factor) }}</span>
<span class="jp-xp-label">统计年</span><span class="jp-xp-val">{{ fmt(j.metric_year) }}</span>
</div>
<div class="jp-xp-group">
<span class="jp-xp-label">年报版本</span><span class="jp-xp-val">{{ j.metric_report_year ? `${j.metric_report_year}版` : '—' }}</span>
<span class="jp-xp-label">年报页码</span><span class="jp-xp-val">{{ j.annual_report_page ? `第${j.annual_report_page}页` : '—' }}</span>
<span class="jp-xp-label">核对状态</span><span class="jp-xp-val" :class="checkCls(j.jif_check_status, JIF_OK)">{{ j.jif_check_status || '—' }}</span>
</div>
<div class="jp-xp-group">
<span class="jp-xp-label">官网核对</span><span class="jp-xp-val" :class="checkCls(j.official_check_status, URL_OK)">{{ j.official_check_status || '—' }}</span>
</div>
<div class="jp-xp-group">
<span class="jp-xp-label">指标口径</span><span class="jp-xp-val">{{ j.metric_caliber || '—' }}</span>
</div>
<div class="jp-xp-group">
<span class="jp-xp-label">来源</span>
<template v-if="j.data_source_url">
<a class="jp-link" :href="j.data_source_url" target="_blank" rel="noopener" @click.stop>
年报原页:{{ shortUrl(j.data_source_url) }}
</a>
<span class="jp-src-note">(国内自然科学期刊年报 2025 版)</span>
</template>
<span v-else class="jp-dash">年报原页:无</span>
<template v-if="j.jif_source_url">
<a class="jp-link" :href="j.jif_source_url" target="_blank" rel="noopener" @click.stop>
JIF来源:{{ shortUrl(j.jif_source_url) }}
</a>
<span class="jp-src-note">(汇编镜像,官方入口需机构订阅)</span>
</template>
<span v-else class="jp-dash">JIF来源:无</span>
<span class="jp-src-note">分区来源:{{ j.partition_source_note }}</span>
</div>
<p class="jp-xp-note">⚠ 国内IF与JIF统计源不同,不可混排</p>
</div>
</td>
</tr>
</template>
</tbody>
</table>
<!-- 分页(后端分页;total 超过 size 才显示) -->
<footer v-if="edu.directoryStatus === 'ready' && totalPages > 1" class="jp-pager">
<button class="jp-page-btn" type="button" :disabled="q.page <= 1" @click="gotoPage(q.page - 1)">‹ 上一页</button>
<span class="jp-page-info">第 {{ q.page }} / {{ totalPages }} 页</span>
<button class="jp-page-btn" type="button" :disabled="q.page >= totalPages" @click="gotoPage(q.page + 1)">下一页 ›</button>
<label class="jp-page-jump">
跳至
<input v-model="jumpInput" class="jp-page-input" type="number" min="1" :max="totalPages" @change="jumpPage">
页
</label>
<span class="jp-page-size">每页 {{ q.size }} 条</span>
</footer>
<!-- 底部数据源声明(表C 长版,拍板决策3;双 Tab 统一) -->
<p class="jp-foot">{{ FOOT_NOTE }}</p>
</section>
</template>
<style scoped>
.jp {
display: flex;
flex-direction: column;
gap: 10px;
}
.jp-head {
display: flex;
align-items: baseline;
gap: 10px;
}
.jp-title {
margin: 0;
font-size: 16px;
font-weight: 600;
color: var(--pa-ink);
}
.jp-count {
font-size: 12px;
color: var(--pa-ink-muted);
}
.jp-note {
margin: 0;
font-size: 12px;
line-height: 1.5;
color: var(--pa-ink-subtle);
}
.jp-note--warn {
color: var(--pa-warning);
}
/* —— Tab —— */
.jp-tabs {
display: flex;
gap: 6px;
}
.jp-tab {
padding: 6px 14px;
border: 1px solid var(--pa-hairline-strong);
border-radius: var(--pa-r-pill);
background: var(--pa-surface-1);
color: var(--pa-ink-muted);
font-size: 12.5px;
cursor: pointer;
transition: background .15s var(--pa-ease), color .15s var(--pa-ease), border-color .15s var(--pa-ease);
}
.jp-tab:hover {
background: var(--pa-surface-2);
color: var(--pa-ink);
}
.jp-tab.on {
background: color-mix(in srgb, var(--pa-g-from) 14%, transparent);
border-color: color-mix(in srgb, var(--pa-g-from) 50%, transparent);
color: var(--pa-ink);
font-weight: 600;
}
/* —— 搜索 —— */
.jp-tools {
display: flex;
}
.jp-search {
width: min(360px, 100%);
padding: 6px 10px;
border: 1px solid var(--pa-hairline-strong);
border-radius: var(--pa-r-md);
background: var(--pa-surface-1);
color: var(--pa-ink);
font-size: 13px;
}
.jp-search:focus {
outline: none;
border-color: color-mix(in srgb, var(--pa-g-from) 55%, transparent);
}
.jp-state {
display: flex;
flex-direction: column;
gap: 8px;
padding: 14px 0;
}
.jp-state-msg {
margin: 0;
font-size: 13px;
color: var(--pa-ink-muted);
}
.jp-retry {
align-self: flex-start;
padding: 5px 14px;
border: none;
border-radius: var(--pa-r-md);
background: var(--pa-surface-2);
color: var(--pa-ink);
font-size: 12px;
cursor: pointer;
transition: background .15s var(--pa-ease);
}
.jp-retry:hover {
background: var(--pa-surface-3);
}
.jp-skel-head,
.jp-skel-row {
border-radius: var(--pa-r-sm);
background: var(--pa-surface-2);
animation: jp-pulse 1.2s var(--pa-ease) infinite alternate;
}
.jp-skel-head {
height: 34px;
margin-bottom: 2px;
}
.jp-skel-row {
height: 30px;
margin-bottom: 6px;
}
@keyframes jp-pulse {
from { opacity: .55; }
to { opacity: 1; }
}
.jp-table {
width: 100%;
border-collapse: collapse;
font-size: 13px;
border: 1px solid var(--pa-hairline);
border-radius: var(--pa-r-md);
overflow: hidden;
}
.jp-table thead th {
padding: 9px 12px;
text-align: left;
font-size: 12px;
font-weight: 500;
color: var(--pa-ink-muted);
background: var(--pa-surface-1);
border-bottom: 1px solid var(--pa-hairline);
white-space: nowrap;
}
.jp-th-sort {
cursor: pointer;
user-select: none;
transition: color .15s var(--pa-ease);
}
.jp-th-sort:hover {
color: var(--pa-ink);
}
.jp-th-sort.on {
color: var(--pa-ink);
font-weight: 600;
}
.jp-arrow {
font-size: 10px;
color: var(--pa-g-from);
}
.jp-table tbody td {
padding: 9px 12px;
border-bottom: 1px solid var(--pa-hairline);
color: var(--pa-ink);
}
.jp-table tbody tr:last-child td {
border-bottom: none;
}
.jp-table tbody tr:hover {
background: var(--pa-surface-2);
}
.jp-name {
font-weight: 500;
}
.jp-num {
text-align: center;
font-family: var(--pa-font-mono);
color: var(--pa-ink-muted);
}
.jp-link {
color: var(--pa-g-from);
text-decoration: none;
}
.jp-link:hover {
text-decoration: underline;
}
.jp-dash {
color: var(--pa-ink-subtle);
}
/* 来源口径说明(灰色小字):分区常量文案 + 链接后括号补充 */
.jp-src-note {
font-size: 12px;
color: var(--pa-ink-subtle);
}
/* —— 列宽白名单(table 自适应 + min-width,不硬截断)—— */
.jp-c-name { min-width: 200px; }
.jp-c-dir { min-width: 140px; }
.jp-c-part { min-width: 64px; text-align: center; }
.jp-c-jif { min-width: 110px; }
.jp-c-url { min-width: 180px; }
.jp-c-comp { min-width: 110px; }
.jp-c-compr { min-width: 110px; }
/* —— 凭证状态配色:可靠=绿 / 未逐站复核=浅绿 / 未检得·待核实=橙 —— */
.jp-ok {
color: var(--pa-success);
font-weight: 500;
}
.jp-ok-soft {
color: color-mix(in srgb, var(--pa-success) 60%, var(--pa-ink));
}
.jp-warn {
color: var(--pa-warning);
font-weight: 500;
}
/* —— 筛选栏 —— */
.jp-filters {
display: flex;
flex-direction: column;
gap: 8px;
padding: 10px 12px;
background: var(--pa-surface-1);
border: 1px solid var(--pa-hairline);
border-radius: var(--pa-r-md);
}
.jp-fgroup {
display: flex;
flex-wrap: wrap;
align-items: center;
gap: 6px;
}
.jp-flabel {
flex: none;
width: 56px;
font-size: 12px;
color: var(--pa-ink-muted);
}
.jp-select {
padding: 4px 8px;
border: 1px solid var(--pa-hairline-strong);
border-radius: var(--pa-r-sm);
background: var(--pa-surface-2);
color: var(--pa-ink);
font-size: 12px;
}
.jp-clear {
align-self: flex-start;
padding: 4px 12px;
border: none;
border-radius: var(--pa-r-md);
background: var(--pa-surface-3);
color: var(--pa-ink);
font-size: 12px;
cursor: pointer;
transition: background .15s var(--pa-ease);
}
.jp-clear:hover {
background: var(--pa-surface-2);
}
/* —— 行展开 —— */
.jp-part {
text-align: center;
font-weight: 500;
}
.jp-row {
cursor: pointer;
}
.jp-row.open {
background: var(--pa-surface-2);
}
.jp-xp-row td {
background: var(--pa-surface-2);
border-bottom: 1px solid var(--pa-hairline);
}
.jp-xp {
display: flex;
flex-direction: column;
gap: 8px;
padding: 4px 2px;
}
.jp-xp-group {
display: flex;
flex-wrap: wrap;
align-items: center;
gap: 6px;
}
.jp-xp-label {
flex: none;
width: 56px;
font-size: 11px;
color: var(--pa-ink-subtle);
}
.jp-xp-val {
font-size: 12.5px;
color: var(--pa-ink);
}
.jp-mono {
font-family: var(--pa-font-mono);
}
.jp-xp-note {
margin: 0;
font-size: 12px;
line-height: 1.5;
color: var(--pa-warning);
}
.jp-chip {
padding: 3px 10px;
border: 1px solid var(--pa-hairline-strong);
border-radius: var(--pa-r-pill);
background: var(--pa-surface-2);
color: var(--pa-ink-muted);
font-size: 12px;
line-height: 1.5;
}
.jp-chip.on {
background: color-mix(in srgb, var(--pa-g-from) 16%, transparent);
border-color: color-mix(in srgb, var(--pa-g-from) 50%, transparent);
color: var(--pa-ink);
font-weight: 500;
}
/* —— 分页 —— */
.jp-pager {
display: flex;
flex-wrap: wrap;
align-items: center;
gap: 10px;
}
.jp-page-btn {
padding: 5px 12px;
border: 1px solid var(--pa-hairline-strong);
border-radius: var(--pa-r-md);
background: var(--pa-surface-1);
color: var(--pa-ink);
font-size: 12px;
cursor: pointer;
transition: background .15s var(--pa-ease);
}
.jp-page-btn:hover:not(:disabled) {
background: var(--pa-surface-2);
}
.jp-page-btn:disabled {
opacity: .4;
cursor: default;
}
.jp-page-info {
font-family: var(--pa-font-mono);
font-size: 12px;
color: var(--pa-ink-muted);
}
.jp-page-jump {
display: inline-flex;
align-items: center;
gap: 4px;
font-size: 12px;
color: var(--pa-ink-muted);
}
.jp-page-input {
width: 56px;
padding: 3px 6px;
border: 1px solid var(--pa-hairline-strong);
border-radius: var(--pa-r-sm);
background: var(--pa-surface-1);
font-size: 12px;
}
.jp-page-size {
font-size: 12px;
color: var(--pa-ink-subtle);
}
/* —— 底部数据源声明(表C 长版) —— */
.jp-foot {
margin: 0;
padding-top: 4px;
border-top: 1px solid var(--pa-hairline);
font-size: 12px;
line-height: 1.6;
color: var(--pa-ink-subtle);
}
</style>
@@ -0,0 +1,808 @@
<!-- PresubmitPanel.vue —— ③ AI 预审稿系统(步骤8,产品核心功能)。
链路:本地 PDF(form-data)→ edu.submitPresubmit(fd, {onUploadProgress})
→ POST /api/review/presubmit(file + target_journal;≤50MB,vstore 解析 + 六维 LLM)
→ {ok, report{summary, major/minor_weaknesses[], presentation_format[],
questions_for_authors[], recommendation(规则引擎计算), recommendation_rationale},
meta{...,tier,tier_label,tier_source}}
判定链(2026-10-12):LLM 只列 weakness(major 带 hard_rule/fatal 标签),
recommendation 由 recommend_engine 规则引擎计算并附 rationale(可解释);
fatal → reject 红标 + "建议人工复核"(克制展示,须人工核对)。
优先级:edu.report 存在 → 结果区(不退回上传区);否则 loading > error > 上传区。
结果/targetJournal 草稿/已选 PDF(edu.presubmitFile,仅内存)均存 store 跨菜单保留,
切菜单回来:有报告显示报告,无报告保留已选文件可直接提交。
http.js FormData+onUploadProgress → XHR 分支,上传阶段显示真实百分比。 -->
<script setup>
import { computed, ref } from 'vue';
import { useEduStore } from '../../../stores/edu.js';
const edu = useEduStore();
const MAX_PDF = 50 * 1024 * 1024;
const REC = {
accept: { label: '接收', cls: 'ok' },
minor_revision: { label: '小修', cls: 'minor' },
major_revision: { label: '大修', cls: 'major' },
reject: { label: '拒稿', cls: 'reject' },
};
const HARD_RULE_LABELS = {
busco_missing: 'BUSCO 完整度缺失',
hic_missing: 'Hi-C 挂载率缺失',
accession_missing: '数据 Accession 缺失',
voucher_missing: '凭证标本缺失',
abs_missing: 'ABS/名古屋合规声明缺失',
};
const fileInput = ref(null);
const file = ref(edu.presubmitFile || null); // File 存 store(切菜单/面板卸载不丢);本地 ref 为渲染镜像
const fileError = ref('');
const dragging = ref(false);
const uploadPct = ref(0);
const hasReport = computed(() => !!(edu.report && edu.report.report));
const loading = computed(() => edu.reportStatus === 'loading');
const errored = computed(() => edu.reportStatus === 'error');
const report = computed(() => edu.report?.report || null);
const meta = computed(() => edu.report?.meta || null);
const rec = computed(() => REC[report.value?.recommendation] || REC.major_revision);
const rationale = computed(() => report.value?.recommendation_rationale || null);
const isReject = computed(() => report.value?.recommendation === 'reject');
/** 判定档位提示:同一论文投不同 tier 结果可能不同,必须显式告知 */
const tierText = computed(() => {
const r = rationale.value;
const m = meta.value;
const tier = r?.tier ?? m?.tier;
if (!tier) return '';
const label = r?.tier_label || m?.tier_label || '';
const journal = (m?.target_journal || '').trim();
const name = journal || (m?.tier_source && m.tier_source !== '默认' ? m.tier_source : '未指定期刊');
return `判定档位:${name}(tier ${tier} ${label})`;
});
const hardHits = computed(() =>
(rationale.value?.hard_hits || []).map((t) => HARD_RULE_LABELS[t] || t)
);
const scannerConflicts = computed(() => rationale.value?.scanner_conflicts || []);
const droppedSections = computed(() => {
const d = meta.value?.dropped_sections || [];
const pretty = {
preamble: '文首', abstract: '摘要', introduction: '引言', results: '结果',
discussion: '讨论', methods: '方法', data_availability: '数据可用性',
references: '参考文献', acknowledgements: '致谢',
};
return d.filter((s) => !s.startsWith('[')).map((s) => pretty[s] || s);
});
/** 上传阶段(pct<1)显示真实百分比;上传完成后是解析 + LLM 长等待 */
const phaseText = computed(() =>
uploadPct.value < 1
? `上传中 ${Math.round(uploadPct.value * 100)}%`
: '审稿生成中…(约 15–60 秒,PDF 解析 + 六维 LLM)'
);
const fmtSize = (b) => (b / 1048576).toFixed(1) + ' MB';
function acceptFile(f) {
fileError.value = '';
if (!f) return;
if (!String(f.name || '').toLowerCase().endsWith('.pdf')) {
fileError.value = '仅支持 PDF 文件';
return;
}
if (!f.size) {
fileError.value = '上传文件为空';
return;
}
if (f.size > MAX_PDF) {
fileError.value = 'PDF 超过 50MB 上限';
return;
}
file.value = f;
edu.presubmitFile = f; // 进 store:切菜单/面板卸载不丢
}
function onPick(e) {
acceptFile(e.target.files?.[0]);
e.target.value = ''; // 允许重复选择同名文件
}
function onDrop(e) {
dragging.value = false;
acceptFile(e.dataTransfer?.files?.[0]);
}
function removeFile() {
file.value = null;
edu.presubmitFile = null;
}
async function submit() {
if (!file.value || loading.value) return;
const fd = new FormData();
fd.append('file', file.value); // 浏览器自动 multipart boundary(http.js 不设 Content-Type)
fd.append('target_journal', (edu.drafts.targetJournal || '').trim());
uploadPct.value = 0;
await edu.submitPresubmit(fd, {
onUploadProgress: (e) => {
uploadPct.value = e.pct;
},
});
}
/** 重新上传(结果区)/ 重新选择(错误区):清结果回上传区,保留 targetJournal 草稿 */
function reset() {
edu.clearReport();
file.value = null;
uploadPct.value = 0;
fileError.value = '';
}
</script>
<template>
<section class="pp">
<header class="pp-head">
<h1 class="pp-title">AI 预审稿系统</h1>
<span class="pp-sub">植物基因组学六维清单 · PDF ≤ 50MB</span>
</header>
<!-- ========== ① 有结果 → 结果区(最高优先级,不退回上传区) ========== -->
<template v-if="hasReport">
<div v-if="meta" class="pp-meta">
📄 {{ meta.filename }}
<template v-if="meta.target_journal"> · 目标期刊 {{ meta.target_journal }}</template>
· {{ meta.text_chars }} 字符
<span v-if="meta.truncated" class="pp-truncated">· 正文超限已截断(保摘要/数据可用性/方法/结果/讨论)</span>
</div>
<p class="pp-ai-note">本判定由 AI 生成,仅供投稿前参考;fatal 级判定请务必人工核对后再决定。</p>
<div class="pp-topline">
<span class="pp-rec" :class="rec.cls">{{ rec.label }}</span>
<span v-if="isReject" class="pp-rec-warn">建议人工复核</span>
<span v-if="tierText" class="pp-tier">{{ tierText }}</span>
<button class="pp-again" type="button" @click="reset">重新上传</button>
</div>
<!-- 判定依据(规则引擎 rationale:可解释、可复现) -->
<div v-if="rationale" class="pp-rationale">
<div class="pp-rationale-head">判定依据</div>
<p class="pp-rationale-text">{{ rationale.explanation }}</p>
<div v-if="hardHits.length" class="pp-hard-chips">
<span v-for="(h, i) in hardHits" :key="'hh-' + i" class="pp-hard-chip">{{ h }}</span>
</div>
<!-- 扫描器冲突(黄标:证伪了硬性缺项,请人工核对) -->
<div v-if="scannerConflicts.length" class="pp-conflicts">
<div class="pp-conflict-title">关键词扫描器冲突(已降级为非硬性,请人工核对)</div>
<div v-for="(c, i) in scannerConflicts" :key="'sc-' + i" class="pp-conflict-item">
<span class="pp-conflict-tag">{{ HARD_RULE_LABELS[c.hard_rule] || c.hard_rule }}</span>
<span class="pp-conflict-reason">{{ c.reason }}</span>
</div>
</div>
<!-- 截断提示:被丢弃的低优先级节(判定价值低,不代表论文缺失) -->
<div v-if="droppedSections.length" class="pp-dropped">
未送审部分:{{ droppedSections.join('、') }}(截断所致,非论文缺失)
</div>
</div>
<p class="pp-summary">{{ report.summary }}</p>
<!-- 主要问题(重视觉) -->
<h2 class="pp-h2">主要问题({{ report.major_weaknesses.length }})</h2>
<article
v-for="(it, i) in report.major_weaknesses"
:key="'maj-' + i"
class="pp-card major"
>
<div class="pp-card-title">
<span class="pp-idx">{{ i + 1 }}</span>{{ it.title }}
<span v-if="it.hard_rule" class="pp-hard-badge" title="硬性规则命中,不可协商">硬性</span>
<span v-if="it.fatal" class="pp-fatal-badge" title="fatal 级:请人工核对证据">fatal</span>
</div>
<p class="pp-detail">{{ it.detail }}</p>
<div v-if="it.evidence" class="pp-evidence">
<span class="pp-tag">证据</span><code class="pp-evi-text">{{ it.evidence }}</code>
</div>
<div v-if="it.suggestion" class="pp-suggestion">
<span class="pp-tag">建议</span>{{ it.suggestion }}
</div>
</article>
<p v-if="!report.major_weaknesses.length" class="pp-empty">无主要问题</p>
<!-- 次要问题(轻视觉) -->
<h2 class="pp-h2">次要问题({{ report.minor_weaknesses.length }})</h2>
<article
v-for="(it, i) in report.minor_weaknesses"
:key="'min-' + i"
class="pp-card minor"
>
<div class="pp-card-title">
<span class="pp-idx light">{{ i + 1 }}</span>{{ it.title }}
<span
v-if="it.scanner_downgraded"
class="pp-down-badge"
title="扫描器在正文检出该缺项证据,已从大修降级为小修;请人工核对"
>冲突降级</span>
</div>
<p class="pp-detail light">{{ it.detail }}</p>
<div v-if="it.evidence" class="pp-evidence light">
<span class="pp-tag">证据</span><code class="pp-evi-text">{{ it.evidence }}</code>
</div>
<div v-if="it.suggestion" class="pp-suggestion light">
<span class="pp-tag">建议</span>{{ it.suggestion }}
</div>
</article>
<p v-if="!report.minor_weaknesses.length" class="pp-empty">无次要问题</p>
<!-- 排版与规范(默认折叠) -->
<details class="pp-details">
<summary>排版与规范({{ report.presentation_format.length }})</summary>
<article
v-for="(it, i) in report.presentation_format"
:key="'pre-' + i"
class="pp-card minor"
>
<div class="pp-card-title">
<span class="pp-idx light">{{ i + 1 }}</span>{{ it.title }}
</div>
<p class="pp-detail light">{{ it.detail }}</p>
<div v-if="it.evidence" class="pp-evidence light">
<span class="pp-tag">证据</span><code class="pp-evi-text">{{ it.evidence }}</code>
</div>
<div v-if="it.suggestion" class="pp-suggestion light">
<span class="pp-tag">建议</span>{{ it.suggestion }}
</div>
</article>
<p v-if="!report.presentation_format.length" class="pp-empty">无排版类意见</p>
</details>
<!-- 给作者的问题 -->
<h2 class="pp-h2">给作者的问题({{ report.questions_for_authors.length }})</h2>
<ol class="pp-questions">
<li v-for="(q, i) in report.questions_for_authors" :key="'q-' + i">{{ q }}</li>
</ol>
<p v-if="!report.questions_for_authors.length" class="pp-empty">无</p>
</template>
<!-- ========== ② loading:上传进度 / 审稿长等待 ========== -->
<div v-else-if="loading" class="pp-state" aria-busy="true">
<div class="pp-bar">
<div class="pp-bar-fill" :style="{ width: Math.round(uploadPct * 100) + '%' }"></div>
</div>
<div class="pp-skel"></div>
<div class="pp-skel pp-skel-mid"></div>
<p class="pp-state-msg">{{ phaseText }}</p>
</div>
<!-- ========== ③ error ========== -->
<div v-else-if="errored" class="pp-state" role="alert">
<p class="pp-state-msg pp-state-error">{{ edu.reportError }}</p>
<div class="pp-err-btns">
<button v-if="file" class="pp-retry" type="button" @click="submit">重试</button>
<button class="pp-retry" type="button" @click="reset">重新选择文件</button>
</div>
</div>
<!-- ========== ④ 上传区(report 为 null 时才显示) ========== -->
<div v-else class="pp-upload">
<div
class="pp-drop"
:class="{ dragging, filled: !!file }"
role="button"
tabindex="0"
@click="fileInput.click()"
@keydown.enter="fileInput.click()"
@dragover.prevent="dragging = true"
@dragleave.prevent="dragging = false"
@drop.prevent="onDrop"
>
<input
ref="fileInput"
class="pp-file-input"
type="file"
accept=".pdf,application/pdf"
@click.stop
@change="onPick"
/>
<template v-if="file">
<span class="pp-file-name">📄 {{ file.name }} · {{ fmtSize(file.size) }}</span>
<button class="pp-remove" type="button" title="移除文件" @click.stop="removeFile">×</button>
</template>
<template v-else>
<span class="pp-drop-main">拖拽 PDF 到此处,或点击选择</span>
<span class="pp-hint">仅支持 PDF · ≤ 50MB</span>
</template>
</div>
<p v-if="fileError" class="pp-file-error">{{ fileError }}</p>
<label class="pp-label" for="pp-tj">目标期刊(选填,影响格式类意见)</label>
<input
id="pp-tj"
v-model="edu.drafts.targetJournal"
class="pp-input"
type="text"
placeholder="如 The Plant Cell(留空则不限定)"
/>
<button class="pp-submit" type="button" :disabled="!file || loading" @click="submit">
{{ loading ? phaseText : '开始预审稿' }}
</button>
</div>
</section>
</template>
<style scoped>
.pp {
display: flex;
flex-direction: column;
gap: 12px;
}
.pp-head {
display: flex;
align-items: baseline;
gap: 10px;
}
.pp-title {
margin: 0;
font-size: 16px;
font-weight: 600;
color: var(--pa-ink);
}
.pp-sub {
font-size: 12px;
color: var(--pa-ink-subtle);
}
.pp-meta {
font-size: 12px;
color: var(--pa-ink-muted);
}
.pp-truncated {
color: var(--pa-warning);
}
.pp-topline {
display: flex;
align-items: center;
justify-content: space-between;
gap: 10px;
}
.pp-rec {
display: inline-flex;
align-items: center;
padding: 3px 14px;
border: 1px solid currentColor;
border-radius: var(--pa-r-pill);
font-size: 13px;
font-weight: 700;
}
.pp-rec.ok { color: var(--pa-success); }
.pp-rec.minor { color: var(--pa-info); }
.pp-rec.major { color: var(--pa-warning); }
.pp-rec.reject { color: var(--pa-error); }
.pp-ai-note {
margin: 0;
padding: 6px 10px;
border: 1px dashed var(--pa-hairline);
border-radius: var(--pa-r-sm);
font-size: 12px;
color: var(--pa-ink-subtle);
}
.pp-rec-warn {
flex: none;
padding: 2px 8px;
border-radius: var(--pa-r-sm);
background: var(--pa-error);
color: #fff;
font-size: 11px;
font-weight: 600;
}
.pp-tier {
flex: 1;
font-size: 12px;
color: var(--pa-ink-muted);
}
.pp-rationale {
padding: 10px 12px;
background: var(--pa-surface-1);
border: 1px solid var(--pa-hairline);
border-radius: var(--pa-r-md);
}
.pp-rationale-head {
font-size: 12px;
font-weight: 600;
color: var(--pa-ink-muted);
margin-bottom: 4px;
}
.pp-rationale-text {
margin: 0;
font-size: 13px;
line-height: 1.65;
color: var(--pa-ink);
}
.pp-hard-chips {
display: flex;
flex-wrap: wrap;
gap: 6px;
margin-top: 8px;
}
.pp-hard-chip {
padding: 1px 8px;
border: 1px solid var(--pa-error);
border-radius: var(--pa-r-pill);
font-size: 11.5px;
color: var(--pa-error);
}
.pp-conflicts {
margin-top: 10px;
padding: 8px 10px;
border: 1px solid var(--pa-warn, #d4a017);
border-radius: var(--pa-r-sm);
background: color-mix(in srgb, var(--pa-warn, #d4a017) 8%, transparent);
}
.pp-conflict-title {
font-size: 11.5px;
font-weight: 600;
color: var(--pa-warn, #9a6b00);
margin-bottom: 4px;
}
.pp-conflict-item {
display: flex;
gap: 6px;
align-items: baseline;
font-size: 12px;
line-height: 1.6;
color: var(--pa-ink);
}
.pp-conflict-tag {
flex: none;
padding: 0 6px;
border: 1px solid var(--pa-warn, #d4a017);
border-radius: var(--pa-r-pill);
font-size: 10.5px;
color: var(--pa-warn, #9a6b00);
}
.pp-conflict-reason {
color: var(--pa-muted, #666);
}
.pp-dropped {
margin-top: 8px;
font-size: 11.5px;
color: var(--pa-muted, #777);
}
.pp-hard-badge {
flex: none;
margin-left: 6px;
padding: 0 6px;
border-radius: var(--pa-r-sm);
border: 1px solid var(--pa-error);
font-size: 10.5px;
font-weight: 600;
color: var(--pa-error);
line-height: 1.6;
}
.pp-down-badge {
flex: none;
margin-left: 6px;
padding: 0 6px;
border-radius: var(--pa-r-sm);
border: 1px solid var(--pa-warn, #d4a017);
font-size: 10.5px;
font-weight: 600;
color: var(--pa-warn, #9a6b00);
line-height: 1.6;
}
.pp-fatal-badge {
flex: none;
margin-left: 4px;
padding: 0 6px;
border-radius: var(--pa-r-sm);
background: var(--pa-error);
font-size: 10.5px;
font-weight: 700;
color: #fff;
line-height: 1.6;
}
.pp-again {
padding: 5px 14px;
border: 1px solid var(--pa-hairline);
border-radius: var(--pa-r-md);
background: transparent;
color: var(--pa-ink-muted);
font-size: 12px;
cursor: pointer;
}
.pp-again:hover {
color: var(--pa-ink);
background: var(--pa-surface-2);
}
.pp-summary {
margin: 0;
padding: 12px 14px;
background: var(--pa-surface-1);
border: 1px solid var(--pa-hairline);
border-radius: var(--pa-r-md);
font-size: 13.5px;
line-height: 1.7;
color: var(--pa-ink);
}
.pp-h2 {
margin: 8px 0 0;
font-size: 14px;
font-weight: 600;
color: var(--pa-ink);
}
.pp-card {
display: flex;
flex-direction: column;
gap: 7px;
padding: 12px 14px;
border-radius: var(--pa-r-md);
}
.pp-card.major {
background: var(--pa-surface-1);
border: 1px solid var(--pa-hairline-strong);
}
.pp-card.minor {
background: transparent;
border: 1px solid var(--pa-hairline);
}
.pp-card-title {
display: flex;
align-items: flex-start;
gap: 8px;
font-size: 13.5px;
font-weight: 600;
color: var(--pa-ink);
line-height: 1.5;
}
.pp-idx {
flex: none;
display: inline-flex;
align-items: center;
justify-content: center;
width: 18px;
height: 18px;
border-radius: 50%;
background: var(--pa-surface-3);
color: var(--pa-ink);
font-family: var(--pa-font-mono);
font-size: 11px;
margin-top: 1px;
}
.pp-idx.light {
background: transparent;
border: 1px solid var(--pa-hairline);
color: var(--pa-ink-muted);
}
.pp-detail {
margin: 0;
font-size: 13px;
line-height: 1.65;
color: var(--pa-ink);
}
.pp-detail.light {
color: var(--pa-ink-muted);
}
.pp-evidence {
display: flex;
align-items: flex-start;
gap: 8px;
padding: 8px 10px;
background: var(--pa-code-bg);
border-radius: var(--pa-r-sm);
}
.pp-evidence.light {
background: transparent;
border: 1px dashed var(--pa-hairline);
}
.pp-evi-text {
font-family: var(--pa-font-mono);
font-size: 12.5px;
line-height: 1.6;
color: var(--pa-ink);
white-space: normal;
}
.pp-evidence.light .pp-evi-text {
color: var(--pa-ink-muted);
}
.pp-suggestion {
font-size: 13px;
line-height: 1.6;
color: var(--pa-ink);
}
.pp-suggestion.light {
color: var(--pa-ink-muted);
}
.pp-tag {
flex: none;
display: inline-block;
margin-right: 8px;
padding: 1px 7px;
border-radius: var(--pa-r-sm);
background: var(--pa-surface-3);
font-size: 11px;
color: var(--pa-ink-muted);
vertical-align: 1px;
}
.pp-empty {
margin: 0;
font-size: 12.5px;
color: var(--pa-ink-subtle);
}
.pp-details {
border: 1px solid var(--pa-hairline);
border-radius: var(--pa-r-md);
padding: 8px 14px;
}
.pp-details summary {
cursor: pointer;
font-size: 13.5px;
font-weight: 600;
color: var(--pa-ink-muted);
}
.pp-details summary:hover {
color: var(--pa-ink);
}
.pp-details[open] summary {
margin-bottom: 10px;
color: var(--pa-ink);
}
.pp-questions {
margin: 0;
padding-left: 20px;
display: flex;
flex-direction: column;
gap: 6px;
font-size: 13px;
line-height: 1.65;
color: var(--pa-ink);
}
.pp-state {
display: flex;
flex-direction: column;
gap: 10px;
padding: 6px 0;
}
.pp-bar {
height: 6px;
border-radius: var(--pa-r-pill);
background: var(--pa-surface-2);
overflow: hidden;
}
.pp-bar-fill {
height: 100%;
background: var(--pa-g-from);
transition: width .2s var(--pa-ease);
}
.pp-skel {
height: 56px;
border-radius: var(--pa-r-md);
background: var(--pa-surface-2);
animation: pp-pulse 1.2s var(--pa-ease) infinite alternate;
}
.pp-skel-mid {
height: 88px;
}
@keyframes pp-pulse {
from { opacity: .55; }
to { opacity: 1; }
}
.pp-state-msg {
margin: 0;
font-size: 13px;
color: var(--pa-ink-muted);
}
.pp-state-error {
color: var(--pa-error);
}
.pp-err-btns {
display: flex;
gap: 10px;
}
.pp-retry {
padding: 5px 14px;
border: none;
border-radius: var(--pa-r-md);
background: var(--pa-surface-2);
color: var(--pa-ink);
font-size: 12px;
cursor: pointer;
}
.pp-retry:hover {
background: var(--pa-surface-3);
}
.pp-upload {
display: flex;
flex-direction: column;
gap: 10px;
}
.pp-drop {
position: relative;
display: flex;
flex-direction: column;
align-items: center;
justify-content: center;
gap: 6px;
min-height: 130px;
padding: 18px;
border: 1.5px dashed var(--pa-hairline-strong);
border-radius: var(--pa-r-lg);
background: var(--pa-surface-1);
cursor: pointer;
transition: border-color .15s var(--pa-ease), background .15s var(--pa-ease);
}
.pp-drop:hover,
.pp-drop.dragging {
border-color: var(--pa-g-from);
background: var(--pa-surface-2);
}
.pp-drop.filled {
border-style: solid;
}
.pp-file-input {
display: none;
}
.pp-drop-main {
font-size: 13.5px;
color: var(--pa-ink);
}
.pp-hint {
font-size: 12px;
color: var(--pa-ink-subtle);
}
.pp-file-name {
font-size: 13.5px;
color: var(--pa-ink);
word-break: break-all;
}
.pp-remove {
position: absolute;
top: 8px;
right: 10px;
width: 22px;
height: 22px;
border: none;
border-radius: 50%;
background: var(--pa-surface-3);
color: var(--pa-ink-muted);
font-size: 15px;
line-height: 1;
cursor: pointer;
}
.pp-remove:hover {
color: var(--pa-ink);
}
.pp-file-error {
margin: 0;
font-size: 12.5px;
color: var(--pa-error);
}
.pp-label {
font-size: 12px;
font-weight: 500;
color: var(--pa-ink-muted);
}
.pp-input {
width: 320px;
max-width: 100%;
box-sizing: border-box;
padding: 7px 11px;
border: 1px solid var(--pa-hairline);
border-radius: var(--pa-r-md);
background: var(--pa-surface-2);
color: var(--pa-ink);
font-size: 13px;
}
.pp-input:focus {
outline: none;
border-color: var(--pa-g-from);
}
.pp-submit {
align-self: flex-start;
padding: 8px 22px;
border: none;
border-radius: var(--pa-r-md);
background: var(--pa-gradient);
color: #fff;
font-size: 13px;
font-weight: 600;
cursor: pointer;
}
.pp-submit:disabled {
opacity: .45;
cursor: not-allowed;
}
</style>
@@ -0,0 +1,635 @@
<!-- RebuttalPanel.vue —— 审稿回复助手(Rebuttal Phase 1,UI v2)。
独立工作,不依赖 tracker(tracker 已解除映射,2026-10-12)。
步骤引导:① 粘贴审稿意见 → ② 智能拆条 → ③ 逐条回复 → ④ 导出 Response Letter。
布局(大屏三栏,<1100px 两栏降级,letter 折叠):
左 220px:Reviewer 折叠分组 + comment 列表(编号/severity 徽标/状态点)
中 flex-1:原话(灰底只读)+ 问题要点(LLM 归纳)+ 5 类表单
+ draft 预览 + 校验红条 + 逐条确认
右 40% 可折叠:Letter 预览(仅已填 draft 条目)+ X/Y 已确认 + 下载
状态机:无 job→粘贴区;loading→拆条动画;error→重试;NOT_FOUND→任务过期。
样例文本与 docs/samples/rebuttal_sample_reviewer.txt 同源(前端内置副本)。 -->
<script setup>
import { computed, ref, watch } from 'vue';
import { useEduStore } from '../../../stores/edu.js';
const edu = useEduStore();
const rb = computed(() => edu.rebuttal);
const job = computed(() => rb.value.job);
const SAMPLE_TEXT = `Reviewer #1:
1. The GWAS analysis lacks multiple-testing correction. Please re-run with FDR control and report q-values for all significant loci. In addition, the sample size justification is missing — please add a power analysis or at least discuss the detectable effect size.
2. Figure 3 is blurry and the axis labels are unreadable. As noted in Comment 3, the same issue applies to Figure S2. Please replace all figures with high-resolution versions.
3. Minor: please add the standard error estimates to Supplementary Table 2.
Reviewer #2:
1. The claim of novelty overstates the advance relative to Zhang et al. 2023. The introduction should more clearly delineate what is new.
2. How were the batch effects between the two sequencing centers corrected? This is essential to support the conclusions.`;
const textInput = ref('');
const showPdf = ref(false);
const partErr = ref('');
const PART_TYPES = [
{ key: 'new_data', label: '补充新数据', hint: '新增实验/数据(图/表编号、关键数值)' },
{ key: 'reanalysis', label: '重新分析', hint: '重跑的分析、方法/参数变化与新结论' },
{ key: 'location', label: '定位/指出位置', hint: '修改或证据在稿件中的位置(Section/Fig/Methods)' },
{ key: 'clarification', label: '澄清说明', hint: '针对误解的准确解释' },
{ key: 'rebuttal', label: '礼貌反驳', hint: '礼貌但明确的不同立场与理由' },
];
const collapsed = ref({}); // reviewerId → bool
const allComments = computed(() => {
const j = job.value;
if (!j) return [];
return (j.reviewers || []).flatMap((r) =>
(r.comments || []).map((c, i) => ({ ...c, reviewer: r.label, ord: i + 1 })));
});
const activeComment = computed(() => allComments.value.find((c) => c.id === rb.value.activeCid) || null);
const unconfirmedCount = computed(() => allComments.value.filter((c) => !c.human_confirmed).length);
const confirmedCount = computed(() => allComments.value.length - unconfirmedCount.value);
const allConfirmed = computed(() => allComments.value.length > 0 && unconfirmedCount.value === 0);
const letterComments = computed(() => allComments.value.filter((c) => String(c.draft || '').trim()));
const step = computed(() => {
if (rb.value.status === 'loading') return 2;
if (!job.value) return 1;
if (job.value.letter_md && allConfirmed.value) return 4;
return 3;
});
const isExpired = computed(() => rb.value.expired === true);
const forms = ref({});
function formOf(cid) {
if (!forms.value[cid]) {
const c = allComments.value.find((x) => x.id === cid);
const parts = (c?.response?.parts || []).map((p) => ({ ...p }));
forms.value[cid] = { parts: parts.length ? parts : [{ type: 'clarification', content: '', location_hint: '' }] };
}
return forms.value[cid];
}
const canDraft = computed(() => {
const f = activeComment.value && forms.value[activeComment.value.id];
if (!f) return false;
return f.parts.length > 0 && f.parts.every((p) => String(p.content || '').trim());
});
const validationOf = computed(() => activeComment.value?.validation || null);
const validationFailed = computed(() => validationOf.value && validationOf.value.passed === false);
// 前端立场词预检(与后端 _STANCE 同词表):只提示不阻止保存/编辑
const STANCE_RE = /\b(disagree|maintain|stand\s+by|reject|respectfully|not\s+persuaded|cannot\s+agree|dispute)\b/i;
const STANCE_HINT = '礼貌反驳需要包含 maintain/disagree/respectfully 等立场词,'
+ '例如:We respectfully maintain that... 或 We disagree with the reviewer\'s point that...';
function stanceMissing(p) {
const text = String(p.content || '').trim();
return p.type === 'rebuttal' && !!text && !STANCE_RE.test(text);
}
const stanceHintParts = computed(() => {
const f = activeComment.value && forms.value[activeComment.value.id];
if (!f) return [];
return f.parts.map((p, i) => (stanceMissing(p) ? i : -1)).filter((i) => i >= 0);
});
function statusDot(c) {
if (c.human_confirmed) return 'done';
const f = forms.value[c.id] || c.response;
const parts = f?.parts || [];
const filled = c.draft || parts.some((p) => String(p.content || '').trim());
return filled ? 'filled' : 'empty';
}
function fillSample() {
textInput.value = SAMPLE_TEXT;
}
async function submitText() {
partErr.value = '';
const t = textInput.value.trim();
if (!t) { partErr.value = '请粘贴审稿意见文本'; return; }
const jobNew = await edu.rebuttalCreate(t);
if (jobNew?.reviewers?.[0]?.comments?.[0]) {
edu.rebuttalSetActive(jobNew.reviewers[0].comments[0].id);
}
}
async function onPdf(ev) {
const f = ev.target.files && ev.target.files[0];
if (!f) return;
partErr.value = '';
if (!f.name.toLowerCase().endsWith('.pdf')) {
partErr.value = '仅支持 PDF(推荐直接粘贴文本)';
ev.target.value = '';
return;
}
const fd = new FormData();
fd.append('file', f);
const jobNew = await edu.rebuttalCreatePdf(fd);
ev.target.value = '';
if (jobNew?.reviewers?.[0]?.comments?.[0]) {
edu.rebuttalSetActive(jobNew.reviewers[0].comments[0].id);
}
}
function partsPayload(cid) {
return formOf(cid).parts.map((p) => ({
type: p.type, content: String(p.content || ''), location_hint: p.location_hint || null,
}));
}
function addPart() {
formOf(activeComment.value.id).parts.push({ type: 'clarification', content: '', location_hint: '' });
}
function removePart(i) {
const f = formOf(activeComment.value.id);
if (f.parts.length > 1) f.parts.splice(i, 1);
}
const draftMsg = ref('');
async function genDraft() {
const c = activeComment.value;
if (!c || !canDraft.value) return;
draftMsg.value = '';
// 无独立"保存"按钮:生成前自动保存当前要点(保存+生成一步完成)
const res = await edu.rebuttalSaveResponse(c.id, partsPayload(c.id));
if (!res.ok) { draftMsg.value = res.error; return; }
const d = await edu.rebuttalDraft(c.id);
if (!d.ok) {
// 校验失败:按钮已由 store finally 解锁;这里补"如何改"的具体建议
const noStance = d.validation?.findings?.some((f) => f.code === 'REBUTTAL_NO_STANCE');
draftMsg.value = noStance
? `${d.error || '草稿生成失败'}。${STANCE_HINT}`
: (d.error || '草稿生成失败');
}
}
async function toggleConfirm(c, ev) {
const res = await edu.rebuttalConfirm(c.id, ev.target.checked);
if (!res.ok) draftMsg.value = res.error;
}
const letterAssembling = ref(false);
const letterError = ref('');
const letterCollapsed = ref(false);
async function assembleLetter() {
letterAssembling.value = true; letterError.value = '';
const res = await edu.rebuttalAssembleLetter();
letterAssembling.value = false;
if (!res.ok) letterError.value = res.error;
}
async function downloadLetter() {
if (!job.value?.human_ack) return;
letterError.value = '';
try {
const { rebuttalDownloadLetterMd } = await import('../../../api/review.js');
const md = await rebuttalDownloadLetterMd(job.value.id);
const blob = new Blob([md], { type: 'text/markdown;charset=utf-8' });
const a = document.createElement('a');
a.href = URL.createObjectURL(blob);
a.download = `response-letter-${job.value.id}.md`;
a.click();
URL.revokeObjectURL(a.href);
} catch (err) {
letterError.value = err?.message || '下载失败';
}
}
function retryParse() {
edu.clearRebuttal();
if (!textInput.value.trim() && job.value === null) return; // 保留已输入文本
}
watch(() => rb.value.activeCid, () => {
partErr.value = ''; draftMsg.value = '';
});
</script>
<template>
<div class="rb-root">
<header class="rb-head">
<h2 class="rb-title">审稿回复助手</h2>
<p class="rb-sub">Phase 1:粘贴审稿意见 → 智能拆条 → 逐条回复 → 导出 Response Letter(.md)</p>
</header>
<!-- 步骤引导 -->
<ol class="rb-steps" data-testid="rb-steps">
<li v-for="(s, i) in ['粘贴审稿意见', '智能拆条', '逐条回复', '导出 Response Letter']"
:key="i" class="rb-step" :class="{ on: step === i + 1, past: step > i + 1 }">
<span class="rb-step-num"><span class="rb-step-digit">{{ i + 1 }}</span></span>{{ s }}
</li>
</ol>
<!-- 状态:拆条中 -->
<section v-if="rb.status === 'loading'" class="rb-parsing" data-testid="rb-parsing">
<div class="rb-spinner" aria-hidden="true" />
<p>正在拆条…(约 5-15 秒)</p>
<p class="rb-hint">正在识别 Reviewer 分节与编号条目,并归纳问题要点</p>
</section>
<!-- 状态:任务过期 -->
<section v-else-if="isExpired" class="rb-expired">
<p>任务已过期,请重新创建。</p>
<button class="rb-btn rb-btn-primary" type="button" @click="edu.clearRebuttal()">重新开始</button>
</section>
<!-- 状态:解析失败 -->
<section v-else-if="rb.status === 'error'" class="rb-expired">
<p class="rb-err">{{ rb.error || '拆条失败' }}</p>
<button class="rb-btn rb-btn-primary" type="button" @click="retryParse">重试</button>
</section>
<!-- 状态:无 job → 粘贴区 -->
<section v-else-if="!job" class="rb-input">
<div class="rb-input-head">
<label class="rb-label" for="rb-text">审稿意见文本</label>
<button class="rb-link" type="button" data-testid="rb-sample" @click="fillSample">填充示例</button>
</div>
<textarea
id="rb-text" v-model="textInput" class="rb-textarea"
placeholder="直接粘贴审稿意见(支持 Reviewer 1/2 分节或编号条目)..."
/>
<div class="rb-input-actions">
<button class="rb-btn rb-btn-primary" type="button" data-testid="rb-parse"
:disabled="!textInput.trim()" @click="submitText">
解析并拆条
</button>
</div>
<div class="rb-pdf-card">
<button class="rb-btn" type="button" data-testid="rb-pdf-toggle" @click="showPdf = !showPdf">
或上传 PDF
</button>
<p class="rb-hint">如果是审稿人批注版 PDF,通常提取不到批注,建议用文本粘贴。</p>
<div v-if="showPdf" class="rb-pdf">
<input type="file" accept="application/pdf,.pdf" @change="onPdf" />
</div>
</div>
<p v-if="partErr" class="rb-err">{{ partErr }}</p>
</section>
<!-- 主区:三栏 -->
<section v-else class="rb-main">
<div class="rb-toolbar">
<span />
<button class="rb-link rb-danger" type="button" @click="edu.rebuttalDelete()">删除任务</button>
</div>
<div class="rb-banner" :class="allConfirmed ? 'rb-banner-ok' : 'rb-banner-warn'">
<template v-if="allConfirmed">
全部已确认{{ job.human_ack ? '(human_ack 已置位)' : '' }} —— 可下载 letter.md
</template>
<template v-else>{{ unconfirmedCount }} 条未确认 —— 全部勾选确认后才能下载 letter.md</template>
</div>
<div class="rb-cols" :class="{ 'rb-cols-2': letterCollapsed }">
<!-- 左:Reviewer → Comment 树 -->
<aside class="rb-tree">
<div v-for="r in job.reviewers" :key="r.id" class="rb-rev">
<button class="rb-rev-label" type="button" @click="collapsed[r.id] = !collapsed[r.id]">
<span class="rb-rev-caret" :class="{ open: !collapsed[r.id] }">▸</span>
{{ r.label }}({{ (r.comments || []).length }})
</button>
<template v-if="!collapsed[r.id]">
<button
v-for="(c, i) in r.comments" :key="c.id"
class="rb-c-item" :class="{ active: c.id === rb.activeCid }"
type="button" @click="edu.rebuttalSetActive(c.id)"
>
<span class="rb-c-ord">{{ i + 1 }}</span>
<span class="rb-c-title">{{ c.title || c.id }}</span>
<span class="rb-c-sev" :class="c.severity">{{ c.severity }}</span>
<span class="rb-c-dot" :class="statusDot(c)" :title="statusDot(c)" />
</button>
</template>
</div>
</aside>
<!-- 中:编辑区 -->
<div v-if="activeComment" class="rb-form">
<div class="rb-form-head">
<h3 class="rb-form-title">{{ activeComment.title }}</h3>
<label class="rb-confirm">
<input
type="checkbox" :checked="activeComment.human_confirmed"
data-testid="rb-confirm" @change="toggleConfirm(activeComment, $event)"
/>
已确认本条
</label>
</div>
<div class="rb-original">
<div class="rb-original-label">审稿人原话({{ activeComment.reviewer }} · #{{ activeComment.ord }})</div>
<p class="rb-original-body">{{ activeComment.body }}</p>
</div>
<!-- 问题要点(Phase 1 砍手工合并/拆分:多子条由 LLM 拆分,纠错留 Phase 2) -->
<div class="rb-point">
<div class="rb-point-body">
<div class="rb-original-label">问题要点</div>
<p class="rb-point-text">{{ activeComment.title }}</p>
</div>
</div>
<div v-if="activeComment.cross_refs?.length" class="rb-xref">
交叉引用:<span v-for="(x, i) in activeComment.cross_refs" :key="i">「{{ x.raw }}」{{ x.target_id ? `→ ${x.target_id}` : '(未解析,保留原文)' }} </span>
</div>
<div class="rb-parts">
<div class="rb-parts-label">回复要点(user_response)</div>
<div v-for="(p, i) in formOf(activeComment.id).parts" :key="i" class="rb-part">
<select v-model="p.type" class="rb-select" :data-testid="`rb-type-${i}`">
<option v-for="t in PART_TYPES" :key="t.key" :value="t.key">{{ t.label }}</option>
</select>
<textarea
v-model="p.content" class="rb-part-content" rows="3"
:placeholder="PART_TYPES.find((t) => t.key === p.type)?.hint"
:data-testid="`rb-content-${i}`"
/>
<!-- 立场词预检:只提示不阻止继续编辑/生成 -->
<p
v-if="stanceMissing(p)" class="rb-err rb-stance"
:data-testid="`rb-stance-hint-${i}`"
>{{ STANCE_HINT }}</p>
<input
v-if="p.type === 'location'"
v-model="p.location_hint" class="rb-part-hint" data-testid="rb-location-hint"
placeholder="位置提示:如 Section 3 / Fig. S2 / Methods 第 2 段"
/>
</div>
<div class="rb-part-actions">
<button class="rb-link" type="button" @click="addPart">+ 添加要点</button>
<button
v-if="formOf(activeComment.id).parts.length > 1"
class="rb-link" type="button"
@click="removePart(formOf(activeComment.id).parts.length - 1)"
>移除最后一条</button>
</div>
</div>
<div class="rb-actions">
<button
class="rb-btn rb-btn-primary" type="button" data-testid="rb-draft"
:disabled="!canDraft || rb.draftCid === activeComment.id"
@click="genDraft"
>
{{ rb.draftCid === activeComment.id ? '生成中…' : '生成 draft' }}
</button>
<span class="rb-hint">填写要点后点击生成;内容会自动保存</span>
</div>
<p v-if="draftMsg" class="rb-err">{{ draftMsg }}</p>
<div v-if="validationFailed" class="rb-banner rb-banner-err" data-testid="rb-validation">
反幻觉校验未通过({{ validationOf.findings?.length || 0 }} 项):
<ul>
<li v-for="(f, i) in validationOf.findings" :key="i">[{{ f.code }}] {{ f.message }}</li>
</ul>
</div>
<div v-if="activeComment.draft" class="rb-draft" data-testid="rb-draft-preview">
<div class="rb-original-label">draft 预览</div>
<pre class="rb-draft-md">{{ activeComment.draft }}</pre>
</div>
</div>
<div v-else class="rb-empty">← 选择一条审稿意见开始回复</div>
<!-- 右:Letter 预览(可折叠) -->
<aside v-if="!letterCollapsed" class="rb-letter">
<div class="rb-letter-head">
<span class="rb-letter-count" data-testid="rb-letter-count">
{{ confirmedCount }}/{{ allComments.length }} 条已确认
</span>
<button class="rb-iconbtn" type="button" title="折叠" @click="letterCollapsed = true">»</button>
</div>
<div v-if="!letterComments.length" class="rb-empty rb-letter-empty">
尚无 draft —— 填写回复要点并生成后将在此预览
</div>
<div v-for="c in letterComments" :key="c.id" class="rb-letter-item">
<div class="rb-letter-title">{{ c.reviewer }} · {{ c.title }}</div>
<pre class="rb-letter-md">{{ c.draft }}</pre>
</div>
<div class="rb-letter-actions">
<button class="rb-btn" type="button" :disabled="letterAssembling" @click="assembleLetter">
{{ letterAssembling ? '拼装中…' : '拼装 letter' }}
</button>
<button
class="rb-btn rb-btn-primary" type="button" data-testid="rb-download"
:disabled="!job.human_ack || !job.letter_md" @click="downloadLetter"
>
下载 .md
</button>
</div>
<span v-if="!allConfirmed" class="rb-letter-gate" data-testid="rb-gate">
{{ unconfirmedCount }} 条未确认,下载暂不可用
</span>
<p v-if="letterError" class="rb-err">{{ letterError }}</p>
</aside>
<button v-else class="rb-letter-expand" type="button" title="展开 Letter 预览" @click="letterCollapsed = false">
« Letter
</button>
</div>
</section>
</div>
</template>
<style scoped>
/* 2026-10-12 深浅双主题适配:全部走 tokens.css 真实变量
(--pa-hairline/--pa-surface-N/--pa-raised/--pa-ink-N/--pa-g-*);
步骤徽章纯 CSS 圆形(无 emoji 数字圈,深色下对比度可控)。 */
.rb-root { display: flex; flex-direction: column; gap: 14px; padding: 18px 22px; max-width: 1280px; color: var(--pa-ink); }
.rb-title { font-size: 20px; margin: 0; color: var(--pa-ink); }
.rb-sub { color: var(--pa-ink-muted); font-size: 13px; margin: 4px 0 0; }
/* 步骤条:纯 CSS 圆形徽章 */
.rb-steps { display: flex; gap: 8px; list-style: none; margin: 0; padding: 0; flex-wrap: wrap; }
.rb-step {
display: flex; align-items: center; gap: 8px;
font-size: 12px; color: var(--pa-ink-subtle);
padding: 6px 14px 6px 8px; border-radius: var(--pa-r-pill);
background: var(--pa-surface-2); border: 1px solid var(--pa-hairline);
}
.rb-step-num {
width: 20px; height: 20px; border-radius: 50%;
display: inline-flex; align-items: center; justify-content: center;
font-size: 11px; font-weight: 600; flex-shrink: 0;
border: 1px solid var(--pa-ink-subtle); color: var(--pa-ink-subtle);
background: transparent;
}
/* 当前步骤:品牌渐变填充 + 白字 */
.rb-step.on {
background: var(--pa-surface-1); color: var(--pa-ink);
border-color: transparent; font-weight: 600;
}
.rb-step.on .rb-step-num {
background: var(--pa-gradient); border-color: transparent; color: #fff;
}
/* 已完成步骤:绿勾 + 提亮文字 */
.rb-step.past { color: var(--pa-success); border-color: var(--pa-hairline); }
.rb-step.past .rb-step-num {
border-color: var(--pa-success); color: var(--pa-success); background: transparent;
}
.rb-step.past .rb-step-num::before { content: '✓'; font-size: 11px; }
.rb-step.past .rb-step-num > .rb-step-digit { display: none; }
/* 输入区:surface 底,不用纯白 */
.rb-label, .rb-parts-label, .rb-original-label { font-size: 13px; font-weight: 600; color: var(--pa-ink); }
.rb-input-head { display: flex; justify-content: space-between; align-items: baseline; }
.rb-textarea {
width: 100%; box-sizing: border-box; font: inherit; padding: 10px;
background: var(--pa-surface-2); color: var(--pa-ink);
border: 1px solid var(--pa-hairline); border-radius: var(--pa-r-md);
min-height: 240px; max-height: 45vh; overflow-y: auto; resize: vertical;
}
.rb-textarea:focus { outline: none; border-color: var(--pa-g-from); }
.rb-textarea::placeholder { color: var(--pa-ink-subtle); }
.rb-input-actions { display: flex; gap: 12px; align-items: center; margin-top: 8px; }
/* PDF 次要卡片:虚线 = hairline 50% 透明;说明文字 = muted */
.rb-pdf-card {
margin-top: 12px; padding: 12px 14px;
border: 1px dashed color-mix(in srgb, var(--pa-hairline) 50%, transparent);
border-radius: var(--pa-r-lg);
display: flex; flex-direction: column; gap: 6px; align-items: flex-start;
background: var(--pa-surface-1);
}
.rb-pdf { margin-top: 4px; }
.rb-pdf input { font: inherit; color: var(--pa-ink); accent-color: var(--pa-g-from); }
.rb-btn {
padding: 6px 14px; border: 1px solid var(--pa-hairline-strong); border-radius: var(--pa-r-md);
background: var(--pa-raised); color: var(--pa-ink); cursor: pointer; font: inherit;
}
.rb-btn:hover:not(:disabled) { border-color: var(--pa-g-from); }
.rb-btn:disabled { opacity: 0.5; cursor: not-allowed; }
.rb-btn-primary { background: var(--pa-gradient); color: #fff; border-color: transparent; }
.rb-link { background: none; border: none; color: var(--pa-info); cursor: pointer; font: inherit; text-decoration: underline; }
.rb-danger { color: var(--pa-error); }
.rb-err { color: var(--pa-error); font-size: 13px; }
.rb-stance { margin: 4px 0 0; font-size: 12px; }
.rb-hint { color: var(--pa-ink-muted); font-size: 12px; margin: 0; }
/* 解析中 / 过期 / 失败 */
.rb-parsing, .rb-expired {
display: flex; flex-direction: column; align-items: center; gap: 8px; padding: 48px 20px;
border: 1px solid var(--pa-hairline); border-radius: var(--pa-r-lg); background: var(--pa-surface-1);
color: var(--pa-ink);
}
.rb-spinner {
width: 28px; height: 28px; border-radius: 50%;
border: 3px solid var(--pa-hairline-strong); border-top-color: var(--pa-g-to);
animation: rb-spin 0.8s linear infinite;
}
@keyframes rb-spin { to { transform: rotate(360deg); } }
/* 主区三栏:左/右 surface-2,中 surface-1 区分层级 */
.rb-toolbar { display: flex; justify-content: space-between; align-items: center; }
.rb-banner { padding: 8px 12px; border-radius: var(--pa-r-md); font-size: 13px; }
.rb-banner-warn { background: color-mix(in srgb, var(--pa-warning) 14%, transparent); color: var(--pa-warning); }
.rb-banner-ok { background: color-mix(in srgb, var(--pa-success) 14%, transparent); color: var(--pa-success); }
.rb-banner-err { background: color-mix(in srgb, var(--pa-error) 14%, transparent); color: var(--pa-error); margin-top: 8px; }
.rb-banner-err ul { margin: 4px 0 0 16px; padding: 0; }
.rb-cols { display: grid; grid-template-columns: 220px minmax(0, 1fr) 40%; gap: 14px; align-items: start; }
.rb-cols-2 { grid-template-columns: 220px minmax(0, 1fr) auto; }
.rb-tree {
border: 1px solid var(--pa-hairline); border-radius: var(--pa-r-lg);
padding: 6px; max-height: 560px; overflow: auto;
background: var(--pa-surface-2);
}
.rb-rev-label {
display: flex; align-items: center; gap: 4px; width: 100%; text-align: left;
border: none; background: none; font-weight: 600; font-size: 13px; cursor: pointer;
padding: 6px 4px; color: var(--pa-ink);
}
.rb-rev-caret { display: inline-block; transition: transform 0.15s; font-size: 11px; color: var(--pa-ink-muted); }
.rb-rev-caret.open { transform: rotate(90deg); }
.rb-c-item {
display: flex; gap: 6px; align-items: center; width: 100%; text-align: left;
padding: 5px 6px; border: none; background: none; cursor: pointer;
border-radius: var(--pa-r-sm); font: inherit; color: var(--pa-ink);
}
.rb-c-item.active { background: var(--pa-surface-3); box-shadow: inset 2px 0 0 var(--pa-g-from); }
.rb-c-ord {
width: 16px; height: 16px; border-radius: var(--pa-r-xs); background: var(--pa-surface-3); color: var(--pa-ink-muted);
font-size: 10px; display: inline-flex; align-items: center; justify-content: center; flex-shrink: 0;
}
.rb-c-title { flex: 1; font-size: 12px; overflow: hidden; text-overflow: ellipsis; white-space: nowrap; color: var(--pa-ink); }
.rb-c-sev { font-size: 10px; padding: 1px 5px; border-radius: var(--pa-r-pill); flex-shrink: 0; }
.rb-c-sev.major { background: color-mix(in srgb, var(--pa-error) 18%, transparent); color: var(--pa-error); }
.rb-c-sev.minor { background: color-mix(in srgb, var(--pa-warning) 18%, transparent); color: var(--pa-warning); }
.rb-c-sev.question { background: color-mix(in srgb, var(--pa-info) 18%, transparent); color: var(--pa-info); }
.rb-c-dot { width: 8px; height: 8px; border-radius: 50%; flex-shrink: 0; }
.rb-c-dot.empty { background: var(--pa-ink-subtle); }
.rb-c-dot.filled { background: var(--pa-info); }
.rb-c-dot.done { background: var(--pa-success); }
.rb-form {
border: 1px solid var(--pa-hairline); border-radius: var(--pa-r-lg); padding: 14px;
display: flex; flex-direction: column; gap: 10px; background: var(--pa-surface-1);
}
.rb-form-head { display: flex; justify-content: space-between; align-items: center; gap: 10px; }
.rb-form-title { margin: 0; font-size: 15px; color: var(--pa-ink); }
.rb-confirm { font-size: 13px; display: flex; gap: 6px; align-items: center; white-space: nowrap; color: var(--pa-ink); }
.rb-original { background: var(--pa-surface-2); border-radius: var(--pa-r-md); padding: 8px 10px; }
.rb-original-body { margin: 4px 0 0; font-size: 13px; white-space: pre-wrap; color: var(--pa-ink); }
.rb-point {
display: flex; gap: 8px; align-items: flex-start;
border: 1px solid var(--pa-hairline); border-radius: var(--pa-r-md); padding: 8px 10px;
background: var(--pa-surface-2);
}
.rb-point-body { flex: 1; }
.rb-point-text { margin: 2px 0 0; font-size: 13px; font-weight: 600; color: var(--pa-ink); }
.rb-iconbtn {
border: 1px solid var(--pa-hairline); background: var(--pa-raised); border-radius: var(--pa-r-sm);
cursor: pointer; font-size: 13px; padding: 2px 8px; color: var(--pa-ink-muted);
}
.rb-iconbtn:hover { color: var(--pa-ink); border-color: var(--pa-g-from); }
.rb-xref { font-size: 12px; color: var(--pa-ink-muted); }
.rb-part { display: flex; flex-direction: column; gap: 6px; margin-top: 8px; }
.rb-select, .rb-part-hint {
font: inherit; padding: 6px 8px; border: 1px solid var(--pa-hairline); border-radius: var(--pa-r-md);
max-width: 320px; background: var(--pa-surface-2); color: var(--pa-ink);
}
.rb-part-content {
font: inherit; padding: 8px; border: 1px solid var(--pa-hairline); border-radius: var(--pa-r-md);
background: var(--pa-surface-2); color: var(--pa-ink);
}
.rb-part-content::placeholder, .rb-part-hint::placeholder { color: var(--pa-ink-subtle); }
.rb-part-actions { display: flex; gap: 12px; margin-top: 6px; }
.rb-actions { display: flex; gap: 8px; flex-wrap: wrap; align-items: center; }
.rb-draft { border-top: 1px solid var(--pa-hairline); padding-top: 8px; }
.rb-draft-md {
white-space: pre-wrap; font-size: 13px; background: var(--pa-code-bg);
border: 1px solid var(--pa-hairline); border-radius: var(--pa-r-md); padding: 10px; margin: 6px 0 0;
color: var(--pa-ink);
}
.rb-empty { color: var(--pa-ink-subtle); padding: 30px; text-align: center; }
/* 右栏 letter:surface-2 与中栏区分 */
.rb-letter {
border: 1px solid var(--pa-hairline); border-radius: var(--pa-r-lg); padding: 10px;
max-height: 640px; overflow: auto; display: flex; flex-direction: column; gap: 8px;
background: var(--pa-surface-2);
}
.rb-letter-head { display: flex; justify-content: space-between; align-items: center; }
.rb-letter-count { font-size: 12px; font-weight: 600; color: var(--pa-success); }
.rb-letter-empty { padding: 16px; font-size: 12px; }
.rb-letter-item { border-top: 1px solid var(--pa-hairline); padding-top: 6px; }
.rb-letter-title { font-size: 12px; font-weight: 600; margin-bottom: 4px; color: var(--pa-ink); }
.rb-letter-md {
white-space: pre-wrap; font-size: 12px; background: var(--pa-code-bg);
border: 1px solid var(--pa-hairline); border-radius: var(--pa-r-md); padding: 8px; margin: 0;
color: var(--pa-ink);
}
.rb-letter-actions { display: flex; gap: 8px; flex-wrap: wrap; }
.rb-letter-gate { font-size: 12px; color: var(--pa-warning); }
.rb-letter-expand {
writing-mode: vertical-rl; border: 1px solid var(--pa-hairline); background: var(--pa-surface-2);
border-radius: var(--pa-r-lg); cursor: pointer; font: inherit; font-size: 12px; padding: 12px 4px;
color: var(--pa-ink-muted);
}
.rb-letter-expand:hover { color: var(--pa-ink); border-color: var(--pa-g-from); }
@media (max-width: 1100px) {
.rb-cols, .rb-cols-2 { grid-template-columns: 200px minmax(0, 1fr); }
.rb-letter { grid-column: 1 / -1; max-height: none; }
.rb-letter-expand { display: none; }
}
</style>
@@ -0,0 +1,507 @@
<!-- RecommendPanel.vue —— ② 智能投稿推荐(步骤7,产品核心功能)。
链路:表单草稿 → edu.submitRecommend(payload) → POST /api/review/recommend(JSON)
→ {ok, tiers{challenge,fit,safe}{label,items}, meta{vector_ok,llm_ok,...}}
(真实响应结构已于写入前 curl 8100 核对,按真实字段渲染)。
纯文本粘贴版(PDF 上传后续迭代);目标期刊字段首版砍掉(后端无此入参)。
tier chips 为纯前端结果筛选(不改 payload 语义);结果与草稿存 edu store,
切菜单往返不丢、mount 无请求。D2 同样只读。 -->
<script setup>
import { computed } from 'vue';
import { useEduStore } from '../../../stores/edu.js';
const edu = useEduStore();
const TIERS = ['challenge', 'fit', 'safe'];
const FILTERS = [
{ key: 'all', label: '全部' },
{ key: 'challenge', label: '挑战' },
{ key: 'fit', label: '适配' },
{ key: 'safe', label: '稳妥' },
];
const abstractLen = computed(() => edu.drafts.abstract.trim().length);
const abstractOk = computed(() => abstractLen.value >= 50);
const loading = computed(() => edu.recommendStatus === 'loading');
const errored = computed(() => edu.recommendStatus === 'error');
const result = computed(() =>
edu.recommend && edu.recommend.ok && edu.recommend.tiers ? edu.recommend : null
);
const meta = computed(() => result.value?.meta || null);
const visibleTiers = computed(() => {
if (!result.value) return [];
const f = edu.drafts.tierFilter;
return TIERS.filter((k) => f === 'all' || f === k);
});
const itemsOf = (key) => result.value?.tiers?.[key]?.items || [];
const labelOf = (key) => result.value?.tiers?.[key]?.label || key;
function setFilter(k) {
edu.drafts.tierFilter = k;
}
/** prefs(同构草稿)→ preferences(接口字段):null 数值剔除,tier_focus 恒 'all'(chips 纯前端筛选) */
function buildPayload() {
const { max_review_weeks: w, min_impact_factor: inf, tier_focus: focus } = edu.drafts.prefs;
const preferences = { tier_focus: focus || 'all' };
const num = (v) => (v === null || v === undefined || v === '' || Number.isNaN(Number(v)) ? null : Number(v));
const nw = num(w);
const ninf = num(inf);
// 本地钳制到接口 pydantic 范围(越界会触发 FastAPI 422 非信封响应)
if (nw !== null) preferences.max_review_weeks = Math.min(104, Math.max(1, nw));
if (ninf !== null) preferences.min_impact_factor = Math.min(200, Math.max(0, ninf));
return { abstract: edu.drafts.abstract.trim(), preferences };
}
async function submit() {
if (!abstractOk.value || loading.value) return;
await edu.submitRecommend(buildPayload());
}
const fmt = (v) => (v === null || v === undefined ? '—' : v);
const riskClass = (note) => {
if (!note || note === '无') return 'none';
return String(note).includes('⚠') ? 'warn' : '';
};
</script>
<template>
<section class="rp">
<header class="rp-head">
<h1 class="rp-title">智能投稿推荐</h1>
<span class="rp-sub">向量匹配期刊范围 + LLM 三档重排</span>
</header>
<!-- ========== 表单区(草稿存 edu.drafts,切菜单不丢) ========== -->
<div class="rp-form">
<label class="rp-label" for="rp-abstract">
论文摘要 <span class="rp-req">必填</span>
</label>
<textarea
id="rp-abstract"
v-model="edu.drafts.abstract"
class="rp-textarea"
rows="7"
maxlength="20000"
placeholder="粘贴论文摘要(≥50 字符),或粘贴全文前 500 字"
></textarea>
<div class="rp-count" :class="{ ok: abstractOk }">
{{ edu.drafts.abstract.trim().length }} / 20000 字符
<span v-if="!abstractOk">· 至少需要 50 字符</span>
</div>
<div class="rp-prefs">
<div class="rp-field">
<label class="rp-label" for="rp-weeks">最大审稿周期(周,选填)</label>
<input
id="rp-weeks"
v-model.number="edu.drafts.prefs.max_review_weeks"
class="rp-input"
type="number"
min="1"
max="104"
placeholder="如 8"
/>
</div>
<div class="rp-field">
<label class="rp-label" for="rp-if">最低影响因子(选填)</label>
<input
id="rp-if"
v-model.number="edu.drafts.prefs.min_impact_factor"
class="rp-input"
type="number"
min="0"
max="200"
step="0.1"
placeholder="如 3"
/>
</div>
</div>
<button
class="rp-submit"
type="button"
:disabled="!abstractOk || loading"
@click="submit"
>
{{ loading ? '推荐生成中…(约 10–30 秒)' : '开始推荐' }}
</button>
</div>
<!-- ========== 状态区 ========== -->
<div v-if="loading" class="rp-state" aria-busy="true">
<div class="rp-skel"></div>
<div class="rp-skel rp-skel-mid"></div>
<div class="rp-skel"></div>
<p class="rp-state-msg">正在进行向量匹配与 LLM 重排,请稍候…</p>
</div>
<div v-else-if="errored" class="rp-state" role="alert">
<p class="rp-state-msg rp-state-error">{{ edu.recommendError }}</p>
<button class="rp-retry" type="button" @click="submit">重试</button>
</div>
<div v-else-if="!result" class="rp-state">
<p class="rp-state-msg">粘贴摘要后点击「开始推荐」:从期刊库语义匹配候选,按挑战/适配/稳妥三档给出匹配理由与风险提示。</p>
</div>
<!-- ========== 结果区 ========== -->
<template v-else>
<!-- 降级横幅(meta 标志,非报错红) -->
<div v-if="meta && (!meta.vector_ok || !meta.llm_ok)" class="rp-degraded">
{{ !meta.llm_ok ? 'LLM 不可用:以下为影响因子/周期规则分档' : '向量匹配降级:按全量期刊范围重排' }}
</div>
<!-- 结果元信息 -->
<div v-if="meta" class="rp-meta">
候选 {{ meta.candidate_count }} / 种子 {{ meta.seed_count }} 本
· 幻觉丢弃 {{ meta.dropped_hallucinated }} · 规则补位 {{ meta.repaired }}
</div>
<!-- 档位 chips(纯前端筛选,不重查) -->
<div class="rp-chips" role="tablist" aria-label="档位筛选">
<button
v-for="f in FILTERS"
:key="f.key"
class="rp-chip"
:class="{ on: edu.drafts.tierFilter === f.key }"
type="button"
role="tab"
:aria-selected="edu.drafts.tierFilter === f.key"
@click="setFilter(f.key)"
>
{{ f.label }}
</button>
</div>
<section v-for="key in visibleTiers" :key="key" class="rp-tier">
<h2 class="rp-tier-head">
<span class="rp-dot" :class="key" aria-hidden="true"></span>
{{ labelOf(key) }}
<span class="rp-tier-count">{{ itemsOf(key).length }} 本</span>
</h2>
<p v-if="!itemsOf(key).length" class="rp-empty">本档暂无期刊</p>
<article v-for="it in itemsOf(key)" :key="it.id" class="rp-card">
<header class="rp-card-head">
<span class="rp-card-name">{{ it.name }}</span>
<span class="rp-card-metrics">
<span class="rp-metric">IF {{ fmt(it.impact_factor) }}</span>
<span class="rp-metric">约 {{ fmt(it.review_time_weeks) }} 周</span>
<a
v-if="it.official_url"
class="rp-link"
:href="it.official_url"
target="_blank"
rel="noopener"
>官网 ↗</a>
</span>
</header>
<p v-if="it.similarity !== null && it.similarity !== undefined" class="rp-sim">
语义匹配 {{ Number(it.similarity).toFixed(2) }}
</p>
<p class="rp-reason">
<span class="rp-k">匹配理由</span>{{ it.match_reason }}
</p>
<p class="rp-risk" :class="riskClass(it.risk_note)">
<span class="rp-k">风险</span>{{ it.risk_note }}
</p>
</article>
</section>
</template>
</section>
</template>
<style scoped>
.rp {
display: flex;
flex-direction: column;
gap: 14px;
}
.rp-head {
display: flex;
align-items: baseline;
gap: 10px;
}
.rp-title {
margin: 0;
font-size: 16px;
font-weight: 600;
color: var(--pa-ink);
}
.rp-sub {
font-size: 12px;
color: var(--pa-ink-subtle);
}
.rp-form {
display: flex;
flex-direction: column;
gap: 8px;
padding: 14px 16px;
background: var(--pa-surface-1);
border: 1px solid var(--pa-hairline);
border-radius: var(--pa-r-lg);
}
.rp-label {
font-size: 12px;
font-weight: 500;
color: var(--pa-ink-muted);
}
.rp-req {
margin-left: 4px;
font-size: 11px;
color: var(--pa-warning);
}
.rp-textarea {
width: 100%;
box-sizing: border-box;
resize: vertical;
min-height: 120px;
padding: 10px 12px;
border: 1px solid var(--pa-hairline);
border-radius: var(--pa-r-md);
background: var(--pa-surface-2);
color: var(--pa-ink);
font-family: var(--pa-font-ui);
font-size: 13px;
line-height: 1.55;
}
.rp-textarea:focus {
outline: none;
border-color: var(--pa-g-from);
}
.rp-count {
font-size: 11.5px;
color: var(--pa-ink-subtle);
text-align: right;
}
.rp-count.ok {
color: var(--pa-success);
}
.rp-prefs {
display: flex;
gap: 14px;
flex-wrap: wrap;
}
.rp-field {
display: flex;
flex-direction: column;
gap: 5px;
}
.rp-input {
width: 150px;
box-sizing: border-box;
padding: 6px 10px;
border: 1px solid var(--pa-hairline);
border-radius: var(--pa-r-md);
background: var(--pa-surface-2);
color: var(--pa-ink);
font-family: var(--pa-font-mono);
font-size: 13px;
}
.rp-input:focus {
outline: none;
border-color: var(--pa-g-from);
}
.rp-submit {
align-self: flex-start;
padding: 8px 22px;
border: none;
border-radius: var(--pa-r-md);
background: var(--pa-gradient);
color: #fff;
font-size: 13px;
font-weight: 600;
cursor: pointer;
transition: opacity .15s var(--pa-ease);
}
.rp-submit:disabled {
opacity: .45;
cursor: not-allowed;
}
.rp-state {
display: flex;
flex-direction: column;
gap: 8px;
padding: 6px 0;
}
.rp-skel {
height: 56px;
border-radius: var(--pa-r-md);
background: var(--pa-surface-2);
animation: rp-pulse 1.2s var(--pa-ease) infinite alternate;
}
.rp-skel-mid {
height: 88px;
}
@keyframes rp-pulse {
from { opacity: .55; }
to { opacity: 1; }
}
.rp-state-msg {
margin: 0;
font-size: 13px;
line-height: 1.6;
color: var(--pa-ink-muted);
}
.rp-state-error {
color: var(--pa-error);
}
.rp-retry {
align-self: flex-start;
padding: 5px 14px;
border: none;
border-radius: var(--pa-r-md);
background: var(--pa-surface-2);
color: var(--pa-ink);
font-size: 12px;
cursor: pointer;
}
.rp-retry:hover {
background: var(--pa-surface-3);
}
.rp-degraded {
padding: 8px 12px;
border-radius: var(--pa-r-md);
background: var(--pa-surface-2);
border-left: 3px solid var(--pa-warning);
font-size: 12.5px;
color: var(--pa-warning);
}
.rp-meta {
font-size: 11.5px;
color: var(--pa-ink-subtle);
}
.rp-chips {
display: flex;
gap: 8px;
}
.rp-chip {
padding: 4px 14px;
border: 1px solid var(--pa-hairline);
border-radius: var(--pa-r-pill);
background: transparent;
color: var(--pa-ink-muted);
font-size: 12px;
cursor: pointer;
transition: color .15s var(--pa-ease), background .15s var(--pa-ease);
}
.rp-chip:hover {
color: var(--pa-ink);
}
.rp-chip.on {
color: #fff;
background: var(--pa-g-from);
border-color: transparent;
font-weight: 600;
}
.rp-tier {
display: flex;
flex-direction: column;
gap: 10px;
}
.rp-tier-head {
display: flex;
align-items: center;
gap: 8px;
margin: 0;
font-size: 14px;
font-weight: 600;
color: var(--pa-ink);
}
.rp-dot {
width: 8px;
height: 8px;
border-radius: 50%;
flex: none;
}
.rp-dot.challenge { background: var(--pa-warning); }
.rp-dot.fit { background: var(--pa-info); }
.rp-dot.safe { background: var(--pa-success); }
.rp-tier-count {
font-size: 11.5px;
font-weight: 400;
color: var(--pa-ink-subtle);
}
.rp-empty {
margin: 0;
font-size: 12.5px;
color: var(--pa-ink-subtle);
}
.rp-card {
display: flex;
flex-direction: column;
gap: 6px;
padding: 12px 14px;
background: var(--pa-surface-1);
border: 1px solid var(--pa-hairline);
border-radius: var(--pa-r-md);
transition: background .15s var(--pa-ease);
}
.rp-card:hover {
background: var(--pa-surface-2);
}
.rp-card-head {
display: flex;
align-items: center;
justify-content: space-between;
gap: 12px;
flex-wrap: wrap;
}
.rp-card-name {
font-size: 14px;
font-weight: 600;
color: var(--pa-ink);
}
.rp-card-metrics {
display: flex;
align-items: center;
gap: 10px;
}
.rp-metric {
font-family: var(--pa-font-mono);
font-size: 12px;
color: var(--pa-ink-muted);
}
.rp-link {
font-size: 12px;
color: var(--pa-g-from);
text-decoration: none;
}
.rp-link:hover {
text-decoration: underline;
}
.rp-sim {
margin: 0;
font-size: 11.5px;
color: var(--pa-ink-subtle);
}
.rp-reason,
.rp-risk {
margin: 0;
font-size: 13px;
line-height: 1.6;
}
.rp-reason {
color: var(--pa-ink);
}
.rp-risk {
color: var(--pa-ink-muted);
}
.rp-risk.warn {
color: var(--pa-warning);
}
.rp-risk.none {
color: var(--pa-ink-subtle);
}
.rp-k {
display: inline-block;
margin-right: 8px;
padding: 1px 7px;
border-radius: var(--pa-r-sm);
background: var(--pa-surface-3);
font-size: 11px;
color: var(--pa-ink-muted);
vertical-align: 1px;
}
</style>
File diff suppressed because it is too large Load Diff
@@ -0,0 +1,433 @@
<!-- ReportPanel.vue —— ④ 专业审稿意见报告(读者视角,正式报告版式)。
与 PresubmitPanel(作者视角·修改工作台)共用同一份 edu.report
({ok, report{summary, major/minor_weaknesses[], presentation_format[],
questions_for_authors[], recommendation}, meta{filename,target_journal,text_chars,truncated,model}}),
生成时间取 edu.reportCreatedAt(store 盖章,payload 无时间字段)。
无报告 → 引导去 section='presubmit'。
工具栏:导出 PDF = window.print()(打印时 :global 隐藏 .edu-sidenav/.top-bar/.rp-toolbar);
复制 Markdown = clipboard API(安全上下文)→ execCommand 兜底(LAN http:// 非安全上下文)。
不动 presubmit 后端 / self_review.py / 六维 Prompt,纯前端只读展示。 -->
<script setup>
import { computed, onUnmounted, ref } from 'vue';
import { useEduStore } from '../../../stores/edu.js';
const edu = useEduStore();
const REC = {
accept: { label: '接收', cls: 'ok' },
minor_revision: { label: '小修', cls: 'minor' },
major_revision: { label: '大修', cls: 'major' },
reject: { label: '拒稿', cls: 'reject' },
};
const toast = ref(false);
let toastTimer = null;
const report = computed(() => edu.report?.report || null);
const meta = computed(() => edu.report?.meta || null);
const rec = computed(() => REC[report.value?.recommendation] || REC.major_revision);
const createdAtText = computed(() => {
const s = edu.reportCreatedAt;
// ISO → "10-12 15:25" 短格式(不裸露完整时间戳)
return s ? String(s).slice(5, 16).replace('T', ' ') : '—';
});
/* 五节结构:1 总体评价(summary 单列)+ 2..5 列表节(questions 映射为 {title} 条目) */
const sections = computed(() => {
const r = report.value;
if (!r) return [];
return [
{ title: '主要问题', items: r.major_weaknesses || [] },
{ title: '次要问题', items: r.minor_weaknesses || [] },
{ title: '排版与规范', items: r.presentation_format || [] },
{
title: '给作者的问题',
items: (r.questions_for_authors || []).map((q) => ({ title: q, detail: '', evidence: '', suggestion: '' })),
},
];
});
function exportPdf() {
window.print();
}
function buildMarkdown() {
const r = report.value;
if (!r) return '';
const m = meta.value || {};
const lines = [
'# AI 预审稿报告',
'',
`- 文件:${m.filename || '—'}`,
`- 目标期刊:${m.target_journal || '未指定'}`,
`- 生成时间:${createdAtText.value}`,
`- 推荐决定:${rec.value.label}(${r.recommendation})`,
'',
'## 总体评价',
'',
r.summary || '无',
'',
];
const weakSec = (title, items) => {
lines.push(`## ${title}`, '');
if (!items || !items.length) {
lines.push('无', '');
return;
}
items.forEach((it, i) => {
lines.push(`${i + 1}. ${it.title}`, '');
if (it.detail) lines.push(it.detail, '');
if (it.evidence) lines.push(` - 证据:${it.evidence}`);
if (it.suggestion) lines.push(` - 建议:${it.suggestion}`);
lines.push('');
});
};
weakSec('主要问题', r.major_weaknesses);
weakSec('次要问题', r.minor_weaknesses);
weakSec('排版与规范', r.presentation_format);
lines.push('## 给作者的问题', '');
const qs = r.questions_for_authors || [];
if (!qs.length) lines.push('无', '');
else qs.forEach((q, i) => lines.push(`${i + 1}. ${q}`));
lines.push('', '---', `*正文 ${m.text_chars ?? '—'} 字符${m.truncated ? ' · 已截断' : ''}*`);
return lines.join('\n');
}
function showToast() {
toast.value = true;
clearTimeout(toastTimer);
toastTimer = setTimeout(() => (toast.value = false), 1600);
}
async function copyMarkdown() {
const text = buildMarkdown();
if (!text) return;
let ok = false;
try {
if (navigator.clipboard && window.isSecureContext) {
await navigator.clipboard.writeText(text);
ok = true;
}
} catch {
/* fallthrough → execCommand 兜底 */
}
if (!ok) {
// LAN http:// 非安全上下文 navigator.clipboard 不可用 → 隐藏 textarea + execCommand
try {
const ta = document.createElement('textarea');
ta.value = text;
ta.style.cssText = 'position:fixed;top:-1000px;opacity:0';
document.body.appendChild(ta);
ta.select();
ok = document.execCommand('copy');
ta.remove();
} catch {
ok = false;
}
}
if (ok) showToast();
}
onUnmounted(() => clearTimeout(toastTimer));
</script>
<template>
<section class="rp">
<!-- ========== ① 无报告 → 引导 ========== -->
<div v-if="!edu.hasReport" class="rp-guide">
<div class="rp-guide-icon" aria-hidden="true">📝</div>
<p class="rp-guide-text">尚无审稿报告。先上传 PDF 运行 AI 预审稿,生成后在此查看正式报告。</p>
<button class="rp-guide-btn" type="button" @click="edu.setSection('presubmit')">
去预审稿 →
</button>
</div>
<!-- ========== ② 有报告 → 正式报告(读者视角) ========== -->
<template v-else>
<div class="rp-toolbar">
<button class="rp-tool" type="button" @click="exportPdf">📥 导出 PDF</button>
<button class="rp-tool" type="button" @click="copyMarkdown">📋 复制为 Markdown</button>
<transition name="rp-fade">
<span v-if="toast" class="rp-toast" role="status">已复制</span>
</transition>
</div>
<article class="rp-sheet">
<header class="rp-head">
<h1 class="rp-title">AI 预审稿报告</h1>
<div class="rp-headmeta">
<span class="rp-meta-line">
📄 {{ meta?.filename || '—' }}
<template v-if="meta?.target_journal"> · 目标期刊 {{ meta.target_journal }}</template>
· 生成于 {{ createdAtText }}
</span>
<span class="rp-rec" :class="rec.cls">{{ rec.label }} · {{ report.recommendation }}</span>
</div>
</header>
<!-- 1. 总体评价 -->
<section class="rp-sec">
<h2 class="rp-h2">1. 总体评价</h2>
<p class="rp-summary">{{ report.summary || '无' }}</p>
</section>
<!-- 2..5 列表节 -->
<section v-for="(s, si) in sections" :key="s.title" class="rp-sec">
<h2 class="rp-h2">{{ si + 2 }}. {{ s.title }}({{ s.items.length }})</h2>
<div v-for="(it, i) in s.items" :key="i" class="rp-item">
<p class="rp-item-title">{{ i + 1 }}. {{ it.title }}</p>
<p v-if="it.detail" class="rp-item-detail">{{ it.detail }}</p>
<p v-if="it.evidence" class="rp-item-evi"><b>证据:</b>{{ it.evidence }}</p>
<p v-if="it.suggestion" class="rp-item-sug"><b>建议:</b>{{ it.suggestion }}</p>
</div>
<p v-if="!s.items.length" class="rp-none">无</p>
</section>
<footer class="rp-foot">
正文 {{ meta?.text_chars ?? '—' }} 字符<template
v-if="meta?.truncated"
> · 已截断至 6 万字符</template
> · 报告生成于 {{ createdAtText }}
</footer>
</article>
</template>
</section>
</template>
<style scoped>
.rp {
display: flex;
flex-direction: column;
gap: 14px;
}
/* ---------- 引导空态 ---------- */
.rp-guide {
display: flex;
flex-direction: column;
align-items: center;
gap: 10px;
padding: 56px 24px;
text-align: center;
border: 1px dashed var(--pa-hairline);
border-radius: var(--pa-r-lg);
}
.rp-guide-icon {
font-size: 30px;
}
.rp-guide-text {
margin: 0;
font-size: 13.5px;
line-height: 1.7;
color: var(--pa-ink-muted);
max-width: 420px;
}
.rp-guide-btn {
padding: 8px 22px;
border: none;
border-radius: var(--pa-r-md);
background: var(--pa-gradient);
color: #fff;
font-size: 13px;
font-weight: 600;
cursor: pointer;
}
.rp-guide-btn:hover {
filter: brightness(1.08);
}
/* ---------- 工具栏 ---------- */
.rp-toolbar {
position: relative;
display: flex;
gap: 10px;
}
.rp-tool {
padding: 7px 16px;
border: 1px solid var(--pa-hairline);
border-radius: var(--pa-r-md);
background: var(--pa-surface-1);
color: var(--pa-ink);
font-size: 12.5px;
cursor: pointer;
}
.rp-tool:hover {
background: var(--pa-surface-2);
border-color: var(--pa-hairline-strong);
}
.rp-toast {
position: absolute;
left: 50%;
top: -8px;
transform: translate(-50%, -100%);
padding: 5px 14px;
border-radius: var(--pa-r-pill);
background: var(--pa-raised);
border: 1px solid var(--pa-success);
color: var(--pa-success);
font-size: 12px;
pointer-events: none;
}
.rp-fade-enter-active,
.rp-fade-leave-active {
transition: opacity .2s var(--pa-ease);
}
.rp-fade-enter-from,
.rp-fade-leave-to {
opacity: 0;
}
/* ---------- 纸面版式:等宽正式报告,左右留白宽、行距松 ---------- */
.rp-sheet {
max-width: 760px;
width: 100%;
margin: 0 auto;
padding: 40px 56px;
box-sizing: border-box;
background: var(--pa-surface-1);
border: 1px solid var(--pa-hairline);
border-radius: var(--pa-r-lg);
font-family: var(--pa-font-mono);
color: var(--pa-ink);
line-height: 1.85;
}
.rp-head {
padding-bottom: 16px;
border-bottom: 2px solid var(--pa-hairline-strong);
}
.rp-title {
margin: 0 0 10px;
font-family: var(--pa-font-mono);
font-size: 19px;
font-weight: 700;
letter-spacing: .04em;
}
.rp-headmeta {
display: flex;
align-items: center;
justify-content: space-between;
gap: 12px;
flex-wrap: wrap;
}
.rp-meta-line {
font-size: 12px;
color: var(--pa-ink-muted);
}
.rp-rec {
display: inline-flex;
padding: 3px 14px;
border: 1px solid currentColor;
border-radius: var(--pa-r-pill);
font-size: 12.5px;
font-weight: 700;
white-space: nowrap;
}
.rp-rec.ok { color: var(--pa-success); }
.rp-rec.minor { color: var(--pa-info); }
.rp-rec.major { color: var(--pa-warning); }
.rp-rec.reject { color: var(--pa-error); }
.rp-sec {
margin-top: 26px;
}
.rp-h2 {
margin: 0 0 12px;
font-family: var(--pa-font-mono);
font-size: 14.5px;
font-weight: 700;
color: var(--pa-ink);
letter-spacing: .03em;
}
.rp-summary {
margin: 0;
font-size: 13.5px;
line-height: 1.95;
color: var(--pa-ink);
}
.rp-item {
padding: 13px 0;
border-bottom: 1px solid var(--pa-hairline);
}
.rp-item:last-child {
border-bottom: none;
}
.rp-item-title {
margin: 0 0 6px;
font-size: 13.5px;
font-weight: 700;
line-height: 1.7;
color: var(--pa-ink);
}
.rp-item-detail {
margin: 0;
font-size: 13px;
line-height: 1.9;
color: var(--pa-ink);
}
.rp-item-evi {
margin: 9px 0 0;
padding-left: 13px;
border-left: 3px solid var(--pa-hairline-strong);
font-size: 12.5px;
line-height: 1.8;
color: var(--pa-ink-muted);
}
.rp-item-sug {
margin: 6px 0 0;
font-size: 12.5px;
line-height: 1.8;
color: var(--pa-ink-muted);
}
.rp-item-evi b,
.rp-item-sug b {
color: var(--pa-ink);
font-weight: 700;
}
.rp-none {
margin: 0;
font-size: 13px;
color: var(--pa-ink-subtle);
}
.rp-foot {
margin-top: 30px;
padding-top: 14px;
border-top: 1px dashed var(--pa-hairline);
font-family: var(--pa-font-mono);
font-size: 11.5px;
color: var(--pa-ink-subtle);
}
/* ---------- 打印(导出 PDF = window.print):只留报告纸面 ----------
注:打印态下 #fff/#000/#bbb 为硬编码(仅 @media print 生效)——
屏幕用暗色主题变量直接打印会输出大面积黑底,故打印强制白底黑字。 */
@media print {
:global(.edu-sidenav),
:global(.top-bar),
.rp-toolbar {
display: none !important;
}
/* 2026-10-12 修"导出只导一页":祖先链 height:100vh + overflow:auto 会把打印
内容裁在视口第一页——打印态整链展开为正常文档流,让浏览器自然分页。 */
:global(.edu-workspace) {
height: auto !important;
display: block !important;
}
:global(.edu-panel) {
height: auto !important;
overflow: visible !important;
display: block !important;
padding: 0 !important;
}
.rp-sheet {
max-width: none;
padding: 0;
border: none;
background: #fff;
}
.rp-sheet * {
color: #000 !important;
background: transparent !important;
border-color: #bbb !important;
}
}
</style>
@@ -0,0 +1,480 @@
<!-- TrackerPanel.vue —— ⑦ 投稿进度台账(纯前端 localStorage,无后端)。
v3 方案 A 极简台账(2026-10-12):
- 定位:只做"我投了哪些稿、现在什么状态",不与 Rebuttal 假联动
- 顶部统计条:总投稿 | 进行中 | 待返修 | 已接收 | 已拒绝
- 卡片:期刊/状态/日期/备注 + 返修轮次与截止倒计时(台账信息)
- "去写返修"仅在 status ∈ {under_review, revision} 显示,跳转 RebuttalPanel
自行操作;不回写 jobId、不显示"已开启/未开始"联动徽章
- 表单保留返修截止日/返修轮次字段(台账数据)
方案 B 真联动(回写 jobId + 返修时间线)留待 Phase 2。 -->
<script setup>
import { computed, reactive, ref } from 'vue';
import { useEduStore, SUBMISSION_STATUS } from '../../../stores/edu.js';
const edu = useEduStore();
const STATUS_LABEL = {
draft: '草稿',
submitted: '已投稿',
under_review: '审稿中',
revision: '返修中',
accepted: '录用',
rejected: '拒稿',
};
const formOpen = ref(false);
const mode = ref('create'); // 'create' | 'edit'
const editingId = ref(null);
const formError = ref('');
const pendingDeleteId = ref(null); // 删除行内二次确认
const form = reactive({
journal: '', status: 'draft', date: '', notes: '',
revisionDue: '', revisionRound: '',
});
const todayStr = () => new Date().toISOString().slice(0, 10);
const dateOf = (s) => String(s || '').slice(0, 10);
const dtOf = (s) => String(s || '').slice(0, 16).replace('T', ' ');
// 返修截止倒计时:"overdue 2d" / "due today" / "due in 3d"
function dueText(due) {
if (!due) return '';
const dueDay = new Date(`${String(due).slice(0, 10)}T23:59:59`);
const diff = Math.ceil((dueDay - Date.now()) / 86400000);
if (Number.isNaN(diff)) return `due ${dateOf(due)}`;
if (diff < 0) return `已逾期 ${-diff} 天`;
if (diff === 0) return '今天截止';
return `还剩 ${diff} 天`;
}
const stats = computed(() => {
const rows = edu.submissionsSorted;
return {
total: rows.length,
active: rows.filter((r) => r.status === 'submitted' || r.status === 'under_review').length,
revision: rows.filter((r) => r.status === 'revision').length,
accepted: rows.filter((r) => r.status === 'accepted').length,
rejected: rows.filter((r) => r.status === 'rejected').length,
};
});
function openCreate() {
mode.value = 'create';
editingId.value = null;
form.journal = '';
form.status = 'draft';
form.date = todayStr();
form.notes = '';
form.revisionDue = '';
form.revisionRound = '';
formError.value = '';
pendingDeleteId.value = null;
formOpen.value = true;
}
function openEdit(row) {
mode.value = 'edit';
editingId.value = row.id;
form.journal = row.journal;
form.status = row.status;
form.date = dateOf(row.submittedAt);
form.notes = row.notes || '';
form.revisionDue = row.revisionDue || '';
form.revisionRound = row.revisionRound != null ? String(row.revisionRound) : '';
formError.value = '';
pendingDeleteId.value = null;
formOpen.value = true;
}
function closeForm() {
formOpen.value = false;
formError.value = '';
}
function save() {
const journal = form.journal.trim();
if (!journal) {
formError.value = '请输入期刊名';
return;
}
const round = form.revisionRound === '' ? null : Math.max(1, parseInt(form.revisionRound, 10) || 1);
const extra = {
notes: form.notes,
revisionDue: form.revisionDue || '',
revisionRound: round,
};
if (mode.value === 'create') {
const rec = edu.addSubmission({ journal, status: form.status, ...extra });
// addSubmission 默认 submittedAt=now(ISO);仅当用户改了投稿日期才补丁
if (form.date && form.date !== todayStr()) {
edu.updateSubmission(rec.id, { submittedAt: form.date });
}
} else {
edu.updateSubmission(editingId.value, {
journal, status: form.status, submittedAt: form.date, ...extra,
});
}
closeForm();
}
function confirmDelete() {
if (pendingDeleteId.value) edu.removeSubmission(pendingDeleteId.value);
pendingDeleteId.value = null;
}
function startRebuttal(row) {
edu.rebuttalStartFromTracker(row);
}
</script>
<template>
<section class="tk">
<header class="tk-head">
<h1 class="tk-title">投稿进度台账</h1>
<span class="tk-sub">本地台账 · 仅存于当前浏览器</span>
<button class="tk-add" type="button" @click="openCreate">+ 新增投稿</button>
</header>
<!-- ========== 统计条 ========== -->
<div class="tk-stats" data-testid="tk-stats">
<div class="tk-stat"><b>{{ stats.total }}</b><span>总投稿</span></div>
<div class="tk-stat"><b>{{ stats.active }}</b><span>进行中</span></div>
<div class="tk-stat tk-stat-rev"><b>{{ stats.revision }}</b><span>待返修</span></div>
<div class="tk-stat tk-stat-ok"><b>{{ stats.accepted }}</b><span>已接收</span></div>
<div class="tk-stat tk-stat-no"><b>{{ stats.rejected }}</b><span>已拒绝</span></div>
</div>
<!-- ========== 新增/编辑共用抽屉 ========== -->
<div v-if="formOpen" class="tk-form">
<div class="tk-form-grid">
<label class="tk-field">
<span class="tk-label">期刊名<i class="tk-req">*</i></span>
<input
v-model="form.journal"
class="tk-input"
type="text"
placeholder="如 The Plant Cell"
@keydown.enter="save"
/>
</label>
<label class="tk-field">
<span class="tk-label">状态</span>
<select v-model="form.status" class="tk-input tk-select">
<option v-for="s in SUBMISSION_STATUS" :key="s" :value="s">
{{ STATUS_LABEL[s] }}
</option>
</select>
</label>
<label class="tk-field">
<span class="tk-label">投稿日期</span>
<input v-model="form.date" class="tk-input" type="date" />
</label>
<label class="tk-field">
<span class="tk-label">返修截止日(可选)</span>
<input v-model="form.revisionDue" class="tk-input" type="date" data-testid="tk-revision-due" />
</label>
<label class="tk-field">
<span class="tk-label">返修轮次(可选,默认 1)</span>
<input v-model="form.revisionRound" class="tk-input" type="number" min="1" placeholder="1" data-testid="tk-revision-round" />
</label>
<label class="tk-field tk-field-wide">
<span class="tk-label">备注(可空)</span>
<textarea
v-model="form.notes"
class="tk-input tk-textarea"
rows="3"
placeholder="如:审稿 2 人已返回,等待编辑决定…"
></textarea>
</label>
</div>
<p v-if="formError" class="tk-form-error">{{ formError }}</p>
<div class="tk-form-btns">
<button class="tk-save" type="button" @click="save">
{{ mode === 'create' ? '创建' : '保存' }}
</button>
<button class="tk-cancel" type="button" @click="closeForm">取消</button>
</div>
</div>
<!-- ========== 空态 ========== -->
<p v-if="!edu.submissionsSorted.length" class="tk-empty">
暂无投稿记录。点击「新增投稿」记录你投出的稿件。
</p>
<!-- ========== 列表(store 已按 updatedAt 倒序) ========== -->
<div
v-for="row in edu.submissionsSorted"
:key="row.id"
class="tk-row"
:class="{ confirming: pendingDeleteId === row.id }"
data-testid="tk-row"
>
<div class="tk-main">
<span class="tk-journal" :title="row.journal">{{ row.journal }}</span>
<span class="tk-badge" :class="row.status">{{ STATUS_LABEL[row.status] || row.status }}</span>
<span class="tk-date">投稿 {{ dateOf(row.submittedAt) || '—' }}</span>
<span class="tk-updated">更新 {{ dtOf(row.updatedAt) || '—' }}</span>
<!-- 返修轮次 + 截止倒计时(台账信息,无联动暗示) -->
<span v-if="row.revisionRound || row.revisionDue" class="tk-rev" data-testid="tk-rev-info">
第 {{ row.revisionRound || 1 }} 轮返修
<template v-if="row.revisionDue"> · due {{ dateOf(row.revisionDue) }}({{ dueText(row.revisionDue) }})</template>
</span>
</div>
<p class="tk-notes" :class="{ empty: !row.notes }">{{ row.notes || '—' }}</p>
<div class="tk-actions">
<template v-if="pendingDeleteId === row.id">
<span class="tk-confirm-q">确认删除该记录?</span>
<button class="tk-danger" type="button" @click="confirmDelete">确认删除</button>
<button class="tk-cancel" type="button" @click="pendingDeleteId = null">取消</button>
</template>
<template v-else>
<button class="tk-act" type="button" @click="openEdit(row)">编辑</button>
<button class="tk-act tk-danger" type="button" @click="pendingDeleteId = row.id">
删除
</button>
<!-- 方案 A:仅审稿中/返修中可跳去写返修(纯跳转,无联动) -->
<button
v-if="row.status === 'under_review' || row.status === 'revision'"
class="tk-act tk-rebuttal-btn" type="button" data-testid="tk-start-rebuttal"
@click="startRebuttal(row)"
>
去写返修
</button>
</template>
</div>
</div>
</section>
</template>
<style scoped>
.tk {
display: flex;
flex-direction: column;
gap: 12px;
}
.tk-head {
display: flex;
align-items: baseline;
gap: 10px;
}
.tk-title {
margin: 0;
font-size: 16px;
font-weight: 600;
color: var(--pa-ink);
}
.tk-sub {
font-size: 12px;
color: var(--pa-ink-subtle);
margin-right: auto;
}
.tk-add {
padding: 7px 16px;
border: none;
border-radius: var(--pa-r-md);
background: var(--pa-gradient);
color: #fff;
font-size: 13px;
font-weight: 600;
cursor: pointer;
}
.tk-add:hover {
filter: brightness(1.08);
}
/* ---------- 统计条 ---------- */
.tk-stats {
display: flex;
gap: 10px;
flex-wrap: wrap;
}
.tk-stat {
display: flex;
align-items: baseline;
gap: 6px;
padding: 8px 14px;
background: var(--pa-surface-1);
border: 1px solid var(--pa-hairline);
border-radius: var(--pa-r-md);
font-size: 12px;
color: var(--pa-ink-muted);
}
.tk-stat b {
font-size: 18px;
color: var(--pa-ink);
}
.tk-stat-rev b { color: #b8860b; }
.tk-stat-ok b { color: #2b8a3e; }
.tk-stat-no b { color: #c92a2a; }
/* ---------- 抽屉表单 ---------- */
.tk-form {
display: flex;
flex-direction: column;
gap: 10px;
padding: 14px 16px;
background: var(--pa-surface-1);
border: 1px solid var(--pa-hairline-strong);
border-radius: var(--pa-r-lg);
}
.tk-form-grid {
display: grid;
grid-template-columns: repeat(auto-fit, minmax(180px, 1fr));
gap: 12px;
}
.tk-field {
display: flex;
flex-direction: column;
gap: 5px;
}
.tk-field-wide {
grid-column: 1 / -1;
}
.tk-label {
font-size: 12px;
font-weight: 500;
color: var(--pa-ink-muted);
}
.tk-req {
color: var(--pa-error);
font-style: normal;
margin-left: 3px;
}
.tk-input {
padding: 7px 11px;
border: 1px solid var(--pa-hairline);
border-radius: var(--pa-r-md);
background: var(--pa-surface-2);
color: var(--pa-ink);
font-size: 13px;
}
.tk-textarea {
resize: vertical;
min-height: 56px;
}
.tk-form-error {
margin: 0;
color: var(--pa-error);
font-size: 12px;
}
.tk-form-btns {
display: flex;
gap: 8px;
}
.tk-save {
padding: 7px 18px;
border: none;
border-radius: var(--pa-r-md);
background: var(--pa-accent);
color: #fff;
font-size: 13px;
font-weight: 600;
cursor: pointer;
}
.tk-cancel {
padding: 7px 14px;
border: 1px solid var(--pa-hairline);
border-radius: var(--pa-r-md);
background: transparent;
color: var(--pa-ink-muted);
font-size: 13px;
cursor: pointer;
}
/* ---------- 空态 ---------- */
.tk-empty {
margin: 0;
padding: 28px 18px;
text-align: center;
color: var(--pa-ink-subtle);
font-size: 13px;
background: var(--pa-surface-1);
border: 1px dashed var(--pa-hairline-strong);
border-radius: var(--pa-r-lg);
line-height: 1.7;
}
/* ---------- 列表行 ---------- */
.tk-row {
display: flex;
flex-direction: column;
gap: 6px;
padding: 12px 14px;
background: var(--pa-surface-1);
border: 1px solid var(--pa-hairline);
border-radius: var(--pa-r-lg);
}
.tk-row.confirming {
border-color: var(--pa-error);
}
.tk-main {
display: flex;
align-items: center;
gap: 10px;
flex-wrap: wrap;
}
.tk-journal {
font-weight: 600;
font-size: 14px;
color: var(--pa-ink);
max-width: 260px;
overflow: hidden;
text-overflow: ellipsis;
white-space: nowrap;
}
.tk-badge {
padding: 2px 10px;
border-radius: 999px;
font-size: 11px;
font-weight: 600;
}
.tk-badge.draft { background: #f1f3f5; color: #495057; }
.tk-badge.submitted { background: #e7f5ff; color: #1971c2; }
.tk-badge.under_review { background: #fff9db; color: #997404; }
.tk-badge.revision { background: #fff3bf; color: #b8860b; }
.tk-badge.accepted { background: #d3f9d8; color: #2b8a3e; }
.tk-badge.rejected { background: #ffe3e3; color: #c92a2a; }
.tk-date, .tk-updated {
font-size: 12px;
color: var(--pa-ink-subtle);
}
.tk-rev {
font-size: 12px;
font-weight: 600;
color: #b8860b;
}
.tk-notes {
margin: 0;
font-size: 12px;
color: var(--pa-ink-muted);
line-height: 1.5;
}
.tk-notes.empty {
color: var(--pa-ink-subtle);
}
.tk-actions {
display: flex;
gap: 8px;
align-items: center;
}
.tk-confirm-q {
font-size: 12px;
color: var(--pa-error);
}
.tk-act {
padding: 4px 12px;
border: 1px solid var(--pa-hairline);
border-radius: var(--pa-r-md);
background: transparent;
color: var(--pa-ink);
font-size: 12px;
cursor: pointer;
}
.tk-act:hover {
background: var(--pa-surface-2);
}
.tk-danger {
color: var(--pa-error);
border-color: var(--pa-error);
}
.tk-rebuttal-btn {
color: var(--pa-accent);
border-color: var(--pa-accent);
font-weight: 600;
}
</style>
@@ -0,0 +1,16 @@
<!-- TrainingPanel.vue —— ⑦ 审稿训练与教育(步骤4 占位)。 -->
<script setup>
</script>
<template>
<section class="edu-panel-inner">
<h1 class="edu-title">审稿训练与教育</h1>
<p class="edu-placeholder">功能开发中,敬请期待</p>
</section>
</template>
<style scoped>
.edu-panel-inner { display: flex; flex-direction: column; gap: 8px; }
.edu-title { margin: 0; font-size: 16px; font-weight: 600; color: var(--pa-ink); }
.edu-placeholder { margin: 0; font-size: 13px; color: var(--pa-ink-muted); }
</style>
+20
View File
@@ -14,6 +14,7 @@ import { APP_NAME, STATUS_LABEL, T } from '../../i18n/labels.js';
import { BF } from '../../i18n/bioflow.js';
import { useThemeStore } from '../../stores/theme.js';
import { useBioflowStore } from '../../stores/bioflow.js';
import { useAppStore } from '../../stores/app.js';
const props = defineProps({
/** 当前会话标题(无会话为 null → 显示「就绪」徽章) */
@@ -40,6 +41,9 @@ const bioflowStore = useBioflowStore();
const bioflowOnline = computed(() => bioflowStore.availability === 'online');
const bioflowStatus = computed(() => bioflowStore.availability);
/* ---------- 教育科研入口(步骤5;覆盖层视图切换 D1,同 themeStore 静态导入) ---------- */
const appStore = useAppStore();
/* ---------- B2/B3 store 数据(动态导入 + 空值守卫) ---------- */
const chatStore = ref(null);
const benchStore = ref(null);
@@ -160,6 +164,8 @@ const iconClose = '<svg viewBox="0 0 24 24" fill="none" stroke="currentColor" st
const iconRailExt = '<svg viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round"><path d="M12 2l2.4 4.9 5.4.8-3.9 3.8.9 5.4-4.8-2.5-4.8 2.5.9-5.4L4.2 7.7l5.4-.8z"/><path d="M20 14v5a2 2 0 0 1-2 2H6a2 2 0 0 1-2-2v-5"/></svg>';
const iconRailSettings = '<svg viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round"><circle cx="12" cy="12" r="3"/><path d="M19.4 15a1.7 1.7 0 0 0 .34 1.87l.06.06a2 2 0 1 1-2.83 2.83l-.06-.06a1.7 1.7 0 0 0-1.87-.34 1.7 1.7 0 0 0-1 1.55V21a2 2 0 1 1-4 0v-.09a1.7 1.7 0 0 0-1-1.55 1.7 1.7 0 0 0-1.87.34l-.06.06a2 2 0 1 1-2.83-2.83l.06-.06a1.7 1.7 0 0 0 .34-1.87 1.7 1.7 0 0 0-1.55-1H3a2 2 0 1 1 0-4h.09a1.7 1.7 0 0 0 1.55-1 1.7 1.7 0 0 0-.34-1.87l-.06-.06a2 2 0 1 1 2.83-2.83l.06.06a1.7 1.7 0 0 0 1.87.34h0a1.7 1.7 0 0 0 1-1.55V3a2 2 0 1 1 4 0v.09a1.7 1.7 0 0 0 1 1.55h0a1.7 1.7 0 0 0 1.87-.34l.06-.06a2 2 0 1 1 2.83 2.83l-.06.06a1.7 1.7 0 0 0-.34 1.87v0a1.7 1.7 0 0 0 1.55 1H21a2 2 0 1 1 0 4h-.09a1.7 1.7 0 0 0-1.55 1z"/></svg>';
const iconRailBio = '<svg viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round"><path d="M7 3c0 4-1.2 8.6-5 11"/><path d="M7 3c0 4 1.2 8.6 5 11"/><path d="M17 3c0 4 1.2 8.6 5 11"/><path d="M17 3c0 4-1.2 8.6-5 11"/><path d="M8.5 8h7"/><path d="M8 13.5h8"/><path d="M10.5 18h3"/></svg>';
// 教育科研(步骤5:毕业帽,与 rail 同款内联 SVG)
const iconRailEdu = '<svg viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round"><path d="M22 10L12 5 2 10l10 5 10-5z"/><path d="M6 12.5V17c0 1.7 2.7 3 6 3s6-1.3 6-3v-4.5"/><path d="M22 10v6"/></svg>';
</script>
<template>
@@ -223,6 +229,12 @@ const iconRailBio = '<svg viewBox="0 0 24 24" fill="none" stroke="currentColor"
<span v-html="iconRailBio"></span>
<span class="rail-label">生信</span>
</button>
<!-- 教育科研入口(步骤5:覆盖层切 edu 视图;on 高亮在 edu 态由 EduSideNav 返回后可见) -->
<button class="icon-btn top-rail-btn" :class="{ on: appStore.isEdu }" type="button" title="教育科研" aria-label="教育科研"
@click="appStore.setView('edu')">
<span v-html="iconRailEdu"></span>
<span class="rail-label">教育科研</span>
</button>
<button class="icon-btn top-rail-btn" type="button" :title="T.railSettings" :aria-label="T.railSettings"
@click="$emit('goto-settings')">
<span v-html="iconRailSettings"></span>
@@ -245,3 +257,11 @@ const iconRailBio = '<svg viewBox="0 0 24 24" fill="none" stroke="currentColor"
</button>
</header>
</template>
<style scoped>
/* 教育科研入口高亮(步骤5;仅现成 --pa-* 变量,同 bench-tab.on 思路) */
.top-rail-btn.on {
color: var(--pa-ink);
background: var(--pa-surface-2);
}
</style>

Some files were not shown because too many files have changed in this diff Show More