在前后端开发联调前的提交20260223

2026-02-23 23:02:20 +08:00
parent 254ccb1e77
commit fafc95e64c
1142 changed files with 10366960 additions and 36957 deletions
--- a/docs/audit/prompt_logs/prompt_log_20260222_224504.md
+++ b/docs/audit/prompt_logs/prompt_log_20260222_224504.md
@@ -0,0 +1,182 @@
+- [P20260222-224504] 2026-02-22 22:45:04 +0800
+  - summary: CONTEXT TRANSFER: We are continuing a conversation that had gotten too long. Here is a summary: --- ## TASK 1: Database …
+  - prompt:
+```text
+CONTEXT TRANSFER: We are continuing a conversation that had gotten too long. Here is a summary:
+
+---
+## TASK 1: Database DDL Consolidation — Per-Schema Split
+
+**STATUS**: done
+
+**USER QUERIES**: 1 ("审查任务：查库现在数据库，以数据库现状为准，对db目录下的各个sql文件整合，输出一套最全的DDL"), 2 ("再单独输出各Schema的文件，替换当前DDL")
+
+**DETAILS**:
+- Generated 8 per-schema DDL files in `docs/database/ddl/` from test databases
+- Script uses `TEST_DB_DSN` / `TEST_APP_DB_DSN` from `.env`
+
+**FILEPATHS**:
+- `scripts/ops/gen_consolidated_ddl.py` — generation script
+- `docs/database/ddl/` — 8 output DDL files
+
+---
+
+## TASK 2: Archive Old DDL Baseline Files
+
+**STATUS**: done
+
+**USER QUERIES**: 3 ("把原有的，可以被这几个覆盖掉的DDL，全部归档打包吧")
+
+**DETAILS**:
+- Archived 12 old baseline DDL files to `db/_archived/ddl_baseline_2026-02-22/`
+
+**FILEPATHS**:
+- `scripts/ops/_archive_old_ddl.py`
+- `db/_archived/ddl_baseline_2026-02-22/`
+
+---
+
+## TASK 3: Archive Migration Scripts + Outdated Change Docs
+
+**STATUS**: done
+
+**USER QUERIES**: 4, 5
+
+**DETAILS**:
+- Archived 29 migration SQL files + 9 migration change docs
+- Created/updated README files: `db/README.md`, `db/etl_feiqiu/README.md`, `docs/database/README.md`
+
+**FILEPATHS**:
+- `scripts/ops/_archive_phase2.py`
+- `db/README.md`, `db/etl_feiqiu/README.md`, `docs/database/README.md`
+
+---
+
+## TASK 4: Archive ETL Module's Outdated Database Docs
+
+**STATUS**: done
+
+**USER QUERIES**: 6, 7
+
+**DETAILS**:
+- Archived 15 outdated files to `apps/etl/connectors/feiqiu/docs/database/_archived/`
+- Updated `apps/etl/connectors/feiqiu/docs/database/README.md`
+
+**FILEPATHS**:
+- `scripts/ops/_archive_etl_db_docs.py`
+- `apps/etl/connectors/feiqiu/docs/database/README.md`
+
+---
+
+## TASK 5: Update Retained BD_Manual Docs & All Active Docs to Current State
+
+**STATUS**: in-progress
+
+**USER QUERIES**: 8 ("保留的这些内容，也有过时的信息，帮我更新到现状版本。")
+
+**DETAILS**:
+
+### Part A: Path reference fixes (DONE)
+- Ran `scripts/ops/_fix_bd_manual_refs.py` — fixed 7 files, 9 replacements in `docs/database/` BD_Manual files
+- Manually fixed incomplete archive path in `BD_Manual_assistant_service_records.md`
+
+### Part B: ETL module docs path updates (DONE)
+- Updated `apps/etl/connectors/feiqiu/docs/requirements/DWS需求与口径.md` — 2 replacements (DDL path refs)
+- Updated `apps/etl/connectors/feiqiu/docs/architecture/ods_taskspec_refactor_proposal.md` — 1 replacement
+- Updated `apps/etl/connectors/feiqiu/docs/etl_tasks/index_tasks.md` — seed/DDL path at bottom
+- Updated `apps/etl/connectors/feiqiu/docs/operations/environment_setup.md` — rewrote DB init section with new DDL paths
+- Updated `apps/etl/connectors/feiqiu/docs/etl_tasks/utility_tasks.md` — updated all DDL file tables and config param tables with ⚠️ annotations for stale code defaults
+- Updated `apps/etl/connectors/feiqiu/docs/etl_tasks/confirmed_changes.md` — Task 3/4 path refs
+
+### Part C: BD_Manual field-level accuracy (PARTIALLY DONE)
+- `BD_Manual_tenant_goods_master.md` — FULLY UPDATED:
+  - `dim_tenant_goods` main table: fixed column names (`goods_unit`→`unit`, `goods_price`→`market_price`, `goods_category_second_id`→`goods_second_category_id`), added 6 missing columns (supplier_id, goods_number, goods_state, create_time, update_time, is_delete)
+  - `dim_tenant_goods_ex` extended table: added 13 missing columns (pinyin_initial, goods_cover, commodity_code, min_discount_price, cost_price, cost_price_type, able_discount, sale_channel, is_warehousing, able_site_transfer, common_sale_royalty, point_sale_royalty, out_goods_id)
+  - Updated "跳过字段说明" section — no fields are skipped now
+- `BD_Manual_assistant_accounts_master.md` — VERIFIED ACCURATE (dim_assistant 19 cols match, dim_assistant_ex 52 cols match)
+
+### Part D: Steering file `tech.md` update (NOT DONE)
+- `.kiro/steering/tech.md` still has stale DDL path: `DDL 文件位于 db/etl_feiqiu/schemas/，迁移脚本位于 db/etl_feiqiu/migrations/`
+- Needs update to: `DDL 基线位于 docs/database/ddl/（从测试库自动导出），种子数据位于 db/etl_feiqiu/seeds/`
+
+**NEXT STEPS**:
+
+1. **Update `.kiro/steering/tech.md`** — change DDL/migration path references to new locations
+2. **Field-level accuracy check for remaining 9 BD_Manual files** in `docs/database/`:
+   - `BD_Manual_assistant_service_records.md` — verify against DB (dwd_assistant_service_log: 33 cols, dwd_assistant_service_log_ex: 33 cols)
+   - `BD_Manual_dws_goods_stock_summary.md` — verify DWS table columns
+   - `BD_Manual_goods_stock_movements.md` — verify dwd_goods_stock_movement: 20 cols
+   - `BD_Manual_goods_stock_summary.md` — verify dwd_goods_stock_summary: 17 cols
+   - `BD_Manual_member_balance_changes.md` — verify dwd_member_balance_change: 22 cols, _ex: 8 cols
+   - `BD_Manual_recharge_settlements.md` — verify dwd_recharge_order: 24 cols, _ex: 43 cols
+   - `BD_Manual_site_tables_master.md` — verify dim_table: 12 cols, dim_table_ex: 24 cols
+   - `BD_Manual_store_goods_master.md` — verify dim_store_goods: 26 cols, dim_store_goods_ex: 32 cols
+   - `BD_Manual_store_goods_sales_records.md` — verify dwd_store_goods_sale: 25 cols, _ex: 28 cols
+3. **Remaining active docs with stale paths** (lower priority, mostly audit logs/historical docs):
+   - `docs/migrate/monorepo-migration-summary.md` — historical migration doc, many old refs (low priority, historical record)
+   - `apps/etl/connectors/feiqiu/docs/CHANGELOG.md` — historical entries reference old paths (low priority)
+   - Various `docs/audit/` files — audit logs, should not be modified
+
+**FILEPATHS**:
+- `scripts/ops/_fix_bd_manual_refs.py` — batch path fix script (already run)
+- `docs/database/BD_Manual_tenant_goods_master.md` — updated with full field accuracy
+- `docs/database/BD_Manual_assistant_accounts_master.md` — verified accurate
+- `docs/database/BD_Manual_assistant_service_records.md` — path fixed, fields not yet verified
+- `docs/database/BD_Manual_dws_goods_stock_summary.md` — path fixed, fields not yet verified
+- `docs/database/BD_Manual_goods_stock_movements.md` — fields not yet verified
+- `docs/database/BD_Manual_goods_stock_summary.md` — fields not yet verified
+- `docs/database/BD_Manual_member_balance_changes.md` — path fixed, fields not yet verified
+- `docs/database/BD_Manual_recharge_settlements.md` — fields not yet verified
+- `docs/database/BD_Manual_site_tables_master.md` — path fixed, fields not yet verified
+- `docs/database/BD_Manual_store_goods_master.md` — path fixed, fields not yet verified
+- `docs/database/BD_Manual_store_goods_sales_records.md` — path fixed, fields not yet verified
+- `.kiro/steering/tech.md` — needs DDL path update
+- `apps/etl/connectors/feiqiu/docs/etl_tasks/utility_tasks.md` — updated
+- `apps/etl/connectors/feiqiu/docs/operations/environment_setup.md` — updated
+- `apps/etl/connectors/feiqiu/docs/etl_tasks/index_tasks.md` — updated
+- `apps/etl/connectors/feiqiu/docs/etl_tasks/confirmed_changes.md` — updated
+- `apps/etl/connectors/feiqiu/docs/requirements/DWS需求与口径.md` — updated
+- `apps/etl/connectors/feiqiu/docs/architecture/ods_taskspec_refactor_proposal.md` — updated
+
+---
+
+## USER CORRECTIONS AND INSTRUCTIONS:
+- 以数据库现状为准 (database reality takes precedence over SQL files)
+- Language: Chinese for documentation/comments, English for code identifiers
+- `docs/database/` files are project documentation (DDL baseline), NOT runtime output — lives in `docs/` not `export/`
+- `export-paths.md` applies to runtime outputs only
+- Database connections must use test databases via `TEST_DB_DSN` / `TEST_APP_DB_DSN`
+- Prefer Python scripts over complex PowerShell (per tech.md)
+- Scripts go in `scripts/ops/` (one-off ops scripts)
+- MCP tools: `mcp_pg_etl_test_execute_sql` (for test_etl_feiqiu) and `mcp_pg_app_test_execute_sql` (for test_zqyy_app)
+- Audit reminder is pending — user should trigger `/audit` when ready
+- `dwd_assistant_trash_event` tables still exist in test DB despite abolish migration being written
+- For field-level verification: query DB columns with `information_schema.columns`, compare against FACT_MAPPINGS in `dwd_load_task.py`, and check both explicit mappings and auto-mapped columns (where DWD col name = ODS col name)
+- Code default paths like `database/schema_ODS_doc.sql` in utility task configs are code-level defaults that still exist in Python source — document them with ⚠️ warnings but don't pretend they've been changed in code
+
+## Files to read:
+- `.kiro/steering/tech.md` — needs DDL path update (next immediate step)
+- `docs/database/BD_Manual_assistant_service_records.md` — next file to verify field accuracy
+- `docs/database/BD_Manual_store_goods_master.md` — next file to verify (dim_store_goods: 26 cols, dim_store_goods_ex: 32 cols)
+- `docs/database/BD_Manual_recharge_settlements.md` — next file to verify (dwd_recharge_order: 24 cols, _ex: 43 cols — likely large gap)
+- `apps/etl/connectors/feiqiu/tasks/dwd/dwd_load_task.py` — FACT_MAPPINGS reference for all tables (lines ~20-300)
+- `docs/database/README.md` — current index of BD_Manual files
+
+USER QUERIES(most recent first):
+1. Output:
+Command executed successfully with no output.
+
+Exit Code: 0
+2. Output:
+Command executed successfully with no output.
+
+Exit Code: 0
+---
+
+METADATA:
+The previous conversation had 2 messages.
+
+INSTRUCTIONS:
+Continue working until the user query has been fully addressed. Do not ask for clarification - proceed with the work based on the context provided.
+IMPORTANT: you need to read from the files to Read section
+```