在前后端开发联调前 的提交20260223
This commit is contained in:
124
export/SYSTEM/LOGS/2026-02-21__etl_run_result.md
Normal file
124
export/SYSTEM/LOGS/2026-02-21__etl_run_result.md
Normal file
@@ -0,0 +1,124 @@
|
||||
# ETL 执行结果报告
|
||||
|
||||
> 生成时间：2026-02-21 19:18:58
|
||||
> execution_id：dbf0c29a-253a-4705-a1ef-35cd71243d48
|
||||
> run_uuid：4ba9d2d365ee4a858f1c4104b1942dc2
|
||||
|
||||
---
|
||||
|
||||
## 执行概览
|
||||
|
||||
| 项目 | 值 |
|
||||
|------|-----|
|
||||
| 状态 | success |
|
||||
| 开始时间 | 2026-02-21T15:29:20.233302+08:00 |
|
||||
| 结束时间 | 2026-02-21T15:39:10.909320+08:00 |
|
||||
| 总时长 | 590.7s (9.8m) |
|
||||
| 退出码 | 0 |
|
||||
| 任务总数 | 41 |
|
||||
| 成功 | 10 |
|
||||
| 失败 | 31 |
|
||||
|
||||
---
|
||||
|
||||
## 任务级结果
|
||||
|
||||
| # | 任务 | 层 | 状态 | 开始 | 结束 | 耗时 | 窗口数 | 备注 |
|
||||
|---|------|-----|------|------|------|------|--------|------|
|
||||
| 1 | ODS_ASSISTANT_ACCOUNT | ODS | ✅ success | 15:29:21 | 15:29:31 | 10.0s | 4 | {'fetched': 276, 'inserted': 0, 'updated': 276, 'skipped'... |
|
||||
| 2 | ODS_ASSISTANT_LEDGER | ODS | ✅ success | 15:29:32 | 15:30:08 | 36.0s | 4 | {'fetched': 2277, 'inserted': 342, 'updated': 2277, 'skip... |
|
||||
| 3 | ODS_ASSISTANT_ABOLISH | ODS | ✅ success | 15:30:08 | 15:30:11 | 3.0s | 4 | {'fetched': 78, 'inserted': 0, 'updated': 78, 'skipped': ... |
|
||||
| 4 | DWS_ASSISTANT_DAILY | DWS | ❌ failed | 15:30:13 | 15:30:14 | 1.0s | — | 错误: 当前事务被终止, 事务块结束之前的查询被忽略 |
|
||||
| 5 | DWS_ASSISTANT_MONTHLY | DWS | ❌ failed | | 15:30:14 | — | — | 错误: 当前事务被终止, 事务块结束之前的查询被忽略 |
|
||||
| 6 | DWS_ASSISTANT_CUSTOMER | DWS | ❌ failed | | 15:30:14 | — | — | 错误: 当前事务被终止, 事务块结束之前的查询被忽略 |
|
||||
| 7 | DWS_ASSISTANT_SALARY | DWS | ❌ failed | | 15:30:14 | — | — | 错误: 当前事务被终止, 事务块结束之前的查询被忽略 |
|
||||
| 8 | DWS_ASSISTANT_FINANCE | DWS | ❌ failed | | 15:30:14 | — | — | 错误: 当前事务被终止, 事务块结束之前的查询被忽略 |
|
||||
| 9 | ODS_SETTLEMENT_RECORDS | ODS | ❌ failed | | 15:30:14 | — | — | 错误: 当前事务被终止, 事务块结束之前的查询被忽略 |
|
||||
| 10 | ODS_PAYMENT | ODS | ❌ failed | | 15:30:15 | — | — | 错误: 当前事务被终止, 事务块结束之前的查询被忽略 |
|
||||
| 11 | ODS_REFUND | ODS | ❌ failed | | 15:30:15 | — | — | 错误: 当前事务被终止, 事务块结束之前的查询被忽略 |
|
||||
| 12 | DWS_BUILD_ORDER_SUMMARY | DWS | ❌ failed | 15:30:15 | 15:30:15 | 0.0s | — | 错误: 当前事务被终止, 事务块结束之前的查询被忽略 |
|
||||
| 13 | ODS_TABLE_USE | ODS | ✅ success | 15:30:15 | 15:35:01 | 4.8m | 4 | {'fetched': 36412, 'inserted': 0, 'updated': 36412, 'skip... |
|
||||
| 14 | ODS_TABLE_FEE_DISCOUNT | ODS | ✅ success | 15:35:02 | 15:36:04 | 1.0m | 4 | {'fetched': 6464, 'inserted': 0, 'updated': 6464, 'skippe... |
|
||||
| 15 | ODS_TABLES | ODS | ✅ success | 15:36:05 | 15:36:10 | 5.0s | 4 | {'fetched': 296, 'inserted': 0, 'updated': 296, 'skipped'... |
|
||||
| 16 | ODS_MEMBER | ODS | ✅ success | 15:36:11 | 15:36:28 | 17.0s | 4 | {'fetched': 2228, 'inserted': 0, 'updated': 2228, 'skippe... |
|
||||
| 17 | ODS_MEMBER_CARD | ODS | ✅ success | 15:36:29 | 15:37:05 | 36.0s | 4 | {'fetched': 3784, 'inserted': 0, 'updated': 3784, 'skippe... |
|
||||
| 18 | ODS_MEMBER_BALANCE | ODS | ✅ success | 15:37:06 | 15:38:59 | 1.9m | 4 | {'fetched': 8740, 'inserted': 0, 'updated': 8740, 'skippe... |
|
||||
| 19 | ODS_RECHARGE_SETTLE | ODS | ✅ success | 15:39:01 | 15:39:06 | 5.0s | 4 | {'fetched': 191, 'inserted': 0, 'updated': 191, 'skipped'... |
|
||||
| 20 | DWS_MEMBER_CONSUMPTION | DWS | ❌ failed | 15:39:06 | 15:39:07 | 1.0s | — | 错误: 当前事务被终止, 事务块结束之前的查询被忽略 |
|
||||
| 21 | DWS_MEMBER_VISIT | DWS | ❌ failed | | 15:39:07 | — | — | 错误: 当前事务被终止, 事务块结束之前的查询被忽略 |
|
||||
| 22 | ODS_GOODS_CATEGORY | ODS | ❌ failed | | 15:39:07 | — | — | 错误: 当前事务被终止, 事务块结束之前的查询被忽略 |
|
||||
| 23 | ODS_STORE_GOODS | ODS | ❌ failed | | 15:39:07 | — | — | 错误: 当前事务被终止, 事务块结束之前的查询被忽略 |
|
||||
| 24 | ODS_STORE_GOODS_SALES | ODS | ❌ failed | | 15:39:07 | — | — | 错误: 当前事务被终止, 事务块结束之前的查询被忽略 |
|
||||
| 25 | ODS_TENANT_GOODS | ODS | ❌ failed | | 15:39:07 | — | — | 错误: 当前事务被终止, 事务块结束之前的查询被忽略 |
|
||||
| 26 | ODS_PLATFORM_COUPON | ODS | ❌ failed | | 15:39:07 | — | — | 错误: 当前事务被终止, 事务块结束之前的查询被忽略 |
|
||||
| 27 | ODS_GROUP_PACKAGE | ODS | ❌ failed | | 15:39:07 | — | — | 错误: 当前事务被终止, 事务块结束之前的查询被忽略 |
|
||||
| 28 | ODS_GROUP_BUY_REDEMPTION | ODS | ❌ failed | | 15:39:07 | — | — | 错误: 当前事务被终止, 事务块结束之前的查询被忽略 |
|
||||
| 29 | ODS_INVENTORY_STOCK | ODS | ❌ failed | | 15:39:07 | — | — | 错误: 当前事务被终止, 事务块结束之前的查询被忽略 |
|
||||
| 30 | ODS_INVENTORY_CHANGE | ODS | ❌ failed | | 15:39:07 | — | — | 错误: 当前事务被终止, 事务块结束之前的查询被忽略 |
|
||||
| 31 | DWS_GOODS_STOCK_DAILY | DWS | ❌ failed | | 15:39:07 | — | — | 错误: 当前事务被终止, 事务块结束之前的查询被忽略 |
|
||||
| 32 | DWS_GOODS_STOCK_WEEKLY | DWS | ❌ failed | | 15:39:07 | — | — | 错误: 当前事务被终止, 事务块结束之前的查询被忽略 |
|
||||
| 33 | DWS_GOODS_STOCK_MONTHLY | DWS | ❌ failed | | 15:39:07 | — | — | 错误: 当前事务被终止, 事务块结束之前的查询被忽略 |
|
||||
| 34 | DWS_FINANCE_DAILY | DWS | ❌ failed | | 15:39:07 | — | — | 错误: 当前事务被终止, 事务块结束之前的查询被忽略 |
|
||||
| 35 | DWS_FINANCE_RECHARGE | DWS | ❌ failed | | 15:39:07 | — | — | 错误: 当前事务被终止, 事务块结束之前的查询被忽略 |
|
||||
| 36 | DWS_FINANCE_INCOME_STRUCTURE | DWS | ❌ failed | | 15:39:08 | — | — | 错误: 当前事务被终止, 事务块结束之前的查询被忽略 |
|
||||
| 37 | DWS_FINANCE_DISCOUNT_DETAIL | DWS | ❌ failed | | 15:39:08 | — | — | 错误: 当前事务被终止, 事务块结束之前的查询被忽略 |
|
||||
| 38 | DWS_WINBACK_INDEX | DWS | ❌ failed | 15:39:08 | 15:39:08 | 0.0s | — | 错误: 当前事务被终止, 事务块结束之前的查询被忽略 |
|
||||
| 39 | DWS_NEWCONV_INDEX | DWS | ❌ failed | 15:39:08 | 15:39:08 | 0.0s | — | 错误: 当前事务被终止, 事务块结束之前的查询被忽略 |
|
||||
| 40 | DWS_RELATION_INDEX | DWS | ❌ failed | 15:39:08 | 15:39:08 | 0.0s | — | 错误: 当前事务被终止, 事务块结束之前的查询被忽略 |
|
||||
| 41 | DWD_LOAD_FROM_ODS | DWD | ❌ failed | | 15:39:08 | — | — | 错误: 当前事务被终止, 事务块结束之前的查询被忽略 |
|
||||
|
||||
---
|
||||
|
||||
## 失败任务分析
|
||||
|
||||
### 根因：DWS_ASSISTANT_DAILY
|
||||
|
||||
错误：`错误: 当前事务被终止, 事务块结束之前的查询被忽略`
|
||||
|
||||
原因：`_extract_trash_records` SQL 引用了 `dwd_assistant_trash_event` 中不存在的字段 `assistant_service_id`。
|
||||
|
||||
### 级联失败
|
||||
|
||||
- DWS_ASSISTANT_MONTHLY：InFailedSqlTransaction（事务污染）
|
||||
- DWS_ASSISTANT_CUSTOMER：InFailedSqlTransaction（事务污染）
|
||||
- DWS_ASSISTANT_SALARY：InFailedSqlTransaction（事务污染）
|
||||
- DWS_ASSISTANT_FINANCE：InFailedSqlTransaction（事务污染）
|
||||
- ODS_SETTLEMENT_RECORDS：InFailedSqlTransaction（事务污染）
|
||||
- ODS_PAYMENT：InFailedSqlTransaction（事务污染）
|
||||
- ODS_REFUND：InFailedSqlTransaction（事务污染）
|
||||
- DWS_BUILD_ORDER_SUMMARY：InFailedSqlTransaction（事务污染）
|
||||
- DWS_MEMBER_CONSUMPTION：InFailedSqlTransaction（事务污染）
|
||||
- DWS_MEMBER_VISIT：InFailedSqlTransaction（事务污染）
|
||||
- ODS_GOODS_CATEGORY：InFailedSqlTransaction（事务污染）
|
||||
- ODS_STORE_GOODS：InFailedSqlTransaction（事务污染）
|
||||
- ODS_STORE_GOODS_SALES：InFailedSqlTransaction（事务污染）
|
||||
- ODS_TENANT_GOODS：InFailedSqlTransaction（事务污染）
|
||||
- ODS_PLATFORM_COUPON：InFailedSqlTransaction（事务污染）
|
||||
- ODS_GROUP_PACKAGE：InFailedSqlTransaction（事务污染）
|
||||
- ODS_GROUP_BUY_REDEMPTION：InFailedSqlTransaction（事务污染）
|
||||
- ODS_INVENTORY_STOCK：InFailedSqlTransaction（事务污染）
|
||||
- ODS_INVENTORY_CHANGE：InFailedSqlTransaction（事务污染）
|
||||
- DWS_GOODS_STOCK_DAILY：InFailedSqlTransaction（事务污染）
|
||||
- DWS_GOODS_STOCK_WEEKLY：InFailedSqlTransaction（事务污染）
|
||||
- DWS_GOODS_STOCK_MONTHLY：InFailedSqlTransaction（事务污染）
|
||||
- DWS_FINANCE_DAILY：InFailedSqlTransaction（事务污染）
|
||||
- DWS_FINANCE_RECHARGE：InFailedSqlTransaction（事务污染）
|
||||
- DWS_FINANCE_INCOME_STRUCTURE：InFailedSqlTransaction（事务污染）
|
||||
- DWS_FINANCE_DISCOUNT_DETAIL：InFailedSqlTransaction（事务污染）
|
||||
- DWS_WINBACK_INDEX：InFailedSqlTransaction（事务污染）
|
||||
- DWS_NEWCONV_INDEX：InFailedSqlTransaction（事务污染）
|
||||
- DWS_RELATION_INDEX：InFailedSqlTransaction（事务污染）
|
||||
- DWD_LOAD_FROM_ODS：InFailedSqlTransaction（事务污染）
|
||||
|
||||
### 修复状态
|
||||
|
||||
代码已修复（4 处改动），待下次执行验证。
|
||||
详见：`export/SYSTEM/LOGS/2026-02-21__dws_assistant_daily_bug_fix.md`
|
||||
|
||||
---
|
||||
|
||||
## 下一步
|
||||
|
||||
1. 重新提交包含 9 个失败任务的执行，验证修复
|
||||
2. 运行 ETL Data Consistency Check
|
||||
3. 运行 /audit 审计
|
||||
Reference in New Issue
Block a user