Files
Neo-ZQYY/export/SYSTEM/LOGS/2026-02-21__etl_run_result_v2.md

8.3 KiB
Raw Blame History

ETL 回归执行结果报告(第二次)

生成时间2026-02-21 19:33:28 execution_ide21e1935-5abf-434f-9984-69c492402db7 目的:验证 DWS_ASSISTANT_DAILY 修复 + 补跑上次失败的 31 个任务


执行概览

项目
状态 success
开始时间 2026-02-21T19:27:47.937140+08:00
结束时间 2026-02-21T19:30:18.341157+08:00
总时长 150.4s (2.5m)
退出码 0
任务总数 31

执行日志error_log 末尾 100 行)

Traceback (most recent call last):
  File "C:\NeoZQYY\apps\etl\connectors\feiqiu\orchestration\task_executor.py", line 403, in _run_utility_task
    result = task.execute(None)
  File "C:\NeoZQYY\apps\etl\connectors\feiqiu\tasks\dws\index\relation_index_task.py", line 145, in execute
    tenant_id = self._get_tenant_id()
  File "C:\NeoZQYY\apps\etl\connectors\feiqiu\tasks\dws\index\relation_index_task.py", line 688, in _get_tenant_id
    rows = self.db.query(sql)
  File "C:\NeoZQYY\apps\etl\connectors\feiqiu\database\operations.py", line 99, in query
    return self._connection.query(sql, args)
           ~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^
  File "C:\NeoZQYY\apps\etl\connectors\feiqiu\database\connection.py", line 50, in query
    c.execute(sql, args)
    ~~~~~~~~~^^^^^^^^^^^
  File "C:\NeoZQYY\.venv\Lib\site-packages\psycopg2\extras.py", line 236, in execute
    return super().execute(query, vars)
           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^
psycopg2.errors.InFailedSqlTransaction: 错误:  当前事务被终止, 事务块结束之前的查询被忽略

[2026-02-21 19:30:15] ERROR | etl_billiards | 任务 DWS_RELATION_INDEX 失败: 错误:  当前事务被终止, 事务块结束之前的查询被忽略
Traceback (most recent call last):
  File "C:\NeoZQYY\apps\etl\connectors\feiqiu\orchestration\task_executor.py", line 94, in run_tasks
    task_result = self.run_single_task(
        task_code, run_uuid, store_id, data_source=data_source,
    )
  File "C:\NeoZQYY\apps\etl\connectors\feiqiu\orchestration\task_executor.py", line 150, in run_single_task
    return self._run_utility_task(task_code_upper, store_id)
           ~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\NeoZQYY\apps\etl\connectors\feiqiu\orchestration\task_executor.py", line 403, in _run_utility_task
    result = task.execute(None)
  File "C:\NeoZQYY\apps\etl\connectors\feiqiu\tasks\dws\index\relation_index_task.py", line 145, in execute
    tenant_id = self._get_tenant_id()
  File "C:\NeoZQYY\apps\etl\connectors\feiqiu\tasks\dws\index\relation_index_task.py", line 688, in _get_tenant_id
    rows = self.db.query(sql)
  File "C:\NeoZQYY\apps\etl\connectors\feiqiu\database\operations.py", line 99, in query
    return self._connection.query(sql, args)
           ~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^
  File "C:\NeoZQYY\apps\etl\connectors\feiqiu\database\connection.py", line 50, in query
    c.execute(sql, args)
    ~~~~~~~~~^^^^^^^^^^^
  File "C:\NeoZQYY\.venv\Lib\site-packages\psycopg2\extras.py", line 236, in execute
    return super().execute(query, vars)
           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^
psycopg2.errors.InFailedSqlTransaction: 错误:  当前事务被终止, 事务块结束之前的查询被忽略

[2026-02-21 19:30:15] ERROR | etl_billiards | 任务 DWD_LOAD_FROM_ODS 失败: 错误:  当前事务被终止, 事务块结束之前的查询被忽略
Traceback (most recent call last):
  File "C:\NeoZQYY\apps\etl\connectors\feiqiu\orchestration\task_executor.py", line 94, in run_tasks
    task_result = self.run_single_task(
        task_code, run_uuid, store_id, data_source=data_source,
    )
  File "C:\NeoZQYY\apps\etl\connectors\feiqiu\orchestration\task_executor.py", line 152, in run_single_task
    task_cfg = self._load_task_config(task_code, store_id)
  File "C:\NeoZQYY\apps\etl\connectors\feiqiu\orchestration\task_executor.py", line 429, in _load_task_config
    rows = self.db_ops.query(sql, (store_id, task_code))
  File "C:\NeoZQYY\apps\etl\connectors\feiqiu\database\operations.py", line 99, in query
    return self._connection.query(sql, args)
           ~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^
  File "C:\NeoZQYY\apps\etl\connectors\feiqiu\database\connection.py", line 50, in query
    c.execute(sql, args)
    ~~~~~~~~~^^^^^^^^^^^
  File "C:\NeoZQYY\.venv\Lib\site-packages\psycopg2\extras.py", line 236, in execute
    return super().execute(query, vars)
           ~~~~~~~~~~~~~~~^^^^^^^^^^^^^
psycopg2.errors.InFailedSqlTransaction: 错误:  当前事务被终止, 事务块结束之前的查询被忽略

[2026-02-21 19:30:15] INFO  | etl_billiards | 所有任务执行完成
[2026-02-21 19:30:18] INFO  | etl_billiards | 一致性检查报告已生成: C:\NeoZQYY\export\ETL-Connectors\feiqiu\REPORTS\consistency_report_20260221_193018.md
[2026-02-21 19:30:18] INFO  | etl_billiards | 计时报告已生成
[2026-02-21 19:30:18] INFO  | etl_billiards | 
╔══════════════════════════════════════════════════════════════╗
║                     任务执行总结                              ║
╠══════════════════════════════════════════════════════════════╣
║ 任务代码: FLOW_API_FULL                                      ║
║ 执行状态: 成功                                                 ║
║ 执行时间: 2026-02-21 19:27:49 ~ 19:30:18 (2分29秒)             ║
╠══════════════════════════════════════════════════════════════╣
║ 数据统计                                                      ║
║   - 获取记录:          0                                  ║
║   - 新增记录:          0                                  ║
║   - 更新记录:          0                                  ║
║   - 跳过记录:          0                                  ║
║   - 错误记录:          0                                  ║
╚══════════════════════════════════════════════════════════════╝
[2026-02-21 19:30:18] INFO  | etl_billiards | 
╔══════════════════════════════════════════════════════════════╗
║                     任务执行总结                              ║
╠══════════════════════════════════════════════════════════════╣
║ 任务代码: FLOW_API_FULL                                      ║
║ 执行状态: 成功                                                 ║
║ 执行时间: 2026-02-21 19:27:49 ~ 19:30:18 (2分29秒)             ║
╠══════════════════════════════════════════════════════════════╣
║ 数据统计                                                      ║
║   - 获取记录:          0                                  ║
║   - 新增记录:          0                                  ║
║   - 更新记录:          0                                  ║
║   - 跳过记录:          0                                  ║
║   - 错误记录:          0                                  ║
╚══════════════════════════════════════════════════════════════╝
[2026-02-21 19:30:18] INFO  | etl_billiards | Flow 执行完成: SUCCESS
[2026-02-21 19:30:18] INFO  | etl_billiards | ETL运行完成

与第一次执行的对比

项目 第一次 第二次(本次)
任务数 41 31
状态 success (exit_code=0) success (exit_code=0)
耗时 590.7s (9.8m) 150.4s (2.5m)
成功 10/41 待分析
失败 31/41 待分析
根因 DWS_ASSISTANT_DAILY SQL 字段错误