Files
ZQYY.FQ-ETL/docs/开发笔记/现在进行ETL全流程测试。.txt

11 lines
1.6 KiB
Plaintext
Raw Blame History

This file contains ambiguous Unicode characters
This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.
现在进行ETL全流程测试。
按以下要求后台运行此任务。
你每隔1-10分析获取一遍输出及时DEBUG。
并对完成的没有报错的内容,在数据来源侧和数据落回测进行数据比对。
[09:56:35] [环境变量] WINDOW_SPLIT_UNIT=month
[09:56:35] [环境变量] INDEX_LOOKBACK_DAYS=180
[09:56:35] [环境变量] VERIFY_SKIP_ODS_ON_FETCH=true
[09:56:35] [环境变量] VERIFY_ODS_LOCAL_JSON=true
[09:56:35] [工作目录] C:\dev\LLTQ\ETL\feiqiu-ETL\etl_billiards
[09:56:35] [执行命令] python -m cli.main --pipeline api_full --processing-mode verify_only --fetch-before-verify --window-start 2025-07-07 09:55:21 --window-end 2026-02-09 09:55:21 --window-split month --tasks ODS_MEMBER_BALANCE,ODS_MEMBER,ODS_MEMBER_CARD,ODS_SETTLEMENT_RECORDS,ODS_PAYMENT,ODS_RECHARGE_SETTLE,ODS_REFUND,ODS_SETTLEMENT_TICKET,ODS_ASSISTANT_LEDGER,ODS_ASSISTANT_ABOLISH,ODS_ASSISTANT_ACCOUNT,ODS_TENANT_GOODS,ODS_STORE_GOODS,ODS_STORE_GOODS_SALES,ODS_GOODS_CATEGORY,ODS_TABLES,ODS_TABLE_USE,ODS_TABLE_FEE_DISCOUNT,ODS_GROUP_BUY_REDEMPTION,ODS_GROUP_PACKAGE,ODS_PLATFORM_COUPON,ODS_INVENTORY_STOCK,ODS_INVENTORY_CHANGE,DWD_LOAD_FROM_ODS,PAYMENTS_DWD,MEMBERS_DWD,DWS_BUILD_ORDER_SUMMARY,DWS_ASSISTANT_DAILY,DWS_ASSISTANT_MONTHLY,DWS_ASSISTANT_CUSTOMER,DWS_ASSISTANT_SALARY,DWS_ASSISTANT_FINANCE,DWS_MEMBER_CONSUMPTION,DWS_MEMBER_VISIT,DWS_FINANCE_DAILY,DWS_FINANCE_RECHARGE,DWS_FINANCE_INCOME_STRUCTURE,DWS_FINANCE_DISCOUNT_DETAIL,DWS_MV_REFRESH_FINANCE_DAILY,DWS_MV_REFRESH_ASSISTANT_DAILY,DWS_RETENTION_CLEANUP,DWS_WINBACK_INDEX,DWS_NEWCONV_INDEX,DWS_RELATION_INDEX