Files
Neo-ZQYY/apps/etl
Neo 8228b3fa37 chore: migrate IDE environment from Kiro to Claude Code
- Add CLAUDE.md (root + ETL subdirectory + db subdirectory) consolidating all Kiro steering docs
- Add .mcp.json migrated from .kiro/settings/mcp.json (test DBs enabled, prod disabled)
- Add .claude/commands/ (audit, doc-sync, db-docs) replacing Kiro skills
- Add .claude/hooks/ (session_start, post_edit_audit, stop_audit_check) replacing Kiro hooks
- Add .claude/settings.json registering all hooks
- Add scripts/audit/prescan.py merging Kiro's audit_flagger + compliance_prescan
- Remove .kiro/agents, hooks, scripts, settings, skills, state (migrated or obsolete)
- Update .gitignore for Claude Code

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-04-05 15:48:08 +08:00
..

apps/etl/

作用说明

ETL Connector数据源连接器集合。每个上游数据源对应 pipelines/ 下的一个子目录(即一个 Connector当前仅有飞球平台feiqiu。Connector 负责从 SaaS API 抽取数据,经 ODS→DWD→Core→DWS 逐层处理后落库。

内部结构

  • pipelines/feiqiu/ — 飞球 Connectorapi、cli、config、loaders、models、orchestration、scd、tasks、utils、quality、tests

Roadmap

  • 将通用抽取/加载逻辑抽离为 etl_sdk 共享包,供多 Connector 复用
  • 将各平台 API 客户端拆分为独立 connectors 包,实现可插拔数据源接入
  • 新增 Connector 时在 pipelines/ 下创建同构子目录