S
SkillsMD 发现、学习和掌握最新的 AI 技术 Skills。基于真实社区数据,为开发者提供最权威的 AI 工具导航。
关于 聚焦 AI 技术 Skills 每周数据更新 中英双语文档 © 2026 SkillsMD. All rights reserved.
数据回填与对账操作手册:确保数据完整性、一致性与可信度的DevOps指南 | SkillsMD
首页 / Skills / backfill-and-reconciliation-playbook 数据回填与对账操作手册:确保数据完整性、一致性与可信度的DevOps指南 The Agent Skills Directory
npx skills add https://smithery.ai/skills/amnadtaowsoam/backfill-and-reconciliation-playbook
广告位招租
在这里展示您的产品或服务
触达数万 AI 开发者,精准高效
联系我们
Inputs / Outputs / Contracts
Inputs :
Source database connection strings
Target database connection strings
Date ranges for backfill
Reconciliation check definitions
Entry Conditions :
Database connections are accessible
Source and target schemas are defined
Reconciliation queries are tested
Outputs :
Backfilled data in target system
Reconciliation reports
Discrepancy alerts
Audit logs
Artifacts Required (Deliverables) :
Backfill scripts
Reconciliation queries
Automated reconciliation jobs
Audit logs
Acceptance Evidence :
No data gaps after backfill
Reconciliation passes with acceptable tolerance
Alerts trigger on discrepancies
Audit logs are complete
Success Criteria :
100% of gaps filled
Reconciliation success rate > 99%
Discrepancy alerts within 5 minutes
Audit trail complete
Skill Composition
Quick Start / Implementation Example
Review requirements and constraints
Set up development environment
Implement core functionality following patterns
Write tests for critical paths
Run tests and fix issues
Document any deviations or decisions
# Example implementation following best practices
def example_function():
# Your implementation here
pass
Assumptions / Constraints / Non-goals
Assumptions :
Development environment is properly configured
Required dependencies are available
Team has basic understanding of domain
Constraints :
Must follow existing codebase conventions
Time and resource limitations
Compatibility requirements
Non-goals :
This skill does not cover edge cases outside scope
Not a replacement for formal training
Compatibility & Prerequisites
Supported Versions :
Python 3.8+
Node.js 16+
Modern browsers (Chrome, Firefox, Safari, Edge)
Required AI Tools :
Code editor (VS Code recommended)
Testing framework appropriate for language
Version control (Git)
Dependencies :
Language-specific package manager
Build tools
Testing libraries
Environment Setup :
.env.example keys: API_KEY, DATABASE_URL (no values)
Test Scenario Matrix (QA Strategy) Type Focus Area Required Scenarios / Mocks Unit Core Logic Must cover primary logic and at least 3 edge/error cases. Target minimum 80% coverage Integration DB / API All external API calls or database connections must be mocked during unit tests E2E User Journey Critical user flows to test Performance Latency / Load Benchmark requirements Security Vuln / Auth SAST/DAST or dependency audit Frontend UX / A11y Accessibility checklist (WCAG), Performance Budget (Lighthouse score)
Technical Guardrails & Security Threat Model
1. Security & Privacy (Threat Model)
Top Threats : Injection attacks, authentication bypass, data exposure
Data Handling : Sanitize all user inputs to prevent Injection attacks. Never log raw PII
Secrets Management : No hardcoded API keys. Use Env Vars/Secrets Manager
Authorization : Validate user permissions before state changes
2. Performance & Resources
Execution Efficiency : Consider time complexity for algorithms
Memory Management : Use streams/pagination for large data
Resource Cleanup : Close DB connections/file handlers in finally blocks
3. Architecture & Scalability
Design Pattern : Follow SOLID principles, use Dependency Injection
Modularity : Decouple logic from UI/Frameworks
4. Observability & Reliability
Logging Standards : Structured JSON, include trace IDs request_id
Metrics : Track error_rate, latency, queue_depth
Error Handling : Standardized error codes, no bare except
Observability Artifacts :
Log Fields : timestamp, level, message, request_id
Metrics : request_count, error_count, response_time
Dashboards/Alerts : High Error Rate > 5%
Agent Directives & Error Recovery (ข้อกำหนดสำหรับ AI Agent ในการคิดและแก้ปัญหาเมื่อเกิดข้อผิดพลาด)
Thinking Process : Analyze root cause before fixing. Do not brute-force.
Fallback Strategy : Stop after 3 failed test attempts. Output root cause and ask for human intervention/clarification.
Self-Review : Check against Guardrails & Anti-patterns before finalizing.
Output Constraints : Output ONLY the modified code block. Do not explain unless asked.
Definition of Done (DoD) Checklist
Tests passed + coverage met
Lint/Typecheck passed
Logging/Metrics/Trace implemented
Security checks passed
Documentation/Changelog updated
Accessibility/Performance requirements met (if frontend)
Anti-patterns / Pitfalls
⛔ Don't : Log PII, catch-all exception, N+1 queries
⚠️ Watch out for : Common symptoms and quick fixes
💡 Instead : Use proper error handling, pagination, and logging
Reference Links & Examples
Internal documentation and examples
Official documentation and best practices
Community resources and discussions
Versioning & Changelog
Version : 1.0.0
Changelog :
2026-02-22: Initial version with complete template structure
Azure Data Explorer (Kusto) 查询技能:KQL数据分析、日志遥测与时间序列处理
114,200 周安装