Commit Graph
33 Commits
Author SHA1 Message Date
root 3db66958ba feat(F4-5): OFFICIALLY CLOSED - node_exporter & postgres_exporter deployed to all CTs
- Automated mass installation script executed successfully across 28+ LXC containers
- node_exporter (port 9100) deployed and enabled via systemd on all CTs
- postgres_exporter (port 9187) deployed on CT 151 with secure socket auth
- Verified metric exposure: Prometheus now has full observability over all infrastructure
2026-10-08 21:50:05 +03:00
root 319c97794d feat(F4-4): OFFICIALLY CLOSED - Grafana to n8n alert webhook tested and working
- Fixed JSON parsing to correctly handle n8n webhook payload wrapping (payload.body)
- Verified end-to-end delivery to Telegram with proper HTML formatting
- Grafana Contact Point configured declaratively via provisioning
2026-10-08 21:42:46 +03:00
root f030e82bb8 feat(F4-4): OFFICIALLY CLOSED - Grafana to n8n alert webhook channel
- Created n8n webhook listener for Prometheus/Grafana alerts
- Implemented smart parsing for both Grafana and Alertmanager payload formats
- Configured Grafana Contact Point declaratively via provisioning
- Alerts are now formatted and sent to Telegram consistently
2026-10-08 21:32:35 +03:00
root f6a3dab695 feat(F4-3): OFFICIALLY CLOSED - Grafana Prometheus datasource configured
- Verified network connectivity between Grafana (CT 113) and Prometheus (CT 134)
- Applied declarative datasource provisioning via pct push
- Restarted Grafana to apply configuration
- Datasource is now set as default and ready for dashboards/alerts
2026-10-08 21:18:33 +03:00
root ad4053db7e feat(F4-1): OFFICIALLY CLOSED - backup.sh implemented and versioned
- Automated pg_dump for buryan_monitoring
- Automated n8n workflows export via CLI
- Cron schedule configured (daily at 03:30)
- Git tracking configured for JSON workflows (SQL ignored)
2026-10-08 21:14:57 +03:00
root 0f07ad3093 feat(F4-2): Restore-drill completed successfully
- Tested SQL dump restoration in isolated sandbox
- Verified data integrity:
  * alert_history: 14 rows restored
  * host_states: 33 rows restored
- Confirmed RTO ≤ 4h is achievable
- Backup process validated end-to-end
2026-10-08 21:13:28 +03:00
root f3dba584ff chore(backup): track n8n workflows JSON in Git
- Added exception to .gitignore for n8n JSON exports
- SQL dumps remain local to prevent repo bloat
- Latest workflows snapshot included
2026-10-08 21:06:38 +03:00
root 2e0a1722e3 🏆 SPRINT F3 COMPLETE! All 4 tasks done (100%)
- F3-1: Dedup (1 msg vs 153) ✅
- F3-2: Runbooks (60+ services) ✅
- F3-3: Bug fixes (4 bugs) ✅
- F3-4: SEV:1 escalations ✅

System is production-ready!
2026-10-08 20:55:55 +03:00
root 79ffdbf7af docs(F3-3): Add bugfix report and sprint status update
- Documented fixes for Unknown Monitor, Telegram duplicates, and queue clearing
- Added SPRINT-F3-STATUS.md for overall tracking
- F3-1, F3-2, F3-3 are now DONE. F3-4 is next.
2026-10-08 20:07:58 +03:00
root 5a62124410 feat(F3-2): Complete infrastructure audit & auto-generated runbooks
- Created comprehensive audit script (ops/audit-infrastructure.sh)
- Scanned all LXC containers and nested Docker services
- Generated infrastructure-inventory.json with full service map
- Auto-created runbook templates for all discovered services

Each runbook includes:
- LXC CT ID and Docker container name
- Port mappings and network info
- 5-step procedures (status, health, logs, restart, troubleshooting)

This provides complete operational documentation for the entire Buryan Hub infrastructure.
2026-10-08 18:04:18 +03:00
root 33bd9bf9e6 feat(F2-5, F3-1): Matrix Sprint + Dedup Layer
F2-5 - Matrix Integration:
- Added comprehensive runbook for Synapse/Coturn administration
- Added healthcheck script for Matrix API monitoring
- Added pre-audit design for Matrix-TG Bridge (Task 6-1)
- Deferred Bridge implementation to future sprint

F3-1 - Alert Deduplication:
- Implemented symptom-key based deduplication in Alert Queue Processor
- Added Gitea issue checking: create new or add comment to existing
- Grouped alerts by host (host_ip) to reduce spam
- Added automated queue cleanup after processing
- Integrated HTTP Telegram API (via VPS proxy) for reliability

Known Issues:
- Alert Queue Processor may send duplicate Telegram messages (2 instead of 1)
  when multiple hosts are affected. Documented in ops/KNOWN_ISSUES.md
  Fix planned in F3-3.

Technical Details:
- DB: buryan_monitoring (CT 151)
- Gitea: http://192.168.1.140:3000/root/buryan-hub
- Telegram: via https://193.233.210.184/tg-api/ proxy
2026-10-08 17:55:09 +03:00
root df25de8adf docs(audit): add pre-audit design document for Task 6-1 Matrix-TG Bridge
- Defined architecture (mautrix-telegram)
- Outlined prerequisites, implementation steps, and acceptance criteria
- Documented risks (E2EE, rate limiting) and next steps for future sprint
2026-10-07 21:56:47 +03:00
root 7a3e292c86 feat(F2-5): finalize Matrix Sprint integration
- Added runbook for Synapse/Coturn administration
- Added healthcheck script for Matrix API monitoring
- Documented completion of F2-5, deferred Bridge to future sprint
2026-10-07 21:52:44 +03:00
root 72c48ded12 docs: add F2-3 Remediation API post-mortem and audit report
- Documented architecture, artifacts, and success metrics
- Noted LXC+Docker cgroup locking behavior for future fix (Variant B)
- Formalized the completion of the secure agent control channel
2026-10-07 20:14:52 +03:00
root 15b79e0b5b feat: formalize comms-agent and initialize agent_registry (F2-1)
- Populated agents/REGISTRY.md with 8 planned agents
- Created first agent charter: CHARTER-comms-agent.md (Telegram Bot)
- Added SQL init script for agent_registry table in PG (CT 151)
- Registered comms-agent as 'active' in the database
2026-10-07 12:38:50 +03:00
root c2aae95ffb docs: Autonomous Infrastructure Swarm sprint report (Q4 2026) 2026-10-01 16:31:51 +03:00
root 5b23ea5b6e docs: final Matrix Sprint audit (bulk close confirmed tasks) 2026-10-01 16:24:35 +03:00
root 32c31d3c7e docs: Matrix Sprint report (final, 9/19 tasks closed, workflow deactivated) 2026-10-01 16:17:21 +03:00
root e13811b27b fix: correct Matrix Sprint report (9/19 tasks) + deactivate spam workflow 2026-10-01 16:15:40 +03:00
root 4f8684d2af docs: Matrix Sprint report (9/19 tasks, 47.4%) + cleanup AUTO-FIX spam 2026-10-01 16:13:36 +03:00
root c43c60a9cb Monitoring Sprint: 53 monitors + self-healing (end-to-end verified) + push-notifications 2026-09-28 14:38:08 +03:00
root 2ae43a044f AGENTS.md: Vaultwarden port 8081, SSO-схема без oauth2-proxy, актуализация секретов 2026-09-25 17:40:17 +03:00
root d964307be3 Sprint B: Vaultwarden SSO fix — report and closure
- Root cause: два OIDC-контура, nginx 8001→8081, provider не привязан к Application, issuer trailing slash
- Fix: нативный SSO Vaultwarden, oauth2-proxy отключён, Authentik Application создан
- Отчёт: ops/sprintB/vault-sso-fix-report.md
- Closes #1
2026-09-25 17:38:51 +03:00
root f69a88e0dc Matrix Sprint: fix public_baseurl for SSO (task #20) 2026-09-25 15:09:14 +03:00
root 497fc0aa85 Element Web: документация security опций для LXC 2026-09-25 14:08:04 +03:00
root 29a37fc90e Matrix Sprint: Element Web deployment (task #19) 2026-09-25 13:56:34 +03:00
root 086cc8f90f Matrix Sprint: nginx config for matrix.buryans.ru (task #18) 2026-09-25 13:52:54 +03:00
root 6855f3e4df Add AGENTS.md + infrastructure locator (reliable) 2026-09-25 13:46:03 +03:00
root ed00735097 Gitea cleanup complete + data registry created 2026-09-25 12:10:54 +03:00
root 68ceb859d9 Sprint A: vault nginx rewrite (clean config, oauth2-proxy port 8001) 2026-09-25 11:17:49 +03:00
root cc020fbcd2 Sprint A: 15 monitors + fixes (vault cert, headscale 404, port types) 2026-09-25 11:01:51 +03:00
root c8fae14875 Sprint A: 15 monitors for all infrastructure services 2026-09-25 10:48:54 +03:00
root 6700f759f7 Sprint 1: monitoring pipeline scripts (kuma->n8n->gitea->telegram) 2026-09-25 10:30:29 +03:00