Commit Graph

4 Commits

Author SHA1 Message Date
rafaeldpsilva
41b8753a92 Add scan cache tracking and improve health checks
- Track scanned FTP directories in MongoDB to avoid redundant scans -
Add endpoints to view and clear scan cache - Improve health check logic
for better startup and error reporting - Add readiness endpoint for
deployment probes - Add test script for health check improvements -
Increase logging verbosity for debugging
2025-09-22 15:12:40 +01:00
rafaeldpsilva
b7e734e0d2 Simplify data ingestion service 2025-09-10 15:47:10 +01:00
rafaeldpsilva
13556347b0 Simplify data ingestion service 2025-09-10 15:21:53 +01:00
rafaeldpsilva
5fdce00e5d Add data-ingestion-service for SA4CPS FTP integration
- Implement FTP monitoring and ingestion for SA4CPS .slg_v2 files - Add
robust data processor with multi-format and unit inference support -
Publish parsed data to Redis topics for real-time dashboard simulation -
Include validation, monitoring, and auto-configuration scripts - Provide
documentation and test scripts for SA4CPS integration
2025-09-10 14:43:30 +01:00