Commit Graph

5 Commits

Author SHA1 Message Date
rafaeldpsilva
2932e0a424 Switch to PyMongo, update config and requirements, fix FTP extension
typo

- Replace Motor (async) with PyMongo (sync) in database manager - Update
environment variable names for FTP and MongoDB config - Remove unused
dependencies from requirements.txt - Fix file extension typo: .slg_v2 →
.sgl_v2 throughout code and docs - Add debug prints for MongoDB env vars
in config - Update FTP monitor to use correct file extension and PyMongo
- Adjust FastAPI descriptions for new extension
2025-09-11 11:45:19 +01:00
rafaeldpsilva
b2a5b3d229 Data ingestion service tests 2025-09-10 15:47:28 +01:00
rafaeldpsilva
b7e734e0d2 Simplify data ingestion service 2025-09-10 15:47:10 +01:00
rafaeldpsilva
13556347b0 Simplify data ingestion service 2025-09-10 15:21:53 +01:00
rafaeldpsilva
5fdce00e5d Add data-ingestion-service for SA4CPS FTP integration
- Implement FTP monitoring and ingestion for SA4CPS .slg_v2 files - Add
robust data processor with multi-format and unit inference support -
Publish parsed data to Redis topics for real-time dashboard simulation -
Include validation, monitoring, and auto-configuration scripts - Provide
documentation and test scripts for SA4CPS integration
2025-09-10 14:43:30 +01:00