Commit Graph

20 Commits

Author SHA1 Message Date
rafaeldpsilva
863e0161b0 Implement dynamic energy data collections per building
- Store energy data in separate MongoDB collections for each
SLGs/Community/Building directory - Update FTP monitor and database
manager to track directory paths and select appropriate collections -
Add collection stats to database statistics API - Update sensor and
token services for improved API consistency - Add 'rb' (rebuild and
restart) option to deploy.sh script
2025-10-08 14:03:57 +01:00
rafaeldpsilva
ba99b09e08 Remove comments and verbose logging from services 2025-09-23 15:05:59 +01:00
rafaeldpsilva
78151feb86 Documentation files 2025-09-22 15:25:52 +01:00
rafaeldpsilva
02a0d54e14 Add room and analytics services with CRUD API endpoints
- Implement RoomService for room management and metrics - Add
AnalyticsService for sensor data analytics and trends - Extend models
with Room, RoomCreate, RoomUpdate, RoomInfo - Add room CRUD endpoints to
FastAPI app - Add database connection logic for MongoDB and Redis -
Refactor sensor service logic into SensorService class
2025-09-22 15:13:14 +01:00
rafaeldpsilva
2008ea0e70 Refactor service registry and load balancer integration
- Pass service registry to load balancer for dependency injection -
Remove dynamic imports of service registry in load balancer - Update
service registration and health check logic - Enable token-service in
docker-compose and service config - Add room names and rooms proxy
endpoints - Improve logging for proxy requests and health checks -
Update deploy script project name to sa4cps - Add test script for
coroutine fix - Minor code cleanup and formatting
2025-09-22 15:13:06 +01:00
rafaeldpsilva
41b8753a92 Add scan cache tracking and improve health checks
- Track scanned FTP directories in MongoDB to avoid redundant scans -
Add endpoints to view and clear scan cache - Improve health check logic
for better startup and error reporting - Add readiness endpoint for
deployment probes - Add test script for health check improvements -
Increase logging verbosity for debugging
2025-09-22 15:12:40 +01:00
rafaeldpsilva
c3ba7c0dc0 Remove layered architecture files and related modules 2025-09-22 15:12:24 +01:00
rafaeldpsilva
aa07347604 Implement iterative FTP scan and skip logic with processed file cache
- Add iterative directory scanning to prevent infinite recursion - Cache
processed files in memory to avoid redundant database lookups - Skip
already processed files using cache and database fallback - Add tests
for skip logic and iterative scan behavior - Change logging for MongoDB
connection and file storage to debug level - Clean up FastAPI app and
remove redundant docstrings
2025-09-12 13:43:21 +01:00
rafaeldpsilva
a703240b27 Add data ingestion service proxy routes and update configs
- Add proxy routes for data ingestion service in API gateway - Register
data-ingestion-service in SERVICES config - Update docker-compose to
include data-ingestion-service and sensor-service dependencies - Fix
import typo in sensor-service (contextual -> contextlib) - Update FTP
credentials and environment variables for data-ingestion-service
2025-09-11 11:47:22 +01:00
rafaeldpsilva
2932e0a424 Switch to PyMongo, update config and requirements, fix FTP extension
typo

- Replace Motor (async) with PyMongo (sync) in database manager - Update
environment variable names for FTP and MongoDB config - Remove unused
dependencies from requirements.txt - Fix file extension typo: .slg_v2 →
.sgl_v2 throughout code and docs - Add debug prints for MongoDB env vars
in config - Update FTP monitor to use correct file extension and PyMongo
- Adjust FastAPI descriptions for new extension
2025-09-11 11:45:19 +01:00
rafaeldpsilva
b2a5b3d229 Data ingestion service tests 2025-09-10 15:47:28 +01:00
rafaeldpsilva
b7e734e0d2 Simplify data ingestion service 2025-09-10 15:47:10 +01:00
rafaeldpsilva
13556347b0 Simplify data ingestion service 2025-09-10 15:21:53 +01:00
rafaeldpsilva
fa694443e7 Add sensor-service microservice with FastAPI, models, and WebSocket
manager
2025-09-10 14:43:41 +01:00
rafaeldpsilva
5fdce00e5d Add data-ingestion-service for SA4CPS FTP integration
- Implement FTP monitoring and ingestion for SA4CPS .slg_v2 files - Add
robust data processor with multi-format and unit inference support -
Publish parsed data to Redis topics for real-time dashboard simulation -
Include validation, monitoring, and auto-configuration scripts - Provide
documentation and test scripts for SA4CPS integration
2025-09-10 14:43:30 +01:00
rafaeldpsilva
d4f280de93 Remove legacy backend files and update microservices config
- Delete ARCHITECTURE.md and old services directory - Add sensor-service
and data-ingestion-service to Docker Compose - Comment out unused
services in docker-compose.yml - Update deploy.sh to use `docker
compose` command - Extend API gateway to proxy sensor-service routes and
WebSocket - Refactor health checks and service dependencies
2025-09-10 14:42:49 +01:00
rafaeldpsilva
90c95d6801 Delete pycache 2025-09-09 13:59:55 +01:00
rafaeldpsilva
3bcddf9602 Remove legacy API and database modules for layered refactor 2025-09-09 13:50:53 +01:00
rafaeldpsilva
4bde7a951c Create git ignore file 2025-09-09 13:48:45 +01:00
rafaeldpsilva
a7a18e6295 first commit 2025-09-09 13:46:42 +01:00