Add data-ingestion-service for SA4CPS FTP integration

- Implement FTP monitoring and ingestion for SA4CPS .slg_v2 files - Add
robust data processor with multi-format and unit inference support -
Publish parsed data to Redis topics for real-time dashboard simulation -
Include validation, monitoring, and auto-configuration scripts - Provide
documentation and test scripts for SA4CPS integration

microservices/data-ingestion-service/requirements.txt

@@ -0,0 +1,35 @@
+# FastAPI and web framework dependencies
+fastapi==0.104.1
+uvicorn==0.24.0
+pydantic==2.5.0
+
+# Database dependencies
+motor==3.3.2
+pymongo==4.6.0
+redis==5.0.1
+
+# FTP handling
+ftputil==5.0.4
+
+# Data processing
+pandas==2.1.4
+numpy==1.25.2
+openpyxl==3.1.2
+xlrd==2.0.1
+
+# Async HTTP client
+httpx==0.25.2
+
+# Logging and monitoring
+structlog==23.2.0
+
+# Date/time utilities
+python-dateutil==2.8.2
+
+# Type checking
+typing-extensions==4.8.0
+
+# Development dependencies (optional)
+pytest==7.4.3
+pytest-asyncio==0.21.1
+pytest-cov==4.1.0