Commit Graph

4 Commits

Author SHA1 Message Date
rafaeldpsilva
aa07347604 Implement iterative FTP scan and skip logic with processed file cache
- Add iterative directory scanning to prevent infinite recursion - Cache
processed files in memory to avoid redundant database lookups - Skip
already processed files using cache and database fallback - Add tests
for skip logic and iterative scan behavior - Change logging for MongoDB
connection and file storage to debug level - Clean up FastAPI app and
remove redundant docstrings
2025-09-12 13:43:21 +01:00
rafaeldpsilva
b2a5b3d229 Data ingestion service tests 2025-09-10 15:47:28 +01:00
rafaeldpsilva
b7e734e0d2 Simplify data ingestion service 2025-09-10 15:47:10 +01:00
rafaeldpsilva
13556347b0 Simplify data ingestion service 2025-09-10 15:21:53 +01:00