#workers

Can we have a scalable fastapi service with common cache ?

So as it goes, we were using FastAPI for one of the apps. Our app uses a lot of memory(for ml models). Premise: I wanted to launch multiple workers of the app as Python is single-threaded and also be able to have a common cache across. We can use Uvi...