> Relying on the e.g
> Relying on the e.g. Servlet Container not being able to handle requests seems rather bad to me. That is a very rough error handling. It's one of those situations where the simplest "what you get by accident with a single-threaded non-evented server" solution, and the most fancy-and-complex solution, actually look alike from a client's perspective. What you actually want is that each of your backends monitors its own resource usage, and flags itself as unhealthy in its readiness-check endpoint when it's approaching its known per-backend maximum resource capacity along any particular dimension — threads, memory usage, DB pool checked-out connections, etc. …
Original discussionWhy messaging is much better than REST for inter-microservice communications156 source comments · at import