The software architect of lemmy is unfortunately doomed. The very concept of how it works means exponential storage and bandwidth needs as it grows in sublemmits and instances.
A better design would have been instances being the sublemmits themselves, and leaving it up to the clients to subscribe and aggregate them into a feed. This way scaling is a lot more horizontal, and communities that get too big can scale up individually or purge old data without affecting the rest of the system.
The software architect of lemmy is unfortunately doomed. The very concept of how it works means exponential storage and bandwidth needs as it grows in sublemmits and instances. A better design would have been instances being the sublemmits themselves, and leaving it up to the clients to subscribe and aggregate them into a feed. This way scaling is a lot more horizontal, and communities that get too big can scale up individually or purge old data without affecting the rest of the system.