• 0 Posts
  • 17 Comments
Joined 3 years ago
cake
Cake day: July 2nd, 2023

help-circle
  • Great work! Enjoyable read. I’ve always thought those basic droplets would choke as soon as any significant traffic began to scale up, but this shows it can stretch pretty far.

    The only real issue here is that the tests assume applications are receiving legitimate human visits, but we know something like 90% of all traffic are bots and scrapers. Serving 4000 actual users would be significant, because the application could be serving more like 40,000 other requests from bots in that case. That’s why we’re inclined to not launch apps without implementing advanced caching and CDNs.












  • I think it’ll make a comeback eventually. LLMs will get progressively less useful as a replacement as its’ training data stales. Without refreshed data it’s going to be just as irrelevant as the years go on. Where will it get data about new programming languages or solutions to problems in new software? LLM knowledge will be stuck in 2025 unless new training material is given to it.