Revolut says that in less than a year it’s managed to slash its [code generation] costs by roughly 90 percent by making self-hosted models its default instead of relying primarily on commercial services like Claude.

  • tofu@lemmy.nocturnal.garden
    link
    fedilink
    English
    arrow-up
    9
    ·
    2 days ago

    That it’s in the hand of a few people is one major issue, but the externalized costs* are even worse one in my book and this is another post where it’s conveniently ignored mostly.

    • Energy consumption, water usage, scraping ddos
    • JLD@lemmy.zip
      link
      fedilink
      English
      arrow-up
      1
      ·
      11 hours ago

      It is quite concerning, but I feel like those issues have a solution, if the tech moves out of those greedy bastards hands.

      They just want to scale as fast as possible without any concerns for communities, energy, or water. That’s because they are running a completely unsustainable business and they need to spread quickly, to make more people depend on the tech, as provided by them, so that eventually they get government backing and become comparable to energy, as they have said before.

      But it’s a fucking scam. We could run AI locally with less resources per area, so by distributing it the impact would be negligible compared to what massive data centers bring. I would actually love to see some numbers on this, but the ones funding it are the ones interested in building the data centers, and they have the government reach to keep them from doing a fair study as well.