• Hackworth@piefed.ca
    link
    fedilink
    English
    arrow-up
    13
    arrow-down
    8
    ·
    14 hours ago

    Did you try it? In the few coding tasks I threw at it, it performed much better than Opus.

    • ID10T@programming.dev
      link
      fedilink
      English
      arrow-up
      12
      ·
      12 hours ago

      I played with it at work for the afternoon when I noticed I had access. It was fine. Sure, it was an improvement, but it wasn’t so good that it could end the world. It was basically just more of the same for anyone familiar with coding agents.

    • rozodru@piefed.world
      link
      fedilink
      English
      arrow-up
      10
      ·
      14 hours ago

      I tried it, had to VPN in to do so but I tried it. I gave it 5 tasks, it succeeded in 2 of them, rest were hallucinations. so…yeah…guess it’s much better than Opus.

      • Hackworth@piefed.ca
        link
        fedilink
        English
        arrow-up
        3
        arrow-down
        2
        ·
        13 hours ago

        rest were hallucinations

        I’m having trouble parsing whatcha mean here if they were coding tasks. The code didn’t run? Ran but had 0 functionality? If they were non-coding tasks, then agreed, I didn’t notice it being significantly more accurate. Though I did appreciate the larger vocab. I wasn’t gonna be able to afford to keep using it once it went to API pricing anyway.

        • rozodru@piefed.world
          link
          fedilink
          English
          arrow-up
          5
          ·
          13 hours ago

          sorry should have been more specific. it was a mix of coding and non-coding. 1 coding task ran fine, another one just didn’t work at all. one was a basic walk through tutorial type task that was accurate, the others were hallucinations.

    • abbadon420@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      4
      ·
      14 hours ago

      Of course not. It’s offline and my boss only pays for ChatGpt. I have used ChatGpt 5.4 and it’s performance is fine. I have not used it for coding, but I did notice it being a bit more coherent. I am am not a poweruser though. I don’t work with agents. I’m sure that makes it better, but I’m not willing ti pay for the tokens.

      • Hackworth@piefed.ca
        link
        fedilink
        English
        arrow-up
        3
        arrow-down
        1
        ·
        14 hours ago

        I just use the web app, mostly to make self-contained html toys. During the brief period it was up and part of the general subscription, I asked it to make Terrace (the old board game from TNG) with very little help in the initial prompt. I kinda know how involved that task is, cause I manually wrote a Godot version back in '20. It nailed it with only minor fixes - 3D, reactive sound and visuals, a music score that is pretty chill, with Easy, Medium, and Hard levels of AI to compete against. I have yet to beat it on Hard. Opus couldn’t touch that. I’m pretty sure the fed’s response is simple retaliation against Anthropic for not playing ball with the DoD/W, but the capability jump was definitely notable. I saw someone liken it to the jump from gpt 3.5 to 4, and I agree, if not a bit more.

        • abbadon420@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          3
          ·
          13 hours ago

          Yeah, that sounds like just another LLM iteration. It’s nice and all. Great technological innovationn. Very impressive. But is it wort investing billion upon billions of dollars? Is it worth breaking the chip market? Is it worth breaking the job market? Is it worth (possibly) causing a complete marhet crash when the bubble bursts?