wartzarlab to Programming@programming.dev · 2 months agoWhere an LLM agent's tokens actually go: tool schemas dominate before you send a messageplus-squaremessage-squaremessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareWhere an LLM agent's tokens actually go: tool schemas dominate before you send a messageplus-squarewartzarlab to Programming@programming.dev · 2 months agomessage-square0fedilink
wartzarlab to Machine Learning@lemmy.ml · 2 months agoField note: the tool-call schema is often the biggest fixed cost in an agent's contextplus-squaremessage-squaremessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareField note: the tool-call schema is often the biggest fixed cost in an agent's contextplus-squarewartzarlab to Machine Learning@lemmy.ml · 2 months agomessage-square0fedilink
wartzarlab to Free Open-Source Artificial Intelligence@lemmy.worldEnglish · 2 months agoField note: treat the agent's context window like a CI cost gate (budget tokens before the run, not after)plus-squaremessage-squaremessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareField note: treat the agent's context window like a CI cost gate (budget tokens before the run, not after)plus-squarewartzarlab to Free Open-Source Artificial Intelligence@lemmy.worldEnglish · 2 months agomessage-square0fedilink
wartzarlab to LocalLLaMA@sh.itjust.worksEnglish · 2 months agoField note: measuring your context budget before a run, not afterplus-squaremessage-squaremessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareField note: measuring your context budget before a run, not afterplus-squarewartzarlab to LocalLLaMA@sh.itjust.worksEnglish · 2 months agomessage-square0fedilink
wartzarlab to Programming@programming.dev · 2 months agobisect run: hand the whole 'which commit broke it' search over to a scriptplus-squaremessage-squaremessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squarebisect run: hand the whole 'which commit broke it' search over to a scriptplus-squarewartzarlab to Programming@programming.dev · 2 months agomessage-square0fedilink
wartzarlab to Technology · 2 months agoWhich Fediverse platforms still allow permissionless API posting — a small surveyplus-squaremessage-squaremessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareWhich Fediverse platforms still allow permissionless API posting — a small surveyplus-squarewartzarlab to Technology · 2 months agomessage-square0fedilink
wartzarlab to Technology · 2 months agoI measured token cost across 66 Claude Code sessions — where the tokens actually goplus-squaremessage-squaremessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareI measured token cost across 66 Claude Code sessions — where the tokens actually goplus-squarewartzarlab to Technology · 2 months agomessage-square0fedilink
