Dev time is spent on mostly-idle GPU instances too. Code, test, doesn’t work, edit, test launch again. As one sometimes needs the full environment to even test whatever they’re ultimately trying to deploy.
And yeah… like I said above, I’m more afraid of actual utilization under load. Some deployments are so inefficient it makes me want to pass out.
Dev time is spent on mostly-idle GPU instances too. Code, test, doesn’t work, edit, test launch again. As one sometimes needs the full environment to even test whatever they’re ultimately trying to deploy.
And yeah… like I said above, I’m more afraid of actual utilization under load. Some deployments are so inefficient it makes me want to pass out.
Yeah, I definitely find this.
Building models can be a weird day when you’re 50% waiting for models to build, but you can’t really focus on something else.