Shovels reposted this
Shovels runs its own model on sference. Shovels processes millions of building permits. Tagging them with a frontier model works, but you're paying frontier prices for a task a small model handles just as well. So their ML team distilled their own encoder for permit tagging. With our BYOM support, it now runs in production on sference, on hardware sized for the model. Right-sized model, right-sized hardware. That's the whole idea. Thanks to Benjamin Džubur and the Shovels team (Luka K., Petra Kopić) for pushing BYOM into production with us.