A very nice model for optimising tasks not only for cost, but speed too 🔥 https://twitter.com/charmcli/status/2115087348023136267
X (formerly Twitter)Charm (@charmcli) on XMeet Prism, a specialized 8B model trained to route coding tasks to the right model in real time.
Prism chooses fast cost-efficient models for the easy stuff and bigger, smarter models for the hard stuff. We're seeing upwards 45% lower inference costs.
Now live on Charm Hyper.