Prompt classification in ~140 ms decides which LLM gets each request: 20x cheaper and 6x faster than before.
0 online0 visits
What are people building with Jev?
1 project · @StarchildOnX on X ↗
Prompt classification in ~140 ms decides which LLM gets each request: 20x cheaper and 6x faster than before.