Launching prompt adaptation
How does Not Diamond determine which model to call?
Nine months ago we launched the world’s most powerful model router, successfully helping over 100,000 users predictively determine the best suited LLM for every query. Our router outperforms every individual foundation model across all major benchmarks, delivering higher accuracy at lower cost and latency.
But choosing the right model is only half the battle. The next big challenge is prompting each model correctly. As the AI landscape becomes increasingly fragmented, every developer has seen firsthand that prompts written for one model don’t easily transfer to others. Manually rewriting them for every new model that’s released quickly becomes unsustainable, with teams spending thousands of hours on manual prompt engineering as they begin scaling to dozens of different prompts across a constantly shifting pool of models.
Today, we're excited to launch early access for Prompt Adaptation, a state-of-the-art agentic prompt rewriting system that automatically adapts prompts across different models, significantly enhancing accuracy and dramatically cutting down engineering time.
Our enterprise and startup customers have already begun benefitting from Prompt Adaptation. At SAP Sapphire in 2025, Philipp Herzig, Chief Technology Officer and Chief AI Officer of SAP SE, showcased a preview of the SAP prompt optimization service integration into SAP’s generative AI hub powered by Not Diamond with the intent of driving accuracy improvements on its use cases and accelerating engineering throughput:
“Prompt optimization is key to make Enterprise AI more flexible, cheaper, more accurate, and less brittle,” said Philipp Herzig, Chief Technology Officer and Chief AI Officer at SAP. “With Not Diamond, we can adapt to AI innovations and new models much faster and benefit from performance improvements in AI development. This is just the beginning—we’re a to continue building the multi-model future together.”
How Prompt Adaptation Works
Nine months ago we launched the world’s most powerful model router, successfully helping over 100,000 users predictively determine the best suited LLM for every query. Our router outperforms every individual foundation model across all major benchmarks, delivering higher accuracy at lower cost and latency.
But choosing the right model is only half the battle. The next big challenge is prompting each model correctly. As the AI landscape becomes increasingly fragmented, every developer has seen firsthand that prompts written for one model don’t easily transfer to others. Manually rewriting them for every new model that’s released quickly becomes unsustainable, with teams spending thousands of hours on manual prompt engineering as they begin scaling to dozens of different prompts across a constantly shifting pool of models.
Today, we're excited to launch early access for Prompt Adaptation, a state-of-the-art agentic prompt rewriting system that automatically adapts prompts across different models, significantly enhancing accuracy and dramatically cutting down engineering time.
Our enterprise and startup customers have already begun benefitting from Prompt Adaptation. At SAP Sapphire in 2025, Philipp Herzig, Chief Technology Officer and Chief AI Officer of SAP SE, showcased a preview of the SAP prompt optimization service integration into SAP’s generative AI hub powered by Not Diamond with the intent of driving accuracy improvements on its use cases and accelerating engineering throughput: