Press Space to continue
Vendor incentives determine which AI models actually get deployed
Press Space to continue
Prinz has been running legal benchmarks against AI systems and the latest models are very good... but cheaper/low reasoning models are not very good. So, how do you make sure your vendor selling an AI solution is incentivized to serve the good (and therefore expensive) models?
prinz@deredleritt3rSep 2
Reading a memo produced by the client's legal department with extensive help from AI: - looks very pretty; beautiful font; nice formatting; there's even a handsome-looking (although unnecessary) organizational chart included - completely incorrect conclusion on whether a regulatory approval is required for a transaction - even worse, misses two separate reasons due to which the transaction is actually statutorily *prohibited* This is becoming increasingly common and will have a multitude of consequences before in-house lawyers finally learn to use *good* models instead of cheap slop served up by the legal wrapper companies.