Studio Futur

1 Jan 2026·Studio Futuro Lab·Research

LLM benchmark on Italian enterprise technical language

A dataset of 240 technical Italian prompts was built — fiscal, logistics, regulatory domains — and evaluated across six models. Claude Sonnet and the GPT-4 class lead; open-source models show difficulty with technical terminology and legal nuance.

Takeaway

For Italian enterprise technical language, the open vs closed gap remains significant. On sensitive projects, a commercial LLM with a clear DPA outperforms immature self-hosting.

A meeting

Let's talk about your project

You tell us what you're building, where you're stuck, and what needs to work. If it makes sense, we define a first concrete piece.

hello@studiofuturo.ai

Reply within 24 business hours