Original Reddit post

I need an on-premise AI model that understands and responds fluently in Croatian while intelligently calling external APIs and other events. The model must reason about user requests, select the correct tool, fill parameters accurately, and formulate coherent responses — all in Croatian. Initial tests with 7B parameter models showed poor results: frequent misclassification of Croatian queries, grammatical errors in responses, and unreliable tool selection. What I want to know: I need to choose a LLM model that will carry some things that are important to me: Model size vs Croatian language quality?

  • Here i want just eliable, grammatically correct Croatian. The language is a bit complex because it has rules and I want a model that can handle that. How does performance scale from 7B through 14B, 32B, and 70B? Non-English tool calling and function calling?
  • Most tool-calling benchmarks, such as the Berkeley Function Calling Leaderboard, are English-only. Does tool calling still work reliably when the conversation is in Croatian? Which open-source models support both European languages and tool calling?
  • We need a model that does two things simultaneously: understands and responds in Croatian, and correctly selects and invokes tools with accurate parameters. Which models on Hugging Face offer the best combination of European multilingual support and native tool-calling capability? Specifically, how do Qwen, Llama, Mistral, EuroLLM, and Aya compare across both dimensions? Hardware requirements?? Also I am not familiar with the hardware requirements and AI, but I also would like to know what stuff i need? Such as how big GPU hardware is required to eat all that pretty well? What are the quantization trade-offs (4-bit, 8-bit) for non-English languages — does compression degrade Croatian quality more than English? Which inference engine (vLLM, TGI) is best suited for serving a single model to multiple concurrent users? submitted by /u/sonmak123

Originally posted by u/sonmak123 on r/ArtificialInteligence