One of Just AI's key focus areas is developing solutions based on generative AI for business. To find out whether Russian companies face problems integrating popular cloud LLMs, we tested two hypotheses: do companies have access problems with the ChatGPT API, and is sending confidential data to the cloud a blocker?
LLM favorite
According to Wordstat, ChatGPT remains the most popular cloud language model in the Russian-speaking segment. Interest in the ChatGPT API exceeds interest in APIs of all other popular cloud models combined.
Self-hosted LLM
Some companies face serious obstacles in leveraging LLM potential. This mainly concerns those working with government institutions bound by personal data laws. They find alternatives in open-source large language models that can be deployed locally.
How to test and choose the right LLM?
The Just AI team developed Multi Chat — a tool for testing and comparing various generative models, both cloud and self-hosted. Supported models include ChatGPT, Gemini, Claude, GigaChat, YandexGPT, Llama 3.1, and Qwen2.
The Caila platform supports on-premise deployment. For masking sensitive data, the Jay Guard system can be connected. All data leaving the company's closed perimeter to external LLMs is anonymized and sent securely.
Source: https://habr.com/ru/companies/just_ai/articles/831156/