Diasoft has updated its MLOps platform, part of the Digital Q.DataFactory solution, by integrating a new AI Gateway. This tool serves as a centralized entry point designed to manage and secure interactions with large language models (LLMs) within corporate environments.
The AI Gateway provides several security and operational features, including Zero-Trust AI for data masking of sensitive information before it reaches external providers. It also includes intelligent routing that balances workloads based on resource availability and costs, along with automated fallback mechanisms for model failures.
To optimize performance and budget, the platform incorporates semantic caching to identify duplicate queries and reduce LLM load. It also offers comprehensive cost control through metric tracking, such as latency and token usage, alongside quota management and integration with Digital Q.Security for SSO authentication.
The solution features a unified OpenAI-compatible API, allowing businesses to connect to various local and external providers, including GigaChat and Routerai.ru. Content filtering is managed through Guardrails AI to ensure compliance with corporate security standards.
The Digital Q.DataFactory platform is listed in the Russian software registry under entry number 34110. It is designed to consolidate data into a single repository, automate ML model preparation, and facilitate predictive analytics and data visualization.
