Features of ailia LLM

In this page, we present the features that are provided by both the C and the C# APIs.

Loading GGUF

It is possible to load GGUF files and conduct chat.

GPU inference is possible using Metal on iOS and macOS, and Vulkan on Windows.