AiliaLLMModel class
Methods
-
close()
→ void
-
Free memory allocated natively.
-
contextFull()
→ bool
-
-
generate()
→ String?
-
Ask the model to generate the next token.
This function properly handle incomplete multi-byte utf8 character.
-
getTokenCount(String text)
→ int
-
-
noSuchMethod(Invocation invocation)
→ dynamic
-
Invoked when a nonexistent method or property is accessed.
inherited
-
open(String modelPath, int nCtx, {String backend = ""})
→ void
-
Initialize the context using the given model and parameters.
-
setPrompt(List<Map<String, dynamic>> messages)
→ void
-
Set the prompt to be process by the model.
The prompt will be formatted according to the selected format.
messages must be an array of object with two string properties
named 'role' and 'content'.
-
setSamplingParams(int top_k, double top_p, double temp, int dist)
→ void
-
-
toString()
→ String
-
A string representation of this object.
inherited