ailia_llm package¶

Classes¶

class ailia_llm.AiliaLLM¶

Bases: object

__init__()¶

context_full()¶

generate(prompts, top_k=40, top_p=0.9, temp=0.4, dist=1234)¶

generated_token_count()¶

open(model_path, n_ctx=0)¶

prompt_token_count()¶

token_count(text)¶