Interface ILargeLanguageModel

Namespace: DotnetPrompt.Abstractions.LLM
Assembly: DotnetPrompt.Abstractions.dll
Syntax
public interface ILargeLanguageModel

Properties

| Improve this Doc View Source

LLMType

Keyword for model type, used for serialization

Declaration
string LLMType { get; }
Property Value
Type Description
string
| Improve this Doc View Source

MaxRequestTokens

Maximum tokens that could be send to a language model

Declaration
int MaxRequestTokens { get; }
Property Value
Type Description
int

Methods

| Improve this Doc View Source

GenerateAsync(IList<string>, IList<string>)

Run the LLM on the given prompts and stops.

Declaration
Task<ModelResult> GenerateAsync(IList<string> prompts, IList<string> stop = null)
Parameters
Type Name Description
IList<string> prompts
IList<string> stop
Returns
Type Description
Task<ModelResult>
Exceptions
Type Condition
System.InvalidOperationException

When cache asked without

Extension Methods