API reference
API reference
Select your platform
No SDKs available
No versions available

LlamaApiProvider Class

Properties

bool SupportsVision[Get]
override InferenceType DefaultSupportedTypes[Get]

Fields

float temperature[Get]
float topP[Get]
float repetitionPenalty[Get]
int maxCompletionTokens[Get]

Member Functions

async Task< ChatResponse > ChatAsync
( ChatRequest req,
IProgress< ChatDelta > stream,
CancellationToken ct )