【LangChain4J】常见模型参数

模型参数官网

日志

OpenAiChatModel.builder()
    ...
    .logRequests(true)
    .logResponses(true)
    .build();

ChatModelListener监听

OpenAiChatModel.builder()
    ...
    .listeners(List.of(new MyChatModelListener()))
    .build();

@Slf4j
public class MyChatModelListener implements ChatModelListener {

    @Override
    public void onRequest(ChatModelRequestContext requestContext) {
        String uuid = UUID.randomUUID().toString();
        requestContext.attributes().put("TraceId", uuid);
        log.info("Request TraceId: {}" , uuid);

    }

    @Override
    public void onResponse(ChatModelResponseContext responseContext) {
        Object traceId = responseContext.attributes().get("TraceId");
        log.info("Response TraceId: {} " , traceId);
    }

    @Override
    public void onError(ChatModelErrorContext errorContext) {
        log.error("请求异常：{}", errorContext.toString());
    }
}

重试以及超时

OpenAiChatModel.builder()
                ...
                .maxRetries(2) //重试2次 默认3次
                .timeout(Duration.ofSeconds(2)) //超时时间
                .build();