KServe

Provide access to AI model servers with the KServe standard to run inference with remote models

Metadata

<dependency>
    <groupId>org.apache.camel</groupId>
    <artifactId>camel-kserve</artifactId>
    <version>4.10.2</version>
</dependency>

Name	Type	Required	Default	Description
`api`	string	✓		The KServe API
`modelName`	string			The name of the model used for inference.
`modelVersion`	string			The version of the model used for inference.
`target`	string		`localhost:8001`	The target URI of the client. See: https://grpc.github.io/grpc-java/javadoc/io/grpc/Grpc.html#newChannelBuilder%28java.lang.String,io.grpc.ChannelCredentials%29
`lazyStartProducer`	boolean		`false`	Whether the producer should be started lazy (on the first message). By starting lazy you can use this to allow CamelContext and routes to startup in situations where a producer may otherwise fail during starting and cause the route to fail being started. By deferring this startup to be lazy then the startup failure can be handled during routing messages via Camel's routing error handlers. Beware that when the first message is processed then creating and starting the producer may take a little time and prolong the total processing time of the processing.
`credentials`	object			The credentials of the client.