Skip to main content

vantage_sdk.workbench.inference_preset

SDK helpers for cluster inference preset operations.

Classes​

InferencePresetSDK()​

SDK for cluster-scoped inference preset operations.

Methods​

  • create(self, ctx: 'typer.Context', *, cluster_name: 'str', name: 'str', compute_pool: 'str', runtimes: 'list[str]', cpu: 'str' = '2', memory: 'str' = '8Gi', gpu_count: 'int' = 0, min_replicas: 'int' = 1, max_replicas: 'int' = 1, description: 'str | None' = None) -> 'ClusterServiceResponse': No documentation provided.
  • delete(self, ctx: 'typer.Context', *, cluster_name: 'str', name: 'str') -> 'ClusterServiceResponse': No documentation provided.
  • get(self, ctx: 'typer.Context', *, cluster_name: 'str', name: 'str') -> 'ClusterServiceResponse': No documentation provided.
  • list(self, ctx: 'typer.Context', *, cluster_name: 'str') -> 'ClusterServiceResponse': No documentation provided.