Skip to content

Kubernetes Gateway API Inference Extension

InferencePool

kubernetes-sigs/gateway-api-inference-extension

Kubernetes Gateway API Inference Extension

kubernetes-sigs/gateway-api-inference-extension

Overview
Overview
- Introduction
- Concepts
  Concepts
- Implementations
- FAQ
Guides
Guides
- User Guides
  User Guides
  - Getting started
- Implementer's Guide
Reference
Reference
- API Reference
- API Types
  API Types
  - InferencePool InferencePool
    Table of contents
    
    Background
    
    Spec
  - InferenceModel
Enhancements
Enhancements
- Overview
Contributing
Contributing
- How to Get Involved
- Developer Guide

Inference Pool¶

Alpha since v0.1.0

The InferencePool resource is alpha and may have breaking changes in future releases of the API.

Background¶

InferencePool is

Comparing InferencePool with Service

Spec¶

TODO