F5 AI Gateway Demo Stack¶

The AI Gateway Demo Stack is a Helm chart package that integrates Grafana, Prometheus, and Loki with AI Gateway. It provides a turn-key observability solution for demos and proof-of-concept deployments.

Warning

This feature is currently experimental and provided on an “as-is” and “try at your own risk” basis.

It may be unstable, incomplete, or subject to change without notice.

By enabling or using this feature, you acknowledge and accept that:

The feature has not undergone full security review or production-level testing.
The product and its developers make no guarantees regarding the security, reliability, or performance of this feature.

It is strongly recommended that experimental features be tested in non-production environments.

Introduction¶

This chart deploys the F5 AI Gateway Demo Stack in your Kubernetes cluster.

AI Gateway Demo Stack Helm chart is an experimental distribution of the AI Gateway Helm chart with observability tooling included by default.

Prerequisites¶

Requirements¶

Kubernetes: >= 1.25.0-0

Repository	Name	Version
https://grafana.github.io/helm-charts	grafana	9.3.0
https://grafana.github.io/helm-charts	loki	6.34.0
https://grafana.github.io/helm-charts	promtail	6.17.0
https://grafana.github.io/helm-charts	tempo	1.23.2
https://open-telemetry.github.io/opentelemetry-helm-charts	opentelemetry-collector	0.130.0
https://prometheus-community.github.io/helm-charts	prometheus	27.29.0
oci://private-registry.f5.com/aigw/charts	aigw	0.3.1

Install the chart¶

Follow the instructions for installing the AI Gateway Helm chart to configure namespaces, licenses, and other prerequisites. If you are unfamiliar with the AI Gateway Helm chart, refer to these instructions before proceeding.

Ensure that:

The Kubernetes namespace is ai-gateway (if following the guide exactly)
The f5-registry-secret exists in the above namespace
You have logged into the F5 Private Registry with a JWT

Install the chart from the OCI registry¶

To install the latest stable release of AI Gateway Demo Stack Helm chart from the OCI registry in the ai-gateway namespace, run the following command, specifying the registry and license secrets:

helm install aigw oci://private-registry.f5.com/aigw/charts/aigw-demo-stack -n ai-gateway --set "aigw.imagePullSecrets[0].name=f5-registry-secret"

Configuration¶

The following table lists the configurable parameters of the AI Gateway chart and their default values.

Key	Type	Default
aigw.aigw.ui.enabled	bool	`true`
aigw.metrics.endpoint	string	`"http://opentelemetry-collector:4317"`
aigw.tracing.endpoint	string	`"http://opentelemetry-collector:4317"`

AI Gateway Configuration¶

The AI Gateway Helm chart is included as a sub-chart within the AI Gateway Demo Stack Helm chart. To configure values for the sub-chart, nest your configuration under the aigw key inside the parent chart’s values.

aigw:
  imagePullSecrets:
    - name: f5-registry-secret

  aigw:
    config:
      contents: |
        server:
          address: :4141

You can set any value supported by the AI Gateway Helm chart under aigw. Refer to the AI Gateway Helm chart documentation for a full list of available parameters.

Access Grafana¶

To access Grafana, port forward with Kubernetes:

Forward the port to your local machine:

kubectl -n ai-gateway port-forward svc/grafana 3000:80

Open your browser and navigate to http://localhost:3000 to access Grafana.

Access the experimental AI Gateway user interface¶

To access the experimental AI Gateway user interface, follow the instructions in the Access the User Interface guide.

License Notice¶

This chart can optionally deploy Grafana, Loki, and Tempo, which are each licensed under the GNU Affero General Public License v3.0. If you enable these components, you are responsible for reviewing and complying with their license terms.

See the following for license details:

Previous Next