Azure AI Model Setup

The ai init inference command initializes the connection to the Azure AI Inference endpoint. This initialization is required to use the models available in the Azure AI Model Catalog with the Azure AI CLI or with the Azure AI Inference SDK packages.

If you don't have the ai CLI installed ...

Before you begin, you'll need to install the ai CLI.

Install the ai CLI

Initialize connection to Azure AI Inference Endpoint

ai init inference

STEP 1: ⇛ Enter your Azure AI Inference endpoint
STEP 2: ⇛ Enter your Azure AI Inference key

If you don't have an Azure AI Inference endpoint...

Model Catalog
Explore the Azure AI Model Catalog and Deploy a model to an endpoint

Azure AI Serverless Model Documentation
Learn how to deploy an Azure AI Serverless Model to a new Azure AI Inference endpoint.

View Configuration

To view the persisted configuration, use the following commands:

Get chat endpoint

ai config @chat.endpoint

Get chat key

ai config @chat.key