Quick Start

To get started with AI Server, we need can use the following steps:

  • Clone the Repository: Clone the AI Server repository from GitHub.
  • Run the Installer: Run the install.sh to set up the AI Server and ComfyUI Agent.

Quick Start Commands​

git clone https://github.com/ServiceStack/ai-server
cd ai-server
cat install.sh | bash

Running the Installer​

The installer will detect common environment variables for the supported AI Providers like OpenAI, Google, Anthropic, and others, and prompt ask you if you want to add them to your AI Server configuration.

Alternatively, you can specify which providers you want and provide the APIs before continuing with the installation.

Accessing AI Server​

Once the AI Server is running, you can access the Admin Portal at http://localhost:5006/admin to configure your AI providers and generate API keys. If you first ran the AI Server with configured API Keys in your .env file, you providers will be automatically configured for the related services.

INFO

The default password to access the Admin Portal is p@55wOrd. You can change this in your .env file by setting the AUTH_SECRET or providing it during the installation process. You can reset the process by deleting your local App_Data directory and rerunning docker compose up or re-running the install.sh.

You will then be able to make requests to the AI Server API endpoints, and access the Admin Portal user interface like the Chat interface to use your AI Provider models.

Optional ComfyUI Agent​

The installer will also ask if you want to install the ComfyUI Agent locally if you run AI server from the installer.

If you choose to run AI Server, it will prompt you to install the ComfyUI Agent as well, and assume you want to run it locally.

If you want to run the ComfyUI Agent separately, you can follow these steps:

git clone https://github.com/ServiceStack/agent-comfy.git
cd agent-comfy
cat install.sh | bash

Providing your AI Server URL and Auth Secret when prompted will automatically register the ComfyUI Agent with your AI Server to handle related requests.

INFO

You will be prompted to provide the AI Server URL and ComfyUI Agent URL during the installation. These should be the accessible URLs for your AI Server and ComfyUI Agent. When running locally, the ComfyUI Agent will be populated with a docker accessible path as localhost won't be accessible from the AI Server container. If you want to reset the ComfyUI Agent settings, remember to remove the provider from the AI Server Admin Portal.

Edit this page on GitHub