> For the complete documentation index, see [llms.txt](https://docs.saharaai.com/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.saharaai.com/developer-docs-ai-developer-portal/compute-hub.md).

# Compute Hub

### Overview

The Compute Hub provides a user-friendly interface to manage compute instances for AI workloads. Users can view, create, and manage instances, as well as deploy models with ease.

<figure><img src="/files/5ZIXH9n5cDYCFfPqBmBQ" alt=""><figcaption></figcaption></figure>

### **Features**

#### Instance List:

* Displays all running, stopped, or terminated instances.

#### Status indicators:

* Running: Green.
* Stopped: Red.

<figure><img src="/files/s7yTQDPNz8JBV25UOcQV" alt=""><figcaption></figcaption></figure>

**Each instance card shows:**

* Instance Name
* Compute Provider
* Model used for Endpoint
* Machine type
* Price/Token

#### Actions:

* View Details: Click the eye icon to access detailed information.
* Start/Stop: Toggle an instance's operational state.
* Delete: Permanently remove an instance.

#### Create Instance:

* Click the Create Endpoint button to configure a new instance that provides a general use model endpoint.

**Workflow**

* Navigation: Use the search bar or filters (status, provider, model) to locate specific instances quickly.
* Quick Actions: Start, stop, or delete instances directly from the instance list.

### Instance Details Page

When an instance is selected, the user is directed to a detailed page with the following tabs:

### **Info Tab**

#### Endpoint Information:

* Instance Name
* Compute Provider
* Model used for Endpoint
* Machine type
* Price/Token

#### **Actions:**

* Edit Instance: Modify instance parameters.
* Stop Instance: Shut down the instance.
* Delete Instance: Remove the instance permanently.

### &#x20;**Metrics Tab**

#### Displays real-time metrics:

* CPU Usage: Current usage in percentage.
* Memory Usage: Real-time memory utilization.
* GPU Usage: GPU processing load percentage.

### **Logs Tab**

#### Activity Logs:

* Timestamped logs of instance activity (e.g., initialization, model loading, errors).
* Enables debugging and instance health monitoring.

### **Deployed Models Tab**

#### Model Overview:

* Lists all models deployed on the instance.

#### Details include:

* Model name.
* Deployment date.
* Model status (e.g., running or stopped).

#### Actions:

* View model details or stop/start specific models.

### Create Instance Workflow

**Steps**

1. **Initiate: click the New Endpoint button on the Compute Hub home page.**
2. **Configuration**

**Fill out the form with the following details:**

* **Select Provider**: Select Provider from list (Lepton, Predibase, Sagemaker, Bedrock, OpenAI)
* **Select Model**: Opens a popup and allows users to select from available models on platform. Search and press “Select” when you have chosen a model.
* **Name:** Assign a unique name to the instance.

3. **Review and Create:**

* Review the configuration.
* Click Create Instance to launch the instance.

### Common Use Cases

**1. Viewing Instance Metrics**

* Navigate to the Compute Hub home page.
* Select an instance and click the Metrics Tab to monitor performance.

**2. Deploying a Model**

* From the Deployed Models Tab, click Deploy Model.
* Follow the prompts to configure the deployment.

**3. Deleting an Instance**

* Locate the instance in the Compute Hub.
* Click the trash icon to delete it.
* Confirm the deletion in the pop-up dialog.

### Tips and Best Practices

* Regularly monitor metrics to optimize instance usage.
* Use the Logs Tab for quick troubleshooting.
* Organize instances with meaningful names for easier navigation.
* Always confirm configurations during instance creation to avoid unnecessary costs.