Installation and Setup Guide

This document provides step-by-step instructions for setting up the development environment and running the application.

Screenshot

screenshot

Before starting, ensure that you have all the necessary tools installed on your system.

Ollama is required to provide model inference capabilities.

LLama-Stack will be used to manage our inference environment.

Run the following command inside the virtual environment:

INFERENCE_MODEL=llama3.2:3b llama stack build --template ollama --image-type venv --run

or

INFERENCE_MODEL=meta-llama/Llama-3.3-70B-Instruct llama stack build --template together --image-type venv --run

Clone this repository and install the necessary dependencies:

Clone the repository:

git clone [https://github.com/ricardoborges/chatlab.git]
cd [chatlab]

Create a virtual environment and install dependencies:
```
uv venv
uv pip install -r myproject.toml
```

Create togetherAI account if you won't start Ollama local service. So, you would first get an API key from Together if you dont have one already.

You will need this env variables in your .env file:

TAVILY_SEARCH_API_KEY= TOGETHER_API_KEY=

Or just ignore and set DEFAULT_STACK="Ollama" in main.py (if you will run local Ollama service)

Start the Gradio application with the following command:

gradio main.py

After running this command, the application interface will be available in your browser.

If you encounter any issues during installation, check:

For more information about LLama-Stack, refer to the official documentation.