From 7492963e4d5cdac8156a5598ac3c333a8a3d4291 Mon Sep 17 00:00:00 2001 From: sauravniraula Date: Tue, 8 Jul 2025 14:03:36 +0545 Subject: [PATCH] docs(readme): adds openai api compartibility info and version to latest --- README.md | 26 ++++++++++++++++++-------- 1 file changed, 18 insertions(+), 8 deletions(-) diff --git a/README.md b/README.md index 52396400..81215399 100644 --- a/README.md +++ b/README.md @@ -29,6 +29,7 @@ * ✅ **Bring Your Own Key** — Only pay for what you use. OpenAI, Gemini (More coming soon...) * ✅ **API Presentation Generation** — Host as API to generate presentations over requests * ✅ **Ollama Support** — Run open-source models locally with Ollama integration +* ✅ **OpenAI API Compatibility** — Use any OpenAI-compatible API endpoint with your own models * ✅ **Runs Locally** — All code runs on your device * ✅ **Privacy-First** — No tracking, no data stored by us * ✅ **Flexible** — Generate presentations from prompts or outlines @@ -41,12 +42,12 @@ ##### Linux/MacOS (Bash/Zsh Shell): ```bash -docker run -it --name presenton -p 5000:80 -v "./user_data:/app/user_data" ghcr.io/presenton/presenton:v0.3.0-beta +docker run -it --name presenton -p 5000:80 -v "./user_data:/app/user_data" ghcr.io/presenton/presenton:latest ``` ##### Windows (PowerShell): ```bash -docker run -it --name presenton -p 5000:80 -v "${PWD}\user_data:/app/user_data" ghcr.io/presenton/presenton:v0.3.0-beta +docker run -it --name presenton -p 5000:80 -v "${PWD}\user_data:/app/user_data" ghcr.io/presenton/presenton:latest ``` #### 2. Open Presenton @@ -59,20 +60,29 @@ Open http://localhost:5000 on browser of your choice to use Presenton. You may want to directly provide your API KEYS as environment variables and keep them hidden. You can set these environment variables to achieve it. - **CAN_CHANGE_KEYS=[true/false]**: Set this to **false** if you want to keep API Keys hidden and make them unmodifiable. -- **LLM=[openai/google/ollama]**: Select **LLM** of your choice. +- **LLM=[openai/google/ollama/custom]**: Select **LLM** of your choice. - **OPENAI_API_KEY=[Your OpenAI API Key]**: Provide this if **LLM** is set to **openai** - **GOOGLE_API_KEY=[Your Google API Key]**: Provide this if **LLM** is set to **google** -- **OLLAMA_MODEL=[Ollama Model Name]**: Provide this if **LLM** is set to **ollama** -- **PEXELS_API_KEY=[Your Pexels API Key]**: Provide this if **LLM** is set to **ollama** +- **OLLAMA_URL=[Custom Ollama URL]**: Provide this if you want to custom Ollama URL and **LLM** is set to **ollama** +- **OLLAMA_MODEL=[Ollama Model ID]**: Provide this if **LLM** is set to **ollama** +- **CUSTOM_LLM_URL=[Custom OpenAI Compartible URL]**: Provide this if **LLM** is set to **custom** +- **CUSTOM_LLM_API_KEY=[Custom OpenAI Compartible API KEY]**: Provide this if **LLM** is set to **custom** +- **CUSTOM_MODEL=[Custom Model ID]**: Provide this if **LLM** is set to **custom** +- **PEXELS_API_KEY=[Your Pexels API Key]**: Provide this to generate images if **LLM** is set to **ollama** or **custom** ### Using OpenAI ```bash -docker run -it --name presenton -p 5000:80 -e LLM="openai" -e OPENAI_API_KEY="******" -e CAN_CHANGE_KEYS="false" -v "./user_data:/app/user_data" ghcr.io/presenton/presenton:v0.3.0-beta +docker run -it --name presenton -p 5000:80 -e LLM="openai" -e OPENAI_API_KEY="******" -e CAN_CHANGE_KEYS="false" -v "./user_data:/app/user_data" ghcr.io/presenton/presenton:latest ``` ### Using Ollama ```bash -docker run -it --name presenton -p 5000:80 -e LLM="ollama" -e OLLAMA_MODEL="llama3.2:3b" -e PEXELS_API_KEY="*******" -e CAN_CHANGE_KEYS="false" -v "./user_data:/app/user_data" ghcr.io/presenton/presenton:v0.3.0-beta +docker run -it --name presenton -p 5000:80 -e LLM="ollama" -e OLLAMA_MODEL="llama3.2:3b" -e PEXELS_API_KEY="*******" -e CAN_CHANGE_KEYS="false" -v "./user_data:/app/user_data" ghcr.io/presenton/presenton:latest +``` + +### Using OpenAI Compartible API +```bash +docker run -it -p 5000:80 -e CAN_CHANGE_KEYS="false" -e LLM="custom" -e CUSTOM_LLM_URL="http://*****" -e CUSTOM_LLM_API_KEY="*****" -e CUSTOM_MODEL="llama3.2:3b" -v "./user_data:/app/user_data" ghcr.io/presenton/presenton:latest ``` #### Running Presenton with GPU Support @@ -82,7 +92,7 @@ To use GPU acceleration with Ollama models, you need to install and configure th Once the NVIDIA Container Toolkit is installed and configured, you can run Presenton with GPU support by adding the `--gpus=all` flag: ```bash -docker run -it --name presenton --gpus=all -p 5000:80 -e LLM="ollama" -e OLLAMA_MODEL="llama3.2:3b" -e PEXELS_API_KEY="*******" -e CAN_CHANGE_KEYS="false" -v "./user_data:/app/user_data" ghcr.io/presenton/presenton:v0.3.0-beta +docker run -it --name presenton --gpus=all -p 5000:80 -e LLM="ollama" -e OLLAMA_MODEL="llama3.2:3b" -e PEXELS_API_KEY="*******" -e CAN_CHANGE_KEYS="false" -v "./user_data:/app/user_data" ghcr.io/presenton/presenton:latest ``` > **Note:** GPU acceleration significantly improves the performance of Ollama models, especially for larger models. Make sure you have sufficient GPU memory for your chosen model.