eliott/anything-llm
1
0
Fork 0
mirror of https://github.com/Mintplex-Labs/anything-llm synced 2026-04-25 17:15:37 +02:00
Code Issues Packages Projects Releases Wiki Activity

Add Support for NVIDIA NIM (#2766)

Browse Source 
* Add Support for NVIDIA NIM

* update README

* linting
This commit is contained in:
Timothy Carambat
2024-12-05 10:38:23 -08:00
committed by GitHub
parent 6c9e234227
commit b2dd35fe15
23 changed files with 626 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
docker/.env.example
View File

@@ -117,6 +117,10 @@ GID='1000'
# XAI_LLM_API_KEY='xai-your-api-key-here'
# XAI_LLM_MODEL_PREF='grok-beta'
# LLM_PROVIDER='nvidia-nim'
# NVIDIA_NIM_LLM_BASE_PATH='http://127.0.0.1:8000'
# NVIDIA_NIM_LLM_MODEL_PREF='meta/llama-3.2-3b-instruct'
###########################################
######## Embedding API SElECTION ##########
###########################################