Mac本地部署LLama3+AnythingLLM+Docker方式的本地知识库

25-03-07 23:04

4726

13428

blog.csdn.net

id="article_content" class="article_content clearfix"> id="content_views" class="htmledit_views">

一、安装Docker

下载链接：https://docs.docker.com/desktop/install/mac-install/

二、安装ollama

1.下载链接：https://ollama.com/download

2.打开终端执行，下载Llama3模型

ollama run llama3 class="hljs-button signin active" data-title="登录复制" data-report-click="{"spm":"1001.2101.3001.4334"}" onclick="hljs.signin(event)">

3.安装Enchanted

下载链接：https://github.com/AugustDev/enchanted

三、使用docker安装AnythingLLM

1.拉取镜像，终端执行

docker pull mintplexlabs/anythingllm class="hljs-button signin active" data-title="登录复制" data-report-click="{"spm":"1001.2101.3001.4334"}" onclick="hljs.signin(event)">

2.终端执行，STORAGE_LOCATION路径为自己定义的路径，然后访问：http://localhost:3001/就可以访问anythingLLM了

 class="hljs-ln-numbers"> class="hljs-ln-line hljs-ln-n" data-line-number="1">

class="hljs-ln-code"> class="hljs-ln-line">export STORAGE_LOCATION=/Users/lishihao/linkpath/anythingllm && \

 class="hljs-ln-numbers"> class="hljs-ln-line hljs-ln-n" data-line-number="2"> class="hljs-ln-code"> class="hljs-ln-line">mkdir -p $STORAGE_LOCATION && \

 class="hljs-ln-numbers"> class="hljs-ln-line hljs-ln-n" data-line-number="3"> class="hljs-ln-code"> class="hljs-ln-line">touch "$STORAGE_LOCATION/.env" && \

 class="hljs-ln-numbers"> class="hljs-ln-line hljs-ln-n" data-line-number="4"> class="hljs-ln-code"> class="hljs-ln-line">docker run -d -p 3001:3001 \

 class="hljs-ln-numbers"> class="hljs-ln-line hljs-ln-n" data-line-number="5"> class="hljs-ln-code"> class="hljs-ln-line">--cap-add SYS_ADMIN \

 class="hljs-ln-numbers"> class="hljs-ln-line hljs-ln-n" data-line-number="6"> class="hljs-ln-code"> class="hljs-ln-line">-v ${STORAGE_LOCATION}:/app/server/storage \

 class="hljs-ln-numbers"> class="hljs-ln-line hljs-ln-n" data-line-number="7"> class="hljs-ln-code"> class="hljs-ln-line">-v ${STORAGE_LOCATION}/.env:/app/server/.env \

 class="hljs-ln-numbers"> class="hljs-ln-line hljs-ln-n" data-line-number="8"> class="hljs-ln-code"> class="hljs-ln-line">-e STORAGE_DIR="/app/server/storage" \

 class="hljs-ln-numbers"> class="hljs-ln-line hljs-ln-n" data-line-number="9"> class="hljs-ln-code"> class="hljs-ln-line">mintplexlabs/anythingllm

class="hljs-button signin active" data-title="登录复制" data-report-click="{"spm":"1001.2101.3001.4334"}" onclick="hljs.signin(event)">

3.配置ollama

docker启动，所以ollama url要设置成：http://host.docker.internal:11434

注：本文转载自blog.csdn.net的lshlb111的文章"https://blog.csdn.net/2401_83692861/article/details/138426597"。版权归原作者所有，此博客不拥有其著作权，亦不承担相应法律责任。如有侵权，请联系我们删除。

复制链接

发表评论

/ 登录

评论记录：

未查询到任何数据！