langchain-chatchat version 0.2.5 has been released, and its functions have been further enhanced. For details, see the community wiki:https://github.com/chatchat-space/Langchain-Chatchat/wiki
Due to the difficulty of accessing huggingface.co in China, we made an integration package under Windows, which has built-in chatglm2-6B and m3e-base, and can run the LLM, knowledge base, search enhancement and other functions of langchain-chatchat0.2.5 locally.
Link: https://caiyun.139.com/m/i?135ClpbtTooUm
Extraction code: mTjG
[Preparation]
1. (Recommendation) Apply for an account and key in advance on large model platforms such as Zhipu, Minimax, iFlytek and Spark
2. Register an account on Microsoft azure.com in advance, subscribe to the bing search service, and apply for a Key (you can choose the free version)
3. Download the langchain-chatchat0.2.5.zip file
[Installation]
1. Unzip Langchain-Chachat0.2.5.zip, for example, to the c:\tmp\Langchain-Chatchat directory
2 -1. If there is no GPU or the GPU memory is less than 12G, it is recommended to use an online large model: use a text editor to modify the model_config.py file in the config directory, enter the applied large model key into lines 114~184, and modify 100 lines of LLM_MODEL at the same time To correspond to a large model, for example: "zhipu-api" 3. Modify line 37 of kb_config.py in the config directory and change BING_SUBSCRIPTION_KEY to the bing key applied for on Azure 4. It is recommended to install anaconda to virtualize python Environment to manage (https://www.anaconda.com/download/) 5. Click "Start"-》Anaconda3-》Anaconda Powershell Prompt 6 . Create a python virtual environment: conda create -n chatchat python==3.10.9 7. Activate the python virtual environment: conda activate chatchat 8. Enter the program directory ：cd c:\tmp\Langchain-Chachat 9. Install dependency packages: pip install -r requirements.txt -i https://pypi.mirrors.ustc.edu.cn/simple/
[Run]
1. Click "Start"-》Anaconda3-》Anaconda Powershell Prompt
2. Enter the directory and enter: cd c: \tmp\Langchain-Chachat
3. Activate the python environment: conda activate chatchat
4. Run the program: python startup.py -a