This time we will talk about the functional experience brought by the combination of RWKV and ChatGPTBox. These two projects are created by the same master, and they can be used seamlessly.
The following is the tutorial I used to deploy the AI model RWKV locally. If you haven’t deployed AI children’s shoes locally, you can check out the tutorial I published before. Deploy an AI system on your own computer, and you can use it even if you are not connected to the Internet. Benefits a lot.
Localized deployment of AI language model RWKV guide, ChatGPT suddenly feels bad
RWKV-Runner
RWKV-Runner is an open source commercially available large language model tool with one-click deployment, which can be used in conjunction with ChatGPTBox
project address:
https://github.com/josStorer/RWKV-Runner/
RWKV-Runner server configuration
I have an idle server on the internal network as an API server. Since there is no GPU, I can change the model to CPU-28G-78-CN. The model library needs to be downloaded from Huggingface again. Generally, when the service is started after selection, it will automatically prompt that it needs to be downloaded. Model, we click download in the pop-up prompt message box.
- Model download address
https://huggingface.co/BlinkDL/rwkv-4-raven/resolve/main/RWKV-4-Raven-7B-v12-Eng49%25-Chn49%25-Jpn1%25-Other1%25-20230530-ctx8192.pth
After the model download is complete, click the start button in the upper right corner of the chat interface. After the model is loaded and the status is displayed 运行中as can start to enter the dialogue mode.
If you need to call the API non-natively, remember to enable 允许外部访问APIthe function and restart the launcher and model.
ChatGPTBox
ChatGPTBox is a plug-in that integrates ChatGPT into the browser with powerful functions.
- project address
https://github.com/josStorer/chatGPTBox
The project provides support for multiple browser versions. Students who use browsers such as chrome, 360, Baidu, and Maxthon can download chromiun.zipthe compressed package for directory installation.
install extension
In the Chrome browser, you can install the plugins in the directory by following these steps:
- Open the Chrome browser and click the menu button (three vertical dots) in the upper right corner.
- Select the "More Tools" option, then select "Extensions."
- In the upper-right corner of the extension's page, turn on "Developer Mode".
- Click "Load Unpacked Extension".
- In the pop-up file selection dialog box, select the directory where the plugin you want to install is located.
- Click the "Choose Folder" button, and the Chrome browser will automatically load and install the plugin.
- After the installation is complete, you can see the icon of the plugin in the extensions page.
Note that Chrome only allows installation of extensions from the Chrome Web Store. If you want to install plugins from other sources, you need to turn on developer mode and follow the steps above to install them manually. At the same time, you need to make sure that the plugins you are about to install are safe and secure to avoid security issues.
Configure ChatGPTBox
The following is an introduction to the specific configuration of the ChatGPTbox plug-in function
Click the icon to chat
When you click the plug-in icon, the setting interface will pop up by default
Of course, we can also directly open the chat conversation, as long as the icon is clicked, select New Chat, then click the icon and a chat window floating in the browser page will appear
Display method
Please also set the display mode on the regular page according to your own needs, and choose whichever you like.
API address
Enter Advanced - API Address, modify the custom OpenAI API address, if it is started locally, enter 127.0.0.1:8000, if the port has been modified, please pay attention to whether the port number is correct.
- Same network segment service setting
If it is an RWKV server with the same IP segment on the intranet, please obtain the IP address first.
- Windows get ip address command
ipconfig
API mode
In 高级- API模式, we can uncheck the functions that do not need to be displayed, and check the custom model. Of course, if you have Chatgpt Key or other better options, you can choose according to the situation.
general settings
In the API mode on 常规the page , select the custom model, and the default name is rwkv. We can also choose a nice name, such as classmate Xiaoai.
function page
After the setting is complete, enter the function page, we can open the independent dialogue page or independent dialogue window to start the dialogue.
Use ChatGPTbox
Search Engines Trigger AI
When you search for a question in the search engine, a model dialogue tool is embedded under the search bar. If automatic triggering is set in the settings, when you search, it will automatically have a conversation with AI and give a corresponding answer.
If you don't want every question to be automatically triggered, you need to go to 常规the page and change the trigger method to manual trigger.
After you search for a question, you can click 询问ChatGPTthe button to get the answer from AI.
Of course, we can also change it to trigger when the question ends with a question mark, so that it can be ？automatically triggered by adding the end.
Independent window page
translation function
When you select an English word or sentence with the mouse on the page, a function menu will pop up
When translating, pay attention to click on the fixed button, otherwise the mouse will disappear when you click outside the window. ## Title
The basic content is introduced here, and more content is waiting for you to continue digging. I hope this article will bring more help to your study.