2 posts tagged with "v0.1.0"

Hello developers and users,

After receiving feedback from many users since the initial release, we are pleased to announce the stable release of v0.1.0. In this version, we have made some adjustments to the installation process for the Windows version. We have also simultaneously released a Docker version, allowing users to quickly install and adjust the environment structure as needed. Additionally, we have fixed some minor bugs that were known in previous versions.

Here are the main updates in this release:

Windows Portable Version​

1. Adjusted the model setup process to allow for easier configuration of multiple models.
2. Fixed various errors that occurred when using MySQL or PostgreSQL.
3. Readme updated for better completeness.

Docker Version​

1. Docker Compose can now be used to start the entire system and multiple Executors with a single command.
2. Stable software stack selected, suitable for direct use in production environments.
3. Modular design allows for the selection of Executor types and quantities to be launched freely.

Executor​

1. Added a command-line interface launcher that can start multiple Executors with one click, allowing common parameters such as Prompt template, System Prompt, and Generation config to be passed in as commands.
2. Supports common on-premises model inference frameworks such as Huggingface Transformers and Llama.cpp.
3. Supports inference services compatible with OpenAI API or Gemini-Pro API, such as vLLM, LiteLLM, etc.
4. Packaged common functions into the Executor framework, such as automatic registration retry, automatic logout, automatic history record pruning, interrupt generation, etc.
5. Packaged the Executor framework into a package for easy extension of Executors.
6. Fixed a bug in the generation error of the llama.cpp executor.
7. Changed the underlying framework to FastAPI to improve efficiency and stability.

Multi-chat​

1. Fixed bug causing website to jump to /stream route.
2. Added default images for models.
3. Fixed some minor bugs.
4. Added more command-line tools for configuring the website.

For migration from older versions to the new version, please refer to this migration guide.

This is a tutorial for updating from the initial version to the stable version v0.1.0.

1. First, clone the repository using git clone https://github.com/kuwaai/genai-os.git --tag v0.1.0, or download and extract it from here to get a clean copy of the v0.1.0 project.
2. Here, the old version of the project is referred to as the old folder, and the newly obtained version is referred to as the new folder. If you have these files, please copy them completely and replace them in the corresponding locations:
   • old/multi-chat/storage/app/ => new/src/multi-chat/storage/app/
   • old/multi-chat/database/database.sqlite => new/src/multi-chat/database/database.sqlite
   • old/multi-chat/public => new/src/multi-chat/public
   • old/multi-chat/.env => new/src/multi-chat/.env
3. In addition to these files mentioned in point two, if you have modified or added any other files, please copy them over as well.
4. If you are using the Windows portable version, please move the following folders or files to their respective locations (since the Python version has changed, there is no need to move the Python folder):
   • old/windows/nginx-1.24.0/ => new/windows/packages/nginx-1.24.0/
   • old/windows/node-v20.11.1-win-x64/ => new/windows/packages/node-v20.11.1-win-x64/
   • old/windows/php-8.1.27-Win32-vs16-x64/ => new/windows/packages/php-8.1.27-Win32-vs16-x64/
   • old/windows/Redis-6.0.20-Windows-x64-msys2/ => new/windows/packages/Redis-6.0.20-Windows-x64-msys2/
   • old/windows/RunHiddenConsole/ => new/windows/packages/RunHiddenConsole/
   • old/windows/composer.phar => new/windows/packages/composer.phar
5. If you are running on Linux, navigate to new/src/multi-chat/executables/sh/ and run production_update.sh. If you are using the Windows Portable version, run build.bat in new/windows/.
6. The file update should be completed at this point. You can now check if anything is broken. For the Windows Portable version, please proceed to configure the models according to the tutorial for the new version.