This repository contains a simple implementation of an AI chatbot using Web-LLM and web workers to increase load performance.
To use this you an open this link:
https://cabamarcos.github.io/MyChatBot/
The model I used is Gemma, which is not good but its small. If you want to change the model follow this steps:
- Clone the repository.
git clone https://github.com/cabamarcos/MyChatBot.git-
Open the file script.js.
-
Change the selected model with any model available in this link.
The best model available is llama3. Change it doing this:
const SELECTED_MODEL = 'Llama-3-8B-Instruct-q4f32_1-MLC-1k'- Deploy it somewhere and create a database that stores the chats, making it possible to access your last conversations.