Quick deploy: chatbot

In the Quick Deploy menu you have access to a chat-bot image with an Open WebUI web interface and inbuilt support for Ollama.

Click Deploy and wait for the image to be downloaded and for the job to start. Once it is running, open the terminal - see Terminal for more detailed instructions.

You can pull any model supported by Ollama. You can check the current list of provided models on Ollama’s website to choose the one that best suits your needs.

Inside the terminal, run: ‘’’bash ollama pull modelname ‘’’

Where you substitute modelname with the model you want to pull.

Open the Job details view and open port 8080 as an open port - see Exposing ports for detailed instructions on how to do it. This will create a hyperlink in the Addresses field that will take you to your instance of the chatbot.

Create an account - the first user will always register as an admin.

The models you pulled in the previous step will be available there. Feel free to chat, upload files to create your own knowledge base, and explore other features that Open WebUI has to offer!

Keep in mind that all your data is saved inside a running container and will disappaer once the running job has ended.