Deploy Qwen Instruct with Open WebUI through the Linode Marketplace

Open WebUI is an open-source, self-hosted web interface for interacting with and managing Large Language Models (LLMs). It supports multiple AI backends, multi-user access, and extensible integrations, enabling secure and customizable deployment for local or remote model inference.

The Marketplace application deployed in this guide uses a Qwen Instruct model as an instruction-tuned, open-weight LLM optimized for reasoning, code generation, and conversational tasks. Qwen models are designed for high-quality inference across a wide range of general-purpose and technical workloads and integrate seamlessly with self-hosted platforms like Open WebUI.

Deploying a Marketplace App

The Linode Marketplace lets you easily deploy software on a Compute Instance using Cloud Manager. See Get Started with Marketplace Apps for complete steps.

1. Log in to Cloud Manager and select the Marketplace link from the left navigation menu. This displays the Linode Create page with the Marketplace tab pre-selected.

2. Under the Select App section, select the app you would like to deploy.

3. Complete the form by following the steps and advice within the Creating a Compute Instance guide. Depending on the Marketplace App you selected, there may be additional configuration options available. See the Configuration Options section below for compatible distributions, recommended plans, and any additional configuration options available for this Marketplace App.

4. Click the Create Linode button. Once the Compute Instance has been provisioned and has fully powered on, wait for the software installation to complete. If the instance is powered off or restarted before this time, the software installation will likely fail.

To verify that the app has been fully installed, see Get Started with Marketplace Apps > Verify Installation. Once installed, follow the instructions within the Getting Started After Deployment section to access the application and start using it.

Configuration Options

• Recommended plan: RTX4000 Ada x1 Small or Larger GPU Instance

Open WebUI Options

• Linode API Token (required): Your API token is used to deploy additional Compute Instances as part of this deployment. At a minimum, this token must have Read/Write access to Linodes. If you do not yet have an API token, see Get an API Access Token to create one.

• Email address (for the Let’s Encrypt SSL certificate) (required): Your email is used for Let’s Encrypt renewal notices. This allows you to securely access Open WebUI through a browser.

• Open WebUI admin name (required): This is the name associated with your Open WebUI administrator account and is required during initial setup.

• Open WebUI admin email (required): This email address is used to log into Open WebUI.

Limited Sudo User

You need to fill out the following fields to automatically create a limited sudo user, with a strong generated password for your new Compute Instance. This account will be assigned to the sudo group, which provides elevated permissions when running commands with the sudo prefix.

• Limited sudo user: Enter your preferred username for the limited user. No Capital Letters, Spaces, or Special Characters.

  Locating The Generated Sudo Password

  A password is generated for the limited user and stored in a .credentials file in their home directory, along with application specific passwords. This can be viewed by running: cat /home/$USERNAME/.credentials

  For best results, add an account SSH key for the Cloud Manager user that is deploying the instance, and select that user as an authorized_user in the API or by selecting that option in Cloud Manager. Their SSH pubkey will be assigned to both root and the limited user.

• Disable root access over SSH: To block the root user from logging in over SSH, select Yes. You can still switch to the root user once logged in, and you can also log in as root through Lish.

  Accessing The Instance Without SSH

  If you disable root access for your deployment and do not provide a valid Account SSH Key assigned to the authorized_user, you will need to login as the root user via the Lish console and run cat /home/$USERNAME/.credentials to view the generated password for the limited user.

Getting Started After Deployment

Obtain the Credentials

When deployment completes, the system automatically generates credentials to administer your pgvector instance. These are stored in the limited user’s .credentials file.

1. Log in to your Compute Instance using one of the methods below:

   • Lish Console: Log in to Cloud Manager, click Linodes, select your instance, and click Launch LISH Console. Log in as root. To learn more, see Using the Lish Console.
   • SSH: Log in to your instance over SSH using the root user. To learn how, see Connecting to a Remote Server Over SSH.

2. Run the following command to access the contents of the .credentials file:

cat /home/$USERNAME/.credentials

Accessing Open WebUI Frontend

Once your app has finished deploying, you can log into Open WebUI using your browser.

1. Open your web browser and navigate to https://DOMAIN/, where DOMAIN can be replaced with the custom domain you entered during deployment or your Compute Instance’s rDNS domain (such as 192-0-2-1.ip.linodeusercontent.com). See the Managing IP Addresses guide for information on viewing rDNS.

Now that you’ve accessed your dashboard, check out the official OpenWebUI documentation to learn how to further use your instance.

More Information

You may wish to consult the following resources for additional information on this topic. While these are provided in the hope that they will be useful, please note that we cannot vouch for the accuracy or timeliness of externally hosted materials.

• Open WebUI Documentation
• Qwen Documentation