We have hosted the application alpaca cpp in order to run this application in our online workstations with Wine or directly.


Quick description about alpaca cpp:

Run a fast ChatGPT-like model locally on your device. This combines the LLaMA foundation model with an open reproduction of Stanford Alpaca a fine-tuning of the base model to obey instructions (akin to the RLHF used to train ChatGPT) and a set of modifications to llama.cpp to add a chat interface. Download the zip file corresponding to your operating system from the latest release. The weights are based on the published fine-tunes from alpaca-lora, converted back into a PyTorch checkpoint with a modified script and then quantized with llama.cpp the regular way.

Features:
  • Run a fast ChatGPT-like model locally on your device
  • If you have more than 10GB of RAM, you can use the higher quality 13B model
  • Combines the LLaMA foundation model with an open reproduction of Stanford Alpaca
  • The weights are based on the published fine-tunes from alpaca-lora,
  • You can add other launch options
  • You can now type to the AI in the terminal and it will reply


Programming Language: C++, C.
Categories:
Large Language Models

Page navigation:

©2024. Winfy. All Rights Reserved.

By OD Group OU – Registry code: 1609791 -VAT number: EE102345621.