llama go

We have hosted the application llama go in order to run this application in our online workstations with Wine or directly.

Quick description about llama go:

llama.go is like llama.cpp in pure Golang. The code of the project is based on the legendary ggml.cpp framework of Georgi Gerganov written in C++ with the same attitude to performance and elegance. Both models store FP32 weights, so you'll needs at least 32Gb of RAM (not VRAM or GPU RAM) for LLaMA-7B. Double to 64Gb for LLaMA-13B.

Features:

• Tensor math in pure Golang
• Implement LLaMA neural net architecture and model loading
• Test with smaller LLaMA-7B model
• Be sure Go inference works exactly same way as C++
• Let Go shine! Enable multi-threading and messaging to boost performance
• Cross-patform compatibility with Mac, Linux and Windows

Programming Language: Go.
Categories: