Dolphin🐬 Llama.cpp

Dolphin 3.0 is a powerful, general-purpose local AI model designed for coding, math, and various other tasks, aiming similar to the models like ChatGPT and Claude. This interactive chat interface allows you to experiment with the Dolphin3.0-Qwen2.5-0.5B and Dolphin3.0-Llama3.2-1B text models using various prompts and generation parameters. Users can select different model variants (GGUF format), system prompts, and observe generated responses in real-time. Key generation parameters, such as ⁣temperature, max_tokens, top_k and others are exposed below for tuning model behavior.

Model

Select the AI model to use for chat

512 2048
0.1 2
0.1 1
1 100
1 2