ethanglide/groq-model-comparison
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
main
groq-model-comparison/README.md
Ethan 1a3a1394d3 Add documentation
2024-12-27 20:40:22 -05:00

1.8 KiB
Raw Permalink Blame History

Groq Model Comparison

Desktop application written in Rust to easily compare LLM responses and response times to find the one best suited for your project.

application screenshot

Simply choose the models you are interested in from a list:

model list screenshot

Type your prompt into the text area, then hit "submit"!

Upon prompt submission, the same prompt will be sent to all of the LLMs you have chosen. Review their responses and view the leaderboard to see which models have the best performance.

leaderboard screenshot

Usage

Rust must be installed on your system to build the application. Install Rust here.

Make sure to have your GROQ_API_KEY environment variable set in the .env file for interacting with the Groq API. Create an API key if you don't already have one here.

cd groq-model-comparison

# For debug
cargo build
./target/debug/groq-model-comparison

# For release
cargo build --release
./target/release/groq-model-comparison

Project Information

This project was created for the purposes of learning the Rust programming language. This was a good way to do so because it includes a lot of common concepts that come up in projects:

  • Concurrency/Asyncronous Code (tokio, futures)
    • Blocking
    • Asyncronous
    • Polling
  • Network Requests (reqwest)
    • Processing JSON requests/responses (serde, serde_json)
  • GUI (egui, eframe)
  • Dependency Management (cargo)
  • Environment Variables (dotenv)

Now that I have a good idea on how to work with all of those concepts above, as well as the complex ownership/lifetime/borrowing system in Rust's compiler, I am much better equiped to work on any Rust projects in the future.