Runnning

You will need to download a model for testing, place it on your desired folder and change the route on the line (absolute or relative route, I only tested with relative)

gguf::GGUFReader reader("../../models/Mistral-7b-Q4_K_M/mistral-Q4_K_M.gguf");

After this, you will be able to compile by doing

chmod +x build.sh
./build.sh

After that, the info of the .gguf will be shown on the console, counting and showing info of the metadata, tensors... as said on the format (specification: a link)

I tried and debugged with the following model: a link Downloaded at: a link

So far so good, it works!