What do 4B and 12B mean?
The B means billions of learned parameters, approximately. A larger parameter count gives a model more capacity, but it also asks more from your computer
Model size is not the whole answer. How a model was trained, how it is compressed, how long the chat is, and how much memory is free all change how fast and useful it feels. That’s why Taby tests models on real tasks instead of going by size