Currently I get around 2 tok/s on the 4B model, and 4-5 tok/s on the 1.7B model.