About
Tuning for Efficient Inferencing with vLLM on MI300X
Over the past couple weeks I’ve been doing testing on an 8 x AMD MI300X node provided by Hot Aisle. I’ll have an article on some of my experiments training with MI300’s…
Oct 24, 2024
Leonard Lin
Evaling llm-jp-eval (evals are hard)
With training of shisa-v2 starting in earnest, I’ve been digging a bit more into llm-jp-eval, which I used as a quick and simple benchmark to help to track shisa-v1…
May 24, 2024
Leonard Lin
Shisa 7B
Shisa 7B was the original Japanese-English bilingual model that kicked everything off. The model card is posted here for posterity.
Dec 6, 2023
Leonard Lin
No matching items
