Shisa.AI

1 Million Downloads of shisa-gamma-7b-v1!

Exactly, one year ago, Sakana AI first published Evolving New Foundation Models: Unleashing the Power of Automating Model Development, which used our shisa-gamma-7b-v1 as…

Tuning for Efficient Inferencing with vLLM on MI300X

Over the past couple weeks I’ve been doing testing on an 8 x AMD MI300X node provided by Hot Aisle. I’ll have an article on some of my experiments training with MI300’s…

An Analysis of Chinese LLM Censorship and Bias with Qwen 2 Instruct

All models have biases and most Instruct/Chat models are aligned for “safety”, with Western moral biases, etc. There’s spirited debate on when and where those lines should…

Evaling llm-jp-eval (evals are hard)

With training of shisa-v2 starting in earnest, I’ve been digging a bit more into llm-jp-eval, which I used as a quick and simple benchmark to help to track shisa-v1…

Sakana AI Evolves Models with shisa-gamma-7b-v1

Sakana AI just published some exciting new work on Evolutionary Model Merges of LLMs, applying evolutionary techniques to dicover optimal ways of combining different models.…

Shisa 7B

Shisa 7B was the original Japanese-English bilingual model that kicked everything off. The model card is posted here for posterity.