profile image

Kazuki Fujii

Kazuki Fujii is a Master’s student at the Institute of Science Tokyo, leading the Swallow Project, an open bilingual LLM initiative for Japanese and English. His work focuses on large-scale pre-training, distributed training, FP8 mixed-precision with Megatron-LM and TransformerEngine, and improving the quality of code and math datasets for reasoning LLMs.

Contact: kazuki.fujii [at] rio.scrc.iir.isct.ac.jp