Research Engineer at Preferred Networks, Inc. and master student at Institute of Science Tokyo. My research focuses on distributed training of large models and low-precision training. Also, I am in charge of the maintenance of Pre-training Library for LLMs and conducting experiments on training LLMs.
