This project originated from my attempt to systematically study and improve the understanding of Transformer architecture. While working on the transformer_copy project, I noticed that the attention ...

These results validate that a hybrid approach can dramatically increase performance while maintaining the model's language capabilities, even after a full alignment pipeline. Early Layers perform ...

Abstract: This paper performed the ferroresonance experiment with configuration of capacitance series and shunt to 1 kV transformer core type H and 1 kV transformer core type M. The experiment was ...

Abstract: The high temperature superconducting air-core transformer, which has a large magnetizing current, has been proposed as a possible type of future power transformer having a function as a ...