I enjoy making things. Here are a selection of projects that I have worked on recently, spanning from computer vision, natural language processing to biomedical applications.
Develop a long convolution (Hyena) based architecture to leverage its unique feature extraction capabilities to reconstruct high-frequency details.
Develop an efficient bi-directional vision xLSTM block for capturing long range pixel dependencies of medical images.
Develop a genome LLM model based on BERT architecture and adopt masked language modeling as pretraining strategy.