• Bio
  • Experience
  • News
  • Publications
  • Posts
  • Projects
  • Certificates
  • Teaching
  • Recent & Upcoming Talks
    • Example Talk
  • Projects
    • Hyena for Efficient Image Super Resolution
    • ViLMorph, a Vision LSTM Framework for 3D Medical Image Registration
    • Large Language Model for Long Genome Sequence
  • Recent News
    • 🎉 I have successfully defend my Ph.D. dissertation!
    • 🎉 Two papers are accepted by AAAI 2024!
    • 🎉 One paper is accepted by ICIP 2023!
  • Projects
  • Publications
  • Blog
    • PyTorch DistributedDataParallel Training
    • The Transformer Explained
    • Variational Autoencoder Explained
    • Generative Adversarial Networks
  • Publications
    • CR-SAM: Curvature Regularized Sharpness-Aware Minimization
    • LRS: Enhancing Adversarial Transferability through Lipschitz Regularized Surrogate
    • GNP Attack: Transferable Adversarial Examples via Gradient Norm Penalty
    • Black-Box Attack using Adversarial Examples: A New Method of Improving Transferability
    • Learning Deep Representations via Contrastive Learning for Instance Retrieval
  • Post
  • Teaching
    • CS6405 Clustering Algorithms
    • CS1982 Matlab Programming
    • CS1982 Matlab Programming
    • CS1970 Introduction to C++ Programming
    • CS1982 Matlab Programming
    • CS1982 Matlab Programming
  • Certificates
  • Experience

Large Language Model for Long Genome Sequence

Jun 1, 2024 · 1 min read

Develop a genome LLM model based on BERT architecture and adopt masked language modeling as pretraining strategy.

Last updated on Jun 1, 2024
LLM Bioinformatics
Tao Wu
Authors
Tao Wu
Postdoctoral Fellow
← ViLMorph, a Vision LSTM Framework for 3D Medical Image Registration Aug 1, 2024

© 2025 Tao Wu

Published with Hugo Blox Builder — the free, open source website builder that empowers creators.