[Note] Compressing Large-Scale Transformer-Based Models: A Case Study on BERT

  • A extensive study on various methods for compressing BERT
    • Model size, accuracy, inference speed, device…
  • show different advantages and disadvantages of each methods
  • gave advices and research directions to future researcher

[Note] Compressing Large-Scale Transformer-Based Models: A Case Study on BERT Read More »