# BertAccelerate

**Repository Path**: Parker2020/bert-accelerate

## Basic Information

- **Project Name**: BertAccelerate
- **Description**: bert模型转onnx、图优化及量化加速
- **Primary Language**: Unknown
- **License**: Not specified
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2022-05-20
- **Last Updated**: 2022-05-20

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

# requirement
- PyTorch 1.11
- OnnxRuntime 1.10
- ONNX 1.10
- OnnxRuntime-tools 1.7.0
- transformers
- fine-tuning model: https://download.pytorch.org/tutorial/MRPC.zip 
# accelerate method
cpu/openvino:
- [torch](https://github.com/huggingface/transformers/tree/main/examples/pytorch/text-classification) 
- torch + quantize: './torch_quant.py'
- convert torch to onnx: './torch2onnx.py'
- onnx + opt: './onnx_graph_opt.py'
- onnx + opt: + quantize './onnx_opt_quant.py'

## bert_accelerate
从torch转onnx、图优化及量化压缩可直接执行`./bert_accelerate.py`