Skip to content

Latest commit

 

History

History
89 lines (67 loc) · 3.51 KB

README.md

File metadata and controls

89 lines (67 loc) · 3.51 KB
Raw

FishNet

This repo holds the implementation code of the paper:

FishNet: A Versatile Backbone for Image, Region, and Pixel Level Prediction , Shuyang Sun, Jiangmiao Pang, Jianping Shi, Shuai Yi, Wanli Ouyang, NeurIPS 2018.

FishNet was used as a key component for winning the 1st place in COCO Detection Challenge 2018.

Note that the results released here are a bit better than what we have reported in the paper.

Prerequisites

  • Python 3.6.x
  • PyTorch 0.4.0+

Data Augmentation

Method Settings
Random Flip True
Random Crop 8% ~ 100%
Aspect Ratio 3/4 ~ 4/3
Random PCA Lighting 0.1

Note: We apply weight decay to all weights and biases instead of just the weights of the convolution layers.

Training

To train FishNet-150 with 8 GPUs and batch size 256, simply run

python main.py --config "cfgs/fishnet150.yaml" IMAGENET_ROOT_PATH

Models

Models trained without tricks

Model Params FLOPs Top-1 Top-5 Baidu Yun Google Cloud
FishNet99 16.62M 4.31G 77.41% 93.59% Download Download
FishNet150 24.96M 6.45G 78.14% 93.95% Download Download
FishNet201 44.58M 10.58G 78.76% 94.39% Available Soon Available Soon

Models trained with cosine lr schedule (200 epochs) and label smoothing

Model Params FLOPs Top-1 Top-5 Baidu Yun Google Cloud
FishNet150 24.96M 6.45G 79.35% 94.75% Download Download
FishNet201 44.58M 10.58G 79.71% 94.79% Download Download

To load these models, e.g. FishNet150, you need to first construct your FishNet150 structure like:

from models.network_factory import fishnet150
model = fishnet150()

and then you can load the weights from the pre-trained checkpoint by:

checkpoint = torch.load(model_path)  #  model_path: your checkpoint path, e.g. checkpoints/fishnet150.tar
best_prec1 = checkpoint['best_prec1']
model.load_state_dict(checkpoint['state_dict'])
optimizer.load_state_dict(checkpoint['optimizer'])

Note that you do NOT need to decompress the model using the tar command. The model you download from the cloud could be loaded directly.

TODO:

  • Update our arxiv paper.
  • Release pre-train models.
  • Train the model with more training tricks.

Citation

If you find our research useful, please cite the paper:

@inproceedings{sun2018fishnet,
  title={FishNet: A Versatile Backbone for Image, Region, and Pixel Level Prediction},
  author={Sun, Shuyang and Pang, Jiangmiao and Shi, Jianping and Yi, Shuai and Ouyang, Wanli},
  booktitle={Advances in Neural Information Processing Systems},
  pages={760--770},
  year={2018}
}

Contact

You can contact Shuyang Sun by sending email to [email protected]