Use code from "database_tools" and/or "annotation"

TFODAPI works best in python 2.7. tfrecords files require python 2.7.
TFODAPI requires Tensorflow >= 1.9.0

Follow installation instructions for TFODAPI

If you are having protobuf errors, install protocol buffers from binary as described here

Use code in tfrecords to create tfrecord files for your data

• make_tfrecords_from_json.py demonstrates how to use the provided functions to create one set of tfrecord files from a single .json file
• if you want to run oneclass detection, first convert yor json to oneclass using database_tools/make_oneclass_json.py
• If you run into issues with corrupted .jpg files, you can use database_tools/remove_corrupted_images_from_database.py to create a copy of your database without the images that tensorflow cannot read

• Create experiment directory
  • Within experiment directory create configs folder
  • Example can be seen in the ai4e fileshare at sample_object_detection_experiment_directory/
• Decide on architecture
  • Our example uses Faster-RCNN with Inception Resvet V2 backbone and Atrous Convolutions
• Download appropriate pretrained model from tensorflow model zoo
  • Our example pretrained model is at models/object_detection/faster_rcnn_inception_resnet_v2_atrous/faster_rcnn_inception_resnet_v2_atrous_coco_2018_01_28
  • You can also start training from a pretrained tensorflow classification model
    • We have an example of this in the fileshare at models/object_detection/faster_rcnn_inception_resnet_v2_atrous/train_on_ss_with_ss_pretrained_backbone/
    • Note that to start from a classification backbone, you must add "from_detection_checkpoint: false" to train_config{} in your config file
    • To train a classification backbone, we recommend using this visipedia classification code base
• Copy tf sample config (typically pipeline.config) for that architecture to your configs folder as a starting point (find samples in tfmodels/research/object_detection/samples/configs/)
  • Point within config file to the locations of your training tfrecords, eval tfrecords, pretrained model
  • Make any other config changes you want for this experiment (learning rate, data augmentation, etc.) using the params described in preprocessor.proto
  • Our example can be seen in sample_object_detection_experiment_directory/configs/pipeline.config

You can use the bash script pipeline/run_training.sh

Alternatively, you can run everything from the command line.

Example call:

python  tfmodels/research/object_detection/model_main.py \
--pipeline_config_path=/ai4efs/sample_object_detection_experiment_directory/configs/pipeline.config \
--model_dir=/ai4efs/sample_object_detection_experiment_directory/ \
--num_train_steps=200000 \
--num_eval_steps=1725 \
--alsologtostderr

Make sure you have port 6006 open on your VM

Example call:

tensorboard --logdir /ai4efs/sample_object_detection_experiment_directory/ --port 6006

Use pipeline/run_export_model.sh

Alternatively...

Example call:

python tfmodels/research/object_detection/export_inference_graph.py \
    --input_type=image_tensor \
    --pipeline_config_path=/ai4efs/sample_object_detection_experiment_directory/configs/pipeline.config \
    --trained_checkpoint_prefix=/ai4efs/sample_object_detection_experiment_directory/model.ckpt-[XXXXXX] \
    --output_directory=/ai4efs/models/object_detection/faster_rcnn_inception_resnet_v2_atrous/megadetector_sample/

Use pipeline/run_inference_all.sh to extract bboxes for all test sets to python dicts, or use the individual bash scripts for individual test sets

Alternatively...

Example call:

mkdir /ai4efs/models/object_detection/faster_rcnn_inception_resnet_v2_atrous/megadetector_sample/predictions/

TF_RECORD_FILES=$(ls /ai4efs/tfrecords/caltechcameratraps/oneclass/eccv_18/train-?????-of-????? | tr '\n' ',')

python tfmodels/research/object_detection/inference/infer_detections.py \
--input_tfrecord_paths=$TF_RECORD_FILES \
--output_tfrecord_path=/ai4efs/models/object_detection/faster_rcnn_inception_resnet_v2_atrous/megadetector_sample/predictions/ss_test_detections_imerit_batch_3.tfrecord-00000-of-00001 \
--inference_graph=/ai4efs/models/object_detection/faster_rcnn_inception_resnet_v2_atrous/megadetector_sample/frozen_inference_graph.pb \
--discard_image_pixels

Then you can use tfrecords/read_from_tfrecords.py to read detection results from inference tfrecords into python dicts

detection_eval contains code for evaluating models, based on the python dicts returned from tfrecords/read_from_tfrecords and/or the bash scripts for inference.

Evaluation scripts provided include evaluating at object, image, and sequence levels, evaluating detection models as classifiers (which allows you to evaluate on data that has only class-level annotations), evaluating models per-camera-location, and evaluating models per-species