#cGPRT Code for the paper, Face Alignment using Cascade Gaussian Process Regression Trees. Note that because the code is re-implemented based on armadillo, the results are not exactly same with the results in the paper.
Contact: Donghoon Lee (iamdh@kaist.ac.kr)
##Installation The code is written in c++ using VS2013 and is tests on Windows 8.1 x64 machine. ####Dependencies
####Cropped data and pre-trained models
- cropped data [[down]] (http://143.248.157.13:8080/sharing/IRnxfrsb8) - original data can be found in here
- data list files [[down]] (http://143.248.157.13:8080/sharing/gsCgYWUcq)
- pre-trained models and performance
| Dataset | Paper (full1*) | Paper (fast) | This (full1*) | This (full2*) | This (fast) |
|---|---|---|---|---|---|
| LFPW (29 pts) | 3.51 | N.A. | 3.4407 [down] | 3.4111 [down] | 3.5884 [down] |
| HELEN (194 pts) | 4.63 | N.A. | 4.5663 [down] | 4.5498 [down] | 4.8518 [down] |
| IBUG (68 pts) | 5.71 | 6.32 | 5.7173 [down] | 5.7887** [down] | 6.3181** [down] |
* The full1 configuration enables Gaussian smoothing while full2 does not. Current implementation of Gaussian smoothing is quite slow, and performance improvement is not comparatively small. Thus, we recommend disable Gaussian smoothing.
** We recommend these models for general purpose.
##Usage ####Data format
- data_list example
689 // # data
68 // # landmark points
ibug-cropped/ibug_crop_test/im0001.pgm // image file path
0 0 600 600 // x_start y_start height width
212.138741 272.980541 // x_position y_position (landmark 0)
207.482508 312.712860 // x_position y_position (landmark 1)
...
- config_file example
num_cascades 10 // # cascades
num_forests 10 // # forests
num_trees 10 // # trees
tree_depth 5 // tree depth
nu 0.3 // shrinkage parameter
oversampling_ratio 20 // training data oversampling ratio
num_points 68 // # landmark points
left_eye_idx ( 36 37 38 39 40 41 ) // left_eye_center = average of left_eye_idx landmarkst (start from 0)
right_eye_idx ( 42 43 44 45 46 47 ) // right_eye_center = average of right_eye_idx landmarks (start from 0)
num_split_tests 200 // # split tests for each split nodes
random_seed 1 // random seed for random number generation
####Training
> cGPRT_training config tr_img_dir tr_data_list te_img_dir te_data_list model
####Prediction
> cGPRT_predict model img_dir data_list result
####Custom face detector Rectangles inputted to the cGPRT should be consistent on training and prediction procedures for initializing facial landmarks. The best way to use a custom face detector is (1) detect faces in cropped images, (2) modify rectangles in data_list file by detected face rectangles, (2) train a model using modified data_list files. If you want to use pre-trained models, the rectangles from the face detector should be re-sized to closed to (x=0, y=0, w=600, h=600) for cropped images.
##Citation Please cite the following paper in your publications if it helps your research:
@inproceedings{lee2015face,
title={Face alignment using cascade gaussian process regression trees},
author={Lee, Donghoon and Park, Hyunsin and Yoo, Chang D},
booktitle={Computer Vision and Pattern Recognition (CVPR), 2015 IEEE Conference on},
pages={4204--4212},
year={2015},
organization={IEEE}
}