VisionGL

The objective of this library is to provide an easy way to prototype and 
implement image and video processing functions in CUDA, GLSL and OpenCL. 
The library provides wrapper code generators for all the three languages.

The wrapper functions are generated in C++ from the shader code. Shader 
codes written in CUDA or GLSL must contain three types of directives in 
comments:
1 - Documentation comment: a multiple line comment between /** and */
    This comment is copied ipsis literis to the output files.
2 - Declaration comment: a single line comment describing the parameter 
    list of the wrapper function. The list has variable name, type, and, when  
    it is an image, semantics indicating if it is an input or output image.
3 - Attribution comment: single line comments associating variables in C++
    to its counterparts in GLSL or CUDA

Shader code written in OpenCL require only the two first kinds of comments.

The wrapper functions use a common variable type to store image data, called 
VglImage. It contains space to store the image data in RAM, and handles to 
store the image in both CUDA, OpenGL and OpenCL contexts. These contexts 
are used under demand. If the image is used only in OpenGL context, the 
CUDA handle will be empty (NULL or -1) and vice-versa.


        Compilation

The library requires GLEW 1.6 or superior and freeglut 3 or superior. 
OpenGL support by the hardware is also required!

To install GLEW:
apt-get install libglew1.6 libglew1.6-dev

To install freeglut:
apt-get install freeglut3 freeglut3-dev

To install OpenCV:
apt-get install libopencv-dev

The library can optionally use CUDA 4 or superior, OpenCL, OpenCV, 
libTiff, GDCM or DCMTK.


        Compilation using cmake
On Linux:
		
Go to the root directory of the project and run:
cmake .
make

On Windows:

Go to the root directory of the project and run:
cmake .

Depending on the compiler you have installed, cmake will create a solution,
a project or a MinGW Makefile. The generator works with Microsoft Visual 
Studio 2010. In this case, a solution will be built using the name "visiongl",
just open the solution as usual on Visual Studio, and compile it, you're done.

If you want to use Visual Studio 2010, use the following command:

cmake . -G "Visual Studio 10"

        Compilation using Makefile_linux

Please open Makefile_linux and edit the variables OPENCV_PATH, CUDA_PATH, 
referring to the paths where OpenCV and CUDA are installed. Edit also
INSTALL_PATH, referring to the path where the library and its include files
will be installed.

To build the library:
make -f Makefile_linux all

To install the library to INSTALL_PATH
make -f Makefile_linux install

To build the demos:
make -f Makefile_linux democam
make -f Makefile_linux demofrac
make -f Makefile_linux demobenchmark
make -f Makefile_linux demoio
make -f Makefile_linux demotiff
make -f Makefile_linux demogdcm
make -f Makefile_linux demodcmtk
make -f Makefile_linux demobin

To run the demos:
make -f Makefile_linux rundemocam
make -f Makefile_linux rundemofrac
make -f Makefile_linux rundemobenchmark
make -f Makefile_linux rundemoio
make -f Makefile_linux rundemotiff
make -f Makefile_linux rundemogdcm
make -f Makefile_linux rundemodcmtk
make -f Makefile_linux rundemobin

To build the documentation:
build dox

To generate wrapper code after some shader is modified:
make -f Makefile_linux cl
make -f Makefile_linux frag
make -f Makefile_linux frag_bg
make -f Makefile_linux frag_stereo
make -f Makefile_linux frag_diffeq
make -f Makefile_linux cuda

        Compilation with OpenCV

Please download OpenCV 2.4.0 or superior. It is available from:
https://github.com/opencv/opencv 

To compile VisionGL with support to OpenCV, please set WITH_OPENCV = 1 in 
the VisionGL makefile.

        Compilation with libTIFF

Please install libtiff 4.0 or superior. Install it by running:
sudo apt-get install libtiff4 libtiff4-dev

To compile VisionGL with support to libTIFF, please set WITH_TIFF = 1 in 
the VisionGL makefile.

        Compilation with GDCM

Please download gdcm-2.4.2 source code or later. It is available in: 
http://sourceforge.net/projects/gdcm/files/gdcm%202.x/GDCM%202.4.2/

Set the options below as follows:
GDCM_BUILD_SHARED_LIBS: ON
CMAKE_INSTALL_PREFFIX: /usr/local/gdcm

Optionally, set also
GDCM_BUILD_APPLICATIONS: ON

Then run:
make
sudo make install

To compile VisionGL with support to GDCM, please set WITH_GDCM = 1 in 
the VisionGL makefile.

        Compilation with DCMTK

Please download dcmtk-3.6.1_20131114 source code or later, available in:
http://dicom.offis.de/download/dcmtk/snapshot/

Set the options below as follows:
BUILD_SHARED_LIBS: ON
CMAKE_INSTALL_PREFFIX: /usr/local/dcmtk

Then run:
make
sudo make install

To compile VisionGL with support to DCMTK, please set WITH_DCMTK = 1 in 
the VisionGL makefile.

        About the demos

demofrac: Probably the most basic demo. Does not require any aditional 
library besides the minimum. Use the arrows in the numpad to navigate,
 z/x to zoom in/out, and q to quit. 
 
democam: Another basic demo. Requires OpenCV to obtain images from the 
webcam. Captures images from the first webcam found. The capture is done by 
OpenCV function cvCaptureFromCAM. An OpenGL window shows four versions 
of the captured image after a few operations.
 
demoio and demotiff: To run these examples, please compile VisionGL with
TIFF support. In a previous section there are instructions about how
to compile GDCM.

demogdcm: To run this example, please compile VisionGL with
GDCM support. In a previous section there are instructions about how
to compile GDCM.

demodcmtk: To run this example, please compile VisionGL with
DCMTK support. In a previous section there are instructions about how
to compile DCMTK.

demobenchmark: This demo is composed by six programs.
 - demobenchmark_cv: The simplest one, requires OpenCV.
 - demobenchmark_cl: To run this example, please compile VisionGL with
                     OpenCL support.
 - demobenchmark_cvocl: To run this example, please compile OpenCV with
                     OpenCL support. Download OpenCV and look for the 
                     folder modules/ocl. It may be not present in the
                     master branch from the git repository, but it is 
                     present in the 2.4.8 and 2.4.9 tags. Get OpenCV
                     with git by running:

                     git clone https://github.com/opencv/opencv.git
                     git checkout 2.4.9

 - demobenchmark_cl3d: To run this example, please compile VisionGL with
                     OpenCL support.
                     Your device must support the extension
                     cl_khr_3d_image_writes. This extension is available 
                     in most AMD video cards. Please use the function 
                     clGetDeviceInfo with the option CL_DEVICE_EXTENSIONS
                     to check the extension availability. An alternative is 
                     to look for the card model in compupench.org and look 
                     for the card details.

 - demobenchmark_mm: To run this example, please compile VisionGL with
                     OpenCL support.

 - demobenchmark_fuzzytophat: To run this example, please compile VisionGL with
                     OpenCL support.

demobenchmark_clnd: To run this example, please compile VisionGL with
OpenCL support.

demobin: Examples of operations on binary images (1bpp). To run this 
example, please compile VisionGL with OpenCL support.

References


[1] Daniel Oliveira Dantas, Helton Danilo Passos Leal, Davy Oliveira Barros Sousa
Fast 2D and 3D image processing with OpenCL
International Conference on Image Processing (ICIP), 2015, IEEE, Quebec City.
http://dx.doi.org/10.1109/ICIP.2015.7351730
http://ieeexplore.ieee.org/xpl/articleDetails.jsp?reload=true&arnumber=7351730

[2] Daniel Oliveira Dantas, Helton Danilo Passos Leal, Davy Oliveira Barros Sousa
Fast multidimensional image processing with OpenCL
International Conference on Image Processing (ICIP), 2016, IEEE, Phoenix City.
http://doi.org/10.1109/ICIP.2016.7532664
http://ieeexplore.ieee.org/document/7532664/

[3] Daniel Oliveira Dantas, Junior Barrera
Automatic generation of wrapper code for video processing functions
Learning and Nonlinear models, Vol 9, Num 2, 2011
https://www.academia.edu/4367451/Automatic_generation_of_wrapper_code_for_video_processing_functions
http://www.deti.ufc.br/~lnlm/papers/vol9-no2-art5.pdf