Libva Buffer Sharing HowTo

Beignet has extensions (clCreateBufferFromLibvaIntel/clCreateImageFromLibvaIntel) to share gpu buffer object with libva. So users can utilize OpenCL to do processing on VASurface or VABuffer without buffer copy.

Prerequisite

Libva api version >= 0.36.0. Please check your libva api version by command pkg-config --modversion libva.

Steps

In order to use the extension clCreateBufferFromLibvaIntel/clCreateImageFromLibvaIntel in your program, please follow the steps as below (We have added an example of using clCreateImageFromLibvaIntel, please read next section for details):

  • Get the address of this extension by the function: clGetExtensionFunctionAddress("clCreateBufferFromLibvaIntel") or clGetExtensionFunctionAddress("clCreateImageFromLibvaIntel")

  • Invoke vaAcquireBufferHandle to get VASurface/VABuffer's handle, which you want to do processing by OpenCL.

  • Use clCreateBufferFromLibvaIntel/clCreateImageFromLibvaIntel to create corresponding cl memory object from VASurface/VABuffer's handle. If you create a normal VASurface, you should use clCreateImageFromLibvaIntel to create a cl image object from VASurface, because VASurface is a tiling gpu buffer object. The only case you should use clCreateBufferFromLibvaIntel to create a cl buffer object from VASurface is that: The VASurface is created from an external untiling gpu buffer object. And You should use clCreateBufferFromLibvaIntel to create a cl buffer object from VABuffer.

  • Use OpenCL to do post-processing.

  • Release this cl buffer object by clReleaseMemObject.

  • Unlock this VABuffer by vaReleaseBufferHandle.

Sample code

We have developed an example of using clCreateImageFromLibvaIntel in examples/libva_buffer_sharing directory. This example read a source nv12 file to a VASurface, and create a target VASurface. Then create corresponding cl image objects from them. After using ocl to do a mirror effect post-processing on this source surface, target VASurface is shown on screen by default.

  • Add option -DBUILD_EXAMPLES=ON to enable building examples when running cmake, such as:

    > mkdir build

    > cd build

    > cmake -DBUILD_EXAMPLES=ON ../

  • Build source code:

    > make

  • Run:

    > cd examples

    > . ../utests/setenv.sh

    > ./example-libva_buffer_sharing

In addition, you can choose to save the result as a nv12 file. You can use gst-launch-1.0 to see the result. Just install gstreamer1.0-plugins-base, gstreamer1.0-plugins-bad and gstreamer1.0-x by apt on Ubuntu. Then running the following command:

> gst-launch-1.0 filesrc location=file_name ! videoparse format=nv12 width=xxx height=xxx \ ! imagefreeze ! videoconvert ! video/x-raw, format=BGRx ! ximagesink