QSV does not work in container

spamana

Hey guys,
I'm running fileflows in docker:

System information:

FileFlows 1.0.8.2176
CPU/GPU:  12th Gen Intel(R) Core(TM) i3-12100T

Card was recognized:

ls /dev/dri
card0     renderD128

va info:

libva info: VA-API version 1.14.0
libva info: Trying to open /usr/lib/x86_64-linux-gnu/dri/iHD_drv_video.so
libva info: Found init function __vaDriverInit_1_14
libva info: va_openDriver() returns 0
vainfo: VA-API version: 1.14 (libva 2.12.0)
vainfo: Driver version: Intel iHD driver for Intel(R) Gen Graphics - 22.3.1 ()
vainfo: Supported profile and entrypoints
      VAProfileNone                   : VAEntrypointVideoProc
      VAProfileNone                   : VAEntrypointStats
      VAProfileMPEG2Simple            : VAEntrypointVLD
      VAProfileMPEG2Simple            : VAEntrypointEncSlice
      VAProfileMPEG2Main              : VAEntrypointVLD
      VAProfileMPEG2Main              : VAEntrypointEncSlice
      VAProfileH264Main               : VAEntrypointVLD
      VAProfileH264Main               : VAEntrypointEncSlice
      VAProfileH264Main               : VAEntrypointFEI
      VAProfileH264Main               : VAEntrypointEncSliceLP
      VAProfileH264High               : VAEntrypointVLD
      VAProfileH264High               : VAEntrypointEncSlice
      VAProfileH264High               : VAEntrypointFEI
      VAProfileH264High               : VAEntrypointEncSliceLP
      VAProfileVC1Simple              : VAEntrypointVLD
      VAProfileVC1Main                : VAEntrypointVLD
      VAProfileVC1Advanced            : VAEntrypointVLD
      VAProfileJPEGBaseline           : VAEntrypointVLD
      VAProfileJPEGBaseline           : VAEntrypointEncPicture
      VAProfileH264ConstrainedBaseline: VAEntrypointVLD
      VAProfileH264ConstrainedBaseline: VAEntrypointEncSlice
      VAProfileH264ConstrainedBaseline: VAEntrypointFEI
      VAProfileH264ConstrainedBaseline: VAEntrypointEncSliceLP
      VAProfileHEVCMain               : VAEntrypointVLD
      VAProfileHEVCMain               : VAEntrypointEncSlice
      VAProfileHEVCMain               : VAEntrypointFEI
      VAProfileHEVCMain               : VAEntrypointEncSliceLP
      VAProfileHEVCMain10             : VAEntrypointVLD
      VAProfileHEVCMain10             : VAEntrypointEncSlice
      VAProfileHEVCMain10             : VAEntrypointEncSliceLP
      VAProfileVP9Profile0            : VAEntrypointVLD
      VAProfileVP9Profile1            : VAEntrypointVLD
      VAProfileVP9Profile2            : VAEntrypointVLD
      VAProfileVP9Profile3            : VAEntrypointVLD
      VAProfileHEVCMain12             : VAEntrypointVLD
      VAProfileHEVCMain12             : VAEntrypointEncSlice
      VAProfileHEVCMain422_10         : VAEntrypointVLD
      VAProfileHEVCMain422_10         : VAEntrypointEncSlice
      VAProfileHEVCMain422_12         : VAEntrypointVLD
      VAProfileHEVCMain422_12         : VAEntrypointEncSlice
      VAProfileHEVCMain444            : VAEntrypointVLD
      VAProfileHEVCMain444            : VAEntrypointEncSliceLP
      VAProfileHEVCMain444_10         : VAEntrypointVLD
      VAProfileHEVCMain444_10         : VAEntrypointEncSliceLP
      VAProfileHEVCMain444_12         : VAEntrypointVLD
      VAProfileHEVCSccMain            : VAEntrypointVLD
      VAProfileHEVCSccMain            : VAEntrypointEncSliceLP
      VAProfileHEVCSccMain10          : VAEntrypointVLD
      VAProfileHEVCSccMain10          : VAEntrypointEncSliceLP
      VAProfileHEVCSccMain444         : VAEntrypointVLD
      VAProfileHEVCSccMain444         : VAEntrypointEncSliceLP
      VAProfileAV1Profile0            : VAEntrypointVLD
      VAProfileHEVCSccMain444_10      : VAEntrypointVLD
      VAProfileHEVCSccMain444_10      : VAEntrypointEncSliceLP

When converting a video this error occurs:

2022-11-25 14:05:31.482 [WARN] -> Cant process '/usr/local/bin/ffmpeg -loglevel error -f lavfi -i color=black:s=1080x1080 -vframes 1 -an -c:v hevc_qsv -global_quality 28 -load_plugin hevc_hw -f null -': [hevc_qsv @ 0x562362e05b00] Failed to create a VAAPI device.
Error initializing output stream 0:0 -- Error while opening encoder for output stream #0:0 - maybe incorrect parameters such as bit_rate, rate, width or height

[...]

2022-11-25 14:05:31.580 [INFO] -> Device creation failed: -542398533.
2022-11-25 14:05:31.580 [INFO] -> [rawvideo @ 0x560d6c2ca000] No device available for decoder: device type qsv needed for codec rawvideo.
2022-11-25 14:05:31.580 [INFO] -> Stream mapping:
2022-11-25 14:05:31.580 [INFO] ->   Stream #0:0 -> #0:0 (rawvideo (native) -> h264 (libx264))
2022-11-25 14:05:31.580 [INFO] -> Device setup failed for decoder on input stream #0:0 : Generic error in an external library

reven

just acknowledging i've read this. but I dont have much experience with QSV.

Earlier version of FileFlows using docker, that didnt work with 12th gen and newer out of the box, but that was fixed around 1.0.5, so 1.0.8 is fine.

I'll let the community chime in here, people that are using QSV.

spamana

For me it looks like the wrong Intel gpu driver is used. iHD instead of Intel vaapi driver. And ffmpeg utilizes Intel vaapi for QSV encoding and decoding.

This picture is pretty helpful:

reven

if thats the case, then you should be able to install it manually inside the container, then report back what you had to install and I'll update the docker image.

However, I know others are using qsv inside the docker.

spamana

Is there a way to check if the gpu is used for encoding?

reven

look at the file log and see what the ffargs are being used.

spamana

Ok I'm a bit confused now. FileFlows checks with this command if qsv is available:
/usr/local/bin/ffmpeg -loglevel error -f lavfi -i color=black:s=1080x1080 -vframes 1 -an -c:v hevc_qsv -global_quality 28 -load_plugin hevc_hw -f null -

It fails with:
[hevc_qsv @ 0x55f4a0639b00] Failed to create a VAAPI device. Error initializing output stream 0:0 -- Error while opening encoder for output stream #0:0 - maybe incorrect parameters such as bit_rate, rate, width or height

But when I enter the container and run the exact same command manually, it is successful.

Any ideas?

spamana

Ok I just searched for the error message and found this jellyfin issue:
https://github.com/linuxserver/docker-jellyfin/issues/26

It looks like my current user (I'm running non-root) is not able to access the render device.
I'm using PGID and PUID to change the user. It looks like the entrypoint script is not owning the devices correctly.

spamana

Ok after I fixed the permissions on the devices, it finally worked!!!
May be worth updating the container owning script to avoid such issues.

reven

glad you got it working.

not sure what I could do to add the permissions though. couldnt you just add those permissions to the mapped user outside of docker? eg if you pass in user 1000, outside of docker user 1000 give permissions to /dev/dri/whatever?

spamana

Where can I find the Dockerfile? Is there a way to file an merge request?
What I mean is, when setting PGID and PUID, the container should own on startup the /dev/dri devices.

reven

no, the dockerfile is part of the build resources which is a private repository.

the docker-entrypoint.sh file you can view from within the docker container, thats where it uses pgid/puid.