CPU usage on Unraid

meh404

Hello.

I was wondering if anyone else is having this issue?

When running FileFlows on unraid and limiting CPU cores it seems the Internal processing node uses so much CPU even with GPU support enabled (audio normalisation/removing subtitles) that the fileflows web GUI seems to slow to a crawl.

I have MYSQL database enabled for this, as the local DB version was frankly appalling, highly recommend the £6/month for this!, it does seem to have resolved some of the web GUI lag.

I am wondering if it is worth disabling the internal node and adding fileflows-node to the unraid box and giving it different CPU cores to the fileflows server?

Limiting FileFlows to 8 cores at the moment, as I have to give the rest of my cores to VM's and other dockers. if I don't limit it, it just uses all cores 100%. which is far from ideal.

Around 50k files, it's done 10k so far. so a rather large database.

reven

Depends on how many runners you have and what is happening. Audio normalization is cou intensive. So if multiple files are doing that at once then that would use a lot of cpu. But if you have hardware encoding, then once you hit the encoding step, CPU usage should go down.

SQLite doesn't like multiple connections at once, so it has to wait for other connections to complete. Ifnthere are heaps of connections needing to run close together this can create a long queue.

I tried to ease this in 1.0.9/1.0.10. I'm having difficulty reproducing this, but I'll try again in the next version

meh404

reven At the moment I'm limiting it to 2 runners, did have 4 running in older builds, but not sure what has changed, it seems to struggle since the last few updates. although only got MYSQL added yesterday. so hopefully improves speed. as noticed loads of database lag with SQLite.

Be nice if we could have a way to separate CPU instances inside fileflows docker so that 1/2 cores are always dedicated to the server to stop time outs. maybe its just my use case?

Hats off for the program though, love the interface vs other apps.

reven

you can, just make the server one docker, then setup an external node as a different docker, and turn off the internal processing node., this is how I run it.

reven

Someone requested files be redetected if theyre are modified, as they were saving files to the same location, eg monitoring a /media/movies directory. so i updated the logic to rescan a file if it was changed, it was in preview for about 2 weeks, and no one had issues, so released it publicly.