At that point TemsorFlow was complaining that the CPU supports instructions that the binary was not built with. Before building TF from source, I decided to update cuda and other Nvidia software. After a dance following outdated tutorials, I got it done. Speed improved, but still, while CPUs were at 100%, GPUs were barely loaded.
The server crashed shortly after I left, so no great results.
vmtouch is a nice tool to cache file content into memory.
A beta setup of a Mastodon instance primary for family and friends.