why is that?
@boilingsteam For example, I tend to symlink ~/.cache to a local partition. But then I need to be sure that on every machine I login to that destination exists.
@boilingsteam as of my cluster problem, I might start an rsync daemon to serve data. I already copy data to a local partition using rsync, so that should be easy.
On a second thought, I might use BitTorrent to spread data to the workers. It looks like an ideal setup. I have one BT node at the beginning, when I start many jobs, traffic to the initial BT node will be reduced, as workers will share data between themselves.
I am not sure if this fits with your workflow, but you can also use Syncthing to spread data across clients. Works very well.
I'll give it a try
Yeah. It's like Dropbox but in Free Software. Been using it for years without issue.
The social network of the future: No ads, no corporate surveillance, ethical design, and decentralization! Own your data with Mastodon!