For transfers involving a file system, you must install agents on a machine with access to your file system data. If agents in the same agent pool are installed on different machines, they must all have uniform access to the file system, or the transfer will fail.
See Manage transfer agents for more details.
To limit your agents' access to your file system, see Restricting agent directory access.