For transfers involving a file system as the sink, you must install agents on a machine with access to your file system. If agents in the same agent pool are installed on different machines, they must all have uniform access to the file system, or the transfer will fail.
See Manage transfer agents for more details.
To limit your agents' access to your file system, see Restricting agent directory access.