think tank forum

technology » recommend a protocol!

lucas's avatar
13 years ago
link
lucas
i ❤ demo
i need to copy files (large files around 4 GiB and millions of small files from 100 KiB to 25 MiB) between my network file server running freebsd 8 and my laptop running windows xp pro.

requirements
1. fast (no data encryption)
2. decent gui available for windows xp

preferred
1. credentials are encrypted
andre's avatar
13 years ago
link
andre
No idea how reliable this is but... http://www.seabreezecomputers.com/tips/filexfer.htm

Also: http://www.codesector.com/teracopy.php
nny's avatar
13 years ago
link
nny
M̮͈̣̙̰̝̃̿̎̍ͬa͉̭̥͓ț̘ͯ̈́t̬̻͖̰̞͎ͤ̇ ̈̚J̹͎̿̾ȏ̞̫͈y̭̺ͭc̦̹̟̦̭̫͊̿ͩeͥ̌̾̓ͨ
samba would probably be fastest.
andre's avatar
13 years ago
link
andre
oops, I missed the "freebsd" part when I saw the gui requirement for windows...
lucas's avatar
13 years ago
link
lucas
i ❤ demo
your link recommends mapping a samba share, yeah?

i'll just install samba on the freebsd file server, setup a share, and map it on my windows xp machine.

that works!
Carpetsmoker's avatar
13 years ago
link
Carpetsmoker
Martin
Samba is most certainly the easiest way.

I had to add this to my smb.conf otherwise my performance was *horrible*.

socket options = SO_SNDBUF=16384 SO_RCVBUF=16384 TCP_NODELAY IPTOS_LOWDELAY
lucas's avatar
13 years ago
link
lucas
i ❤ demo
`sudo /usr/libexec/ftpd -D` is much easier than samba. but performance sucks for millions of small files. also, it uses plaintext authentication. :[
Carpetsmoker's avatar
13 years ago
link
Carpetsmoker
Martin
FTP sucks. Period.
phi_'s avatar
13 years ago
link
phi_
... and let the Earth be silent after ye.
Yeah. Samba sounds like the best route, larz. But I don't know of many other protocols...
lucas's avatar
13 years ago
link
lucas
i ❤ demo
i couldn't get samba working, and i was getting extremely frustrated. then randomly, weeks later, i realized that pf was blocking it!

sigh.
Carpetsmoker's avatar
13 years ago
link
Carpetsmoker
Martin
haha
nny's avatar
13 years ago
link
nny
M̮͈̣̙̰̝̃̿̎̍ͬa͉̭̥͓ț̘ͯ̈́t̬̻͖̰̞͎ͤ̇ ̈̚J̹͎̿̾ȏ̞̫͈y̭̺ͭc̦̹̟̦̭̫͊̿ͩeͥ̌̾̓ͨ
Alternatives... openafs / nfs ( a pain on windows but doable ) / not much else....

windows kinda sucks as an operating system.
Carpetsmoker's avatar
13 years ago
link
Carpetsmoker
Martin
Last I checked, openafs support was either buggy or missing on most operating systems ...
nny's avatar
13 years ago
link
nny
M̮͈̣̙̰̝̃̿̎̍ͬa͉̭̥͓ț̘ͯ̈́t̬̻͖̰̞͎ͤ̇ ̈̚J̹͎̿̾ȏ̞̫͈y̭̺ͭc̦̹̟̦̭̫͊̿ͩeͥ̌̾̓ͨ
it does exist though. =P
Carpetsmoker's avatar
13 years ago
link
Carpetsmoker
Martin
It seems to have improved now. I last looked at it maybe 4 or 5 years ago, I guess my info is out of date ... :-/
nny's avatar
13 years ago
link
nny
M̮͈̣̙̰̝̃̿̎̍ͬa͉̭̥͓ț̘ͯ̈́t̬̻͖̰̞͎ͤ̇ ̈̚J̹͎̿̾ȏ̞̫͈y̭̺ͭc̦̹̟̦̭̫͊̿ͩeͥ̌̾̓ͨ
It's still sketch as shit.
Carpetsmoker's avatar
13 years ago
link
Carpetsmoker
Martin
Oh ... So it doesn't really differ from NFS or SMB then?
nny's avatar
13 years ago
link
nny
M̮͈̣̙̰̝̃̿̎̍ͬa͉̭̥͓ț̘ͯ̈́t̬̻͖̰̞͎ͤ̇ ̈̚J̹͎̿̾ȏ̞̫͈y̭̺ͭc̦̹̟̦̭̫͊̿ͩeͥ̌̾̓ͨ
well it does in that it is a distributed file system. blocks can reside in multiple geographic locations at once... or just one. Also it has full integrated kerberos support.
Carpetsmoker's avatar
13 years ago
link
Carpetsmoker
Martin
On of my main issues with NFS is file locking and that the entire system borks when you lose a mount ...
nny's avatar
13 years ago
link
nny
M̮͈̣̙̰̝̃̿̎̍ͬa͉̭̥͓ț̘ͯ̈́t̬̻͖̰̞͎ͤ̇ ̈̚J̹͎̿̾ȏ̞̫͈y̭̺ͭc̦̹̟̦̭̫͊̿ͩeͥ̌̾̓ͨ
oh yeah... svn + nfs + osx used to be a nightmare.
Carpetsmoker's avatar
13 years ago
r1, link
Carpetsmoker
Martin
Incidentally, the FreeBSD status report that came out today mentioned OpenAFS:
http://www.freebsd.org/news/status/report-201 … enAFS-Port

“Work covered in previous reports brought the OpenAFS client to a useful form on 9.0-CURRENT, though with some rough edges. Since our last report, we have fixed several bugs that were impacting usability, and we expect the upcoming 1.6.0 release to be usable for regular client workloads (though not heavy load).”
nny's avatar
13 years ago
link
nny
M̮͈̣̙̰̝̃̿̎̍ͬa͉̭̥͓ț̘ͯ̈́t̬̻͖̰̞͎ͤ̇ ̈̚J̹͎̿̾ȏ̞̫͈y̭̺ͭc̦̹̟̦̭̫͊̿ͩeͥ̌̾̓ͨ
People still use AFS. I think columbia universities email is still based on it...
asemisldkfj's avatar
12 years ago
link
asemisldkfj
the law is no protection
I put ubuntu server edition on my file server because it played nice with my new tv, but if I'm copying mp3 files to a samba share via mp3tag while listening to music on the same share, the music stops playing every few seconds like it's buffering. never had this with freebsd. not a huge deal because copying doesn't take very long, but another point for freebsd.