LinHES Forums
http://forum.linhes.org/

What is the fastest transfer method?
http://forum.linhes.org/viewtopic.php?f=5&t=6651		 Page 1 of 1
Author:  Girkers [ Thu Oct 27, 2005 11:30 pm ]
Post subject:  What is the fastest transfer method?
From what I have read you have three options when transferring files to your Myth box from Windows machine.

a) Samba
b) WinSCP
c) NFS

I have only tried Samba and NFS, with no particular testing strategy but have found that NFS was about 1MB/s quicker then Samba.

What are your experiences and is there any other way to get your files to your Mythbox?
Author:  cesman [ Fri Oct 28, 2005 12:25 am ]
Post subject: 
Windows machine?! What is that?
Author:  Greg Frost [ Fri Oct 28, 2005 1:17 am ]
Post subject: 
Never underestimate the bandwitdth of a truckload of DVDs.
Author:  wififun [ Fri Oct 28, 2005 2:18 am ]
Post subject: 
step 1. remove HD from WinDoze PC
step 2. install in free IDE slot in Knoppmyth box
setp 3. mount -t vfat /dev/hdb1 /mnt/temp
step 4. cp /mnt/temp/my_legal_movies/* /myth/video
step 5. umount /mnt/temp
step 6. reformat the drive and keep it in your knoppmyth box where all your extra storage belongs.
Author:  cesman [ Fri Oct 28, 2005 8:11 am ]
Post subject: 
Good idea wififun!
Author:  Xsecrets [ Fri Oct 28, 2005 8:58 am ]
Post subject: 
Makes since that NFS is is faster than samba, as it is a much cleaner protocol. and they will both be faster than scp as it is encrypted and that takes at least a bit of time.
Author:  tjc [ Fri Oct 28, 2005 7:30 pm ]
Post subject: 
Actually... With decent CPUs SCP will actually beat NFS. When I was making ISO images or recordings on the old KnoppMyth box and copying them from there to the workstation that had the DVD burner, I tried a variety of transfer methods, and SCP was the clear winner. NFS is an older protocol and has some moderately crufty behaviours.
Author:  tjc [ Fri Oct 28, 2005 9:38 pm ]
Post subject: 
OK, I've got to retract this one based on the current system. :oops: I got curious about the question and did some timing tests:
Code:
[xxxxxxxx@silver xxxxxxxx]$ time scp root@black2:/myth/tv/1098_20051026015900_20051026040000.nuv .
Password:
1098_20051026015900_20051026040000.nuv        100% 4385MB  10.9MB/s
06:41146.55user 94.63system 6:45.02elapsed 59%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+921minor)pagefaults 0swaps
[xxxxxxxx@silver xxxxxxxx]$ rm 1098_20051026015900_20051026040000.nuv
rm: remove regular file 1098_20051026015900_20051026040000.nuv'? y
[xxxxxxxx@silver xxxxxxxx]$ time cp /myth/tv/1098_20051026015900_20051026040000.nuv .
1.70user 48.96system 6:30.96elapsed 12%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (0major+156minor)pagefaults 0swaps
[xxxxxxxx@silver xxxxxxxx]$ rm 1098_20051026015900_20051026040000.nuv
rm: remove regular file 1098_20051026015900_20051026040000.nuv'? y
[xxxxxxxx@silver xxxxxxxx]$ time scp root@black2:/myth/tv/1098_20051026015900_20051026040000.nuv .
Password:
1098_20051026015900_20051026040000.nuv        100% 4385MB  10.9MB/s   06:41
143.20user 91.13system 6:43.92elapsed 58%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (4major+916minor)pagefaults 0swaps
[xxxxxxxx@silver xxxxxxxx]$ rm 1098_20051026015900_20051026040000.nuv
rm: remove regular file 1098_20051026015900_20051026040000.nuv'? y
[xxxxxxxx@silver xxxxxxxx]$ time cp /myth/tv/1098_20051026015900_20051026040000.nuv .
1.90user 51.37system 6:40.53elapsed 13%CPU (0avgtext+0avgdata 0maxresident)k
0inputs+0outputs (1major+155minor)pagefaults 0swaps

NFS is not only faster but also shows a lower CPU load. This directly contradicts my recollection of previous experience, but I've got to go with the evidence I can gather at the moment... :roll: Both systems have been upgraded since the last time I tried this, which might have something to do with it, but never let it be said that I don't 'fess up when I'm wrong. ;-)
Author:  Girkers [ Fri Oct 28, 2005 9:41 pm ]
Post subject: 
tjc that is the sort of stuff I was after timings and stuff.

Could you post how you did you testing so we have a reference to test our own systems againts. I don't quite get what you are doing in your code quote.

Thanks.
Author:  tjc [ Fri Oct 28, 2005 9:47 pm ]
Post subject: 
Uhm... Running mount | grep -i nfs on the workstation shows this:
Code:
black2:/myth on /myth type nfs (rw,nosuid,rsize=8192,wsize=8192,soft,addr=192.168.1.103)

Aside from that the test is trivial. I copied the file multiple times from it's remote location on the KnoppMyth box while alternating the methods (cp over NFS, scp over SSL) to minimize buffering and transient effects. The network between the machines is 100BaseT and runs through a LinkSys BEFSR41.
Author:  EmmEff [ Fri Nov 04, 2005 3:33 pm ]
Post subject: 
If you want to improve NFS performance, perhaps try the following to increase the transfer size:

mount -o rsize=32768,wsize=32768 host:/share /mnt

Also, trying tcp improve it as well:

mount -o tcp,rsize=32768,wsize=32768 host:/share /mnt
Author:  lynchaj [ Sat Nov 05, 2005 9:48 am ]
Post subject: 
OK, great thread but I have a question...

Is there a FOSS version of a NFS client for Windows? I use SAMBA because I thought there is no alternative (other than SCP).

I would love to use NFS on my Windows boxen if there are any free clients available.

Thanks!

Andrew Lynch
Author:  Girkers [ Sun Nov 06, 2005 9:45 pm ]
Post subject: 
The only free NFS client that I have found is the one from MS. It is included with the Services for Unix (SFU) download, which is over 200MB. I have downloaded and installed it and it works just through your network neighbourhood.

I haven't had the chance, but I don't know if you could actually just extract that component (probably not legal anyway), but you can install it by itself.
Author:  graysky [ Fri Feb 24, 2006 4:19 pm ]
Post subject: 
Interesting. How does FTP compare to NFS for raw speed in transfers in your opinion? My own tests with mid sized files show that FTP is faster than the version of SAMBA that is included in R5A30.2

@Girkers: what exactly did you need to do to enable the NFS client to see your knoppmyth exports? I added the correct line in my /etc/exports to export some shares to my Win box. I should say that the NFS is configured correctly such that my frontend machine can see the exports. I followed the instructions on the wiki by the way [url=Girkers]here[/url]... I can't seem to get the NFS client on my win side to see my mythbox.

NFS is so much easier to do in LINUX!
Author:  afrosheen [ Mon Mar 06, 2006 11:19 am ]
Post subject: 
Yeah, it's been my experience in the past that FTP is the fastest protocol windows natively supports. Samba is always slow regardless of your network speed/hd speed, etc.
Page 1 of 1 All times are UTC - 6 hours
Powered by phpBB® Forum Software © phpBB Group
http://www.phpbb.com/