 Notes |
(0000691)
peter (administrator)
2007-01-08 18:25
|
What is the throughput on the disk (no network)?
What did you use to test network throughput - Samba, scp? |
|
(0000693)
madpatrick (reporter)
2007-01-09 12:20
|
hdparm -Tt /dev/hda
/dev/hda:
Timing cached reads: 464 MB in 2.01 seconds = 230.42 MB/sec
Timing buffered disk reads: 88 MB in 3.05 seconds = 28.88 MB/sec
hdparm -Tt /dev/sda
/dev/sda:
Timing cached reads: 432 MB in 2.01 seconds = 215.07 MB/sec
Timing buffered disk reads: 118 MB in 3.00 seconds = 39.29 MB/sec
I did the test with Samba and IPtraf. Just copied a large file (900 MB) from server to client. The speed writing to Samba is higher than reading.
Writing to server : 48 Mb/s
Reading from server : 30 Mb/s
I've reinstalled on a second harddisk CC3.2 with the same hardware and configuration and the speed is much higher (78 Mb/s).
-----
ifconfig eth1
eth1 Link encap:Ethernet HWaddr 00:06:29:C9:AB:71
inet addr:192.168.0.1 Bcast:192.168.0.255 Mask:255.255.255.0
inet6 addr: fe80::206:29ff:fec9:ab71/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:53915549 errors:0 dropped:0 overruns:0 frame:0
TX packets:54840644 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:345229106 (329.2 MiB) TX bytes:1282589820 (1.1 GiB) |
|
(0000701)
pehenry (reporter)
2007-01-16 12:02
edited on: 2007-01-16 12:02
|
I would like to also report slow transfer speeds with Samba.
The server has a 4 800JB RAID 5 array, with a GbE network card. The Switch is a Dlink Managed Gigabit switch. And my workstation has a Raptor 150 HD.
When I download from the server share, my bandwidth is capped @ 5MbS.. But, I can upload to the share at 200 to 300 MbS. But, if I download the same file from the FTP site using Filezilla, I get 200 to 300 Mbs.
I removed QoS from my network card, retested and same results.
You can see full server specs here: http://plan6.com/s [^]
|
|
(0000709)
kmartens (reporter)
2007-02-11 11:15
|
same problem here, upload can go to 20 - 25MB/sec download goes to 6MB/sec, i've tried with an ftp-server with the same data, and I could download with 20-25MB/sec
This is really annoying... |
|
(0000711)
seamer (reporter)
2007-02-19 03:55
|
*speculation*
I've found that SATA drives have their own version of hdparm now, since hdparm doesnt -configure- SATA. It's called sdparm and seems quite vague to this self-taught user. Its possible its a samba+SATA issue since my slow file transfers seem to be coming from a SATA drive in my machine. |
|
(0000712)
kmartens (reporter)
2007-02-19 04:43
|
nope, here i have 3 ata disks running in logical volume group. No sata disks.
but i have found a tweak that doubles the transferrate to 12MB/s max. it's still far from the ftp transferrate, but it's an inprovement..
edit the following rule in /etc/samba/smb.conf:
socket options = TCP_NODELAY SO_RCVBUF=8192 SO_SNDBUF=8192
to:
socket options = IPTOS_LOWDELAY TCP_NODELAY SO_RCVBUF=65535 SO_SNDBUF=65535
I don't know what this does, but it helps.. |
|
(0000715)
lampie (reporter)
2007-03-05 17:25
|
I have the same problem, on both IDE and SATA drives, whether in raid or standalone doesn't matter.
System specs:
P4 2.6 HT
1024 DDR RAM
4x 300GB Maxtor SATA2 drives
CC4.0 installation operates from 2 old IDE 20GB drives
Intel 1000MT gigabit ethernet
When i copy a file to CC4.0, steady at +/- 20MB/s
When i copy a file from the CC4.0 then it usually start with 40 MB/s but then after 1 or 2 seconds drops to around 7MB/s and stays here. It literally makes CC4.0 useless for a NAS application :(
When i tested this using the onboard Marvell 940 chipset it operates direcly on 7MB/s and doesnt even boost on start.
On both the old IDE drives and the new SATA drives i get this problem.
I really dont know why it does this. |
|
(0000716)
dgdsantos (reporter)
2007-03-11 07:23
|
We have the same problem with our CC4.0 Enterprise Edition. 'Would appreciate if this will be resolved ASAP.
Thanks. |
|
(0000717)
Duduke (reporter)
2007-03-11 09:46
|
Adding my comments:
I've tried many smb.conf tricks to no avail.
My speed seems to be capped at 4.8MB.
Specs:
4.0 Community
SAMBA currently at version 3.0.24
hda: ST340810A (Capacity: 37.27 GB)-system disk,378.73MB/s(cached),24.29MB/s(buff)
hdb: WDC WD800JB-00ETA0 (Capacity: 74.53 GB)-storage,381.30MB/s,33.17MB/s
hdc: Maxtor 6L250R0 (Capacity: 233.76 GB)-storage,376.36MB/s,37.63MB/s
IDE interface: VIA Technologies, Inc. VT82C586A/B/VT82C686/A/B/VT823x/A/C PIPC Bus Master IDE |
|
(0000719)
msonza (reporter)
2007-04-01 00:46
edited on: 2007-04-01 00:46
|
Thought I would share: I have found a solution (of sorts). The issue (slow download speeds on gigabit) seems to be the result of something in the kernel as upgrading to the latest kernel -2.6.20.4 seems to have done the trick.
Speeds are (for my setup, 3xSATA disks in SW RAID5) cir. 30-40 MB/s (MegaBytes) in both directions.
Hope this helps others.
|
|
(0000733)
madpatrick (reporter)
2007-05-31 02:29
|
Peter,
Is there any progress with this issue.
Transfer speed is still very slow and is getting anoying.. |
|
(0000736)
defiancenl (reporter)
2007-06-01 08:30
edited on: 2007-06-01 08:32
|
Same problem but im using CC 4.1 Community (2.6.9-42.cc)
transfering via FTP ?
(all transfers are seen from server to client)
Upload : 6/7 MB/s
Download: 25 MB/s
diskspeed :
Server : /dev/hdb:
Timing cached reads: 628 MB in 2.01 seconds = 312.95 MB/sec
Timing buffered disk reads: 126 MB in 3.00 seconds = 41.98 MB/sec
Client : /dev/sda (Hardware Raid 0)
/dev/sda5:
Timing cached reads: 544 MB in 2.01 seconds = 271.25 MB/sec
Timing buffered disk reads: 266 MB in 3.01 seconds = 88.27 MB/sec
Network speed test :
[ 4] local 10.0.0.1 port 39978 connected with 10.0.0.234 port 5001
[ 4] 0.0-10.0 sec 68.3 MBytes 57.3 Mbits/sec
[ 4] local 10.0.0.1 port 5001 connected with 10.0.0.234 port 50986
[ 4] 0.0-10.0 sec 386 MBytes 323 Mbits/sec
Hardware Server
Pentium IV 1,7Ghz
1024 DDR
40 GB ATA
Realtek RTL-8169 1Gbit NIC
Hardware Client
Amd AthonXP 1800+
1024 DDR400
2 x 80 GB SATA Raid 0 (3ware 7006)
Realtek RTL-8169 1Gbit Nic
Switch
D-link DGS-1224 1Gbit Switch
|
|
(0000738)
peter (administrator)
2007-06-04 15:03
edited on: 2007-06-04 15:09
|
Here is an update.
Linux 2.6.15 included an overhaul of CIFS (Samba-related) -- see the "filesystems" section @ http://kernelnewbies.org/Linux_2_6_15 [^] . In all likelihood, an upgrade to 2.6.15 or later resolves the issue reported in this bug (knock on wood).
According the release notes of the latest kernel update from Red Hat Enterprise Linux 4 (Update 5), the CIFS subsystem was updated. Details @ https://rhn.redhat.com/errata/RHBA-2007-0304.html [^] . The handful of ClarkConnect patches (PPTP, peer-to-peer, multiwan) have been applied to this Red Hat kernel and the RPMs can be downloaded here:
http://download.clarkconnect.com/community/4.1/other/ [^]
Regardless, the 2.6.9-55.x update will be available via the software update system in the next week or two.
PS the 2.6.18 kernel from Red Hat Enterprise Linux 5 has also been ClarkConnect-ized. Unfortunately, it requires updates to a handful of other RPMS.
|
|
(0000739)
madpatrick (reporter)
2007-06-05 12:20
edited on: 2007-06-13 05:46
|
Peter,
I've installed the new kernel and rebooted the system.
The first speeds test by copying a large file
from server to client : 49148.20 kbits/sec
from client to server : 63596.00 kbits/sec
---
Update !!
I've noticed that my ETH1 is working on half-duplex after installing the new-kernel. Forcing full-duplex gives transfer errors.
Tried to put the NIC in another slot, but gives no change.
Tried to use another brand NIC, also no change.
------
Update !!
Problem solved. The HUB which i placed 2 weeks ago was bugging me. Removed it and i have full duplex again.
Speed with samba is still the same a discribe above.
I noticed that the CPU usage is 100% by copying a file to the server.
|
|
(0000741)
defiancenl (reporter)
2007-07-04 03:56
|
well the samba speed issue might be resolved by this kernel, but the ftp transfer still sucks :(
to server from client = 30MB/s
vice versa = 6MB/s
it has to be clarkconnect, why ?
because the server im running cc on now is different then my last post, and stil has the same issue,
however when i install fedora or wichever distro the transfer speed is normal |
|
(0000748)
chrisgeary (reporter)
2007-07-24 04:51
|
I think the severity of this issue should be upgraded. 4.1 also has this issue, I have upload (to the server) speeds using samba or ftp of less than 6mbits/sec and download speeds of 50mbits/sec. A colleague has also confirmed this on 4.0.
I've also tried the .55 kernel to no effect. Ubuntu server works fine on the same hardware.
Is a resolution in the works? |
|
(0000749)
davez0r (reporter)
2007-07-28 17:02
|
I must agree with Chris, I've just upgraded my CC box to 4.1 and the Windows File Sharing is much slower... So slow that I'll have to roll-back to 3.2 or find an alternative NAS solution. I tested by copying a 1GB file to/from the server over gigabit:
83 seconds copying to cc = 12.47 MBps = 100Mbps
195 seconds copying from cc = 5.31 MBps = 42Mbps
My machine is a bit older- a PentiumIII 500 Mhz with a Belkin Gigabit card. Yes, the Belkin is configured as my LAN side. My hard disk is a Seagate SATA with a Silicon Image controller card.
# /sbin/lspci
00:00.0 Host bridge: Intel Corporation 440BX/ZX/DX - 82443BX/ZX/DX Host bridge (rev 03)
00:01.0 PCI bridge: Intel Corporation 440BX/ZX/DX - 82443BX/ZX/DX AGP bridge (rev 03)
00:04.0 ISA bridge: Intel Corporation 82371AB/EB/MB PIIX4 ISA (rev 02)
00:04.1 IDE interface: Intel Corporation 82371AB/EB/MB PIIX4 IDE (rev 01)
00:04.2 USB Controller: Intel Corporation 82371AB/EB/MB PIIX4 USB (rev 01)
00:04.3 Bridge: Intel Corporation 82371AB/EB/MB PIIX4 ACPI (rev 02)
00:06.0 Multimedia audio controller: Cirrus Logic CS 4614/22/24 [CrystalClear SoundFusion Audio Accelerator] (rev 01)
00:0b.0 Ethernet controller: 3Com Corporation 3c905B 100BaseTX [Cyclone] (rev 30)
00:10.0 RAID bus controller: Silicon Image, Inc. SiI 3512 [SATALink/SATARaid] Serial ATA Controller (rev 01)
00:12.0 Ethernet controller: Marvell Technology Group Ltd. Belkin F5D5005 Gigabit Desktop Network PCI Card (rev 12)
01:00.0 VGA compatible controller: Matrox Graphics, Inc. MGA G200 AGP (rev 03)
# /sbin/hdparm -Tt /dev/sda
/dev/sda:
Timing cached reads: 464 MB in 2.01 seconds = 230.65 MB/sec
Timing buffered disk reads: 122 MB in 3.04 seconds = 40.12 MB/sec
I also upgraded my kernel as suggested earlier:
rpm -ivh kernel-2.6.9-55.cc.i586.rpm
but this has given no improvement to samba file transfer speeds. Any suggestions? |
|
(0000750)
lampie (reporter)
2007-07-28 17:29
|
Im also still suffering from low throughput. I cant believe this "bug" still plagues CC almost one year later!! This is one MAYOR bug in network performance! |
|
(0000752)
peter (administrator)
2007-08-01 14:10
|
Bumped the priority to "urgent". This means we will be actively dealing with the issue in the 4.2 beta release. |
|
(0000759)
kmartens (reporter)
2007-08-20 16:36
|
Also still the same here, a recent installed system, with some other things on it..
But there is somewhere else an bottleneck I think..
Upload to ftp 17-18MB
Upload to smbshare: 17-18MB/sec
Download from smbshare: 6MB/sec
Download from ftp: 12MB/sec
Very strange..
And I think it has been better when I installed the system fresh.. (think, not sure)
for more information, mail me.. |
|
(0000764)
Excrucio (reporter)
2007-09-02 07:03
|
I have the same problem except that I don't think this has anything to do with samba, I have 50/50Mb/s fiber broadband connection and my CC4.1 cannot even use half of my bandwidth.
If I connect my windows computers direct to my broadbandconnection I´ll reach 5.8 MB/sec both directions instantly on torrent. If I run through CC 4.1 I reach 4.8MB/s down and 200-500KB/s up, if I increase the number of connectionsto +200 (server2003) my throughput drops to about 3MB/sec. Nearly no difference if I kill snort. Cpu load is about 50% with snort and 1% without.
Machine specs, dual PIII 1000Mhz, 1,5GB memory, Intel pro 10/100 (tryed realtek and 3com).
If this performance problem not being solved the CC is completely useless and a 15$ Dlink604 is a better choice but if they solve it it's a killer app and I probably can sell a whole bunch of enterprice licenses. |
|
(0000768)
madpatrick (reporter)
2007-09-10 02:36
edited on: 2007-09-10 10:19
|
Updated today the system to 4.2b and the first testresults looks promising.
Will test tonight thoroughly and update this note with the results.
----
Update
----
Server -> PC 63297.20 kbits/sec
PC -> server 90887.20 kbits/sec
Transfer from server to PC is not constant. The speed is falling back to 0 for 1-2 sec and then is transfering for 5 sec.
|
|
(0000769)
chrisgeary (reporter)
2007-09-10 04:30
|
I've also downloaded 4.2b1. I installed this on VMware free server alongside 4.1sp1. I had both running at the same time with samba enabled. Both fresh installations. I copied the cc4.2b1.iso between my XP host and each instance of CC. Here are my findings:
CC4.1SP1 : 136secs upload (27.6mbits/sec) | 85secs download (44.2mbits/sec)
CC4.2B1 : 50s upload (75.2mbits/sec) | 60secs download (62.6mbits/sec)
Given that this is on VMware with the overheads of that plus any measurement errors due to me, XP and environment running variances, I'd still say that this is big well done chaps! Something has clearly changed and improved performance massively. I'd have to test this again on the hardware I originally referred to earlier which showed that 4.1 was unusably slow, but its looking good so far! |
|
(0000770)
darryl (administrator)
2007-09-10 16:35
|
I have conducted the following (non-scientific) test in our office:
-two PCs connected via a 100Mbit link, cross-over cable - no hub/switch
-syswatch and firewall services stopped
-tested upload/download speed of 1MB, 10MB, 100MB, and 500MB files
-protocols: SCP, FTP, SMB/CIFS, HTTP
-results are an average of 4 file sizes transferred 3 times using 4 protocols
The results:
ClarkConnect Office Edition release 3 (22.6.9-28.cc 0000001)
Upload: 9.50MB/s
Download: 9.22MB/s
ClarkConnect Community Edition release 4.1 (2.6.9-42.cc 0000001)
Upload: 9.58MB/s
Download: 9.34MB/s
It seems there is an unexpected (very slight) increase in throughput with CC4.1. I have tried running the same tests with the firewall started and the results were the same. Maybe an updated NIC driver (than one?) is performing poorly in 2.6.9-42.cc 0000001.
CC4.2 will run a significantly updated kernel (2.6.18) and it is my hope that network throughput will perform as expected with this new kernel. |
|
(0000771)
seamer (reporter)
2007-09-10 17:35
|
Darryl, your note says you tried it with 100mbit network, I'd be willing to bet most, if not all, the slow-speed reporters are running on gigabit hardware. Are you able to test under that environment? |
|
(0000772)
darryl (administrator)
2007-09-10 18:01
|
Yes, we just received several gigabit cards here, I will re-test with them and post my results. |
|
(0000775)
mick_w (reporter)
2007-09-15 01:54
|
Just updated to 4.2beta (15 sept) using the instructions here:
http://www.clarkconnect.com/forums/showflat.php?Cat=0&Number=99444&an=0&page=0#Post99444 [^]
...and I'm still getting the slow read speed in SAMBA.
(As its not a clean install, rather an update I'm not sure if something has been missed - but all seems to be working fine...)
With a directory of test files (1GB in size) I get these results:
Write to server 30MB/sec
Read to server 8.6MB/sec
Exactly the same as I got in C-C4.1.
I'm using a Gigabit NIC and "ifconfig eth0" reports:
eth0 Link encap:Ethernet HWaddr 00:1B:2F:2E:EB:DE
inet addr:192.168.0.50 Bcast:192.168.0.255 Mask:255.255.255.0
inet6 addr: fe80::21b:2fff:fe2e:ebde/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:1041237 errors:0 dropped:23 overruns:0 frame:0
TX packets:929057 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:1147560598 (1.0 GiB) TX bytes:1315898471 (1.2 GiB)
Interrupt:11 Base address:0xc000
Webconfig reports I'm running the latest Kernel "2.6.18-8.1.8.8.cc (SMP)" and smbstatus reports I'm running the current version of Samba (3.0.23c-4.cc)
Any Ideas?
Mick |
|
(0000782)
davez0r (reporter)
2007-10-11 12:09
|
I did a fresh install of 4.2 RC1 and I can report some improvement over 4.1:
For a 1 GB iso, previously I was getting:
83 seconds copying to cc = 12.47 MBps = 100Mbps
195 seconds copying from cc = 5.31 MBps = 42Mbps
Now on the same file, I am seeing:
80 seconds copying to cc = 12.8 MBps = 102Mbps
90 seconds copying from cc = 11.4 MBps = 91Mbps
Still, this isn't the kind of performance I had in CC 3.2 which gave around 240Mbps on nearly the same hardware. I have since upgraded my hard drive and am using a PCI Silicon Image SATA controller. Could that my problem? A slow SATA driver? Any performance suggestions? Is it possible to run Samba at a higher priority? |
|
(0000786)
peter (administrator)
2007-10-24 18:30
edited on: 2007-10-24 18:31
|
Ouch... how many hours have we all wasted? Noticing the gigabit speeds (thanks seamer) was the head slap moment. I owe everyone in this bug report a beer or four. If you comment out or remove the "burst" configuration in /etc/firewall, it will resolve the issue:
BANDWIDTH_UPSTREAM_BURST=3000
BANDWIDTH_UPSTREAM_CBURST=3000
BANDWIDTH_DOWNSTREAM_BURST=3000
BANDWIDTH_DOWNSTREAM_CBURST=3000
This is not an issue for 10/100Mbit networks (the burst rate is high enough).
|
|
