проблемы с сервером при большом трафике

V

128

vapetrov

26 августа 2009, 21:15

4933

Есть сервер с CentOS 5.3

На нем стоит apache + lighttpd (или nginx, по настроению ;)

Через лайти раздаются большие файлы.

Канал 100 мегабит.

При загрузке канала больше 60-70 мегабит и около 1000 одновременных соединений наблюдаются нехорошие вещи.

Первое, теряются пакеты. При пинге с соседнего сервера с ключем -f - до 10% потери.

Второе, замедляется скорость работы с сервером, в частности долго подключается ssh/sftp. Третье, при трейсроуте с сервера на любой внешний адрес иногда начинает появляться ошибка

# traceroute host.com

traceroute to host.com (z.z.z.z), 30 hops max, 40 byte packets

send: No buffer space available

Отключение фаирвола ничего не дает.

Пробовал менять параметры, что нагуглил по этому поводу, в net.ipv4 и net.core через sysctl (может не то менял?)

Отключил flow control в сетевой карте, пробовал менять параметры через ethtool -G

Вот конфиги сервера:

# ifconfig

eth0      Link encap:Ethernet  HWaddr 00:30:48:80:E5:34

          inet addr:x.x.x.x  Bcast:x.x.x.y  Mask:255.255.255.192

          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1

          RX packets:36738535 errors:0 dropped:0 overruns:0 frame:0

          TX packets:53736665 errors:0 dropped:0 overruns:0 carrier:0

          collisions:0 txqueuelen:100

          RX bytes:2896754579 (2.6 GiB)  TX bytes:2717593094 (2.5 GiB)

          Base address:0xa000 Memory:fb000000-fb020000

# ethtool -S eth0

NIC statistics:

     rx_packets: 36700345

     tx_packets: 53680021

     rx_bytes: 3040552483

     tx_bytes: 71594361336

     rx_broadcast: 512194

     tx_broadcast: 5

     rx_multicast: 0

     tx_multicast: 0

     rx_errors: 0

     tx_errors: 0

     tx_dropped: 0

     multicast: 0

     collisions: 0

     rx_length_errors: 0

     rx_over_errors: 0

     rx_crc_errors: 0

     rx_frame_errors: 0

     rx_no_buffer_count: 0

     rx_missed_errors: 0

     tx_aborted_errors: 0

     tx_carrier_errors: 0

     tx_fifo_errors: 0

     tx_heartbeat_errors: 0

     tx_window_errors: 0

     tx_abort_late_coll: 0

     tx_deferred_ok: 0

     tx_single_coll_ok: 0

     tx_multi_coll_ok: 0

     tx_timeout_count: 0

     tx_restart_queue: 6781125

     rx_long_length_errors: 0

     rx_short_length_errors: 0

     rx_align_errors: 0

     tx_tcp_seg_good: 172

     tx_tcp_seg_failed: 0

     rx_flow_control_xon: 0

     rx_flow_control_xoff: 0

     tx_flow_control_xon: 0

     tx_flow_control_xoff: 0

     rx_long_byte_count: 3040552483

     rx_csum_offload_good: 36139775

     rx_csum_offload_errors: 118

     rx_header_split: 0

     alloc_rx_buff_failed: 0

     tx_smbus: 0

     rx_smbus: 0

     dropped_smbus: 0


# lspci

00:00.0 Host bridge: Intel Corporation 82875P/E7210 Memory Controller Hub (rev 02)

00:01.0 PCI bridge: Intel Corporation 82875P Processor to AGP Controller (rev 02)

00:03.0 PCI bridge: Intel Corporation 82875P/E7210 Processor to PCI to CSA Bridge (rev 02)

00:06.0 System peripheral: Intel Corporation 82875P/E7210 Processor to I/O Memory Interface (rev 02)

00:1c.0 PCI bridge: Intel Corporation 6300ESB 64-bit PCI-X Bridge (rev 02)

00:1d.0 USB Controller: Intel Corporation 6300ESB USB Universal Host Controller (rev 02)

00:1d.1 USB Controller: Intel Corporation 6300ESB USB Universal Host Controller (rev 02)

00:1d.4 System peripheral: Intel Corporation 6300ESB Watchdog Timer (rev 02)

00:1d.5 PIC: Intel Corporation 6300ESB I/O Advanced Programmable Interrupt Controller (rev 02)

00:1d.7 USB Controller: Intel Corporation 6300ESB USB2 Enhanced Host Controller (rev 02)

00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev 0a)

00:1f.0 ISA bridge: Intel Corporation 6300ESB LPC Interface Controller (rev 02)

00:1f.1 IDE interface: Intel Corporation 6300ESB PATA Storage Controller (rev 02)

00:1f.2 IDE interface: Intel Corporation 6300ESB SATA Storage Controller (rev 02)

00:1f.3 SMBus: Intel Corporation 6300ESB SMBus Controller (rev 02)

02:01.0 Ethernet controller: Intel Corporation 82547GI Gigabit Ethernet Controller

04:09.0 VGA compatible controller: ATI Technologies Inc Rage XL (rev 27)

04:0a.0 Ethernet controller: Intel Corporation 82541GI Gigabit Ethernet Controller

Приватный linux-администратор

V

128

vapetrov

26 августа 2009, 21:18

#1

# dmesg

Linux version 2.6.18-128.7.1.el5 (mockbuild@builder16.centos.org) (gcc version 4.1.2 20080704 (Red Hat 4.1.2-44)) #1 SMP Mon Aug 24 08:20:55 EDT 2009

BIOS-provided physical RAM map:

 BIOS-e820: 0000000000000000 - 000000000009f800 (usable)

 BIOS-e820: 000000000009f800 - 00000000000a0000 (reserved)

 BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved)

 BIOS-e820: 0000000000100000 - 00000000efee0000 (usable)

 BIOS-e820: 00000000efee0000 - 00000000efee3000 (ACPI NVS)

 BIOS-e820: 00000000efee3000 - 00000000efef0000 (ACPI data)

 BIOS-e820: 00000000efef0000 - 00000000eff00000 (reserved)

 BIOS-e820: 00000000fec00000 - 0000000100000000 (reserved)

2942MB HIGHMEM available.

896MB LOWMEM available.

found SMP MP-table at 000f5b20

Memory for crash kernel (0x0 to 0x0) notwithin permissible range

disabling kdump

Using x86 segment limits to approximate NX protection

On node 0 totalpages: 982752

  DMA zone: 4096 pages, LIFO batch:0

  Normal zone: 225280 pages, LIFO batch:31

  HighMem zone: 753376 pages, LIFO batch:31

DMI 2.3 present.

Using APIC driver default

ACPI: RSDP (v000 IntelR                                ) @ 0x000f77e0

ACPI: RSDT (v001 IntelR AWRDACPI 0x42302e31 AWRD 0x00000000) @ 0xefee3000

ACPI: FADT (v001 IntelR AWRDACPI 0x42302e31 AWRD 0x00000000) @ 0xefee3040

ACPI: MADT (v001 IntelR AWRDACPI 0x42302e31 AWRD 0x00000000) @ 0xefee6fc0

ACPI: DSDT (v001 INTELR AWRDACPI 0x00001000 MSFT 0x0100000e) @ 0x00000000

ACPI: PM-Timer IO Port: 0x408

ACPI: Local APIC address 0xfee00000

ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)

Processor #0 15:3 APIC version 20

ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)

Processor #1 15:3 APIC version 20

ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])

ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])

ACPI: IOAPIC (id[0x02] address[0xfec00000] gsi_base[0])

IOAPIC[0]: apic_id 2, version 32, address 0xfec00000, GSI 0-23

ACPI: IOAPIC (id[0x03] address[0xfec10000] gsi_base[24])

IOAPIC[1]: apic_id 3, version 32, address 0xfec10000, GSI 24-47

ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)

ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)

ACPI: IRQ0 used by override.

ACPI: IRQ2 used by override.

ACPI: IRQ9 used by override.

Enabling APIC mode:  Flat.  Using 2 I/O APICs

Using ACPI (MADT) for SMP configuration information

Allocating PCI resources starting at f0000000 (gap: eff00000:0ed00000)

Detected 2795.389 MHz processor.

Built 1 zonelists.  Total pages: 982752

Kernel command line: ro root=LABEL=/

mapped APIC to ffffd000 (fee00000)

mapped IOAPIC to ffffc000 (fec00000)

mapped IOAPIC to ffffb000 (fec10000)

Enabling fast FPU save and restore... done.

Enabling unmasked SIMD FPU exception support... done.

Initializing CPU#0

CPU 0 irqstacks, hard=c0754000 soft=c0734000

PID hash table entries: 4096 (order: 12, 16384 bytes)

Console: colour VGA+ 80x25

Dentry cache hash table entries: 131072 (order: 7, 524288 bytes)

Inode-cache hash table entries: 65536 (order: 6, 262144 bytes)

Memory: 3891484k/3931008k available (2123k kernel code, 38228k reserved, 882k data, 228k init, 3013504k highmem)

Checking if this processor honours the WP bit even in supervisor mode... Ok.

Calibrating delay using timer specific routine.. 5592.85 BogoMIPS (lpj=2796428)

Security Framework v1.0.0 initialized

SELinux:  Initializing.

SELinux:  Starting in permissive mode

selinux_register_security:  Registering secondary module capability

Capability LSM initialized as secondary

Mount-cache hash table entries: 512

CPU: After generic identify, caps: bfebfbff 00000000 00000000 00000000 0000041d 00000000 00000000

CPU: After vendor identify, caps: bfebfbff 00000000 00000000 00000000 0000041d 00000000 00000000

monitor/mwait feature present.

using mwait in idle threads.

CPU: Trace cache: 12K uops, L1 D cache: 16K

CPU: L2 cache: 1024K

CPU: Physical Processor ID: 0

CPU: After all inits, caps: bfebf3ff 00000000 00000000 00000180 0000041d 00000000 00000000

Intel machine check architecture supported.

Intel machine check reporting enabled on CPU#0.

CPU0: Intel P4/Xeon Extended MCE MSRs (12) available

CPU0: Thermal monitoring enabled

Checking 'hlt' instruction... OK.

SMP alternatives: switching to UP code

ACPI: Core revision 20060707

CPU0: Intel(R) Pentium(R) 4 CPU 2.80GHz stepping 03

SMP alternatives: switching to SMP code

Booting processor 1/1 eip 3000

CPU 1 irqstacks, hard=c0755000 soft=c0735000

Initializing CPU#1

Calibrating delay using timer specific routine.. 5589.69 BogoMIPS (lpj=2794846)

CPU: After generic identify, caps: bfebfbff 00000000 00000000 00000000 0000041d 00000000 00000000

CPU: After vendor identify, caps: bfebfbff 00000000 00000000 00000000 0000041d 00000000 00000000

monitor/mwait feature present.

CPU: Trace cache: 12K uops, L1 D cache: 16K

CPU: L2 cache: 1024K

CPU: Physical Processor ID: 0

CPU: After all inits, caps: bfebf3ff 00000000 00000000 00000180 0000041d 00000000 00000000

Intel machine check architecture supported.

Intel machine check reporting enabled on CPU#1.

CPU1: Intel P4/Xeon Extended MCE MSRs (12) available

CPU1: Thermal monitoring enabled

CPU1: Intel(R) Pentium(R) 4 CPU 2.80GHz stepping 03

Total of 2 processors activated (11182.54 BogoMIPS).

ENABLING IO-APIC IRQs

..TIMER: vector=0x31 apic1=0 pin1=2 apic2=-1 pin2=-1

checking TSC synchronization across 2 CPUs: passed.

Brought up 2 CPUs

sizeof(vma)=84 bytes

sizeof(page)=32 bytes

sizeof(inode)=340 bytes

sizeof(dentry)=136 bytes

sizeof(ext3inode)=492 bytes

sizeof(buffer_head)=52 bytes

sizeof(skbuff)=172 bytes

migration_cost=74

checking if image is initramfs... it is

Freeing initrd memory: 2497k freed

NET: Registered protocol family 16

No dock devices found.

ACPI: bus type pci registered

PCI: PCI BIOS revision 2.10 entry at 0xfb860, last bus=4

PCI: Using configuration type 1

Setting up standard PCI resources

ACPI: Interpreter enabled

ACPI: Using IOAPIC for interrupt routing

ACPI: PCI Root Bridge [PCI0] (0000:00)

PCI quirk: region 0400-047f claimed by ICH4 ACPI/GPIO/TCO

PCI quirk: region 0480-04bf claimed by ICH4 GPIO

PCI: Ignoring BAR0-3 of IDE controller 0000:00:1f.1

Boot video device is 0000:04:09.0

PCI: Transparent bridge - 0000:00:1e.0

ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT]

ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.CSAB._PRT]

ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.HUB0._PRT]

ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.HRB_._PRT]

ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 *5 7 9 10 11 12 14 15)

ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 7 9 10 11 *12 14 15)

ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 7 9 10 *11 12 14 15)

ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 7 9 *10 11 12 14 15)

ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 7 9 10 11 12 14 15) *0, disabled.

ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 7 9 10 11 12 14 15) *0, disabled.

ACPI: PCI Interrupt Link [LNK0] (IRQs 3 4 5 7 9 10 11 12 14 15) *0, disabled.

ACPI: PCI Interrupt Link [LNK1] (IRQs 3 4 5 7 *9 10 11 12 14 15)

Linux Plug and Play Support v0.97 (c) Adam Belay

pnp: PnP ACPI init

pnp: PnP ACPI: found 14 devices

usbcore: registered new driver usbfs

usbcore: registered new driver hub

PCI: Using ACPI for IRQ routing

PCI: If a device doesn't work, try "pci=routeirq".  If it helps, post a report

NetLabel: Initializing

NetLabel:  domain hash size = 128

NetLabel:  protocols = UNLABELED CIPSOv4

NetLabel:  unlabeled traffic allowed by default

pnp: 00:0b: ioport range 0x400-0x4bf could not be reserved

PCI: Bridge: 0000:00:01.0

  IO window: disabled.

  MEM window: disabled.

  PREFETCH window: disabled.

PCI: Bridge: 0000:00:03.0

  IO window: a000-afff

  MEM window: fb000000-fb0fffff

  PREFETCH window: disabled.

PCI: Bridge: 0000:00:1c.0

  IO window: disabled.

  MEM window: disabled.

  PREFETCH window: disabled.

PCI: Bridge: 0000:00:1e.0

  IO window: b000-bfff

  MEM window: f8000000-faffffff

  PREFETCH window: fb200000-fb2fffff

PCI: Setting latency timer of device 0000:00:1e.0 to 64

NET: Registered protocol family 2

IP route cache hash table entries: 32768 (order: 5, 131072 bytes)

TCP established hash table entries: 131072 (order: 8, 1048576 bytes)

TCP bind hash table entries: 65536 (order: 7, 524288 bytes)

TCP: Hash tables configured (established 131072 bind 65536)

TCP reno registered

apm: BIOS version 1.2 Flags 0x07 (Driver version 1.16ac)

apm: disabled - APM is not SMP safe.

audit: initializing netlink socket (disabled)

type=2000 audit(1251321124.066:1): initialized

highmem bounce pool size: 64 pages

Total HugeTLB memory allocated, 0

VFS: Disk quotas dquot_6.5.1

Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)

SELinux:  Registering netfilter hooks

Initializing Cryptographic API

alg: No test for crc32c (crc32c-generic)

ksign: Installing public key data

V

128

vapetrov

26 августа 2009, 21:18

#2

продолжение dmesg

Loading keyring

- Added public key 3AA42D05590DB7E0

- User ID: CentOS (Kernel Module GPG key)

io scheduler noop registered

io scheduler anticipatory registered

io scheduler deadline registered

io scheduler cfq registered (default)

pci_hotplug: PCI Hot Plug PCI Core version: 0.5

ACPI: Fan [FAN] (on)

ACPI: Thermal Zone [THRM] (0 C)

Real Time Clock Driver v1.12ac

Non-volatile memory driver v1.2

Linux agpgart interface v0.101 (c) Dave Jones

agpgart: Detected an Intel i875 Chipset.

agpgart: AGP aperture is 128M @ 0xf0000000

Serial: 8250/16550 driver $Revision: 1.90 $ 4 ports, IRQ sharing enabled

serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A

serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A

00:07: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A

00:08: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A

RAMDISK driver initialized: 16 RAM disks of 16384K size 4096 blocksize

Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2

ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx

ICH5: IDE controller at PCI slot 0000:00:1f.1

ACPI: PCI Interrupt 0000:00:1f.1[A] -> GSI 18 (level, low) -> IRQ 169

ICH5: chipset revision 2

ICH5: not 100% native mode: will probe irqs later

    ide0: BM-DMA at 0xf000-0xf007, BIOS settings: hda:DMA, hdb:pio

    ide1: BM-DMA at 0xf008-0xf00f, BIOS settings: hdc:DMA, hdd:pio

Probing IDE interface ide0...

Probing IDE interface ide1...

Probing IDE interface ide0...

Probing IDE interface ide1...

ide-floppy driver 0.99.newide

usbcore: registered new driver hiddev

usbcore: registered new driver usbhid

drivers/usb/input/hid-core.c: v2.6:USB HID core driver

PNP: PS/2 Controller [PNP0303:PS2K] at 0x60,0x64 irq 1

PNP: PS/2 controller doesn't have AUX irq; using default 12

serio: i8042 KBD port at 0x60,0x64 irq 1

mice: PS/2 mouse device common for all mice

md: md driver 0.90.3 MAX_MD_DEVS=256, MD_SB_DISKS=27

md: bitmap version 4.39

TCP bic registered

Initializing IPsec netlink socket

NET: Registered protocol family 1

NET: Registered protocol family 17

Using IPI No-Shortcut mode

ACPI: (supports S0 S1 S4 S5)

Time: tsc clocksource has been installed.

Freeing unused kernel memory: 228k freed

Write protecting the kernel read-only data: 397k

ACPI: PCI Interrupt 0000:00:1d.7[D] -> GSI 23 (level, low) -> IRQ 177

PCI: Setting latency timer of device 0000:00:1d.7 to 64

ehci_hcd 0000:00:1d.7: EHCI Host Controller

ehci_hcd 0000:00:1d.7: new USB bus registered, assigned bus number 1

PCI: cache line size of 128 is not supported by device 0000:00:1d.7

ehci_hcd 0000:00:1d.7: irq 177, io mem 0xfb100000

ehci_hcd 0000:00:1d.7: USB 2.0 started, EHCI 1.00, driver 10 Dec 2004

usb usb1: configuration #1 chosen from 1 choice

hub 1-0:1.0: USB hub found

hub 1-0:1.0: 4 ports detected

ohci_hcd: 2005 April 22 USB 1.1 'Open' Host Controller (OHCI) Driver (PCI)

USB Universal Host Controller Interface driver v3.0

ACPI: PCI Interrupt 0000:00:1d.0[A] -> GSI 16 (level, low) -> IRQ 185

PCI: Setting latency timer of device 0000:00:1d.0 to 64

uhci_hcd 0000:00:1d.0: UHCI Host Controller

uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2

uhci_hcd 0000:00:1d.0: irq 185, io base 0x0000c400

usb usb2: configuration #1 chosen from 1 choice

hub 2-0:1.0: USB hub found

hub 2-0:1.0: 2 ports detected

ACPI: PCI Interrupt 0000:00:1d.1 -> GSI 19 (level, low) -> IRQ 193

PCI: Setting latency timer of device 0000:00:1d.1 to 64

uhci_hcd 0000:00:1d.1: UHCI Host Controller

uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3

uhci_hcd 0000:00:1d.1: irq 193, io base 0x0000c000

usb usb3: configuration #1 chosen from 1 choice

hub 3-0:1.0: USB hub found

hub 3-0:1.0: 2 ports detected

SCSI subsystem initialized

libata version 3.00 loaded.

ata_piix 0000:00:1f.2: version 2.12

ACPI: PCI Interrupt 0000:00:1f.2[A] -> GSI 18 (level, low) -> IRQ 169

ata_piix 0000:00:1f.2: MAP [ P0 -- P1 -- ]

PCI: Setting latency timer of device 0000:00:1f.2 to 64

scsi0 : ata_piix

scsi1 : ata_piix

ata1: SATA max UDMA/133 cmd 0xc800 ctl 0xcc00 bmdma 0xd800 irq 169

ata2: SATA max UDMA/133 cmd 0xd000 ctl 0xd400 bmdma 0xd808 irq 169

ata1.00: ATA-6: WDC WD2000JD-00HBB0, 08.02D08, max UDMA/133

ata1.00: 390721968 sectors, multi 1: LBA48

ata1.00: configured for UDMA/133

ata2.00: ATA-6: WDC WD2000JD-00HBB0, 08.02D08, max UDMA/133

ata2.00: 390721968 sectors, multi 1: LBA48

ata2.00: configured for UDMA/133

  Vendor: ATA       Model: WDC WD2000JD-00H  Rev: 08.0

  Type:   Direct-Access                      ANSI SCSI revision: 05

SCSI device sda: 390721968 512-byte hdwr sectors (200050 MB)

sda: Write Protect is off

sda: Mode Sense: 00 3a 00 00

SCSI device sda: drive cache: write back

SCSI device sda: 390721968 512-byte hdwr sectors (200050 MB)

sda: Write Protect is off

sda: Mode Sense: 00 3a 00 00

SCSI device sda: drive cache: write back

 sda: sda1 sda2 sda3 sda4

sd 0:0:0:0: Attached scsi disk sda

  Vendor: ATA       Model: WDC WD2000JD-00H  Rev: 08.0

  Type:   Direct-Access                      ANSI SCSI revision: 05

SCSI device sdb: 390721968 512-byte hdwr sectors (200050 MB)

sdb: Write Protect is off

sdb: Mode Sense: 00 3a 00 00

SCSI device sdb: drive cache: write back

SCSI device sdb: 390721968 512-byte hdwr sectors (200050 MB)

sdb: Write Protect is off

sdb: Mode Sense: 00 3a 00 00

SCSI device sdb: drive cache: write back

 sdb: sdb1

sd 1:0:0:0: Attached scsi disk sdb

Initializing USB Mass Storage driver...

usbcore: registered new driver usb-storage

USB Mass Storage support registered.

device-mapper: uevent: version 1.0.3

device-mapper: ioctl: 4.11.5-ioctl (2007-12-12) initialised: dm-devel@redhat.com

device-mapper: dm-raid45: initialized v0.2429

kjournald starting.  Commit interval 5 seconds

EXT3-fs: mounted filesystem with ordered data mode.

SELinux:  Disabled at runtime.

SELinux:  Unregistering netfilter hooks

type=1404 audit(1251321156.000:2): selinux=0 auid=4294967295 ses=4294967295

parport: PnPBIOS parport detected.

parport0: PC-style at 0x378, irq 7 [PCSPP,TRISTATE]

intel_rng: FWH not detected

i6300ESB timer: initialized (0xf88c8000). heartbeat=30 sec (nowayout=0)

EDAC MC: Ver: 2.0.1 Aug 24 2009

sd 0:0:0:0: Attached scsi generic sg0 type 0

Intel(R) PRO/1000 Network Driver - version 7.3.20-k2-NAPI

Copyright (c) 1999-2006 Intel Corporation.

ACPI: PCI Interrupt 0000:02:01.0[A] -> GSI 18 (level, low) -> IRQ 169

PCI: Setting latency timer of device 0000:02:01.0 to 64

sd 1:0:0:0: Attached scsi generic sg1 type 0

e1000: 0000:02:01.0: e1000_probe: (PCI:33MHz:32-bit) 00:30:48:80:e5:34

input: PC Speaker as /class/input/input0

e1000: eth0: e1000_probe: Intel(R) PRO/1000 Network Connection

ACPI: PCI Interrupt 0000:04:0a.0[A] -> GSI 19 (level, low) -> IRQ 193

e1000: 0000:04:0a.0: e1000_probe: (PCI:33MHz:32-bit) 00:30:48:80:e5:35

e1000: eth1: e1000_probe: Intel(R) PRO/1000 Network Connection

EDAC i82875p: i82875p init one

ACPI: PCI Interrupt 0000:00:1f.3 -> GSI 17 (level, low) -> IRQ 201

PCI: Unable to reserve mem region #1:1000@fecf0000 for device 0000:00:06.0

EDAC MC0: Giving out device to i82875p_edac i82875p: DEV 0000:00:00.0

FDC 0 is a post-1991 82077

lp0: using parport0 (interrupt-driven).

lp0: console ready

ACPI: Power Button (FF) [PWRF]

ACPI: Power Button (CM) [PWRB]

md: Autodetecting RAID arrays.

md: autorun ...

md: ... autorun DONE.

device-mapper: multipath: version 1.0.5 loaded

EXT3 FS on sda2, internal journal

kjournald starting.  Commit interval 5 seconds

EXT3 FS on sda3, internal journal

EXT3-fs: mounted filesystem with ordered data mode.

kjournald starting.  Commit interval 5 seconds

EXT3-fs warning: maximal mount count reached, running e2fsck is recommended

EXT3 FS on sda1, internal journal

EXT3-fs: mounted filesystem with ordered data mode.

kjournald starting.  Commit interval 5 seconds

EXT3-fs warning: maximal mount count reached, running e2fsck is recommended

EXT3 FS on sdb1, internal journal

EXT3-fs: mounted filesystem with ordered data mode.

Adding 2096472k swap on /dev/sda4.  Priority:-1 extents:1 across:2096472k

IA-32 Microcode Update Driver: v1.14a <tigran@veritas.com>

microcode: CPU1 updated from revision 0xb to 0xc, date = 04212005

microcode: CPU0 updated from revision 0xb to 0xc, date = 04212005

ip_tables: (C) 2000-2006 Netfilter Core Team

Netfilter messages via NETLINK v0.30.

ip_conntrack version 2.4 (8192 buckets, 65536 max) - 228 bytes per conntrack

e1000: eth0: e1000_watchdog_task: NIC Link is Up 100 Mbps Full Duplex, Flow Control: RX

e1000: eth0: e1000_set_tso: TSO is Disabled

10

gor-

27 августа 2009, 01:08

#3

vapetrov:
Отключение фаирвола ничего не дает.

Как именно отключался? выгружались модули или просто очищались правила?

IT Patrol inc. Хостинг (http://it-patrol.ru/drupal_hosting) | Сайты на Drupal | Iphone App & etc...

N

419

netwind

27 августа 2009, 07:00

#4

это dmesg при старте. а во время возникновения проблем есть еще сообщения в dmesg?

скорее всего надо увеличить sysclt net.core.wmem_max и net.ipv4.tcp_wmem

в худшем случае вы достигли предела любезности провайдера в 60-70 мегабит.

Кнопка вызова админа ()

40

qwartyr

27 августа 2009, 07:05

#5

в /etc/sysctl.conf

net.core.rmem_max = 16777216

net.core.wmem_max = 16777216

net.ipv4.tcp_rmem = 4096 87380 16777216

net.ipv4.tcp_wmem = 4096 65536 16777216

net.ipv4.tcp_max_syn_backlog="2048"

а потом sysctl -p

профессиональное администрирование серверов (http://www.unixsupport.ru) отзывы (http://www.free-lance.ru/users/qwartyr/opinions/) на free-lance.ru

822

Andreyka

27 августа 2009, 10:24

#6

А еще можно поменять алгоритм tcp, если ядро позволяет

Не стоит плодить сущности без необходимости

V

128

vapetrov

27 августа 2009, 13:09

#7

qwartyr:
в /etc/sysctl.conf
net.core.rmem_max = 16777216
net.core.wmem_max = 16777216
net.ipv4.tcp_rmem = 4096 87380 16777216
net.ipv4.tcp_wmem = 4096 65536 16777216
net.ipv4.tcp_max_syn_backlog="2048"

а потом sysctl -p

пробовал с подобными настройками

немного лучше, но при 80 мбитах все равно начинаются тормоза и потери...

пробовал менять net.ipv4.tcp_congestion_control на htcp и прочие - эффекта нет

фаирвол отключал через service iptables stop, при этом модули выгружаются

и после всех изменений ошибка осталась:

# traceroute host.com
traceroute to host.com (216.57.210.200), 30 hops max, 40 byte packets
send: No buffer space available

:(

какие это могут быть буферы?

в худшем случае вы достигли предела любезности провайдера в 60-70 мегабит

Провайдер Мастерхост.

Можно подробнее, что в данном случае зависит от провайдера?

N

419

netwind

27 августа 2009, 13:21

#8

vapetrov, 80Мбит это уже практически потолок. Чем вы меряли загрузку сетевой карты, mrtg ?

10

gor-

27 августа 2009, 13:42

#9

vapetrov:
фаирвол отключал через service iptables stop, при этом модули выгружаются

после выгрузки файрвола - покажите lsmod

VN

34

V@NEK

27 августа 2009, 16:43

#10

no buffer space avaiable на время помогает перезагрузка сетевого интерфейса.

Зачем быть уникальным в мире, где все можно скопировать

Курс биткоина превысил $50 тысяч