Запустите mysqltuner - Администрирование серверов

Проблема с MySQL

Продюсер · 2013-01-21T05:04:37.0000000Z

После переустановки системы столкнулся с проблемой, что мускул падает переодически в разное время( закономерности не выявил). Поднять удается только рестартом сервиса mysqld. Пробовал различные конфиги my.ini, все безуспешно. Вот лог(за несколько часов до ): ******************* 130116 20:30:12 InnoDB: Waiting for the background threads to start 130116 20:30:13 InnoDB: 1.1.8 started; log sequence number 1726150 /usr/libexec/mysqld: File './mysql-bin.000013' not found (Errcode: 2) 130116 20:30:13 [ERROR] Failed to open log (file './mysql-bin.000013', errno 2) 130116 20:30:13 [ERROR] Could not open log file 130116 20:30:13 [ERROR] Can't init tc log 130116 20:30:13 [ERROR] Aborting 130116 20:30:13 InnoDB: Starting shutdown... 130116 20:30:14 InnoDB: Shutdown completed; log sequence number 1726150 130116 20:30:14 [Note] /usr/libexec/mysqld: Shutdown complete 130116 20:30:14 mysqld_safe mysqld from pid file /var/run/mysqld/mysqld.pid ended 130116 20:31:01 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql 130116 20:31:01 [Note] Plugin 'FEDERATED' is disabled. 130116 20:31:01 InnoDB: The InnoDB memory heap is disabled 130116 20:31:01 InnoDB: Mutexes and rw_locks use GCC atomic builtins 130116 20:31:01 InnoDB: Compressed tables use zlib 1.2.3 130116 20:31:01 InnoDB: Using Linux native AIO 130116 20:31:01 InnoDB: Initializing buffer pool, size = 128.0M 130116 20:31:01 InnoDB: Completed initialization of buffer pool 130116 20:31:01 InnoDB: highest supported file format is Barracuda. 130116 20:31:01 InnoDB: Waiting for the background threads to start 130116 20:31:02 InnoDB: 1.1.8 started; log sequence number 1726150 /usr/libexec/mysqld: File './mysql-bin.000013' not found (Errcode: 2) 130116 20:31:02 [ERROR] Failed to open log (file './mysql-bin.000013', errno 2) 130116 20:31:02 [ERROR] Could not open log file 130116 20:31:02 [ERROR] Can't init tc log 130116 20:31:02 [ERROR] Aborting 130116 20:31:02 InnoDB: Starting shutdown... 130116 20:31:03 InnoDB: Shutdown completed; log sequence number 1726150 130116 20:31:03 [Note] /usr/libexec/mysqld: Shutdown complete 130116 20:31:03 mysqld_safe mysqld from pid file /var/run/mysqld/mysqld.pid ended 130116 20:34:21 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql 130116 20:34:21 [Note] Plugin 'FEDERATED' is disabled. 130116 20:34:21 InnoDB: The InnoDB memory heap is disabled 130116 20:34:21 InnoDB: Mutexes and rw_locks use GCC atomic builtins 130116 20:34:21 InnoDB: Compressed tables use zlib 1.2.3 130116 20:34:21 InnoDB: Using Linux native AIO 130116 20:34:21 InnoDB: Initializing buffer pool, size = 128.0M 130116 20:34:21 InnoDB: Completed initialization of buffer pool 130116 20:34:21 InnoDB: highest supported file format is Barracuda. 130116 20:34:21 InnoDB: Waiting for the background threads to start 130116 20:34:22 InnoDB: 1.1.8 started; log sequence number 1726150 /usr/libexec/mysqld: File './mysql-bin.000013' not found (Errcode: 2) 130116 20:34:22 [ERROR] Failed to open log (file './mysql-bin.000013', errno 2) 130116 20:34:22 [ERROR] Could not open log file 130116 20:34:22 [ERROR] Can't init tc log 130116 20:34:22 [ERROR] Aborting 130116 20:34:22 InnoDB: Starting shutdown... 130116 20:34:23 InnoDB: Shutdown completed; log sequence number 1726150 130116 20:34:23 [Note] /usr/libexec/mysqld: Shutdown complete 130116 20:34:23 mysqld_safe mysqld from pid file /var/run/mysqld/mysqld.pid ended 130116 20:38:14 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql 130116 20:38:14 [Warning] You need to use --log-bin to make --binlog-format work. 130116 20:38:14 [Note] Plugin 'FEDERATED' is disabled. 130116 20:38:14 InnoDB: The InnoDB memory heap is disabled 130116 20:38:14 InnoDB: Mutexes and rw_locks use GCC atomic builtins 130116 20:38:14 InnoDB: Compressed tables use zlib 1.2.3 130116 20:38:14 InnoDB: Using Linux native AIO 130116 20:38:14 InnoDB: Initializing buffer pool, size = 128.0M 130116 20:38:14 InnoDB: Completed initialization of buffer pool 130116 20:38:14 InnoDB: highest supported file format is Barracuda. 130116 20:38:14 InnoDB: Waiting for the background threads to start 130116 20:38:15 InnoDB: 1.1.8 started; log sequence number 1726150 130116 20:38:15 [Note] Server hostname (bind-address): '0.0.0.0'; port: 3306 130116 20:38:15 [Note] - '0.0.0.0' resolves to '0.0.0.0'; 130116 20:38:15 [Note] Server socket created on IP: '0.0.0.0'. 130116 20:38:15 [Note] Event Scheduler: Loaded 0 events 130116 20:38:15 [Note] /usr/libexec/mysqld: ready for connections. Version: '5.5.28' socket: '/var/lib/mysql/mysql.sock' port: 3306 MySQL Community Server (GPL) 130116 20:42:22 [ERROR] Got an error from thread_id=291, /builddir/build/BUILD/mysql-5.5.28/storage/myisam/ha_myisam.cc:912 130116 20:42:22 [ERROR] MySQL thread id 291, OS thread handle 0x7f93e8c70700, query id 3606 localhost dom Checking table CHECK TABLE `post` 130116 23:37:11 [Warning] IP address '114.80.154.66' could not be resolved: Name or service not known 130117 0:12:51 [Warning] IP address '116.247.118.204' could not be resolved: Name or service not known 130117 17:08:22 mysqld_safe Number of processes running now: 0 130117 17:08:22 mysqld_safe mysqld restarted 130117 20:53:31 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql 130117 20:53:31 [Warning] You need to use --log-bin to make --binlog-format work. 130117 20:53:31 [Note] Plugin 'FEDERATED' is disabled. 130117 20:53:31 InnoDB: The InnoDB memory heap is disabled 130117 20:53:31 InnoDB: Mutexes and rw_locks use GCC atomic builtins 130117 20:53:31 InnoDB: Compressed tables use zlib 1.2.3 130117 20:53:31 InnoDB: Using Linux native AIO 130117 20:53:31 InnoDB: Initializing buffer pool, size = 128.0M 130117 20:53:31 InnoDB: Completed initialization of buffer pool 130117 20:53:31 InnoDB: highest supported file format is Barracuda. 130117 20:53:31 InnoDB: Waiting for the background threads to start 130117 20:53:32 InnoDB: 1.1.8 started; log sequence number 1726150 130117 20:53:32 [Note] Server hostname (bind-address): '0.0.0.0'; port: 3306 130117 20:53:32 [Note] - '0.0.0.0' resolves to '0.0.0.0'; 130117 20:53:32 [Note] Server socket created on IP: '0.0.0.0'. 130117 20:53:32 [Note] Event Scheduler: Loaded 0 events 130117 20:53:32 [Note] /usr/libexec/mysqld: ready for connections. Version: '5.5.28' socket: '/var/lib/mysql/mysql.sock' port: 3306 MySQL Community Server (GPL) 130117 22:12:45 [Warning] IP address '218.93.205.46' could not be resolved: Name or service not known 130118 22:10:33 [Warning] IP address '210.102.55.141' could not be resolved: Name or service not known 130119 2:48:35 [Warning] IP address '219.136.252.240' could not be resolved: Name or service not known 130120 3:48:43 [Warning] IP address '117.28.254.69' could not be resolved: Name or service not known 130121 00:53:15 mysqld_safe Number of processes running now: 0 130121 00:53:15 mysqld_safe mysqld restarted 130121 0:53:15 [Warning] You need to use --log-bin to make --binlog-format work. 130121 0:53:15 [Note] Plugin 'FEDERATED' is disabled. 130121 0:53:15 InnoDB: The InnoDB memory heap is disabled 130121 0:53:15 InnoDB: Mutexes and rw_locks use GCC atomic builtins 130121 0:53:15 InnoDB: Compressed tables use zlib 1.2.3 130121 0:53:15 InnoDB: Using Linux native AIO 130121 0:53:15 InnoDB: Initializing buffer pool, size = 128.0M InnoDB: mmap(137363456 bytes) failed; errno 12 130121 0:53:15 InnoDB: Completed initialization of buffer pool 130121 0:53:15 InnoDB: Fatal error: cannot allocate memory for the buffer pool 130121 0:53:15 [ERROR] Plugin 'InnoDB' init function returned error. 130121 0:53:15 [ERROR] Plugin 'InnoDB' registration as a STORAGE ENGINE failed. 130121 0:53:15 [ERROR] Unknown/unsupported storage engine: InnoDB 130121 0:53:15 [ERROR] Aborting 130121 0:53:15 [Note] /usr/libexec/mysqld: Shutdown complete 130121 00:53:15 mysqld_safe mysqld from pid file /var/run/mysqld/mysqld.pid ended 130121 07:06:40 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql 130121 7:06:40 [Warning] You need to use --log-bin to make --binlog-format work. 130121 7:06:40 [Note] Plugin 'FEDERATED' is disabled. 130121 7:06:40 InnoDB: The InnoDB memory heap is disabled 130121 7:06:40 InnoDB: Mutexes and rw_locks use GCC atomic builtins 130121 7:06:40 InnoDB: Compressed tables use zlib 1.2.3 130121 7:06:40 InnoDB: Using Linux native AIO 130121 7:06:40 InnoDB: Initializing buffer pool, size = 128.0M 130121 7:06:40 InnoDB: Completed initialization of buffer pool 130121 7:06:40 InnoDB: highest supported file format is Barracuda. 130121 7:06:40 InnoDB: Waiting for the background threads to start 130121 7:06:41 InnoDB: 1.1.8 started; log sequence number 1726150 130121 7:06:41 [Note] Server hostname (bind-address): '0.0.0.0'; port: 3306 130121 7:06:41 [Note] - '0.0.0.0' resolves to '0.0.0.0'; 130121 7:06:41 [Note] Server socket created on IP: '0.0.0.0'. 130121 7:06:41 [Note] Event Scheduler: Loaded 0 events 130121 7:06:41 [Note] /usr/libexec/mysqld: ready for connections. Version: '5.5.28' socket: '/var/lib/mysql/mysql.sock' port: 3306 MySQL Community Server (GPL) Как видно все грохнулось в 00:53 и только утром я его перезапустил. Подскажите куда копать? какая еще информация нужна для выяснения проблемы?

MT

49

MarcusTven

21 января 2013, 11:28

#11

Если не используется InnoDB - отключите его с помощью skip-innodb добавив его в секцию [mysqld]

Это отлично, но сами vb форумы перед установкой уже могли пронюхать наличие innodb engine и при инстале сделать импорт таблиц с структурой и форматом innodb. Соответственно, при отключении скорее всего появится сообщение "Unknown table engine 'InnoDB'".

Можно конвертнуть все в майисам но вариант того что скорость работы форума снизится - более чем реален.

Я бы докинул немного памяти, переехал на perconadb, оптимизировал с помощью утилит перконы таблицы, а через пару суток запустил-бы mysqltuner.pl.

marcus@cluster:~$

Оптимизация MYSQL DB - Upgrade MySQL 5.7 до InnoDB в MyISAM

116

Evas EvaSystems

21 января 2013, 11:50

#12

Соответственно, при отключении скорее всего появится сообщение "Unknown table engine 'InnoDB'".

Ключевым словом в моём посте было если. Сперва надо выяснить используется ли? А затем уже принимать решение об отключении или же о тюнинге.

Системный администратор Linux. Настройка, сопровождение и оптимизация серверов. Отзывы - searchengines.guru/ru/forum/1017473

36

Продюсер

21 января 2013, 13:06

#13

Himiko:
можете запустить команду:
mysql -u root -pПАРОЛЬ_ROOT_ОТ_MYSQL -e "select engine from information_schema.tables" | sort | uniq -c
Покажет, какие типы таблиц у вас используются.

2 CSV

1 engine

39 MEMORY

1094 MyISAM

17 PERFORMANCE_SCHEMA

Himiko:
Может есть смысл вообще выключить его. (skip-innodb)

отключил, перестал запускаться mysqld

130121 16:57:01 mysqld_safe mysqld from pid file /var/run/mysqld/mysqld.pid ended
130121 16:58:11 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql
130121 16:58:11 [Warning] You need to use --log-bin to make --binlog-format work.
130121 16:58:11 [Note] Plugin 'FEDERATED' is disabled.
130121 16:58:11 [Note] Plugin 'InnoDB' is disabled.
130121 16:58:11 [ERROR] Unknown/unsupported storage engine: InnoDB
130121 16:58:11 [ERROR] Aborting

130121 16:58:11 [Note] /usr/libexec/mysqld: Shutdown complete

130121 16:58:11 mysqld_safe mysqld from pid file /var/run/mysqld/mysqld.pid ended
130121 16:58:35 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql
130121 16:58:35 [Warning] You need to use --log-bin to make --binlog-format work.
130121 16:58:35 [Note] Plugin 'FEDERATED' is disabled.
130121 16:58:35 InnoDB: The InnoDB memory heap is disabled
130121 16:58:35 InnoDB: Mutexes and rw_locks use GCC atomic builtins
130121 16:58:35 InnoDB: Compressed tables use zlib 1.2.3
130121 16:58:35 InnoDB: Using Linux native AIO
130121 16:58:35 InnoDB: Initializing buffer pool, size = 128.0M
130121 16:58:35 InnoDB: Completed initialization of buffer pool
130121 16:58:35 InnoDB: highest supported file format is Barracuda.
130121 16:58:35 InnoDB: Waiting for the background threads to start
130121 16:58:36 InnoDB: 1.1.8 started; log sequence number 1726150
130121 16:58:36 [Note] Server hostname (bind-address): '0.0.0.0'; port: 3306
130121 16:58:36 [Note] - '0.0.0.0' resolves to '0.0.0.0';
130121 16:58:36 [Note] Server socket created on IP: '0.0.0.0'.
130121 16:58:36 [Note] Event Scheduler: Loaded 0 events
130121 16:58:36 [Note] /usr/libexec/mysqld: ready for connections.
Version: '5.5.28' socket: '/var/lib/mysql/mysql.sock' port: 3306 MySQL Community Server (GPL)
130121 17:07:53 [Note] /usr/libexec/mysqld: Normal shutdown

130121 17:07:53 [Note] Event Scheduler: Purging the queue. 0 events
130121 17:07:53 InnoDB: Starting shutdown...
130121 17:07:54 InnoDB: Shutdown completed; log sequence number 1726150
130121 17:07:54 [Note] /usr/libexec/mysqld: Shutdown complete

130121 17:07:54 mysqld_safe mysqld from pid file /var/run/mysqld/mysqld.pid ended
130121 17:07:54 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql
130121 17:07:54 [Warning] You need to use --log-bin to make --binlog-format work.
130121 17:07:54 [Note] Plugin 'FEDERATED' is disabled.
130121 17:07:54 InnoDB: The InnoDB memory heap is disabled
130121 17:07:54 InnoDB: Mutexes and rw_locks use GCC atomic builtins
130121 17:07:54 InnoDB: Compressed tables use zlib 1.2.3
130121 17:07:54 InnoDB: Using Linux native AIO
130121 17:07:54 InnoDB: Initializing buffer pool, size = 16.0M
130121 17:07:54 InnoDB: Completed initialization of buffer pool
130121 17:07:54 InnoDB: highest supported file format is Barracuda.
130121 17:07:54 InnoDB: Waiting for the background threads to start
130121 17:07:55 InnoDB: 1.1.8 started; log sequence number 1726150
130121 17:07:55 [Note] Server hostname (bind-address): '0.0.0.0'; port: 3306
130121 17:07:55 [Note] - '0.0.0.0' resolves to '0.0.0.0';
130121 17:07:55 [Note] Server socket created on IP: '0.0.0.0'.
130121 17:07:55 [Note] Event Scheduler: Loaded 0 events
130121 17:07:55 [Note] /usr/libexec/mysqld: ready for connections.
Version: '5.5.28' socket: '/var/lib/mysql/mysql.sock' port: 3306 MySQL Community Server (GPL)

на 16 мб буфер изменил, посмотрим что с этого выйдет..

остальное еще не пробывал..

116

Evas EvaSystems

21 января 2013, 13:31

#14

В 5.5 InnoDB стал движком по умолчанию.

Поэтому сперва необходимо это поменять:

default-storage-engine=myisam

а затем уже

skip-innodb

Всё в секции [mysqld], причем default-storage-engine необходимо расположить выше, чем skip-innodb

А вообще с такими ресурсами вам как хлеб необходима оптимизация как mysql сервера, так и самой бд...

также не помешает и код сайтов оптимизировать, избавив его от громоздких и сложных запросов

P.S переходить на InnoDB с такими ресурсами плохая идея.

Вебмастера возвращаются на HTTP, Ускорение сайтов на WordPress Яндекс закрывает Бар и

36

Продюсер

21 января 2013, 13:45

#15

Вроде получилось отключить:

130121 17:07:55 [Note] /usr/libexec/mysqld: ready for connections.
Version: '5.5.28' socket: '/var/lib/mysql/mysql.sock' port: 3306 MySQL Community Server (GPL)
130121 17:42:07 [Note] /usr/libexec/mysqld: Normal shutdown

130121 17:42:07 [Note] Event Scheduler: Purging the queue. 0 events
130121 17:42:07 InnoDB: Starting shutdown...
130121 17:42:08 InnoDB: Shutdown completed; log sequence number 1726150
130121 17:42:08 [Note] /usr/libexec/mysqld: Shutdown complete

130121 17:42:08 mysqld_safe mysqld from pid file /var/run/mysqld/mysqld.pid ended
130121 17:42:09 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql
130121 17:42:09 [Warning] You need to use --log-bin to make --binlog-format work.
130121 17:42:09 [Note] Plugin 'FEDERATED' is disabled.
130121 17:42:09 [Note] Plugin 'InnoDB' is disabled.
130121 17:42:09 [Note] Server hostname (bind-address): '0.0.0.0'; port: 3306
130121 17:42:09 [Note] - '0.0.0.0' resolves to '0.0.0.0';
130121 17:42:09 [Note] Server socket created on IP: '0.0.0.0'.
130121 17:42:09 [Note] Event Scheduler: Loaded 0 events
130121 17:42:09 [Note] /usr/libexec/mysqld: ready for connections.
Version: '5.5.28' socket: '/var/lib/mysql/mysql.sock' port: 3306 MySQL Community Server (GPL)

Потестирую,спасибо.

Добавить ресурсов мне не проблема, но просто зачем переплачивать если можно просто отключить ненужные функции.

A

130

admak

21 января 2013, 14:19

#16

admak:
покажите еще вывод тюнера
https://github.com/rackerhacker/MySQLTuner-perl

наверное, прикольно настраивать вслепую... тюнер запустите, попутно он покажет еще тонкие места.

.............

36

Продюсер

21 января 2013, 15:27

#17

admak:
покажите еще вывод тюнера
https://github.com/rackerhacker/MySQLTuner-perl

вот результат:

[root@92 ~]# ./mysqltuner.pl

>> MySQLTuner 1.2.0 - Major Hayden <major@mhtx.net>
>> Bug reports, feature requests, and downloads at http://mysqltuner.com/
>> Run with '--help' for additional options and output filtering
Please enter your MySQL administrative login: root
Please enter your MySQL administrative password:

-------- General Statistics --------------------------------------------------
[--] Skipped version check for MySQLTuner script
[OK] Currently running supported MySQL version 5.5.28
[OK] Operating on 64-bit architecture

-------- Storage Engine Statistics -------------------------------------------
[--] Status: +Archive -BDB -Federated -InnoDB -ISAM -NDBCluster
[--] Data in MyISAM tables: 364M (Tables: 1063)
[--] Data in PERFORMANCE_SCHEMA tables: 0B (Tables: 17)
[--] Data in MEMORY tables: 1009K (Tables: 8)
[!!] Total fragmented tables: 62

-------- Security Recommendations -------------------------------------------
[OK] All database users have passwords assigned

-------- Performance Metrics -------------------------------------------------
[--] Up for: 1h 42m 10s (140K q [22.967 qps], 9K conn, TX: 4B, RX: 39M)
[--] Reads / Writes: 87% / 13%
[--] Total buffers: 32.0M global + 1.6M per thread (151 max threads)
[OK] Maximum possible memory usage: 277.4M (54% of installed RAM)
[OK] Slow queries: 0% (0/140K)
[OK] Highest usage of available connections: 5% (8/151)
[OK] Key buffer size / total MyISAM indexes: 16.0M/138.7M
[OK] Key buffer hit rate: 98.1% (2M cached / 55K reads)
[!!] Query cache is disabled
[OK] Sorts requiring temporary tables: 0% (0 temp sorts / 17K sorts)
[!!] Joins performed without indexes: 64
[OK] Temporary tables created on disk: 22% (529 on disk / 2K total)
[!!] Thread cache is disabled
[!!] Table cache hit rate: 0% (64 open / 10K opened)
[OK] Open file limit used: 11% (122/1K)
[OK] Table locks acquired immediately: 100% (166K immediate / 166K locks)

-------- Recommendations -----------------------------------------------------
General recommendations:
Run OPTIMIZE TABLE to defragment tables for better performance
MySQL started within last 24 hours - recommendations may be inaccurate
Enable the slow query log to troubleshoot bad queries
Adjust your join queries to always utilize indexes
Set thread_cache_size to 4 as a starting value
Increase table_cache gradually to avoid file descriptor limits
Variables to adjust:
query_cache_size (>= 8M)
join_buffer_size (> 128.0K, or always use indexes with joins)
thread_cache_size (start at 4)
table_cache (> 64)

[root@92 ~]#

116

Evas EvaSystems

21 января 2013, 15:31

#18

62 фрагментированные таблички. Запустите

mysqlcheck -A -o -p

Ну и остальное сделайте, чего советует тюнер. Только с умом, не переусердствуйте. У вас не так много ресурсов.

После сделайте mysql restart, и подождите некое время, затем опять проверьте тюнером...

Руководство «Одноклассников» назвало минувший Интернет реклама - №2 Лучшие SEO-практики по каноникализации

36

Продюсер

21 января 2013, 15:48

#19

спасибо за советы, попробую!

A

130

admak

21 января 2013, 15:57

#20

по тюнеру поставьте пока такие параметры


table_open_cache = 2048

max_connections = 40



thread_cache_size = 8

query_cache_size = 48M

key_buffer_size = 32M



max_heap_table_size = 16M

tmp_table_size = 16M



join_buffer_size = 1M



# если репликацию не используюте, то закомментируйте

#binlog_format=mixed

через часик работы запустите еще раз тюнер и покажите его вывод.

если памяти хватит, то потом увеличим еще кеши.

Вышел новый Яндекс Браузер с YandexGPT и YandexART

Все что нужно знать о DDоS-атаках грамотному менеджеру

Проблема с MySQL