welcome to my space

Latest Entries
Mar 12

Optimization Request (utilizing excessive resources)

  • my host says,
    Your account is utilizing excessive resources, causing a significant
    degradation of services on the server. This is a shared environment and we can
    not allow one user to utilize the majority of the resources on a server as it
    affects all users adversely. Because of this, you have been temporarily moved
    to the *** server. A detail of the problem is shown below:

    User Domain %CPU %MEM Mysql Processes
    numturk2 4umturk.com 5.12 2.05 0.0
    Top Process %CPU 99.9 /usr/bin/php
    Top Process %CPU 97.5 /usr/bin/php
    Top Process %CPU 96.7 /usr/bin/php

    blap blap blap.......


    I deleted old vb 3.5.3. version and my database and I installed fresh vb 3.5.4 and new database,and I moved only forum,user,thread and post tables,I have only 257 forums on my board


    1. 300 accounts
    2. 3.02GHz Dual Xeon
    4GB
    300GB HD
    Redhat based Linux OS

    my server configration is:

    Server Type Linux
    Web Server Apache v1.3.34 (cgi)
    PHP 4.4.1
    PHP Max Post Size 55.00 MB
    PHP Maximum Upload Size 2.00 MB
    PHP Memory Limit None
    MySQL Version 4.0.25-standard
    MySQL Packet Size 15.00 MB

    Bandwidth per Month
    400 GB/Month ,I use 3-5 GB per Month
    host name:lunarpages.com

    3. /etc/my.cnf


    6. MySQL Variables
    back_log 50
    basedir /
    binlog_cache_size 32768
    bulk_insert_buffer_size 8388608
    character_set latin1
    character_sets latin1 big5 czech euc_kr gb2312 gbk latin1_de sjis tis620 ujis dec8 dos german1 hp8 koi8_ru latin2 swe7 usa7 cp1251 danish hebrew win1251 estonia hungarian koi8_ukr win1251ukr greek win1250 croat cp1257 latin5
    concurrent_insert ON
    connect_timeout 5
    convert_character_set
    datadir /var/lib/mysql/
    default_week_format 0
    delay_key_write ON
    delayed_insert_limit 100
    delayed_insert_timeout 300
    delayed_queue_size 1000
    flush OFF
    flush_time 0
    ft_boolean_syntax + -><()~*:""&
    ft_min_word_len 4
    ft_max_word_len 254
    ft_max_word_len_for_sort 20
    ft_stopword_file (built-in)
    have_bdb NO
    have_crypt YES
    have_innodb DISABLED
    have_isam YES
    have_raid NO
    have_symlink YES
    have_openssl NO
    have_query_cache YES
    init_file
    innodb_additional_mem_pool_size 1048576
    innodb_autoextend_increment 8
    innodb_buffer_pool_size 8388608
    innodb_data_file_path
    innodb_data_home_dir
    innodb_file_io_threads 4
    innodb_force_recovery 0
    innodb_thread_concurrency 8
    innodb_flush_log_at_trx_commit 1
    innodb_fast_shutdown ON
    innodb_flush_method
    innodb_lock_wait_timeout 50
    innodb_log_arch_dir
    innodb_log_archive OFF
    innodb_log_buffer_size 1048576
    innodb_log_file_size 5242880
    innodb_log_files_in_group 2
    innodb_log_group_home_dir
    innodb_mirrored_log_groups 1
    innodb_max_dirty_pages_pct 90
    innodb_max_purge_lag 0
    innodb_table_locks ON
    interactive_timeout 28800
    join_buffer_size 131072
    key_buffer_size 67108864
    language /usr/share/mysql/english/
    large_files_support ON
    license GPL
    local_infile ON
    locked_in_memory OFF
    log OFF
    log_update OFF
    log_bin OFF
    log_slave_updates OFF
    log_slow_queries OFF
    log_warnings 1
    long_query_time 10
    low_priority_updates OFF
    lower_case_file_system OFF
    lower_case_table_names 0
    max_allowed_packet 15727616
    max_binlog_cache_size 4294967295
    max_binlog_size 1073741824
    max_connections 1500
    max_connect_errors 100000
    max_delayed_threads 20
    max_insert_delayed_threads 20
    max_heap_table_size 16777216
    max_join_size 4294967295
    max_relay_log_size 0
    max_seeks_for_key 4294967295
    max_sort_length 1024
    max_user_connections 50
    max_tmp_tables 32
    max_write_lock_count 4294967295
    myisam_max_extra_sort_file_size 268435456
    myisam_max_sort_file_size 2147483647
    myisam_repair_threads 1
    myisam_recover_options OFF
    myisam_sort_buffer_size 8388608
    net_buffer_length 16384
    net_read_timeout 30
    net_retry_count 10
    net_write_timeout 60
    new OFF
    open_files_limit 8096
    pid_file /var/lib/mysql/arneb.lunarpages.com.pid
    log_error
    port 3306
    protocol_version 10
    query_alloc_block_size 8192
    query_cache_limit 1048576
    query_cache_size 33554432
    query_cache_type ON
    query_cache_wlock_invalidate OFF
    query_prealloc_size 8192
    range_alloc_block_size 2048
    read_buffer_size 1044480
    read_only OFF
    read_rnd_buffer_size 262144
    rpl_recovery_rank 0
    server_id 0
    slave_net_timeout 3600
    skip_external_locking ON
    skip_networking OFF
    skip_show_database OFF
    slow_launch_time 2
    socket /var/lib/mysql/mysql.sock
    sort_buffer_size 4194296
    sql_mode 0
    table_cache 256
    table_type MYISAM
    thread_cache_size 0
    thread_stack 126976
    tx_isolation REPEATABLE-READ
    timezone PST
    tmp_table_size 33554432
    tmpdir /tmp/
    transaction_alloc_block_size 8192
    transaction_prealloc_size 4096
    version 4.0.25-standard
    version_comment Official MySQL RPM
    version_compile_os pc-linux-gnu
    wait_timeout 200


    7. MySQL Status
    Aborted_clients 772
    Aborted_connects 138
    Bytes_received 2893072751
    Bytes_sent 1442845732
    Com_admin_commands 5466
    Com_alter_table 18
    Com_analyze 0
    Com_backup_table 0
    Com_begin 0
    Com_change_db 3421958
    Com_change_master 0
    Com_check 6
    Com_commit 0
    Com_create_db 5
    Com_create_function 0
    Com_create_index 0
    Com_create_table 76
    Com_delete 100800
    Com_delete_multi 0
    Com_drop_db 1
    Com_drop_function 0
    Com_drop_index 0
    Com_drop_table 1
    Com_flush 30
    Com_grant 53
    Com_ha_close 0
    Com_ha_open 0
    Com_ha_read 0
    Com_insert 895176
    Com_insert_select 12728
    Com_kill 0
    Com_load 0
    Com_load_master_data 0
    Com_load_master_table 0
    Com_lock_tables 15849
    Com_optimize 26
    Com_purge 0
    Com_rename_table 0
    Com_repair 0
    Com_replace 25029
    Com_replace_select 0
    Com_reset 0
    Com_restore_table 0
    Com_revoke 0
    Com_rollback 0
    Com_savepoint 0
    Com_select 7457217
    Com_set_option 337703
    Com_show_binlog_events 0
    Com_show_binlogs 6
    Com_show_create 827
    Com_show_databases 105
    Com_show_fields 425
    Com_show_grants 16
    Com_show_keys 8
    Com_show_logs 0
    Com_show_master_status 0
    Com_show_new_master 0
    Com_show_open_tables 0
    Com_show_processlist 751
    Com_show_slave_hosts 0
    Com_show_slave_status 0
    Com_show_status 752
    Com_show_innodb_status 0
    Com_show_tables 1065
    Com_show_variables 130
    Com_slave_start 0
    Com_slave_stop 0
    Com_truncate 0
    Com_unlock_tables 15849
    Com_update 2290396
    Com_update_multi 327
    Connections 899880
    Created_tmp_disk_tables 4048
    Created_tmp_tables 274808
    Created_tmp_files 0
    Delayed_insert_threads 0
    Delayed_writes 0
    Delayed_errors 0
    Flush_commands 1
    Handler_commit 0
    Handler_delete 190612
    Handler_read_first 335186
    Handler_read_key 120476325
    Handler_read_next 329968219
    Handler_read_prev 833511
    Handler_read_rnd 70921011
    Handler_read_rnd_next 2416276865
    Handler_rollback 0
    Handler_update 4121859
    Handler_write 18881321
    Key_blocks_used 62345
    Key_read_requests 351430022
    Key_reads 116333
    Key_write_requests 4360530
    Key_writes 3218998
    Max_used_connections 99
    Not_flushed_key_blocks 0
    Not_flushed_delayed_rows 0
    Open_tables 256
    Open_files 497
    Open_streams 0
    Opened_tables 13477
    Questions 22919774
    Qcache_queries_in_cache 2888
    Qcache_inserts 6751081
    Qcache_hits 7437207
    Qcache_lowmem_prunes 87071
    Qcache_not_cached 706118
    Qcache_free_memory 12360552
    Qcache_free_blocks 1974
    Qcache_total_blocks 9115
    Rpl_status NULL
    Select_full_join 1548
    Select_full_range_join 29
    Select_range 370225
    Select_range_check 0
    Select_scan 4552070
    Slave_open_temp_tables 0
    Slave_running OFF
    Slow_launch_threads 3
    Slow_queries 21
    Sort_merge_passes 0
    Sort_range 316446
    Sort_rows 129849024
    Sort_scan 359929
    Table_locks_immediate 12191208
    Table_locks_waited 149989
    Threads_cached 0
    Threads_created 899879
    Threads_connected 9
    Threads_running 4
    Uptime 225403


    9. cookie timeout 1800 seconds, 20 or 40 user online on my forum
    10. http://www.4umturk.com/phpinfo.php (http://www.4umturk.com/phpinfo.php)
    12.and my vb version 3.5.4

    Today;
    User Domain %CPU %MEM Mysql Processes
    numturk2 4umturk.com 1.66 0.74 0.0
    Top Process %CPU 72.0 /usr/bin/php
    Top Process %CPU 47.0 /usr/bin/php
    Top Process %CPU 40.0 [php ]


    Best regards


  • ...


  • bad news they said that
    We cannot make these changes to the my.cnf file. As our my.cnf file works fine
    with many other installation of vbulliten. Please let us know once you have
    corrected the issue.


    what will we do now?


  • For my.cnf try this


    [mysqld]
    safe-show-database
    skip-innodb
    max_connections = 1024
    # personally get rid of max_user_connection
    # but for shared hosting you might want to use such a limit
    #max_user_connections 50
    key_buffer = 256M
    myisam_sort_buffer_size = 128M
    join_buffer_size = 1M
    read_buffer_size = 1M
    sort_buffer_size = 3M
    table_cache = 1800
    thread_cache_size = 512
    wait_timeout = 45
    connect_timeout = 10
    tmp_table_size = 256M
    max_heap_table_size = 256M
    max_allowed_packet = 64M
    max_connect_errors = 10
    read_rnd_buffer_size = 524288
    bulk_insert_buffer_size = 8M
    thread_concurrency = 4
    query_cache_limit = 8M
    query_cache_size = 128M
    query_cache_type = 1
    query_prealloc_size = 65536
    query_alloc_block_size = 32768

    [mysqld_safe]
    open_files_limit = 8192

    [mysqldump]
    quick
    max_allowed_packet = 16M

    [myisamchk]
    key_buffer = 64M
    sort_buffer = 64M
    read_buffer = 16M
    write_buffer = 16M

    [mysqlhotcopy]
    interactive-timeout


    you will end up using more memory for mysql which is what improves mysql's performance = more fast memory allocation + fast scsi 15k rpm disks in raid 10.

    Install mysqlreport http://www.vbulletin.com/forum/showthread.php?t=175177 and run and post it's output before and after the new my.cnf is in place


  • yes thanks eva2000,all of them are closed I know..

    I read and applied all things..And at the final I need server optimization.

    and I have no ability mysql my.cnf settings ,my host will change.they are waiting your Optimization.you will suggest,I will sent and they will change


  • i suggest you find a better web host then


  • is this VPS a/c or just shared a/c as the entire server is only using 99 mysql concurrent connections... do you have the ability to recompile PHP and change mysql my.cnf settings ?

    PHP would be better installed as ISAPI instead of CGI but ultimately your web hosts server is over crowded with 300 a/cs and they probably have to be strict on cpu usage

    Ensure that usepconnect in vB config.php is set to 0 for disabled as well.

    If you just upgraded to vB 3.5.x try to disable these 4 options:

    Admin CP -> vBulletin Options -> Forums Home Page Options -> Display Logged in Users?

    Admin CP -> vBulletin Options -> Forum Display Options (forumdisplay) -> Show Users Browsing Forums

    Admin CP -> vBulletin Options -> Thread Display Options -> Show Users Browsing Thread

    Admin CP -> vBulletin Options -> Message Searching Options -> Automatic Similar Thread search

    Probably just better to find a better host with less overcrowded server or less severe restrictions on your usage.


  • thanks eva2000 I sent your suggestion to my host,I am waiting good news,I will return you.







  • #If you have any other info about this subject , Please add it free.#
    Your name:
    E-mail:
    Telphone:

    Your comments:


    If you have any other info about Optimization Request (utilizing excessive resources) , Please add it free.