___________________________________________________________________________________________
System: Linux elm3b96.eng 2.4.17-dch2 #15 SMP Thu Feb 28 19:39:04 PST 2002 i686
Total counts
All (8) CPUs
Start time: Fri Mar 1 02:54:32 2002
End time: Fri Mar 1 02:57:48 2002
Delta Time: 196.87 sec.
Hash table slots in use: 259.
Global read lock slots in use: 999.
*************************** Warnings! ******************************
Read Lock table overflowed.
The data in this report may be in error due to this.
************************ End of Warnings! **************************
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
SPINLOCKS HOLD WAIT
UTIL CON MEAN( MAX ) MEAN( MAX )(% CPU) TOTAL NOWAIT SPIN RJECT NAME
14.7% 1.0us( 15ms) 9.4us( 14ms)(10.1%) 115599554 85.3% 14.7% 0.00% *TOTAL*
0.00% 0% 0.9us( 2.2us) 0us 4 100% 0% 0% [0xc3213a34]
0.00% 0% 0.6us( 1.0us) 0us 2 100% 0% 0% kmem_cache_grow+0xa4
0.00% 0% 1.2us( 2.2us) 0us 2 100% 0% 0% kmem_cache_grow+0x1f4
0.00% 0% 0.1us( 0.3us) 0us 120 100% 0% 0% [0xf2fb4658]
0.00% 0% 0.1us( 0.3us) 0us 120 100% 0% 0% sys_rt_sigprocmask+0x18c
0.00% 0% 4.6us( 6.0us) 0us 21 100% 0% 0% [0xf738c910]
0.00% 0% 3.3us( 4.4us) 0us 2 100% 0% 0% unmap_fixup+0x8c
0.00% 0% 4.7us( 6.0us) 0us 19 100% 0% 0% unmap_fixup+0x134
0.00% 1.6% 1.7us( 2.6us) 1.6us( 1.6us)(0.00%) 61 98.4% 1.6% 0% [0xf77f25c8]
0.00% 1.6% 1.7us( 2.6us) 1.6us( 1.6us)(0.00%) 61 98.4% 1.6% 0% unmap_fixup+0xa8
0.00% 0% 1.6us( 5.3us) 0us 787 100% 0% 0% [0xf7b32698]
0.00% 0% 1.6us( 5.3us) 0us 787 100% 0% 0% rh_int_timer_do+0x4c
0.00% 0% 4.9us( 8.2us) 0us 49 100% 0% 0% [0xf7b7b0d0]
0.00% 0% 4.9us( 8.2us) 0us 49 100% 0% 0% dev_watchdog+0x14
0.00% 0% 0.1us( 0.1us) 0us 80 100% 0% 0% [0xf7bb64ec]
0.00% 0% 0.1us( 0.1us) 0us 20 100% 0% 0% shmem_delete_inode+0x68
0.00% 0% 0.1us( 0.1us) 0us 20 100% 0% 0% shmem_get_inode+0x1c
0.00% 0% 0.1us( 0.1us) 0us 20 100% 0% 0% shmem_getpage_locked+0x274
0.00% 0% 0.1us( 0.1us) 0us 20 100% 0% 0% shmem_recalc_inode+0x48
0.00% 0% 3.6us( 38us) 0us 575 100% 0% 0% [0xf7bca810]
0.00% 0% 3.6us( 38us) 0us 575 100% 0% 0% ahc_linux_queue+0x38
0.00% 0% 1.2us( 5.6us) 0us 238 100% 0% 0% allocator_request_lock
0.00% 0% 1.9us( 5.6us) 0us 119 100% 0% 0% scsi_free+0x1c
0.00% 0% 0.4us( 2.6us) 0us 119 100% 0% 0% scsi_malloc+0x48
0.12% 0.04% 0.3us( 57us) 2.0us( 44us)(0.00%) 751188 100% 0.04% 0% arbitration_lock
0.00% 0% 0.4us( 1.5us) 0us 366 100% 0% 0% deny_write_access+0xc
0.12% 0.04% 0.3us( 57us) 2.0us( 44us)(0.00%) 750822 100% 0.04% 0% get_write_access+0xc
0.00% 0% 2.2us( 3.3us) 0us 5 100% 0% 0% bdev_lock
0.00% 0% 2.2us( 3.3us) 0us 5 100% 0% 0% bdget+0x34
0.03% 0% 13us( 56us) 0us 5182 100% 0% 0% call_lock
0.03% 0% 13us( 56us) 0us 5182 100% 0% 0% smp_call_function+0x58
4.4% 9.6% 0.7us( 727us) 4.5us( 731us)(0.34%) 12538156 90.4% 9.6% 0% dcache_lock
0.00% 0% 1.4us( 2.5us) 0us 13 100% 0% 0% autofs4_expire+0x38
0.01% 7.5% 0.3us( 87us) 4.5us( 97us)(0.00%) 94515 92.5% 7.5% 0% d_alloc+0x138
0.03% 12.5% 0.3us( 9.0us) 4.7us( 390us)(0.01%) 194420 87.5% 12.5% 0% d_delete+0x10
0.00% 3.0% 0.2us( 4.6us) 4.4us( 50us)(0.00%) 4220 97.0% 3.0% 0% d_delete+0x94
0.04% 10.3% 0.2us( 66us) 4.3us( 269us)(0.01%) 288936 89.7% 10.3% 0% d_instantiate+0x30
3.8% 9.5% 0.7us( 120us) 4.4us( 731us)(0.28%) 10607473 90.5% 9.5% 0% d_lookup+0x5c
0.02% 10.7% 1.3us( 11us) 4.1us( 149us)(0.00%) 39000 89.3% 10.7% 0% d_move+0x48
0.01% 5.1% 0.2us( 41us) 3.7us( 76us)(0.00%) 94495 94.9% 5.1% 0% d_rehash+0x50
0.00% 2.0% 0.2us( 3.4us) 3.6us( 17us)(0.00%) 1400 98.0% 2.0% 0% d_unhash+0x44
0.44% 10.5% 0.8us( 65us) 4.7us( 547us)(0.04%) 1153349 89.5% 10.5% 0% dput+0x30
0.00% 4.0% 1.2us( 4.4us) 4.0us( 6.9us)(0.00%) 50 96.0% 4.0% 0% link_path_walk+0x2c8
0.00% 4.3% 2.7us( 493us) 3.7us( 28us)(0.00%) 3350 95.7% 4.3% 0% prune_dcache+0x14
0.02% 6.7% 0.9us( 534us) 4.3us( 58us)(0.00%) 51187 93.3% 6.7% 0% prune_dcache+0x148
0.02% 2.6% 5.7us( 727us) 3.7us( 26us)(0.00%) 5748 97.4% 2.6% 0% select_parent+0x20
0.00% 0% 1.3us( 8.5us) 0us 1150 100% 0% 0% device_request_lock
0.00% 0% 0.6us( 5.4us) 0us 575 100% 0% 0% __scsi_release_command+0x14
0.00% 0% 2.0us( 8.5us) 0us 575 100% 0% 0% scsi_allocate_device+0x30
0.00% 0% 2.7us( 35us) 0us 385 100% 0% 0% emergency_lock
0.00% 0% 2.7us( 35us) 0us 385 100% 0% 0% bounce_end_io_write+0x28
1.0% 3.0% 0.9us( 64us) 2.7us( 66us)(0.01%) 2179280 97.0% 3.0% 0% files_lock
0.00% 0% 0.5us( 0.9us) 0us 40 100% 0% 0% check_tty_count+0x10
0.16% 4.3% 0.4us( 58us) 2.8us( 56us)(0.01%) 726332 95.7% 4.3% 0% file_move+0x18
0.12% 2.7% 0.3us( 56us) 2.7us( 66us)(0.00%) 726454 97.3% 2.7% 0% fput+0x80
0.73% 2.1% 2.0us( 64us) 2.4us( 54us)(0.00%) 726454 97.9% 2.1% 0% get_empty_filp+0xc
0.09% 0.03% 8.9us( 204us) 0us 20732 100% 0% 0.03% global_bh_lock
0.09% 0.03% 8.9us( 204us) 0us 20732 100% 0% 0.03% bh_action+0x18
0.09% 0% 8.8us( 15us) 0us 19687 100% 0% 0% i8253_lock
0.09% 0% 8.8us( 15us) 0us 19687 100% 0% 0% timer_interrupt+0x2c
0.03% 0% 2.9us( 9.3us) 0us 19687 100% 0% 0% i8259A_lock
0.03% 0% 2.9us( 9.3us) 0us 19687 100% 0% 0% timer_interrupt+0x90
0.00% 0% 1.6us( 2.1us) 0us 2 100% 0% 0% inet_peer_unused_lock
0.00% 0% 1.6us( 2.1us) 0us 2 100% 0% 0% cleanup_once+0x24
0.35% 0.36% 0.8us( 54us) 2.3us( 44us)(0.00%) 866243 99.6% 0.36% 0% inode_lock
0.07% 0.13% 0.6us( 40us) 2.3us( 7.1us)(0.00%) 222437 99.9% 0.13% 0% __mark_inode_dirty+0x48
0.12% 0.39% 1.2us( 38us) 2.2us( 44us)(0.00%) 194502 99.6% 0.39% 0% get_empty_inode+0x24
0.00% 0% 0.8us( 1.9us) 0us 27 100% 0% 0% get_new_inode+0x34
0.02% 0.31% 2.1us( 47us) 2.0us( 4.6us)(0.00%) 18667 99.7% 0.31% 0% iget4+0x3c
0.05% 0.16% 0.5us( 46us) 2.1us( 6.2us)(0.00%) 194421 99.8% 0.16% 0% insert_inode_hash+0x44
0.08% 0.82% 0.8us( 54us) 2.3us( 11us)(0.00%) 213168 99.2% 0.82% 0% iput+0x78
0.00% 0% 8.0us( 14us) 0us 39 100% 0% 0% sync_unlocked_inodes+0x10
0.01% 0% 1.0us( 7.9us) 0us 22982 100% 0% 0% sync_unlocked_inodes+0x12c
0.01% 0% 3.2us( 42us) 0us 3921 100% 0% 0% io_request_lock
0.00% 0% 1.6us( 15us) 0us 1024 100% 0% 0% __make_request+0xec
0.00% 0% 7.6us( 25us) 0us 575 100% 0% 0% ahc_linux_isr+0x2ec
0.00% 0% 14us( 21us) 0us 22 100% 0% 0% generic_unplug_device+0x10
0.00% 0% 4.3us( 42us) 0us 575 100% 0% 0% scsi_dispatch_cmd+0x11c
0.00% 0% 0.8us( 5.3us) 0us 575 100% 0% 0% scsi_finish_command+0x18
0.00% 0% 3.1us( 12us) 0us 575 100% 0% 0% scsi_queue_next_request+0x18
0.00% 0% 2.9us( 9.1us) 0us 575 100% 0% 0% scsi_request_fn+0x31c
12.6% 11.0% 2.5us( 15ms) 22us( 14ms)( 1.5%) 9879128 89.0% 11.0% 0% kernel_flag
0.00% 0% 34us( 39us) 0us 20 100% 0% 0% chrdev_open+0x4c
0.00% 3.8% 0.8us( 2.3us) 15us( 15us)(0.00%) 26 96.2% 3.8% 0% de_put+0x28
0.45% 14.2% 3407us( 15ms) 1165us(8861us)(0.00%) 261 85.8% 14.2% 0% do_exit+0xe8
2.6% 18.8% 26us( 751us) 58us( 14ms)(0.13%) 192400 81.2% 18.8% 0% ext2_delete_inode+0x80
0.06% 5.2% 0.2us( 65us) 10.0us(2160us)(0.02%) 457925 94.8% 5.2% 0% ext2_free_blocks+0x230
0.08% 10.9% 0.4us( 22us) 14us(4916us)(0.04%) 390997 89.1% 10.9% 0% ext2_new_block+0x564
0.22% 2.5% 0.2us( 63us) 6.0us(4577us)(0.02%) 2576260 97.5% 2.5% 0% ext2_new_block+0x764
0.01% 1.8% 0.2us( 5.3us) 4.9us( 93us)(0.00%) 49946 98.2% 1.8% 0% ext2_new_block+0x7f8
0.00% 0% 3.8us( 4.0us) 0us 20 100% 0% 0% get_chrfops+0x8c
0.67% 17.5% 15us( 409us) 46us( 11ms)(0.04%) 87334 82.5% 17.5% 0% lookup_hash+0x80
0.23% 18.5% 18us( 246us) 23us(4753us)(0.01%) 25600 81.5% 18.5% 0% notify_change+0x64
0.05% 13.6% 15us( 597us) 55us(3650us)(0.00%) 7100 86.4% 13.6% 0% real_lookup+0x64
1.2% 27.7% 36us(6525us) 23us(3432us)(0.03%) 66100 72.3% 27.7% 0% schedule+0x558
0.06% 15.4% 3271us(5158us) 14us( 42us)(0.00%) 39 84.6% 15.4% 0% sync_old_buffers+0x1c
0.00% 7.1% 13us( 21us) 30us( 30us)(0.00%) 14 92.9% 7.1% 0% sys_ioctl+0x4c
0.00% 0% 0.7us( 0.9us) 0us 20 100% 0% 0% sys_llseek+0x88
1.7% 14.1% 0.6us( 107us) 23us(9479us)( 1.1%) 5597000 85.9% 14.1% 0% sys_lseek+0x6c
0.64% 15.8% 32us( 410us) 23us(4994us)(0.01%) 39000 84.2% 15.8% 0% sys_rename+0x1a0
0.00% 0% 9.4us( 11us) 0us 20 100% 0% 0% tty_release+0x1c
0.00% 0% 29us( 71us) 0us 22 100% 0% 0% tty_write+0x1bc
2.9% 24.1% 30us( 516us) 14us(4860us)(0.04%) 192201 75.9% 24.1% 0% vfs_create+0x8c
0.13% 33.4% 114us( 586us) 31us( 540us)(0.00%) 2220 66.6% 33.4% 0% vfs_mkdir+0x88
0.02% 18.0% 17us( 348us) 201us( 13ms)(0.01%) 2400 82.0% 18.0% 0% vfs_rmdir+0x158
0.00% 0% 9.0us( 12us) 0us 3 100% 0% 0% vfs_statfs+0x4c
1.6% 18.3% 17us( 412us) 25us(7784us)(0.06%) 192200 81.7% 18.3% 0% vfs_unlink+0x118
11.7% 22.7% 0.6us( 418us) 8.2us( 468us)( 4.4%) 37608380 77.3% 22.7% 0% kmap_lock
7.0% 23.2% 0.7us( 418us) 8.1us( 455us)( 2.3%) 18804190 76.8% 23.2% 0% kmap_high+0x10
4.6% 22.2% 0.5us( 127us) 8.2us( 468us)( 2.2%) 18804190 77.8% 22.2% 0% kunmap_high+0xc
0.00% 0% 0.7us( 32us) 0us 261 100% 0% 0% lastpid_lock
0.00% 0% 0.7us( 32us) 0us 261 100% 0% 0% get_pid+0x20
10.7% 24.4% 1.5us( 264us) 15us( 947us)( 3.3%) 14339797 75.6% 24.4% 0% lru_list_lock
0.88% 9.9% 0.7us( 79us) 7.6us( 655us)(0.12%) 2420677 90.1% 9.9% 0% buffer_insert_inode_data_queue+0x10
0.29% 19.2% 0.3us( 62us) 8.1us( 559us)(0.17%) 1762000 80.8% 19.2% 0% buffer_insert_inode_queue+0x14
0.03% 18.0% 0.3us( 11us) 12us( 540us)(0.03%) 194528 82.0% 18.0% 0% inode_has_buffers+0x10
0.04% 18.5% 0.4us( 6.5us) 11us( 520us)(0.03%) 194501 81.5% 18.5% 0% invalidate_inode_buffers+0x10
0.00% 7.7% 11us( 264us) 2.7us( 3.6us)(0.00%) 39 92.3% 7.7% 0% kupdate+0x98
3.9% 29.5% 1.6us( 91us) 16us( 947us)( 1.5%) 4921541 70.5% 29.5% 0% refile_buffer+0xc
2.1% 27.6% 1.7us( 87us) 17us( 813us)(0.71%) 2420620 72.4% 27.6% 0% remove_from_queues+0xc
0.00% 8.5% 12us( 45us) 9.0us( 39us)(0.00%) 71 91.5% 8.5% 0% sync_old_buffers+0x74
3.4% 30.1% 2.8us( 156us) 17us( 661us)(0.79%) 2425820 69.9% 30.1% 0% try_to_free_buffers+0x1c
0.00% 0% 0.5us( 3.3us) 0us 522 100% 0% 0% mmlist_lock
0.00% 0% 0.2us( 1.2us) 0us 261 100% 0% 0% copy_mm+0x120
0.00% 0% 0.8us( 3.3us) 0us 261 100% 0% 0% mmput+0x28
7.3% 11.1% 0.8us( 86us) 2.9us( 123us)(0.37%) 18252478 88.9% 11.1% 0% pagecache_lock
0.15% 12.0% 0.5us( 52us) 2.9us( 119us)(0.01%) 578797 88.0% 12.0% 0% __find_get_page+0x18
2.4% 11.4% 0.6us( 86us) 3.0us( 123us)(0.16%) 7539840 88.6% 11.4% 0% __find_lock_page+0xc
0.00% 0% 1.3us( 1.9us) 0us 20 100% 0% 0% add_to_page_cache+0x18
2.1% 12.0% 1.7us( 75us) 3.2us( 122us)(0.06%) 2418401 88.0% 12.0% 0% add_to_page_cache_unique+0x18
0.99% 11.1% 0.7us( 86us) 2.9us( 104us)(0.05%) 2684466 88.9% 11.1% 0% do_generic_file_read+0x1a4
0.00% 12.8% 1.8us( 7.8us) 3.2us( 27us)(0.00%) 5200 87.2% 12.8% 0% do_generic_file_read+0x370
0.00% 0.46% 0.1us( 4.4us) 2.2us( 17us)(0.00%) 22982 99.5% 0.46% 0% filemap_fdatasync+0x1c
0.00% 0.41% 0.1us( 5.6us) 1.8us( 6.9us)(0.00%) 22982 99.6% 0.41% 0% filemap_fdatawait+0x10
0.00% 14.3% 1.1us( 7.0us) 3.8us( 62us)(0.00%) 2225 85.7% 14.3% 0% find_or_create_page+0x38
0.00% 11.2% 1.8us( 7.0us) 3.3us( 31us)(0.00%) 2225 88.8% 11.2% 0% find_or_create_page+0x78
1.0% 9.2% 0.8us( 53us) 2.6us( 91us)(0.04%) 2425840 90.8% 9.2% 0% remove_inode_page+0x28
0.00% 35.0% 0.9us( 2.6us) 2.0us( 4.6us)(0.00%) 20 65.0% 35.0% 0% set_page_dirty+0x24
0.06% 13.4% 1.0us( 52us) 2.8us( 77us)(0.00%) 123640 86.6% 13.4% 0% truncate_inode_pages+0x38
0.57% 10.8% 0.5us( 45us) 2.7us( 85us)(0.04%) 2425840 89.2% 10.8% 0% truncate_list_pages+0x1f8
1.8% 2.6% 0.7us( 80us) 1.9us( 81us)(0.02%) 5118527 97.4% 2.6% 0% pagemap_lru_lock
0.18% 5.7% 1.5us( 80us) 2.1us( 81us)(0.00%) 249625 94.3% 5.7% 0% activate_page+0xc
1.0% 3.6% 0.8us( 73us) 1.8us( 77us)(0.01%) 2434454 96.4% 3.6% 0% lru_cache_add+0x1c
0.58% 1.2% 0.5us( 57us) 2.1us( 74us)(0.00%) 2434448 98.8% 1.2% 0% lru_cache_del+0xc
1.1% 9.9% 4.2us( 30us) 4.6us( 96us)(0.02%) 529037 90.1% 9.9% 0% runqueue_lock
0.52% 10.4% 5.2us( 30us) 4.0us( 35us)(0.01%) 196524 89.6% 10.4% 0% __wake_up+0x5c
0.00% 41.4% 0.4us( 2.0us) 3.6us( 11us)(0.00%) 239 58.6% 41.4% 0% deliver_signal+0x48
0.00% 0.50% 7.5us( 24us) 4.2us( 5.3us)(0.00%) 398 99.5% 0.50% 0% process_timeout+0x14
0.00% 44.8% 1.9us( 3.5us) 3.0us( 5.8us)(0.00%) 58 55.2% 44.8% 0% schedule_tail+0x58
0.49% 7.7% 3.5us( 19us) 5.6us( 96us)(0.01%) 278437 92.3% 7.7% 0% schedule+0xc0
0.00% 8.8% 1.7us( 10us) 5.5us( 24us)(0.00%) 3254 91.2% 8.8% 0% schedule+0x284
0.11% 20.3% 4.4us( 25us) 4.0us( 41us)(0.00%) 49638 79.7% 20.3% 0% schedule+0x518
0.00% 1.4% 3.6us( 20us) 2.7us( 5.0us)(0.00%) 489 98.6% 1.4% 0% wake_up_process+0x14
0.00% 0% 1.5us( 9.4us) 0us 215 100% 0% 0% sb_lock
0.00% 0% 0.3us( 3.7us) 0us 39 100% 0% 0% drop_super+0x24
0.00% 0% 1.1us( 9.4us) 0us 78 100% 0% 0% sync_supers+0x6c
0.00% 0% 5.0us( 9.3us) 0us 39 100% 0% 0% sync_unlocked_inodes+0x18
0.00% 0% 0.5us( 0.9us) 0us 59 100% 0% 0% sync_unlocked_inodes+0x1ac
0.00% 0% 0.4us( 4.8us) 0us 1725 100% 0% 0% scsi_bhqueue_lock
0.00% 0% 0.2us( 3.8us) 0us 1150 100% 0% 0% scsi_bottom_half_handler+0x1c
0.00% 0% 0.7us( 4.8us) 0us 575 100% 0% 0% scsi_done+0x3c
0.12% 1.1% 0.8us( 11us) 2.5us( 15us)(0.00%) 301743 98.9% 1.1% 0% semaphore_lock
0.02% 1.6% 0.4us( 7.6us) 2.5us( 15us)(0.00%) 124361 98.4% 1.6% 0% __down+0x44
0.09% 0.70% 1.0us( 11us) 2.5us( 11us)(0.00%) 177359 99.3% 0.70% 0% __down+0x78
0.00% 0% 1.1us( 2.7us) 0us 14 100% 0% 0% __down_interruptible+0x48
0.00% 0% 1.1us( 1.7us) 0us 9 100% 0% 0% __down_interruptible+0x88
0.00% 0% 1.0us( 4.9us) 0us 520 100% 0% 0% shm_ids+0x28
0.00% 0% 0.9us( 1.6us) 0us 20 100% 0% 0% ipc_addid+0x94
0.00% 0% 1.7us( 4.9us) 0us 220 100% 0% 0% shm_close+0x54
0.00% 0% 0.2us( 0.4us) 0us 20 100% 0% 0% shm_mmap+0x54
0.00% 0% 0.4us( 2.0us) 0us 200 100% 0% 0% shm_open+0x40
0.00% 0% 1.8us( 3.0us) 0us 20 100% 0% 0% sys_shmat+0xb8
0.00% 0% 0.4us( 0.5us) 0us 20 100% 0% 0% sys_shmat+0x25c
0.00% 0% 1.2us( 2.0us) 0us 20 100% 0% 0% sys_shmctl+0x684
0.00% 0% 0.3us( 0.7us) 0us 40 100% 0% 0% shmem_ilock
0.00% 0% 0.4us( 0.7us) 0us 20 100% 0% 0% shmem_delete_inode+0x38
0.00% 0% 0.1us( 0.7us) 0us 20 100% 0% 0% shmem_get_inode+0x154
0.00% 0% 1.1us( 1.3us) 0us 20 100% 0% 0% swaplock
0.00% 0% 1.1us( 1.3us) 0us 20 100% 0% 0% si_swapinfo+0x18
0.02% 0.01% 1.6us( 11us) 4.6us( 7.1us)(0.00%) 24285 100% 0.01% 0% timerlist_lock
0.00% 0.11% 1.0us( 5.9us) 4.6us( 7.1us)(0.00%) 1781 99.9% 0.11% 0% add_timer+0x10
0.00% 0% 0.3us( 3.9us) 0us 575 100% 0% 0% del_timer+0x14
0.00% 0% 0.8us( 4.1us) 0us 678 100% 0% 0% del_timer_sync+0x1c
0.00% 0% 1.4us( 4.3us) 0us 179 100% 0% 0% mod_timer+0x18
0.02% 0% 1.8us( 11us) 0us 19687 100% 0% 0% timer_bh+0xcc
0.00% 0% 0.3us( 5.8us) 0us 1385 100% 0% 0% timer_bh+0x254
0.00% 0% 5.9us( 9.9us) 0us 41 100% 0% 0% tlbstate_lock
0.00% 0% 5.9us( 9.9us) 0us 41 100% 0% 0% flush_tlb_others+0x90
0.00% 0% 0.4us( 4.3us) 0us 972 100% 0% 0% tqueue_lock
0.00% 0% 0.3us( 4.3us) 0us 486 100% 0% 0% __run_task_queue+0x14
0.00% 0% 0.5us( 4.0us) 0us 440 100% 0% 0% batch_entropy_store+0x7c
0.00% 0% 0.3us( 2.3us) 0us 22 100% 0% 0% generic_plug_device+0x34
0.00% 0% 0.4us( 0.8us) 0us 24 100% 0% 0% rs_sched_event+0x38
1.5% 1.3% 0.6us( 146us) 3.2us( 122us)(0.01%) 4851646 98.7% 1.3% 0% unused_list_lock
0.78% 1.8% 0.6us( 75us) 3.7us( 122us)(0.01%) 2425826 98.2% 1.8% 0% get_unused_buffer_head+0x8
0.77% 0.75% 0.6us( 146us) 2.0us( 48us)(0.00%) 2425820 99.3% 0.75% 0% try_to_free_buffers+0x54
1.3% 2.8% 1.1us( 22us) 1.9us( 56us)(0.01%) 2436672 97.2% 2.8% 0% __free_pages_ok+0x13c
1.1% 0.19% 0.8us( 48us) 3.6us( 34us)(0.00%) 2697514 99.8% 0.19% 0% __wake_up+0x24
0.00% 0% 0.2us( 3.9us) 0us 8303 100% 0% 0% add_wait_queue+0x10
0.02% 9.7% 0.3us( 6.5us) 6.6us( 60us)(0.01%) 124375 90.3% 9.7% 0% add_wait_queue_exclusive+0x10
0.00% 0% 7.8us( 35us) 0us 1150 100% 0% 0% ahc_linux_isr+0x24
0.00% 0% 1.0us( 2.6us) 0us 101 100% 0% 0% change_protection+0x44
0.01% 0% 33us( 69us) 0us 322 100% 0% 0% clear_page_tables+0x1c
0.00% 0% 0.1us( 1.2us) 0us 2826 100% 0% 0% copy_mm+0x1e8
0.01% 0% 2.5us( 77us) 0us 3952 100% 0% 0% copy_mm+0x230
0.01% 0% 2.9us( 78us) 0us 3952 100% 0% 0% copy_page_range+0x100
0.01% 0% 1.0us( 8.5us) 0us 20292 100% 0% 0% do_IRQ+0x40
0.00% 0% 0.4us( 5.4us) 0us 20292 100% 0% 0% do_IRQ+0xc0
0.00% 0% 2.3us( 17us) 0us 2339 100% 0% 0% do_anonymous_page+0xb8
0.00% 0% 0.4us( 0.7us) 0us 61 100% 0% 0% do_brk+0x1d4
0.00% 0% 0.1us( 1.0us) 0us 261 100% 0% 0% do_exit+0x104
0.00% 0% 0.1us( 0.4us) 0us 261 100% 0% 0% do_exit+0x138
0.00% 0% 0.5us( 3.2us) 0us 261 100% 0% 0% do_exit+0x94
0.00% 0.70% 0.9us( 2.5us) 1.7us( 3.3us)(0.00%) 1007 99.3% 0.70% 0% do_mmap_pgoff+0x40c
0.00% 0% 0.6us( 6.8us) 0us 1456 100% 0% 0% do_mmap_pgoff+0x418
0.00% 4.5% 0.2us( 0.5us) 1.1us( 3.5us)(0.00%) 223 95.5% 4.5% 0% do_munmap+0x1b8
0.00% 0% 1.0us( 5.4us) 0us 571 100% 0% 0% do_munmap+0xe0
0.00% 0% 0.1us( 4.0us) 0us 14905 100% 0% 0% do_no_page+0x194
0.00% 0% 0.6us( 3.8us) 0us 301 100% 0% 0% do_page_fault+0xe0
0.00% 0% 0.9us( 4.5us) 0us 813 100% 0% 0% do_sigaction+0x58
0.00% 0% 0.6us( 1.9us) 0us 162 100% 0% 0% do_sigaction+0xd8
0.00% 0% 6.5us( 19us) 0us 259 100% 0% 0% do_signal+0x54
0.01% 0% 3.0us( 77us) 0us 5802 100% 0% 0% do_wp_page+0x20c
0.00% 0% 0.2us( 2.7us) 0us 322 100% 0% 0% exit_mmap+0x18
0.00% 0.21% 0.3us( 3.7us) 1.0us( 1.3us)(0.00%) 3772 99.8% 0.21% 0% exit_mmap+0x88
0.00% 0% 1.4us( 2.6us) 0us 261 100% 0% 0% exit_sighand+0x18
0.30% 0% 41us( 143us) 0us 14267 100% 0% 0% free_block+0x1c
0.01% 0% 0.5us( 15us) 0us 26997 100% 0% 0% handle_mm_fault+0x34
0.00% 0% 0.5us( 2.7us) 0us 259 100% 0% 0% handle_signal+0xb0
0.00% 0% 1.9us( 3.4us) 0us 61 100% 0% 0% insert_vm_struct+0x70
0.18% 0.55% 25us( 99us) 16us( 58us)(0.00%) 14268 99.5% 0.55% 0% kmem_cache_alloc_batch+0x18
0.00% 2.0% 1.4us( 3.2us) 2.5us( 3.2us)(0.00%) 101 98.0% 2.0% 0% mprotect_fixup+0x2a8
0.00% 0% 0.6us( 1.2us) 0us 101 100% 0% 0% mprotect_fixup+0x2b4
0.00% 0% 4.0us( 80us) 0us 966 100% 0% 0% pte_alloc+0x88
0.00% 0% 0.2us( 0.5us) 0us 61 100% 0% 0% put_dirty_page+0x3c
0.00% 1.1% 0.2us( 1.6us) 0.9us( 1.3us)(0.00%) 267 98.9% 1.1% 0% release_task+0x3c
0.02% 20.3% 0.3us( 6.8us) 7.9us( 49us)(0.01%) 132678 79.7% 20.3% 0% remove_wait_queue+0x10
2.9% 8.5% 2.3us( 24us) 3.6us( 41us)(0.05%) 2436680 91.5% 8.5% 0% rmqueue+0x28
0.22% 0.00% 1.6us( 98us) 4.9us( 4.9us)(0.00%) 268302 100% 0.00% 0% schedule+0x4c8
0.00% 0% 1.5us( 14us) 0us 261 100% 0% 0% schedule_tail+0x20
0.00% 0% 5.3us( 33us) 0us 580 100% 0% 0% send_sig_info+0x4c
0.00% 0% 1.1us( 1.7us) 0us 20 100% 0% 0% shmem_getpage_locked+0xd4
0.00% 0% 3.1us( 5.4us) 0us 40 100% 0% 0% shmem_truncate+0x38
0.00% 0% 0.2us( 2.3us) 0us 2012 100% 0% 0% sys_rt_sigprocmask+0x98
0.00% 0% 0.4us( 1.8us) 0us 259 100% 0% 0% sys_sigreturn+0x84
0.00% 0% 0.8us( 1.3us) 0us 61 100% 0% 0% unmap_fixup+0xb8
0.00% 0% 0.2us( 1.3us) 0us 322 100% 0% 0% vma_merge+0x54
0.00% 0% 0.3us( 5.6us) 0us 25600 100% 0% 0% vmtruncate+0x4c
0.04% 0% 13us( 253us) 0us 5713 100% 0% 0% zap_page_range+0x58
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
RWLOCK READS HOLD MAX RDR BUSY PERIOD WAIT
UTIL CON MEAN RDRS MEAN( MAX ) MEAN( MAX )( %CPU) TOTAL NOWAIT SPIN NAME
0.78% 3.4us( 133us)(0.02%) 9988887 99.2% 0.78% *TOTAL*
0.00% 0% 2.2us 1 2.2us( 5.1us) 0us 196 100% 0% [0xf73913c4]
0% 0us 196 100% 0% do_select+0x24
0.00% 0% 1.1us 1 1.1us( 2.8us) 0us 61 100% 0% binfmt_lock
0% 0us 61 100% 0% search_binary_handler+0x38
0.00% 0% 1.2us 1 1.2us( 1.5us) 0us 20 100% 0% chrdevs_lock
0% 0us 20 100% 0% get_chrfops+0x28
3.2% 1.7% 1.4us 5 1.5us( 106us) 3.4us( 133us)(0.02%) 4458959 98.3% 1.7% hash_table_lock
1.7% 3.4us( 133us)(0.02%) 4458959 98.3% 1.7% get_hash_table+0x60
0.05% 0% 27.4us 4 27us( 161us) 0us 4297 100% 0% tasklist_lock
0% 0us 39 100% 0% count_active_tasks+0xc
0% 0us 261 100% 0% exit_notify+0x1c
0% 0us 5 100% 0% get_pid+0x60
0% 0us 20 100% 0% kill_pg_info+0x20
0% 0us 3254 100% 0% schedule+0x238
0% 0us 718 100% 0% sys_wait4+0x8c
0.00% 0% 1.0us 1 1.0us( 5.3us) 0us 366 100% 0% xtime_lock
0% 0us 366 100% 0% do_gettimeofday+0x14
0% 0us 89 100% 0% copy_files+0x108
0% 0us 89 100% 0% do_fork+0x344
0% 0us 1197938 100% 0% ext2_get_branch+0xa4
0% 0us 3642461 100% 0% fget+0x1c
0% 0us 683927 100% 0% path_init+0x134
0% 0us 484 100% 0% path_init+0x30
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
RWLOCK WRITES HOLD WAIT (ALL) WAIT (WW)
UTIL CON MEAN( MAX ) MEAN( MAX )( %CPU) MEAN( MAX ) TOTAL NOWAIT SPIN( WW ) NAME
0.69% 0.5us( 359us) 2.5us( 57us)(0.02%) 0.6us( 42us) 16217680 99.3% 0.65%(0.04%) *TOTAL*
0% 0% 0us 0us 10 100% 0%( 0%) [0xf7487f64]
0% 0% 0us 0us 7 100% 0%( 0%) neigh_periodic_timer__thr+0xa8
0% 0% 0us 0us 3 100% 0%( 0%) neigh_update+0x3c
0% 0% 0us 0us 1 100% 0%( 0%) [0xf7a829b4]
0% 0% 0us 0us 1 100% 0%( 0%) rt_intern_hash+0x64
0% 0% 0us 0us 7 100% 0%( 0%) arp_tbl+0xc8
0% 0% 0us 0us 7 100% 0%( 0%) neigh_periodic_timer__thr+0x20
0.00% 0% 0.9us( 2.0us) 0us 0us 40 100% 0%( 0%) dn_lock
0.00% 0% 0.9us( 2.0us) 0us 0us 40 100% 0%( 0%) fcntl_dirnotify+0x94
0.00% 0% 0.4us( 0.5us) 0us 0us 20 100% 0%( 0%) fasync_lock
0.00% 0% 0.4us( 0.5us) 0us 0us 20 100% 0%( 0%) fasync_helper+0x68
2.6% 2.3% 1.1us( 153us) 2.5us( 57us)(0.02%) 0.6us( 42us) 4846445 97.7% 2.2%(0.15%) hash_table_lock
0.00% 40.0% 2.2us( 3.0us) 1.3us( 1.3us)(0.00%) 0us 5 60.0% 40.0%( 0%) hash_page_buffers+0x48
0.44% 2.5% 0.4us( 49us) 2.4us( 56us)(0.01%) 0.6us( 42us) 2420620 97.5% 2.3%(0.20%) remove_from_queues+0x18
2.2% 2.2% 1.7us( 153us) 2.6us( 57us)(0.01%) 0.6us( 12us) 2425820 97.8% 2.1%(0.10%) try_to_free_buffers+0x28
0.00% 0% 4.0us( 17us) 0us 0us 783 100% 0%( 0%) tasklist_lock
0.00% 0% 1.0us( 2.8us) 0us 0us 261 100% 0%( 0%) do_fork+0x560
0.00% 0% 9.6us( 17us) 0us 0us 261 100% 0%( 0%) exit_notify+0x190
0.00% 0% 1.4us( 5.6us) 0us 0us 261 100% 0%( 0%) release_task+0x8c
0.20% 0% 10us( 42us) 0us 0us 39374 100% 0%( 0%) xtime_lock
0.02% 0% 2.4us( 12us) 0us 0us 19687 100% 0%( 0%) timer_bh+0xc
0.18% 0% 18us( 42us) 0us 0us 19687 100% 0%( 0%) timer_interrupt+0x10
0.00% 0% 0.2us( 0.8us) 0us 0us 42 100% 0%( 0%) do_fcntl+0x140
0.00% 0% 0.1us( 0.2us) 0us 0us 61 100% 0%( 0%) do_pipe+0x184
0.00% 0% 0.1us( 0.1us) 0us 0us 61 100% 0%( 0%) do_pipe+0x1c4
0.00% 0% 0.2us( 2.8us) 0us 0us 200 100% 0%( 0%) expand_fd_array+0x13c
0.00% 0% 1.6us( 11us) 0us 0us 200 100% 0%( 0%) expand_fd_array+0x88
0.16% 0% 0.1us( 64us) 0us 0us 2460421 100% 0%( 0%) ext2_alloc_block+0x1c
0.15% 0% 0.2us( 56us) 0us 0us 1455099 100% 0%( 0%) ext2_discard_prealloc+0x14
0.28% 0% 0.2us( 85us) 0us 0us 2420621 100% 0%( 0%) ext2_get_block+0x100
0.19% 0% 0.2us( 47us) 0us 0us 2420621 100% 0%( 0%) ext2_get_block+0x27c
0.75% 0% 3.8us( 359us) 0us 0us 393217 100% 0%( 0%) ext2_new_block+0x6cc
0.00% 0% 0.2us( 1.6us) 0us 0us 61 100% 0%( 0%) flush_old_exec+0x230
0.00% 0% 0.0us( 0.2us) 0us 0us 21 100% 0%( 0%) flush_old_exec+0x29c
0.06% 0% 0.2us( 9.3us) 0us 0us 726474 100% 0%( 0%) get_unused_fd+0x24
0.00% 0% 0.0us( 0.3us) 0us 0us 61 100% 0%( 0%) load_elf_binary+0x18c
0% 0% 0us 0us 2294 100% 0%( 0%) rt_check_expire__thr+0x64
0.04% 0% 0.1us( 46us) 0us 0us 725195 100% 0%( 0%) sys_close+0x1c
0.00% 0% 0.7us( 3.0us) 0us 0us 60 100% 0%( 0%) sys_dup2+0x2c
0.03% 0% 0.1us( 20us) 0us 0us 726190 100% 0%( 0%) sys_open+0x60
0.00% 0% 0.0us( 0.3us) 0us 0us 101 100% 0%( 0%) sys_open+0xbc
_________________________________________________________________________________________________________________________
Number of read locks found=6