The OpenNET Project / Index page

[ новости /+++ | форум | wiki | теги | ]

форумы  помощь  поиск  регистрация  майллист  вход/выход  слежка  RSS
"Solaris ZFS жутко медленный под NFS"
Вариант для распечатки  
Пред. тема | След. тема 
Форумы Оптимизация и Промышленные системы (Public)
Изначальное сообщение [ Отслеживать ]

"Solaris ZFS жутко медленный под NFS"  
Сообщение от Urgen on 29-Окт-08, 21:31 
Поставил свежескачанную солярку (ОпенСолярис), решил побаловаться могуществом ZFS'a. Только расшарил под NFS'ом разделы и... жесть!
Скорость записи 30Кил/сек, чтения правда поболе 7-8Мб/сек, но что ж это такое?!?!
Делаю scp и имею на гигабитном линке 30Мб/сек без всяких вопросов!
расшаривал и zfs set sharenfs и share -F nfs - одинаково.
Что бы это могло значить? Подскажите, камрады?
Высказать мнение | Ответить | Правка | Cообщить модератору

 Оглавление

Сообщения по теме [Сортировка по времени | RSS]


1. "Solaris ZFS жутко медленный под NFS"  
Сообщение от const email(??) on 30-Окт-08, 09:24 
Могуществом надо не баловаться, а благоговенно восхищаться :)

А если расшарить по NFS не ZFS, а старую UFS - лучше будет?

Высказать мнение | Ответить | Правка | Наверх | Cообщить модератору

2. "Solaris ZFS жутко медленный под NFS"  
Сообщение от Илья Воронин email on 30-Окт-08, 12:44 
>Поставил свежескачанную солярку (ОпенСолярис), решил побаловаться могуществом ZFS'a. Только расшарил под NFS'ом
>разделы и... жесть!
>Скорость записи 30Кил/сек, чтения правда поболе 7-8Мб/сек, но что ж это такое?!?!
>
>Делаю scp и имею на гигабитном линке 30Мб/сек без всяких вопросов!
>расшаривал и zfs set sharenfs и share -F nfs - одинаково.
>Что бы это могло значить? Подскажите, камрады?

Попробуй отключить ZIL, - в /etc/system:
set zil_disable=1
и перезагрузись. Скажи пожалуйста - поможет или нет!

Высказать мнение | Ответить | Правка | Наверх | Cообщить модератору

3. "Solaris ZFS жутко медленный под NFS"  
Сообщение от Urgen on 30-Окт-08, 13:17 
>Попробуй отключить ZIL, - в /etc/system:
>set zil_disable=1
>и перезагрузись. Скажи пожалуйста - поможет или нет!

не помогает.
уже и поотключал согласно советов c opensolaris.org atime=off, checksum=off
все равно жуть...

Высказать мнение | Ответить | Правка | Наверх | Cообщить модератору

4. "Solaris ZFS жутко медленный под NFS"  
Сообщение от Scott Tiger on 31-Окт-08, 12:10 
>>Попробуй отключить ZIL, - в /etc/system:
>>set zil_disable=1
>>и перезагрузись. Скажи пожалуйста - поможет или нет!
>
>не помогает.
>уже и поотключал согласно советов c opensolaris.org atime=off, checksum=off
>все равно жуть...

lockstat -CcwP -s 10 -D 10 sleep 5

Высказать мнение | Ответить | Правка | Наверх | Cообщить модератору

5. "Solaris ZFS жутко медленный под NFS"  
Сообщение от Urgen on 31-Окт-08, 12:21 
>lockstat -CcwP -s 10 -D 10 sleep 5

Adaptive mutex spin: 182 events in 5.039 seconds (36 events/sec)

-------------------------------------------------------------------------------
Count indv cuml rcnt     nsec Lock                   Hottest Caller            
   58  33%  33% 0.00     7920 0xffffff01480c8e00     lookuppnat+0x67          

      nsec ------ Time Distribution ------ count     Stack                  
       512 |@@@@@                          10        lookupnameat+0x82      
      1024 |@@@                            7         cstatat_getvp+0x160    
      2048 |@@@                            7         cstatat32+0x7d          
      4096 |@@@@@@@@@@                     21        lstat32+0x31            
      8192 |@@@@@                          10        lxstat32+0x24          
     16384 |                               1         _sys_sysenter_post_swapgs+0x14b
     32768 |                               0                                        
     65536 |                               0                                        
    131072 |                               0                                        
    262144 |@                              2                                        
-------------------------------------------------------------------------------    
Count indv cuml rcnt     nsec Lock                   Hottest Caller                
   15  22%  55% 0.00    20454 0xffffff01471aa000     callout_execute+0x1d          

      nsec ------ Time Distribution ------ count     Stack                  
       256 |@@                             1         taskq_thread+0x1a7      
       512 |@@@@@@@@@@@@@@                 7         thread_start+0x8        
      1024 |@@                             1                                
      2048 |                               0                                
      4096 |@@                             1                                
      8192 |@@@@@@                         3                                
     16384 |                               0                                
     32768 |                               0                                
     65536 |                               0                                
    131072 |                               0                                
    262144 |@@@@                           2                                
-------------------------------------------------------------------------------
Count indv cuml rcnt     nsec Lock                   Hottest Caller            
   24  16%  72% 0.00     9431 0xffffff01471a10c0     ehci_intr+0x2a            

      nsec ------ Time Distribution ------ count     Stack                  
       512 |@@                             2         av_dispatch_autovect+0x78
      1024 |                               0         dispatch_hardint+0x2f    
      2048 |@@@                            3         switch_sp_and_call+0x13  
      4096 |@                              1                                  
      8192 |@@@@@                          4                                  
     16384 |@@@@@@@@@@@@@                  11                                
     32768 |@@                             2                                  
     65536 |@                              1                                  
-------------------------------------------------------------------------------
Count indv cuml rcnt     nsec Lock                   Hottest Caller            
   10  16%  87% 0.00    21620 0xffffff0149cff658     rrw_exit+0x1a            

      nsec ------ Time Distribution ------ count     Stack                  
       256 |@@@                            1         zfs_root+0x7a          
       512 |@@@                            1         fshead_root+0xb1        
      1024 |                               0         fsop_root+0x2e          
      2048 |                               0         traverse+0x5e          
      4096 |@@@@@@@@@@@@@@@@@@             6         lookuppnvp+0x3c5        
      8192 |@@@                            1         lookuppnat+0x125        
     16384 |                               0         lookupnameat+0x82      
     32768 |                               0         cstatat_getvp+0x160    
     65536 |                               0         cstatat32+0x7d          
    131072 |                               0                                
    262144 |@@@                            1                                
-------------------------------------------------------------------------------
Count indv cuml rcnt     nsec Lock                   Hottest Caller            
   20   4%  92% 0.00     2825 0xffffff014c323080     getf+0x65                

      nsec ------ Time Distribution ------ count     Stack                  
       256 |@                              1         write+0x3a              
       512 |@@@                            2         write32+0x1e            
      1024 |                               0         _sys_sysenter_post_swapgs+0x14b
      2048 |                               0                                        
      4096 |@@@@@@@@@@@@@@@@@@@@@@@@       16                                      
      8192 |@                              1                                        
-------------------------------------------------------------------------------    
Count indv cuml rcnt     nsec Lock                   Hottest Caller                
   22   3%  94% 0.00     1786 0xffffff0147f657c0     cv_wait+0x69                  

      nsec ------ Time Distribution ------ count     Stack                  
       512 |@@@@@@                         5         taskq_thread+0x157      
      1024 |@@@@@@@@@@                     8         thread_start+0x8        
      2048 |@@@@                           3                                
      4096 |@@@@@                          4                                
      8192 |@                              1                                
     16384 |@                              1                                
-------------------------------------------------------------------------------
Count indv cuml rcnt     nsec Lock                   Hottest Caller            
   13   1%  96% 0.00     1512 0xffffff0147f65898     cv_wait+0x69              

      nsec ------ Time Distribution ------ count     Stack                  
       256 |@@                             1         taskq_thread+0x157      
       512 |@@@@@@@@@@@                    5         thread_start+0x8        
      1024 |@@@@@@@@@                      4                                
      2048 |@@                             1                                
      4096 |@@                             1                                
      8192 |                               0                                
     16384 |@@                             1                                
-------------------------------------------------------------------------------
Count indv cuml rcnt     nsec Lock                   Hottest Caller            
    7   1%  97% 0.00     2788 0xffffff01471b0000     callout_execute+0xc1      

      nsec ------ Time Distribution ------ count     Stack                  
       512 |@@@@@@@@@@@@                   3         taskq_thread+0x1a7      
      1024 |@@@@@@@@                       2         thread_start+0x8        
      2048 |                               0                                
      4096 |@@@@                           1                                
      8192 |                               0                                
     16384 |@@@@                           1                                
-------------------------------------------------------------------------------
Count indv cuml rcnt     nsec Lock                   Hottest Caller            
    2   1%  98% 0.00     4709 0xffffff0148f24f80     zfs_zaccess_common+0x176  

      nsec ------ Time Distribution ------ count     Stack                  
      4096 |@@@@@@@@@@@@@@@                1         zfs_zaccess+0x114      
      8192 |@@@@@@@@@@@@@@@                1         zfs_lookup+0xb3        
                                                     fop_lookup+0xf2        
                                                     lookuppnvp+0x351        
                                                     lookuppnat+0x125        
                                                     lookupnameat+0x82      
                                                     cstatat_getvp+0x160    
                                                     cstatat32+0x7d          
                                                     lstat32+0x31            
-------------------------------------------------------------------------------
Count indv cuml rcnt     nsec Lock                   Hottest Caller            
    2   1%  99% 0.00     4125 0xffffff0147fafcd8     cv_wait+0x69              

      nsec ------ Time Distribution ------ count     Stack                  
       512 |@@@@@@@@@@@@@@@                1         taskq_thread+0x11e      
      1024 |                               0         thread_start+0x8        
      2048 |                               0                                
      4096 |                               0                                
      8192 |@@@@@@@@@@@@@@@                1                                
-------------------------------------------------------------------------------

Spin lock spin: 32 events in 5.039 seconds (6 events/sec)

-------------------------------------------------------------------------------
Count indv cuml rcnt     nsec Lock                   Hottest Caller            
   26  69%  69% 0.00     1377 0xffffff014a076930     disp_lock_enter_high+0x11

      nsec ------ Time Distribution ------ count     Stack                  
       128 |@@@@@@@@                       7         setbackdq+0x226        
       256 |@@@@@                          5         sleepq_wakeone_chan+0x83
       512 |@@@@@                          5         cv_signal+0x89          
      1024 |                               0         taskq_dispatch+0x343    
      2048 |@@                             2         callout_schedule_1+0xce
      4096 |@@@                            3         callout_schedule+0x40  
      8192 |@@@                            3         clock+0x364            
     16384 |@                              1         cyclic_softint+0xd1    
                                                     cbe_softclock+0x1a      
-------------------------------------------------------------------------------
Count indv cuml rcnt     nsec Lock                   Hottest Caller            
    6  31% 100% 0.00     2668 cpu0_disp[56]          disp_lock_enter+0x31      

      nsec ------ Time Distribution ------ count     Stack                  
       128 |@@@@@                          1         disp_getbest+0x1d      
       256 |                               0         disp_getwork+0x239      
       512 |@@@@@@@@@@                     2         disp+0x1bb
      1024 |                               0         swtch+0xb5
      2048 |@@@@@                          1         cv_wait_sig_swap_core+0x171
      4096 |@@@@@                          1         cv_wait_sig_swap+0x18
      8192 |                               0         cv_waituntil_sig+0x13f
     16384 |@@@@@                          1         lwp_park+0x14f
                                                     syslwp_park+0x2d
-------------------------------------------------------------------------------

Thread lock spin: 2 events in 5.039 seconds (0 events/sec)

-------------------------------------------------------------------------------
Count indv cuml rcnt     nsec Lock                   Hottest Caller
    1  64%  64% 0.00     1018 cpu[1][1520]           preempt+0x42

      nsec ------ Time Distribution ------ count     Stack
      1024 |@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ 1         trap+0x116f
                                                     sys_rtt_common+0x62
                                                     _sys_rtt_ints_disabled+0x8
-------------------------------------------------------------------------------
Count indv cuml rcnt     nsec Lock                   Hottest Caller
    1  36% 100% 0.00      576 transition_lock[1]     ts_tick+0x27

      nsec ------ Time Distribution ------ count     Stack
      1024 |@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ 1         clock_tick+0x4a
                                                     clock_tick_process+0x148
                                                     clock_tick_execute_common+0x94
                                                     clock_tick_schedule+0x89
                                                     clock+0x312
                                                     cyclic_softint+0xd1
                                                     cbe_softclock+0x1a
                                                     av_dispatch_softvect+0x5f
                                                     dispatch_softint+0x34
-------------------------------------------------------------------------------


Высказать мнение | Ответить | Правка | Наверх | Cообщить модератору

6. "Solaris ZFS жутко медленный под NFS"  
Сообщение от Scott Tiger on 31-Окт-08, 12:42 
>>lockstat -CcwP -s 10 -D 10 sleep 5

А секция Adaptive Mutex Blocks?

Высказать мнение | Ответить | Правка | Наверх | Cообщить модератору

7. "Solaris ZFS жутко медленный под NFS"  
Сообщение от Urgen on 31-Окт-08, 13:06 
>>>lockstat -CcwP -s 10 -D 10 sleep 5
>
>А секция Adaptive Mutex Blocks?

Хм-м-м... ну вроде вот так делал:

lockstat -CcwP -s 10 -D 10 sleep 5 >> ~/res.txt
eugene@nas:~# cat ~/res.txt

Adaptive mutex spin: 212 events in 5.037 seconds (42 events/sec)

-------------------------------------------------------------------------------
Count indv cuml rcnt     nsec Lock                   Hottest Caller            
   73  49%  49% 0.00    11048 0xffffff01480c8e00     lookuppnat+0x67          

      nsec ------ Time Distribution ------ count     Stack                  
       512 |@@@                            9         lookupnameat+0x82      
      1024 |@@@@                           11        cstatat_getvp+0x160    
      2048 |@@                             6         cstatat32+0x7d          
      4096 |@@@@@@@@@@@                    27        lstat32+0x31            
      8192 |@@@@@                          14        lxstat32+0x24          
     16384 |                               1         _sys_sysenter_post_swapgs+0x14b
     32768 |                               1                                        
     65536 |                               0                                        
    131072 |                               0                                        
    262144 |@                              4                                        
-------------------------------------------------------------------------------    
Count indv cuml rcnt     nsec Lock                   Hottest Caller                
    7  15%  63% 0.00    34542 0xffffff0147f65898     cv_wait+0x69                  

      nsec ------ Time Distribution ------ count     Stack                  
      1024 |@@@@@@@@@@@@@@@@@              4         taskq_thread+0x157      
      2048 |                               0         thread_start+0x8        
      4096 |                               0                                
      8192 |@@@@                           1                                
     16384 |                               0                                
     32768 |                               0                                
     65536 |                               0                                
    131072 |@@@@                           1                                
    262144 |@@@@                           1                                
-------------------------------------------------------------------------------
Count indv cuml rcnt     nsec Lock                   Hottest Caller            
    2  10%  73% 0.00    78727 0xffffff0147fbe2d0     cv_wait+0x69              

      nsec ------ Time Distribution ------ count     Stack                  
      1024 |@@@@@@@@@@@@@@@                1         txg_thread_wait+0x60    
      2048 |                               0         txg_timelimit_thread+0xaf
      4096 |                               0         thread_start+0x8        
      8192 |                               0                                  
     16384 |                               0                                  
     32768 |                               0                                  
     65536 |                               0                                  
    131072 |                               0                                  
    262144 |@@@@@@@@@@@@@@@                1                                  
-------------------------------------------------------------------------------
Count indv cuml rcnt     nsec Lock                   Hottest Caller            
   54   9%  82% 0.00     2657 0xffffff014c323080     getf+0x65                

      nsec ------ Time Distribution ------ count     Stack                  
       256 |@                              3         write+0x3a              
       512 |@@                             4         write32+0x1e            
      1024 |                               0         _sys_sysenter_post_swapgs+0x14b
      2048 |                               0                                        
      4096 |@@@@@@@@@@@@@@@@@@@@@@@        42                                      
      8192 |@@                             5                                        
-------------------------------------------------------------------------------    
Count indv cuml rcnt     nsec Lock                   Hottest Caller                
    6   4%  85% 0.00    10661 0xffffff01471a10c0     ehci_hcdi_pipe_bulk_xfer+0x50  

      nsec ------ Time Distribution ------ count     Stack                  
      1024 |@@@@@                          1         usb_pipe_bulk_xfer+0xe6
      2048 |@@@@@                          1         scsa2usb_handle_status_start+0x7c
      4096 |@@@@@                          1         scsa2usb_bulk_only_transport+0x148
      8192 |                               0         scsa2usb_cmd_transport+0x113      
     16384 |@@@@@@@@@@                     2         scsa2usb_transport_request+0x52  
     32768 |                               0         scsa2usb_work_thread+0xa3        
     65536 |@@@@@                          1         taskq_d_thread+0xbb              
                                                     thread_start+0x8                  
-------------------------------------------------------------------------------        
Count indv cuml rcnt     nsec Lock                   Hottest Caller                    
    4   4%  89% 0.00    14974 0xffffff0147fbf988     vdev_queue_io+0x85                

      nsec ------ Time Distribution ------ count     Stack                  
      4096 |@@@@@@@                        1         vdev_disk_io_start+0x54
      8192 |@@@@@@@@@@@@@@@                2         zio_vdev_io_start+0x148
     16384 |                               0         zio_execute+0x7f        
     32768 |                               0         zio_nowait+0x11        
     65536 |@@@@@@@                        1         vdev_mirror_io_start+0x18f
                                                     zio_vdev_io_start+0x156  
                                                     zio_execute+0x7f          
                                                     taskq_thread+0x1a7        
                                                     thread_start+0x8          
-------------------------------------------------------------------------------
Count indv cuml rcnt     nsec Lock                   Hottest Caller            
   10   2%  91% 0.00     3929 0xffffff01471c6618     rrw_exit+0x1a            

      nsec ------ Time Distribution ------ count     Stack                  
       256 |@@@                            1         zfs_lookup+0x15b        
       512 |@@@@@@@@@                      3         fop_lookup+0xf2        
      1024 |@@@                            1         lookuppnvp+0x351        
      2048 |                               0         lookuppnat+0x125        
      4096 |@@@@@@                         2         lookupnameat+0x82      
      8192 |@@@@@@                         2         cstatat_getvp+0x160    
     16384 |@@@                            1         cstatat32+0x7d          
                                                     lstat32+0x31            
                                                     lxstat32+0x24          
-------------------------------------------------------------------------------
Count indv cuml rcnt     nsec Lock                   Hottest Caller            
    7   2%  93% 0.00     3556 0xffffff01471aa000     callout_execute+0xc1      

      nsec ------ Time Distribution ------ count     Stack                  
       512 |@@@@@@@@@@@@                   3         taskq_thread+0x1a7      
      1024 |@@@@@@@@                       2         thread_start+0x8        
      2048 |                               0                                
      4096 |                               0                                
      8192 |                               0                                
     16384 |@@@@@@@@                       2                                
-------------------------------------------------------------------------------
Count indv cuml rcnt     nsec Lock                   Hottest Caller            
    3   1%  94% 0.00     7574 usba_print_mutex[8]    usb_vprintf+0x51          

      nsec ------ Time Distribution ------ count     Stack                  
      8192 |@@@@@@@@@@@@@@@@@@@@           2         usba_vlog+0xb2          
     16384 |@@@@@@@@@@                     1         usb_dprintf2+0xb3      
                                                     scsa2usb_handle_scsi_cmd_sub_class+0x363
                                                     scsa2usb_cmd_transport+0xb5            
                                                     scsa2usb_transport_request+0x52        
                                                     scsa2usb_work_thread+0xa3              
                                                     taskq_d_thread+0xbb                    
                                                     thread_start+0x8                        
-------------------------------------------------------------------------------              
Count indv cuml rcnt     nsec Lock                   Hottest Caller                          
    7   1%  95% 0.00     2429 0xffffff0149cff658     rrw_exit+0x1a                          

      nsec ------ Time Distribution ------ count     Stack                  
       256 |@@@@                           1         zfs_lookup+0x15b        
       512 |@@@@                           1         vhead_lookup+0xf3      
      1024 |                               0         fop_lookup+0xf2        
      2048 |                               0         lookuppnvp+0x351        
      4096 |@@@@@@@@@@@@@@@@@              4         lookuppnat+0x125        
      8192 |@@@@                           1         lookupnameat+0x82      
                                                     cstatat_getvp+0x160
                                                     cstatat32+0x7d
                                                     lstat32+0x31
-------------------------------------------------------------------------------

Spin lock spin: 38 events in 5.037 seconds (8 events/sec)

-------------------------------------------------------------------------------
Count indv cuml rcnt     nsec Lock                   Hottest Caller
   28  54%  54% 0.00     1528 0xffffff014a076930     disp_lock_enter_high+0x11

      nsec ------ Time Distribution ------ count     Stack
       128 |@@@                            3         setbackdq+0x226
       256 |@@@@@@@                        7         sleepq_wakeone_chan+0x83
       512 |@@@@@@@                        7         cv_signal+0x89
      1024 |                               0         taskq_dispatch+0x343
      2048 |@@@@                           4         callout_schedule_1+0xce
      4096 |@@@                            3         callout_schedule+0x40
      8192 |@@@                            3         clock+0x364
     16384 |@                              1         cyclic_softint+0xd1
                                                     cbe_softclock+0x1a
-------------------------------------------------------------------------------
Count indv cuml rcnt     nsec Lock                   Hottest Caller
   10  46% 100% 0.00     3597 cpu0_disp[56]          disp_lock_enter+0x31

      nsec ------ Time Distribution ------ count     Stack
       512 |@@@@@@@@@                      3         disp+0xac
      1024 |@@@@@@                         2         swtch+0xb5
      2048 |                               0         cv_wait_sig_swap_core+0x171
      4096 |@@@@@@                         2         cv_wait_sig_swap+0x18
      8192 |@@@@@@                         2         cv_waituntil_sig+0x13f
     16384 |@@@                            1         lwp_park+0x14f
                                                     syslwp_park+0x2d
                                                     _sys_sysenter_post_swapgs+0x14b
-------------------------------------------------------------------------------

Или я чего-то не так сделал, или не знаю тогда...

Высказать мнение | Ответить | Правка | Наверх | Cообщить модератору

8. "Solaris ZFS жутко медленный под NFS"  
Сообщение от Scott Tiger on 31-Окт-08, 15:57 
Так вроде всё нормально. Надеюсь нагрузка шла во время съёма lockstat-а? :) Потрассируй активность (truss-ом или лучше dtruss-ом), какие системные вызовы тормозить будут, потом для этих медленных сисколлов - разбор полётов, что именно внутри тормозит...
Высказать мнение | Ответить | Правка | Наверх | Cообщить модератору

9. "Solaris ZFS жутко медленный под NFS"  
Сообщение от Urgen on 31-Окт-08, 16:11 
>Так вроде всё нормально. Надеюсь нагрузка шла во время съёма lockstat-а? :)

Как г-рят наши прибалтийские братья - исфини-и-и-ите стор-мо-зи-и-ил :)

вот локстат под нагрузкой и тут же появились adaptive mutex block:

Adaptive mutex spin: 236 events in 5.043 seconds (47 events/sec)

-------------------------------------------------------------------------------
Count indv cuml rcnt     nsec Lock                   Hottest Caller            
   31  25%  25% 0.00    18859 0xffffff014a55b2d8     cv_wait+0x69              

      nsec ------ Time Distribution ------ count     Stack                  
       256 |                               1         taskq_thread+0x11e      
       512 |@@@@                           5         thread_start+0x8        
      1024 |@@@@@@                         7                                
      2048 |@                              2                                
      4096 |@@@@@                          6                                
      8192 |@@@@@                          6                                
     16384 |@                              2                                
     32768 |                               0                                
     65536 |                               0                                
    131072 |                               0                                
    262144 |                               1                                
    524288 |                               1                                
-------------------------------------------------------------------------------
Count indv cuml rcnt     nsec Lock                   Hottest Caller            
   46  19%  43% 0.00     9561 0xffffff01480c8e40     lookuppnat+0x67          

      nsec ------ Time Distribution ------ count     Stack                  
       512 |@@@                            6         lookupnameat+0x82      
      1024 |@@@@                           7         cstatat_getvp+0x160    
      2048 |@@@                            6         cstatat32+0x7d          
      4096 |@@@@@@@@                       13        lstat32+0x31            
      8192 |@@@@@                          9         lxstat32+0x24          
     16384 |@                              3         _sys_sysenter_post_swapgs+0x14b
     32768 |                               0                                        
     65536 |                               0                                        
    131072 |                               0                                        
    262144 |@                              2                                        
-------------------------------------------------------------------------------    
Count indv cuml rcnt     nsec Lock                   Hottest Caller                
    2  15%  58% 0.00   177580 0xffffff0147fbe2d0     cv_wait+0x69                  

      nsec ------ Time Distribution ------ count     Stack                  
    262144 |@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ 2         txg_thread_wait+0x60    
                                                     txg_timelimit_thread+0xaf
                                                     thread_start+0x8        
-------------------------------------------------------------------------------
Count indv cuml rcnt     nsec Lock                   Hottest Caller            
    2  13%  71% 0.00   158750 0xffffff014a7d7cd0     cv_wait+0x69              

      nsec ------ Time Distribution ------ count     Stack                  
    262144 |@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ 2         txg_thread_wait+0x60    
                                                     txg_timelimit_thread+0xaf
                                                     thread_start+0x8        
-------------------------------------------------------------------------------
Count indv cuml rcnt     nsec Lock                   Hottest Caller            
   37   6%  78% 0.00     4167 0xffffff014a80b118     sd_start_cmds+0x304      

      nsec ------ Time Distribution ------ count     Stack                  
       256 |                               1         sd_core_iostart+0x17b  
       512 |                               0         sd_mapblockaddr_iostart+0x185
      1024 |@                              2         sd_xbuf_strategy+0x50        
      2048 |@@@                            4         xbuf_iostart+0x103          
      4096 |@@@@@@@@@@@@@@                 18        ddi_xbuf_qstrategy+0x60      
      8192 |@@@@@                          7         sdstrategy+0xec              
     16384 |@@@@                           5         bdev_strategy+0x77          
                                                     ldi_strategy+0x54            
                                                     vdev_disk_io_start+0x154    
-------------------------------------------------------------------------------  
Count indv cuml rcnt     nsec Lock                   Hottest Caller              
    8   6%  83% 0.00    16504 0xffffff0147fbf988     vdev_queue_io+0x85          

      nsec ------ Time Distribution ------ count     Stack                  
      2048 |@@@                            1         vdev_disk_io_start+0x54
      4096 |@@@@@@@                        2         zio_vdev_io_start+0x148
      8192 |@@@@@@@@@@@@@@@                4         zio_execute+0x7f        
     16384 |                               0         zio_nowait+0x11        
     32768 |                               0         vdev_mirror_io_start+0x18f
     65536 |                               0         zio_vdev_io_start+0x156  
    131072 |@@@                            1         zio_execute+0x7f          
                                                     taskq_thread+0x1a7        
                                                     thread_start+0x8          
-------------------------------------------------------------------------------
Count indv cuml rcnt     nsec Lock                   Hottest Caller            
   13   5%  88% 0.00     8355 0xffffff01471a10c0     ehci_intr+0x2a            

      nsec ------ Time Distribution ------ count     Stack                  
      1024 |@@@@                           2         av_dispatch_autovect+0x78
      2048 |                               0         dispatch_hardint+0x2f    
      4096 |@@@@                           2         switch_sp_and_call+0x13  
      8192 |@@@@@@                         3                                  
     16384 |@@@@@@@@@@@                    5                                  
     32768 |@@                             1                                  
-------------------------------------------------------------------------------
Count indv cuml rcnt     nsec Lock                   Hottest Caller            
   32   3%  91% 0.00     2387 0xffffff014b6221f0     aac_tran_start+0xc6      

      nsec ------ Time Distribution ------ count     Stack                  
       256 |                               1         scsi_transport+0x7a    
       512 |@@@@                           5         sd_start_cmds+0x2f4    
      1024 |@@@@                           5         sd_core_iostart+0x17b  
      2048 |@@@@@@@@@@                     11        sd_mapblockaddr_iostart+0x185
      4096 |@@@                            4         sd_xbuf_strategy+0x50        
      8192 |@@@                            4         xbuf_iostart+0x103          
     16384 |@                              2         ddi_xbuf_qstrategy+0x60      
                                                     sdstrategy+0xec              
                                                     bdev_strategy+0x77          
-------------------------------------------------------------------------------  
Count indv cuml rcnt     nsec Lock                   Hottest Caller              
   17   2%  93% 0.00     3139 0xffffff014a643658     sd_start_cmds+0x304          

      nsec ------ Time Distribution ------ count     Stack                  
      2048 |@@@                            2         sd_core_iostart+0x17b  
      4096 |@@@@@@@@@@@@@@@@@@@@@@@@       14        sd_mapblockaddr_iostart+0x185
      8192 |@                              1         sd_xbuf_strategy+0x50        
                                                     xbuf_iostart+0x103          
                                                     ddi_xbuf_qstrategy+0x60      
                                                     sdstrategy+0xec              
                                                     bdev_strategy+0x77          
                                                     ldi_strategy+0x54            
                                                     vdev_disk_io_start+0x154    
-------------------------------------------------------------------------------  
Count indv cuml rcnt     nsec Lock                   Hottest Caller              
    4   1%  95% 0.00     6779 0xffffff0147ced528     spa_config_enter+0x34        

      nsec ------ Time Distribution ------ count     Stack                  
      1024 |@@@@@@@                        1         bp_get_dasize+0x3d      
      2048 |                               0         dsl_dataset_block_born+0x32
      4096 |                               0         dbuf_write_ready+0x20f    
      8192 |@@@@@@@@@@@@@@@                2         arc_write_ready+0x49      
     16384 |@@@@@@@                        1         zio_ready+0x2c            
                                                     zio_execute+0x7f          
                                                     taskq_thread+0x1a7        
                                                     thread_start+0x8          
-------------------------------------------------------------------------------

Adaptive mutex block: 16 events in 5.043 seconds (3 events/sec)

-------------------------------------------------------------------------------
Count indv cuml rcnt     nsec Lock                   Hottest Caller            
    7  66%  66% 0.00    57913 0xffffff014a55b2d8     taskq_dispatch+0x2c9      

      nsec ------ Time Distribution ------ count     Stack                  
      4096 |@@@@                           1         zio_interrupt+0x30      
      8192 |@@@@@@@@                       2         vdev_disk_io_intr+0x58  
     16384 |                               0         biodone+0x8a            
     32768 |                               0         sd_buf_iodone+0x62      
     65536 |@@@@                           1         sd_mapblockaddr_iodone+0x48
    131072 |@@@@@@@@                       2         sd_return_command+0x158    
    262144 |@@@@                           1         sdintr+0x50a              
                                                     aac_drain_comp_q+0x10b    
                                                     aac_intr_new+0x40          
-------------------------------------------------------------------------------
Count indv cuml rcnt     nsec Lock                   Hottest Caller            
    3  18%  84% 0.00    37741 0xffffff014b6221f0     aac_tran_start+0xc6        

      nsec ------ Time Distribution ------ count     Stack                  
      8192 |@@@@@@@@@@                     1         scsi_transport+0x7a    
     16384 |                               0         sd_start_cmds+0x2f4    
     32768 |                               0         sd_core_iostart+0x17b  
     65536 |@@@@@@@@@@@@@@@@@@@@           2         sd_mapblockaddr_iostart+0x185
                                                     sd_xbuf_strategy+0x50        
                                                     xbuf_iostart+0x103          
                                                     ddi_xbuf_qstrategy+0x60      
                                                     sdstrategy+0xec              
                                                     bdev_strategy+0x77          
-------------------------------------------------------------------------------  
Count indv cuml rcnt     nsec Lock                   Hottest Caller              
    1   8%  92% 0.00    48984 0xffffff014a3acec8     vdev_queue_io_done+0x3b      

      nsec ------ Time Distribution ------ count     Stack                  
     65536 |@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ 1         vdev_disk_io_done+0x18  
                                                     zio_vdev_io_done+0x22  
                                                     zio_execute+0x7f        
                                                     taskq_thread+0x1a7      
                                                     thread_start+0x8        
-------------------------------------------------------------------------------
Count indv cuml rcnt     nsec Lock                   Hottest Caller            
    4   6%  98% 0.00     9927 0xffffff014a80b118     sdintr+0x33              

      nsec ------ Time Distribution ------ count     Stack                  
      8192 |@@@@@@@                        1         aac_drain_comp_q+0x10b  
     16384 |@@@@@@@@@@@@@@@@@@@@@@         3         aac_intr_new+0x40      
                                                     av_dispatch_autovect+0x78
                                                     dispatch_hardint+0x2f    
                                                     switch_sp_and_call+0x13  
-------------------------------------------------------------------------------
Count indv cuml rcnt     nsec Lock                   Hottest Caller            
    1   2% 100% 0.00    10245 0xffffff014b90cd68     txg_list_add+0x2d        

      nsec ------ Time Distribution ------ count     Stack                  
     16384 |@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ 1         dsl_dir_dirty+0x2d      
                                                     dsl_dir_diduse_space+0x40
                                                     dsl_dataset_block_born+0x137
                                                     dbuf_write_ready+0x20f      
                                                     arc_write_ready+0x49        
                                                     zio_ready+0x2c              
                                                     zio_execute+0x7f            
                                                     taskq_thread+0x1a7          
                                                     thread_start+0x8            
-------------------------------------------------------------------------------  

Spin lock spin: 11 events in 5.043 seconds (2 events/sec)

-------------------------------------------------------------------------------
Count indv cuml rcnt     nsec Lock                   Hottest Caller            
    9 100% 100% 0.00    19177 cpu0_disp[56]          disp_lock_enter_high+0x11

      nsec ------ Time Distribution ------ count     Stack                  
       128 |@@@                            1         setfrontdq+0x190        
       256 |                               0         ts_wakeup+0x149        
       512 |@@@@@@@@@@@@@                  4         sleepq_wakeone_chan+0x83
      1024 |@@@                            1         cv_signal+0x89
      2048 |                               0         lwp_unpark+0x6e
      4096 |                               0         lwp_park+0x47
      8192 |@@@@@@                         2         syslwp_park+0x2d
     16384 |                               0         _sys_sysenter_post_swapgs+0x14b
     32768 |                               0
     65536 |                               0
    131072 |                               0
    262144 |@@@                            1
-------------------------------------------------------------------------------
Count indv cuml rcnt     nsec Lock                   Hottest Caller
    1   0% 100% 0.00      467 turnstile_table[4096]  disp_lock_enter+0x31

      nsec ------ Time Distribution ------ count     Stack
       512 |@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ 1         turnstile_lookup+0x61
                                                     mutex_vector_enter+0x1b4
                                                     taskq_dispatch+0x2c9
                                                     zio_interrupt+0x30
                                                     vdev_disk_io_intr+0x58
                                                     biodone+0x8a
                                                     sd_buf_iodone+0x62
                                                     sd_mapblockaddr_iodone+0x48
                                                     sd_return_command+0x158
-------------------------------------------------------------------------------
Count indv cuml rcnt     nsec Lock                   Hottest Caller
    1   0% 100% 0.00      150 0xffffff0149fba968     disp_lock_enter_high+0x11

      nsec ------ Time Distribution ------ count     Stack
       256 |@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ 1         setbackdq+0x226
                                                     sleepq_wakeall_chan+0x78
                                                     cv_broadcast+0x5b
                                                     txg_quiesce_thread+0x115
                                                     thread_start+0x8
-------------------------------------------------------------------------------


Высказать мнение | Ответить | Правка | Наверх | Cообщить модератору

10. "Solaris ZFS жутко медленный под NFS"  
Сообщение от Scott Tiger on 08-Ноя-08, 00:12 
Я бы над нижеследующим стеком помедитировал:

-------------------------------------------------------------------------------
Count indv cuml rcnt     nsec Lock                   Hottest Caller            
    7  66%  66% 0.00    57913 0xffffff014a55b2d8     taskq_dispatch+0x2c9      

      nsec ------ Time Distribution ------ count     Stack                  
      4096 |@@@@                           1         zio_interrupt+0x30      
      8192 |@@@@@@@@                       2         vdev_disk_io_intr+0x58  
     16384 |                               0         biodone+0x8a            
     32768 |                               0         sd_buf_iodone+0x62      
     65536 |@@@@                           1         sd_mapblockaddr_iodone+0x48
    131072 |@@@@@@@@                       2         sd_return_command+0x158    
    262144 |@@@@                           1         sdintr+0x50a              
                                                     aac_drain_comp_q+0x10b    
                                                     aac_intr_new+0x40          

iostat смотрел, там хватает всего?

Высказать мнение | Ответить | Правка | Наверх | Cообщить модератору

11. "Solaris ZFS жутко медленный под NFS"  
Сообщение от Urgen on 25-Ноя-08, 15:59 
Съездил в отпуск (ну её, эту работу :) ) и приехав обнаружил в ящике новость о свежевышедшей 10-ой солярке 10/08 (не опенсолярис).
Ради интереса решил поставить её и, о чудо, данной проблемы сейчас не имею.
На том же железе скорость передачи 9МБ/с.
Параллельно нашел тред http://communities.vmware.com/message/1080719;jsessionid=8F0...
где идентичная проблема объяснилась наличием бага в драйвере интеловой сетевухи.
Ссылка с vmware,потому как в принципе, вся эта солярка мной рассматривается в качестве  сетевого хранилища виртуалок.
В принципе первоначальный вопрос снят, остался такого плана - полученная скорость в 9МБ/сек под НФС (при скорости передачи файлов через ФТП в 30-40МБ/с) является ли нормальной? То есть имеет смысл что-то дальше тюнить с параметрами ZFS/NFS, или где-то так и должно быть (имею ввиду разницу в скорости передачи данных по протоколам НФС/ФТП)?
Высказать мнение | Ответить | Правка | Наверх | Cообщить модератору

12. "Solaris ZFS жутко медленный под NFS"  
Сообщение от супер on 18-Янв-09, 04:06 
не нужно рассказывать как тормозит NFS.
у меня на linux centos52, NFS3 + XFS + Bond Gigabit средняя скорость для гигабитного клиента 35~40МБ/сек.


Высказать мнение | Ответить | Правка | Наверх | Cообщить модератору

Архив | Удалить

Индекс форумов | Темы | Пред. тема | След. тема
Оцените тред (1=ужас, 5=супер)? [ 1 | 2 | 3 | 4 | 5 ] [Рекомендовать для помещения в FAQ]




Спонсоры:
Inferno Solutions
Hosting by Hoster.ru
Хостинг:

Закладки на сайте
Проследить за страницей
Created 1996-2021 by Maxim Chirkov
Добавить, Поддержать, Вебмастеру