Skip to content

Добавить возможность сбора и парсинга perf метрик с помощью stress-ng #404

Description

@Artanias

stress-ng обладает флагом perf, который позволяет собирать дополнительные метрики по стрессорам:

       --perf measure processor and system activity using perf events. Linux only and caveat emptor, according to perf_event_open(2): "Always double-check your results! Various  gen‐
              eralized  events  have  had  wrong  values.".   Note that with Linux 4.7 one needs to have CAP_SYS_ADMIN capabilities for this option to work, or adjust  /proc/sys/ker‐
              nel/perf_event_paranoid to below 2 to use this without CAP_SYS_ADMIN.

Пример вывода для стессоров cpu и sock (скорее всего нужны root права для сбора статистик):

stress-ng: info:  [208659] setting to a 15 secs run per stressor
stress-ng: info:  [208659] dispatching hogs: 16 cpu, 16 sock
stress-ng: info:  [208659] cpu:
stress-ng: info:  [208659]            451,011,912,224 CPU Cycles                    25.912 B/sec
stress-ng: info:  [208659]            658,659,687,712 Instructions                  37.841 B/sec (1.460 instr. per cycle)
stress-ng: info:  [208659]             76,135,510,752 Branch Instructions            4.374 B/sec
stress-ng: info:  [208659]                749,708,592 Branch Misses                 43.072 M/sec ( 0.985%)
stress-ng: info:  [208659]             25,238,354,416 Stalled Cycles Frontend        1.450 B/sec
stress-ng: info:  [208659]            348,245,151,680 Total Cycles                  20.007 B/sec
stress-ng: info:  [208659]             14,450,660,544 Cache References               0.830 B/sec
stress-ng: info:  [208659]                151,690,144 Cache Misses                   8.715 M/sec ( 1.050%)
stress-ng: info:  [208659]            107,334,619,440 Cache L1D Read                 6.167 B/sec
stress-ng: info:  [208659]              8,948,136,944 Cache L1D Read Miss            0.514 B/sec ( 8.337%)
stress-ng: info:  [208659]              6,677,665,760 Cache L1D Prefetch             0.384 B/sec
stress-ng: info:  [208659]              2,160,504,688 Cache L1I Read                 0.124 B/sec
stress-ng: info:  [208659]                  3,556,064 Cache L1I Read Miss            0.204 M/sec
stress-ng: info:  [208659]              2,274,844,768 Cache DTLB Read                0.131 B/sec
stress-ng: info:  [208659]                  5,379,632 Cache DTLB Read Miss           0.309 M/sec ( 0.236%)
stress-ng: info:  [208659]                    570,784 Cache ITLB Read               32.793 K/sec
stress-ng: info:  [208659]                    928,992 Cache ITLB Read Miss          53.373 K/sec (162.757%)
stress-ng: info:  [208659]             71,604,748,928 Cache BPU Read                 4.114 B/sec
stress-ng: info:  [208659]                655,992,224 Cache BPU Read Miss           37.688 M/sec ( 0.916%)
stress-ng: info:  [208659]             93,444,858,736 CPU Clock                      5.369 B/sec
stress-ng: info:  [208659]             94,102,567,472 Task Clock                     5.406 B/sec
stress-ng: info:  [208659]                      7,488 Page Faults Total            430.201 /sec 
stress-ng: info:  [208659]                      7,488 Page Faults Minor            430.201 /sec 
stress-ng: info:  [208659]                          0 Page Faults Major              0.000 /sec 
stress-ng: info:  [208659]                     45,552 Context Switches               2.617 K/sec
stress-ng: info:  [208659]                     14,432 Cgroup Switches              829.148 /sec 
stress-ng: info:  [208659]                        672 CPU Migrations                38.608 /sec 
stress-ng: info:  [208659]                          0 Alignment Faults               0.000 /sec 
stress-ng: info:  [208659]                          0 Emulation Faults               0.000 /sec 
stress-ng: info:  [208659]                     14,432 Cgroup Switches              829.148 /sec 
stress-ng: info:  [208659]                      7,488 Page Faults User             430.201 /sec 
stress-ng: info:  [208659]                          0 Page Faults Kernel             0.000 /sec 
stress-ng: info:  [208659]                      3,040 System Call Enter            174.654 /sec 
stress-ng: info:  [208659]                      3,024 System Call Exit             173.735 /sec 
stress-ng: info:  [208659]                        688 TLB Flushes                   39.527 /sec 
stress-ng: info:  [208659]                          0 Software I/O TLB Bounces       0.000 /sec 
stress-ng: info:  [208659]                        144 Kmalloc                        8.273 /sec 
stress-ng: info:  [208659]                      1,744 Kfree                        100.196 /sec 
stress-ng: info:  [208659]                      3,760 Kmem Cache Alloc             216.020 /sec 
stress-ng: info:  [208659]                      9,232 Kmem Cache Free              530.397 /sec 
stress-ng: info:  [208659]                      7,104 MM Page Alloc                408.139 /sec 
stress-ng: info:  [208659]                      3,056 MM Page Free                 175.574 /sec 
stress-ng: info:  [208659]                          0 MMAP lock start                0.000 /sec 
stress-ng: info:  [208659]                          0 MMAP lock release              0.000 /sec 
stress-ng: info:  [208659]                          0 MMAP lock acquire              0.000 /sec 
stress-ng: info:  [208659]                    336,736 RCU Utilization               19.346 K/sec
stress-ng: info:  [208659]                          0 RCU Stall Warning              0.000 /sec 
stress-ng: info:  [208659]                      1,056 Sched Migrate Task            60.669 /sec 
stress-ng: info:  [208659]                          0 Sched Move NUMA                0.000 /sec 
stress-ng: info:  [208659]                      8,080 Sched Wakeup                 464.213 /sec 
stress-ng: info:  [208659]                          0 Sched Proc Exec                0.000 /sec 
stress-ng: info:  [208659]                          0 Sched Proc Exit                0.000 /sec 
stress-ng: info:  [208659]                          0 Sched Proc Fork                0.000 /sec 
stress-ng: info:  [208659]                         64 Sched Proc Free                3.677 /sec 
stress-ng: info:  [208659]                          0 Sched Proc Hang                0.000 /sec 
stress-ng: info:  [208659]                          0 Sched Proc Wait                0.000 /sec 
stress-ng: info:  [208659]                     45,552 Sched Switch                   2.617 K/sec
stress-ng: info:  [208659]                          0 Sched Wait Task                0.000 /sec 
stress-ng: info:  [208659]                          0 New Task                       0.000 /sec 
stress-ng: info:  [208659]                          0 Context User Enter             0.000 /sec 
stress-ng: info:  [208659]                          0 Context User Exit              0.000 /sec 
stress-ng: info:  [208659]                         16 Signal Generate                0.919 /sec 
stress-ng: info:  [208659]                         16 Signal Deliver                 0.919 /sec 
stress-ng: info:  [208659]                      1,408 IRQ Entry                     80.893 /sec 
stress-ng: info:  [208659]                      1,408 IRQ Exit                      80.893 /sec 
stress-ng: info:  [208659]                     36,288 Soft IRQ Entry                 2.085 K/sec
stress-ng: info:  [208659]                     36,288 Soft IRQ Exit                  2.085 K/sec
stress-ng: info:  [208659]                         48 Tasklet Entry                  2.758 /sec 
stress-ng: info:  [208659]                         48 Tasklet Exit                   2.758 /sec 
stress-ng: info:  [208659]                         48 NMI handler                    2.758 /sec 
stress-ng: info:  [208659]                        864 IPI Send CPU                  49.639 /sec 
stress-ng: info:  [208659]                          0 x86 Platform IPI Entry         0.000 /sec 
stress-ng: info:  [208659]                        512 Call Function Entry           29.415 /sec 
stress-ng: info:  [208659]                          0 IRQ Work Entry                 0.000 /sec 
stress-ng: info:  [208659]                    128,976 Local Timer Entry              7.410 K/sec
stress-ng: info:  [208659]                     14,624 Reschedule Entry             840.179 /sec 
stress-ng: info:  [208659]                          0 Thermal APIC Entry             0.000 /sec 
stress-ng: info:  [208659]                          0 Block BIO Complete             0.000 /sec 
stress-ng: info:  [208659]                          0 IOMAP Read Page                0.000 /sec 
stress-ng: info:  [208659]                          0 IO uring complete              0.000 /sec 
stress-ng: info:  [208659]                          0 Writeback Dirty Inode          0.000 /sec 
stress-ng: info:  [208659]                          0 Writeback Dirty Folio          0.000 /sec 
stress-ng: info:  [208659]                          0 Migrate MM Pages               0.000 /sec 
stress-ng: info:  [208659]                        528 SKB Consume                   30.335 /sec 
stress-ng: info:  [208659]                        928 SKB Kfree                     53.316 /sec 
stress-ng: info:  [208659]                         32 Lock Contention Begin          1.838 /sec 
stress-ng: info:  [208659]                         32 Lock Contention End            1.838 /sec 
stress-ng: info:  [208659]                          0 Maple Tree Read                0.000 /sec 
stress-ng: info:  [208659]                          0 Maple Tree Write               0.000 /sec 
stress-ng: info:  [208659]                          0 Qdisc Enqueue                  0.000 /sec 
stress-ng: info:  [208659]                          0 Qdisc Dequeue                  0.000 /sec 
stress-ng: info:  [208659]                  1,563,888 MSR read                      89.849 K/sec
stress-ng: info:  [208659]                  2,233,584 MSR write                      0.128 M/sec
stress-ng: info:  [208659]                          0 IOMMU IO Page Fault            0.000 /sec 
stress-ng: info:  [208659]                          0 IOMMU Map                      0.000 /sec 
stress-ng: info:  [208659]                         64 IOMMU Unmap                    3.677 /sec 
stress-ng: info:  [208659]                          0 Filemap Page-Cache Add         0.000 /sec 
stress-ng: info:  [208659]                          0 Filemap Page-Cache Del         0.000 /sec 
stress-ng: info:  [208659]                          0 OOM Compact Retry              0.000 /sec 
stress-ng: info:  [208659]                          0 OOM Wake Reaper                0.000 /sec 
stress-ng: info:  [208659]                         16 OOM Score Adjust Update        0.919 /sec 
stress-ng: info:  [208659]                          0 Thermal Zone Trip              0.000 /sec 
stress-ng: info:  [208659] sock:
stress-ng: info:  [208659]            613,851,257,616 CPU Cycles                    35.267 B/sec
stress-ng: info:  [208659]            390,628,115,344 Instructions                  22.442 B/sec (0.636 instr. per cycle)
stress-ng: info:  [208659]             74,590,369,904 Branch Instructions            4.285 B/sec
stress-ng: info:  [208659]              8,682,837,632 Branch Misses                  0.499 B/sec (11.641%)
stress-ng: info:  [208659]            269,966,195,472 Stalled Cycles Frontend       15.510 B/sec
stress-ng: info:  [208659]            474,207,429,664 Total Cycles                  27.244 B/sec
stress-ng: info:  [208659]             37,944,279,872 Cache References               2.180 B/sec
stress-ng: info:  [208659]              1,631,887,552 Cache Misses                  93.755 M/sec ( 4.301%)
stress-ng: info:  [208659]            188,009,586,096 Cache L1D Read                10.802 B/sec
stress-ng: info:  [208659]             20,286,454,800 Cache L1D Read Miss            1.165 B/sec (10.790%)
stress-ng: info:  [208659]              5,290,863,696 Cache L1D Prefetch             0.304 B/sec
stress-ng: info:  [208659]            102,980,695,232 Cache L1I Read                 5.916 B/sec
stress-ng: info:  [208659]                202,967,520 Cache L1I Read Miss           11.661 M/sec
stress-ng: info:  [208659]              1,427,227,504 Cache DTLB Read               81.997 M/sec
stress-ng: info:  [208659]                 36,294,288 Cache DTLB Read Miss           2.085 M/sec ( 2.543%)
stress-ng: info:  [208659]                  3,509,024 Cache ITLB Read                0.202 M/sec
stress-ng: info:  [208659]                150,275,088 Cache ITLB Read Miss           8.634 M/sec (4282.532%)
stress-ng: info:  [208659]             74,858,759,584 Cache BPU Read                 4.301 B/sec
stress-ng: info:  [208659]              8,714,853,120 Cache BPU Read Miss            0.501 B/sec (11.642%)
stress-ng: info:  [208659]            128,720,099,072 CPU Clock                      7.395 B/sec
stress-ng: info:  [208659]            129,976,732,512 Task Clock                     7.467 B/sec
stress-ng: info:  [208659]                      1,024 Page Faults Total             58.831 /sec 
stress-ng: info:  [208659]                      1,008 Page Faults Minor             57.912 /sec 
stress-ng: info:  [208659]                          0 Page Faults Major              0.000 /sec 
stress-ng: info:  [208659]                    500,288 Context Switches              28.743 K/sec
stress-ng: info:  [208659]                     12,864 Cgroup Switches              739.063 /sec 
stress-ng: info:  [208659]                      1,840 CPU Migrations               105.712 /sec 
stress-ng: info:  [208659]                          0 Alignment Faults               0.000 /sec 
stress-ng: info:  [208659]                          0 Emulation Faults               0.000 /sec 
stress-ng: info:  [208659]                     12,864 Cgroup Switches              739.063 /sec 
stress-ng: info:  [208659]                        896 Page Faults User              51.477 /sec 
stress-ng: info:  [208659]                        128 Page Faults Kernel             7.354 /sec 
stress-ng: info:  [208659]                 78,987,632 System Call Enter              4.538 M/sec
stress-ng: info:  [208659]                 78,987,632 System Call Exit               4.538 M/sec
stress-ng: info:  [208659]                    424,752 TLB Flushes                   24.403 K/sec
stress-ng: info:  [208659]                          0 Software I/O TLB Bounces       0.000 /sec 
stress-ng: info:  [208659]                      2,416 Kmalloc                      138.804 /sec 
stress-ng: info:  [208659]                      4,416 Kfree                        253.708 /sec 
stress-ng: info:  [208659]                 21,471,120 Kmem Cache Alloc               1.234 M/sec
stress-ng: info:  [208659]                 20,702,688 Kmem Cache Free                1.189 M/sec
stress-ng: info:  [208659]                  6,516,656 MM Page Alloc                  0.374 M/sec
stress-ng: info:  [208659]                  6,532,816 MM Page Free                   0.375 M/sec
stress-ng: info:  [208659]                        288 MMAP lock start               16.546 /sec 
stress-ng: info:  [208659]                        288 MMAP lock release             16.546 /sec 
stress-ng: info:  [208659]                        320 MMAP lock acquire             18.385 /sec 
stress-ng: info:  [208659]                  1,293,632 RCU Utilization               74.322 K/sec
stress-ng: info:  [208659]                          0 RCU Stall Warning              0.000 /sec 
stress-ng: info:  [208659]                      1,856 Sched Migrate Task           106.631 /sec 
stress-ng: info:  [208659]                          0 Sched Move NUMA                0.000 /sec 
stress-ng: info:  [208659]                    315,872 Sched Wakeup                  18.147 K/sec
stress-ng: info:  [208659]                          0 Sched Proc Exec                0.000 /sec 
stress-ng: info:  [208659]                         16 Sched Proc Exit                0.919 /sec 
stress-ng: info:  [208659]                         16 Sched Proc Fork                0.919 /sec 
stress-ng: info:  [208659]                         32 Sched Proc Free                1.838 /sec 
stress-ng: info:  [208659]                          0 Sched Proc Hang                0.000 /sec 
stress-ng: info:  [208659]                         16 Sched Proc Wait                0.919 /sec 
stress-ng: info:  [208659]                    500,288 Sched Switch                  28.743 K/sec
stress-ng: info:  [208659]                          0 Sched Wait Task                0.000 /sec 
stress-ng: info:  [208659]                         16 New Task                       0.919 /sec 
stress-ng: info:  [208659]                          0 Context User Enter             0.000 /sec 
stress-ng: info:  [208659]                          0 Context User Exit              0.000 /sec 
stress-ng: info:  [208659]                         48 Signal Generate                2.758 /sec 
stress-ng: info:  [208659]                         48 Signal Deliver                 2.758 /sec 
stress-ng: info:  [208659]                          0 IRQ Entry                      0.000 /sec 
stress-ng: info:  [208659]                          0 IRQ Exit                       0.000 /sec 
stress-ng: info:  [208659]                  3,295,440 Soft IRQ Entry                 0.189 M/sec
stress-ng: info:  [208659]                  3,295,440 Soft IRQ Exit                  0.189 M/sec
stress-ng: info:  [208659]                          0 Tasklet Entry                  0.000 /sec 
stress-ng: info:  [208659]                          0 Tasklet Exit                   0.000 /sec 
stress-ng: info:  [208659]                         48 NMI handler                    2.758 /sec 
stress-ng: info:  [208659]                     28,544 IPI Send CPU                   1.640 K/sec
stress-ng: info:  [208659]                          0 x86 Platform IPI Entry         0.000 /sec 
stress-ng: info:  [208659]                        448 Call Function Entry           25.739 /sec 
stress-ng: info:  [208659]                          0 IRQ Work Entry                 0.000 /sec 
stress-ng: info:  [208659]                    135,792 Local Timer Entry              7.802 K/sec
stress-ng: info:  [208659]                      4,720 Reschedule Entry             271.174 /sec 
stress-ng: info:  [208659]                          0 Thermal APIC Entry             0.000 /sec 
stress-ng: info:  [208659]                          0 Block BIO Complete             0.000 /sec 
stress-ng: info:  [208659]                          0 IOMAP Read Page                0.000 /sec 
stress-ng: info:  [208659]                          0 IO uring complete              0.000 /sec 
stress-ng: info:  [208659]                          0 Writeback Dirty Inode          0.000 /sec 
stress-ng: info:  [208659]                          0 Writeback Dirty Folio          0.000 /sec 
stress-ng: info:  [208659]                          0 Migrate MM Pages               0.000 /sec 
stress-ng: info:  [208659]                  1,750,352 SKB Consume                    0.101 M/sec
stress-ng: info:  [208659]                        320 SKB Kfree                     18.385 /sec 
stress-ng: info:  [208659]                      1,360 Lock Contention Begin         78.135 /sec 
stress-ng: info:  [208659]                      1,328 Lock Contention End           76.296 /sec 
stress-ng: info:  [208659]                        160 Maple Tree Read                9.192 /sec 
stress-ng: info:  [208659]                      2,912 Maple Tree Write             167.300 /sec 
stress-ng: info:  [208659]                          0 Qdisc Enqueue                  0.000 /sec 
stress-ng: info:  [208659]                          0 Qdisc Dequeue                  0.000 /sec 
stress-ng: info:  [208659]                  7,051,328 MSR read                       0.405 M/sec
stress-ng: info:  [208659]                  4,604,496 MSR write                      0.265 M/sec
stress-ng: info:  [208659]                          0 IOMMU IO Page Fault            0.000 /sec 
stress-ng: info:  [208659]                          0 IOMMU Map                      0.000 /sec 
stress-ng: info:  [208659]                          0 IOMMU Unmap                    0.000 /sec 
stress-ng: info:  [208659]                          0 Filemap Page-Cache Add         0.000 /sec 
stress-ng: info:  [208659]                          0 Filemap Page-Cache Del         0.000 /sec 
stress-ng: info:  [208659]                          0 OOM Compact Retry              0.000 /sec 
stress-ng: info:  [208659]                          0 OOM Wake Reaper                0.000 /sec 
stress-ng: info:  [208659]                         16 OOM Score Adjust Update        0.919 /sec 
stress-ng: info:  [208659]                          0 Thermal Zone Trip              0.000 /sec 
stress-ng: info:  [208659] skipped: 0
stress-ng: info:  [208659] passed: 32: cpu (16) sock (16)
stress-ng: info:  [208659] failed: 0
stress-ng: info:  [208659] metrics untrustworthy: 0
stress-ng: info:  [208659] successful run completed in 17.41 secs

Требуется расширить обёртку над stress-ng возможностью передать флаг perf и парсером данных метрик, чтобы их также собирать в БД.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

Fields

No fields configured for Task.

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions