IT技术博客大学习 共学习 共进步
全部 移动开发 后端 数据库 AI 算法 安全 DevOps 前端 设计 开发者

ioprofile调查应用IO情况的利器

Erlang非业余研究 2011-01-16 22:37:20 累计浏览 2,469 次
本机暂存

我们在做IO密集型的应用程序的时候,比如MySQL数据库,通常系统的表现取决于workload的类型。 比如我们要调优,我们就必须非常清楚的知道数据的访问规律,收集到足够的数据,用来做调优的依据。

有很多工具可以收集系统层面的,设备层面的,进程层面的IO数据,但是没有一个现成的工具可以回答我们比如应用打开了多少文件,文件的读和写的比例是多少,调用了多少次sync, 每次的数据大小是多少,调用了多少次,每次用了多少时间, 是顺序操作还是随机操作,是那个线程发起的操作。

当然如果你对系统足够熟悉的话,你可以用systemtap来编写脚本获取这些数据,也不是什么难事。但是大部分的同学没有足够的耐心去做这个。

这时候Percona同样来救助了。他提供了一整套工具来协助定位MySQL服务器的问题。这套工具适合于大部分的IO服务器。

Aspersa is a collection of open-source system utilities primarily designed to ease the work of Percona consultants. This manual is the primary documentation for Aspersa tools. Please contribute your improvements.

项目地址: http://code.google.com/p/aspersa/
ioprofile的使用文档: http://aspersa.googlecode.com/svn/html/ioprofile.html

它依赖于strace和lsof来做统计,所以在运行的时候会对目标系统产生一定的性能影响,不过还好,你可以指定收集数据的时间。

现在我们来试验下效果:

以下是引用片段:
[chuba@test.flashcache.sqa.cm4 ~]$ sudo /tmp/aspersa-read-only/ioprofile -p 21826 
Password: 
Sun Jan 16 02:16:52 CST 2011 
     total      pread     pwrite      write      fsync filename 
  0.491959   0.000000   0.453529   0.000000   0.038430 /mnt/ibdata1
  0.296719   0.000000   0.273126   0.000000   0.023593 /mnt/ib_logfile0
  0.161494   0.061440   0.091133   0.000000   0.008921 /u01/mysql/data/ic_test/auction_auctions_0021.ibd 
  0.146056   0.036532   0.102320   0.000000   0.007204 /u01/mysql/data/ic_test/auction_auctions_0020.ibd 
  0.144570   0.007500   0.128466   0.000000   0.008604 /u01/mysql/data/ic_test/auction_auctions_0058.ibd 
  0.138565   0.054159   0.078342   0.000000   0.006064 /u01/mysql/data/ic_test/auction_auctions_0009.ibd 
  0.136702   0.017857   0.111383   0.000000   0.007462 /u01/mysql/data/ic_test/auction_auctions_0000.ibd 
... 
  
[chuba@test.flashcache.sqa.cm4 ~]$ sudo /tmp/aspersa-read-only/ioprofile -p 21826 -c count 
Sun Jan 16 02:18:31 CST 2011 
     total      pread     pwrite      write      fsync       open filename 
      1439          0       1410          0         29          0 /mnt/ib_logfile1
       691          0          0        691          0          0 /u01/mysql/log/mysql-bin.000169 
       366         20        301          0         45          0 /u01/mysql/data/ic_test/auction_auctions_0012.ibd 
       362          0        235          0        127          0 /mnt/ibdata1
       301         18        243          0         40          0 /u01/mysql/data/ic_test/auction_auctions_0036.ibd 
       292         18        237          0         37          0 /u01/mysql/data/ic_test/auction_auctions_0026.ibd 
       291         21        230          0         40          0 /u01/mysql/data/ic_test/auction_auctions_0027.ibd 
       288         21        236          0         31          0 /u01/mysql/data/ic_test/auction_auctions_0013.ibd 
.. 
  
[chuba@test.flashcache.sqa.cm4 ~]$ sudo /tmp/aspersa-read-only/ioprofile -p 21826 -c sizes 
Sun Jan 16 02:22:01 CST 2011 
     total      pread     pwrite      write      fsync filename 
 225542144          0  225542144          0          0 /mnt/ibdata1
   6963200     229376    6733824          0          0 /u01/mysql/data/ic_test/auction_auctions_0013.ibd 
   6094848     360448    5734400          0          0 /u01/mysql/data/ic_test/auction_auctions_0026.ibd 
   5881856     278528    5603328          0          0 /u01/mysql/data/ic_test/auction_auctions_0031.ibd 
   5849088     393216    5455872          0          0 /u01/mysql/data/ic_test/auction_auctions_0035.ibd 
   5816320     311296    5505024          0          0 /u01/mysql/data/ic_test/auction_auctions_0036.ibd 
   5701632     294912    5406720          0          0 /u01/mysql/data/ic_test/auction_auctions_0022.ibd 
   5488640     376832    5111808          0          0 /u01/mysql/data/ic_test/auction_auctions_0029.ibd 
... 
  
[chuba@test.flashcache.sqa.cm4 ~]$ sudo /tmp/aspersa-read-only/ioprofile -p 21826 -c times
Sun Jan 16 02:25:36 CST 2011 
     total      pread     pwrite      write      fsync filename 
  0.448082   0.000000   0.413493   0.000000   0.034589 /mnt/ibdata1
  0.313238   0.000000   0.282403   0.000000   0.030835 /mnt/ib_logfile3
  0.163073   0.089651   0.065107   0.000000   0.008315 /u01/mysql/data/ic_test/auction_auctions_0005.ibd 
  0.143463   0.004427   0.130650   0.000000   0.008386 /u01/mysql/data/ic_test/auction_auctions_0011.ibd 
  0.137938   0.048641   0.080933   0.000000   0.008364 /u01/mysql/data/ic_test/auction_auctions_0021.ibd 
  0.137061   0.006563   0.120739   0.000000   0.009759 /u01/mysql/data/ic_test/auction_auctions_0018.ibd 
  0.136427   0.000000   0.000000   0.136427   0.000000 /u01/mysql/log/mysql-bin.000170 
  0.125673   0.043824   0.074042   0.000000   0.007807 /u01/mysql/data/ic_test/auction_auctions_0000.ibd 
... 
  
[chuba@test.flashcache.sqa.cm4 ~]$ sudo /tmp/aspersa-read-only/ioprofile -p 21826 -c sizes -g filename 
Sun Jan 16 02:29:54 CST 2011 
     total      pread     pwrite      write      fsync       open filename 
 274186240          0  274186240          0          0          0 /mnt/ibdata1
   8306688     442368    7864320          0          0          0 /u01/mysql/data/ic_test/auction_auctions_0044.ibd 
   6881280     262144    6619136          0          0          0 /u01/mysql/data/ic_test/auction_auctions_0042.ibd 
   6799360     344064    6455296          0          0          0 /u01/mysql/data/ic_test/auction_auctions_0053.ibd 
   6668288     475136    6193152          0          0          0 /u01/mysql/data/ic_test/auction_auctions_0047.ibd 
   6602752     327680    6275072          0          0          0 /u01/mysql/data/ic_test/auction_auctions_0027.ibd 
   6504448     344064    6160384          0          0          0 /u01/mysql/data/ic_test/auction_auctions_0041.ibd 
   6275072     344064    5931008          0          0          0 /u01/mysql/data/ic_test/auction_auctions_0024.ibd 
   6094848     393216    5701632          0          0          0 /u01/mysql/data/ic_test/auction_auctions_0038.ibd 
   6078464     180224    5898240          0          0          0 /u01/mysql/data/ic_test/auction_auctions_0037.ibd 
... 
  
[chuba@test.flashcache.sqa.cm4 ~]$ sudo /tmp/aspersa-read-only/ioprofile -p 21826 -c sizes -g pid 
Sun Jan 16 02:31:02 CST 2011 
     total      pread     pwrite      write      fsync pid 
 270971904      32768  270939136          0          0 21854 
  70975488          0   70975488          0          0 21844 
  67518464          0   67518464          0          0 21842 
  66797568          0   66797568          0          0 21843 
  65568768          0   65568768          0          0 21841 
... 
  
[chuba@test.flashcache.sqa.cm4 ~]$ sudo /tmp/aspersa-read-only/ioprofile -p 21826 -c sizes -g all 
Sun Jan 16 02:32:15 CST 2011 
 548216907 TOTAL 
 520120320 pwrite 
  27475968 pread 
    620619 write 
         0 fsync
 

玩的开心!

同分类推荐文章

  1. 使用deepseek进行Oracle恢复,引起重大故障 (2026-06-22 10:56:00)
  2. 接手一个只差临门一脚的数据库恢复 (2026-06-18 00:13:09)
  3. 我做了一个 AI 版的 StarRocks 升级风险扫描工具,直接帮我定位到一个风险 (2026-06-15 01:00:00)

查看更多 数据库 文章 →

建议继续学习

  1. 用Hyer来进行网站的抓取 (累计阅读 158,251)
  2. MySQL数据库在实际应用一些方面的介绍 (累计阅读 36,399)
  3. WordPress插件开发 -- 在插件使用数据库存储数据 (累计阅读 29,164)
  4. Mysql监控指南 (累计阅读 21,351)
  5. 由浅入深探究mysql索引结构原理、性能分析与优化 (累计阅读 16,523)
  6. 在Apache2.2.XX下安装Mod-myvhost模块 (累计阅读 13,057)
  7. 15个最好的免费开源电子商务平台 (累计阅读 12,541)
  8. 浅谈MySQL索引背后的数据结构及算法 (累计阅读 11,907)
  9. 整理了一份招PHP高级工程师的面试题 (累计阅读 11,708)
  10. 深入浅出INNODB MVCC机制与原理 (累计阅读 9,693)