<?xml version="1.0" encoding="UTF-8" ?>
<rss version="2.0">
<channel>
<title><![CDATA[向东博客 专注WEB应用 构架之美 --- 构架之美，在于尽态极妍 | 应用之美，在于药到病除]]></title> 
<link>http://www.jackxiang.com/index.php</link> 
<description><![CDATA[赢在IT，Playin' with IT,Focus on Killer Application,Marketing Meets Technology.]]></description> 
<language>zh-cn</language> 
<copyright><![CDATA[向东博客 专注WEB应用 构架之美 --- 构架之美，在于尽态极妍 | 应用之美，在于药到病除]]></copyright>
<item>
<link>http://www.jackxiang.com/post//</link>
<title><![CDATA[[实践OK]DD命令复制磁盘文件，服务器磁盘坏块检查，Linux下分割、合并文件——dd和cat,linux dd指令用法中参数bs,count,linux dd磁盘坏块修复。]]></title> 
<author>jack &lt;xdy108@126.com&gt;</author>
<category><![CDATA[Unix/LinuxC技术]]></category>
<pubDate>Thu, 18 Apr 2013 09:15:16 +0000</pubDate> 
<guid>http://www.jackxiang.com/post//</guid> 
<description>
<![CDATA[ 
	DD命令复制磁盘文件：<br/>linux下使用dd命令复制磁盘<br/># dd if=/dev/sdc of=/dev/sdd bs=2M status=progress<br/><textarea name="code" class="php" rows="15" cols="100">
Disk /dev/sdc: 500.1 GB, 500107862016 bytes, 976773168 sectors&nbsp;&nbsp; [机械磁盘]
Disk /dev/sdb: 480.1 GB, 480103981056 bytes, 937703088 sectors&nbsp;&nbsp;[固态硬盘]

dd if=/dev/sdc of=/dev/sdb


dd: writing to ‘/dev/sdb’: No space left on device
937703089+0 records in
937703088+0 records out
480103981056 bytes (480 GB) copied, 10647.6 s, 45.1 MB/s

用固态硬盘时出现下面的盘找不到，磁盘太小：
/dev/mapper/centos00-root&nbsp;&nbsp;
/dev/mapper/centos00-home 
</textarea><br/><br/><br/>服务器磁盘坏块检查：<br/><textarea name="code" class="php" rows="15" cols="100">
sudo badblocks -s -v -o sdbbadblocks.log /dev/cciss/c0d0
</textarea><br/><br/>badblocks -s -v /dev/sdb&nbsp;&nbsp;<br/>实践如下：<br/><textarea name="code" class="php" rows="15" cols="100">
badblocks -s -v /dev/sda
Checking blocks 0 to 976762583
Checking for bad blocks (read-only test):&nbsp;&nbsp; 0.58% done, 0:42 elapsed. (0/0/0 errors)
</textarea><br/>====================================================<br/>linux dd指令用法中参数bs,count:<br/>bs=600 count=1，备份第一块为600个字节的区域<br/>若显示0+0,表示备份的空间不到一块指定大小的区域.(大小默认好象为512个字节)<br/>bs=512 count=2，备份前2块总共为1024个字节的区域 <br/>屏幕上显示2+1,表示备份了2个块，1表示文件被整个备份了<br/>屏幕上显示2+0,表示备份了2个块，0表示文件没被整个备份<br/><br/>cat /tmp/sdbbadblocks.log <br/>774968152 774968153 774968154 774968155 774968900 774968901 774968902 774968903 774969648 774969649 774969650 774969651 774970396 774970397 774970398 774970399 774971144 774971145 774971146 774971147 774971892 774971893 774971894 774971895 774973516 774973517 774973518 774973519<br/>写入：<br/>badblocks -w -f /dev/sda 774968152 774968153 774968154 774968155 774968900 774968901 774968902 774968903 774969648 774969649 774969650 774969651 774970396 774970397 774970398 774970399 774971144 774971145 774971146 774971147 774971892 774971893 774971894 774971895 774973516 774973517 774973518 774973519<br/><br/>badblocks是Linux下常用的坏道修复工具。当你觉得硬盘上可能有坏道，或者是SMART数据显示有坏道的时候，都可以用badblocks来检查一下。<br/><br/>假设我们要检查的硬盘是/dev/sdb<br/><br/>$sudo badblocks -s -v -o sdbbadblocks.log /dev/sdb<br/><br/>这样就可以对硬盘进行只读扫描，自动获取硬盘块数目并扫描全部块，将扫描日志输出到屏幕同时记录在sdbbadblocks.log文件中。<br/><br/>由于扫描速度比较低，一次不一定能扫完，可以分多次进行。<br/><br/>sudo badblocks -s -v -o sdbbadblocks.log /dev/sdb END START<br/><br/>将END和START换成结束和开始的块的编号就可以了。<br/><br/>如果找到了坏道，可以进行写入扫描进行修复。写入扫描遇到坏道的时候会自动重映射。写入扫描会覆盖原有数据，所以请先备份。写入扫描速度很低，所以应该只扫描只读扫描时候发现错误的部分。<br/><br/>$sudo badblocks -w -s /dev/sdb END START<br/><br/>背景：Unix上传文件如果是分块断点上传，需要合并文件，如果是想做测试，需要分割文件。<br/>我們得到了一个文件/root/sdb.bad :<br/><br/>16435904<br/><br/>sdb 有1个坏块<br/><br/>先用dd尽量备份坏块<br/><br/>6.dd if=/dev/sdb bs=4096 skip=16435904 of=/tmp/15435904.dat count=1<br/><br/>如果显示读取字节数是0就多试几次, 不行就可能丢失此块数据, 倒是不用担心,一般不会有太大问题.<br/><br/>用badblocks的写测试功能，对这些坏块进行重写(注意! -w写测试会覆盖数据)：<br/><br/>7.badblocks -w -f /dev/sdb2 16435904 16435904<br/><br/>如果前面的操作有成功的备份/tmp/15435904.dat, 就把它写回:<br/><br/>8.dd if=/tmp/15435904.dat of=/dev/sdb seek=15435904 bs=4096 count=1<br/><br/>其实我们不需要等待badblocks扫描完成， 就可以进行修复。<br/><br/>badblocks是对块设备进行处理， 所以可以实现对挂载中的系统进行处理。<br/><br/>在修复前后，利用smartctl 对磁盘进行long测试<br/><br/># smartctl -l selftest /dev/sdb<br/><br/>dd的作用是转换和拷贝文件，我们可以利用它来分割文件，相关的选项如下：<br/>if=filename：输入的文件名<br/>of=finename：输出的文件名<br/>bs=bytes：一次读写的字节数，默认是512bytes<br/>skip=blocks:拷贝前，跳过的输入文件的前blocks块，块的大小有bs决定<br/>count=blocks：只拷贝输入文件的前blocks块<br/> <br/>例如，现在有一个文件file，大小为116616字节：<br/>[plain] view plaincopy<br/>[root]# du -b file&nbsp;&nbsp;<br/>116616&nbsp;&nbsp;file&nbsp;&nbsp;<br/>将其分割为两文件file1和file2，那我们就设置每块为1024字节，将file的前60块放入file1，余下的放入file2：<br/>[plain] view plaincopy<br/>[root]# dd if=file bs=1024 count=60 skip=0&nbsp;&nbsp;of=file1&nbsp;&nbsp;<br/>[root]# dd if=file bs=1024 count=60 skip=60 of=file2&nbsp;&nbsp;<br/>然后用cat将两个文件合并为file.bak，要注意文件的顺序：<br/>[plain] view plaincopy<br/>[root]# cat file1 file2 &gt; file.bak&nbsp;&nbsp;<br/>可以用md5sum验证一下file和file.bak：<br/>[plain] view plaincopy<br/>[root]# md5sum file&nbsp;&nbsp;<br/>3ff53f7c30421ace632eefff36148a70&nbsp;&nbsp;file&nbsp;&nbsp;<br/>[root]# md5sum file.bak&nbsp;&nbsp;<br/>3ff53f7c30421ace632eefff36148a70&nbsp;&nbsp;file.bak&nbsp;&nbsp;<br/>可以证明两个文件时完全相同的。<br/> <br/>为了方便分割、合并文件，我写了两个脚本：<br/>ddf.sh：<br/>[python] view plaincopy<br/>#ddf.sh：分割文件，分割后的文件以数字结尾，例如file分割为两个文件：file1和file2&nbsp;&nbsp;<br/>#!/bin/sh&nbsp;&nbsp;<br/>&nbsp;&nbsp;<br/>#使用脚本是第一参数是要分割的文件名&nbsp;&nbsp;<br/>Filename=$1&nbsp;&nbsp;&nbsp;&nbsp; <br/>Filesize=0&nbsp;&nbsp;<br/>&nbsp;&nbsp;<br/>Path=`pwd`&nbsp;&nbsp;<br/>&nbsp;&nbsp;<br/>#验证文件名是否正确，然后计算文件的大小&nbsp;&nbsp;<br/>if [ -z $Filename ];then&nbsp;&nbsp;<br/>&nbsp;&nbsp;&nbsp;&nbsp;echo &quot;Error:The file name can not be empty&quot;&nbsp;&nbsp;<br/>&nbsp;&nbsp;&nbsp;&nbsp;exit&nbsp;&nbsp;<br/>fi&nbsp;&nbsp;<br/>if [ -e $Filename ];then&nbsp;&nbsp;<br/>&nbsp;&nbsp;&nbsp;&nbsp;Filesize=`du -b $Filename &#124; awk &#039;&#123;print $1&#125;&#039;`&nbsp;&nbsp;<br/>&nbsp;&nbsp;&nbsp;&nbsp;if [ $Filesize == 0 ];then&nbsp;&nbsp;<br/>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;echo &quot;Error:The File size is zero!&quot;&nbsp;&nbsp;<br/>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;exit&nbsp;&nbsp;<br/>&nbsp;&nbsp;&nbsp;&nbsp;fi&nbsp;&nbsp;<br/>&nbsp;&nbsp;&nbsp;&nbsp;echo &quot;The file size is $Filesize Byte&quot;&nbsp;&nbsp;<br/>&nbsp;&nbsp;&nbsp;&nbsp;echo &quot;Plese enter the subfile size(KB):&quot;&nbsp;&nbsp;<br/>else&nbsp;&nbsp;<br/>&nbsp;&nbsp;&nbsp;&nbsp;echo &quot;Error:$Filename does not exist!&quot;&nbsp;&nbsp;<br/>&nbsp;&nbsp;&nbsp;&nbsp;exit&nbsp;&nbsp; <br/>fi&nbsp;&nbsp;<br/>&nbsp;&nbsp;<br/>#输入分割后每个文件的大小，单位是KB&nbsp;&nbsp;<br/>read Subfilesize&nbsp;&nbsp;<br/>if [ -z $Subfilesize ];then&nbsp;&nbsp;<br/>&nbsp;&nbsp;&nbsp;&nbsp;echo &quot;Error:Input can not be empty&quot;&nbsp;&nbsp;<br/>&nbsp;&nbsp;&nbsp;&nbsp;exit&nbsp;&nbsp;<br/>fi&nbsp;&nbsp;<br/>&nbsp;&nbsp;<br/>echo $Subfilesize &#124; grep &#039;^[0-9]&#92;+$&#039; &gt;&gt; /dev/null&nbsp;&nbsp;<br/>if [ $? -ne 0 ];then&nbsp;&nbsp;<br/>&nbsp;&nbsp;&nbsp;&nbsp;echo &quot;Error:The Input is not a number!&quot;&nbsp;&nbsp;<br/>&nbsp;&nbsp;&nbsp;&nbsp;exit&nbsp;&nbsp;<br/>elif [ $Subfilesize -eq 0 ];then&nbsp;&nbsp;<br/>&nbsp;&nbsp;&nbsp;&nbsp;echo &quot;Error:The Subfile size is zero!&quot;&nbsp;&nbsp;<br/>&nbsp;&nbsp;&nbsp;&nbsp;exit&nbsp;&nbsp;<br/>fi&nbsp;&nbsp;<br/>&nbsp;&nbsp;<br/>#计算需要分割为几个文件&nbsp;&nbsp;<br/>SubfileByte=`expr $Subfilesize &#92;* 1024`&nbsp;&nbsp;<br/>Subfilenum=`expr $Filesize / $SubfileByte`&nbsp;&nbsp;<br/>if [ `expr $Filesize % $Subfilesize` -ne 0 ];then&nbsp;&nbsp;<br/>&nbsp;&nbsp;&nbsp;&nbsp;Subfilenum=`expr $Subfilenum + 1`&nbsp;&nbsp;<br/>fi&nbsp;&nbsp;<br/>&nbsp;&nbsp;<br/>#将文件分割&nbsp;&nbsp;<br/>echo &quot;$Filename will be divided into $Subfilenum&quot;&nbsp;&nbsp; <br/>i=1&nbsp;&nbsp;<br/>skipnum=0&nbsp;&nbsp;<br/>while [ $i -le $Subfilenum ]&nbsp;&nbsp;<br/>do&nbsp;&nbsp;<br/>&nbsp;&nbsp;&nbsp;&nbsp;echo &quot;$Filename$i&quot;&nbsp;&nbsp;<br/>&nbsp;&nbsp;&nbsp;&nbsp;dd if=$Filename of=&quot;$Path/$Filename$i&quot; bs=1024 count=$Subfilesize skip=$skipnum&nbsp;&nbsp;<br/>&nbsp;&nbsp;&nbsp;&nbsp;i=`expr $i + 1`&nbsp;&nbsp;<br/>&nbsp;&nbsp;&nbsp;&nbsp;skipnum=`expr $skipnum + $Subfilesize`&nbsp;&nbsp;<br/>done&nbsp;&nbsp;<br/>echo &quot;$Filename has been divided into $Subfilenum&quot;&nbsp;&nbsp;<br/>echo &quot;Done !&quot;&nbsp;&nbsp;<br/> <br/>caf.sh：<br/>[python] view plaincopy<br/>#caf.sh:合并文件，需要合并的文件要放在一个文件夹里&nbsp;&nbsp;<br/>#&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 文件名分为两个部分，第一部分都相同，第二部分必须是从1开始的连续数字，例如file1，file2，file3&nbsp;&nbsp;<br/>#&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 合并后的文件名为file.bak&nbsp;&nbsp;<br/>#!/bin/sh&nbsp;&nbsp;<br/>&nbsp;&nbsp;<br/>#输入文件名的第一部分&nbsp;&nbsp;<br/>echo &quot;Please enter file name:&quot;&nbsp;&nbsp;<br/>read Filename&nbsp;&nbsp;<br/>if [ -z $Filename ];then&nbsp;&nbsp;<br/>&nbsp;&nbsp;&nbsp;&nbsp;echo &quot;Error:File name can not be empty&quot;&nbsp;&nbsp;<br/>&nbsp;&nbsp;&nbsp;&nbsp;exit&nbsp;&nbsp;<br/>fi&nbsp;&nbsp;<br/>&nbsp;&nbsp;<br/>#输入待合并文件的个数&nbsp;&nbsp;<br/>echo &quot;Please enter the number of subfiles:&quot;&nbsp;&nbsp; <br/>read Subfilenum&nbsp;&nbsp;<br/>if [ -z $Subfilenum ];then&nbsp;&nbsp;<br/>&nbsp;&nbsp;&nbsp;&nbsp;echo &quot;Error:The number of subfiles can not be empty&quot;&nbsp;&nbsp;<br/>&nbsp;&nbsp;&nbsp;&nbsp;exit&nbsp;&nbsp;<br/>fi&nbsp;&nbsp;<br/>echo $Subfilenum &#124; grep &#039;^[0-9]&#92;+$&#039; &gt; /dev/null&nbsp;&nbsp;<br/>if [ $? -ne 0 ];then&nbsp;&nbsp;<br/>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;echo &quot;Error:Input must be a number&quot;&nbsp;&nbsp;<br/>exit&nbsp;&nbsp;<br/>fi&nbsp;&nbsp;<br/>if [ $Subfilenum -eq 0 ];then&nbsp;&nbsp;<br/>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;echo &quot;Error:The number of subfiles can not be zero&quot;&nbsp;&nbsp;<br/>exit&nbsp;&nbsp;<br/>fi&nbsp;&nbsp;<br/>&nbsp;&nbsp;<br/>&nbsp;&nbsp;<br/>#合并文件&nbsp;&nbsp;<br/>i=1&nbsp;&nbsp;<br/>Newfile=$Filename&#92;.bak&nbsp;&nbsp;<br/>while [ $i -le $Subfilenum ]&nbsp;&nbsp;<br/>do&nbsp;&nbsp;<br/>&nbsp;&nbsp;&nbsp;&nbsp;Subfilename=$Filename$i&nbsp;&nbsp;<br/>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;if [ -e $Subfilename ];then&nbsp;&nbsp;<br/>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;echo &quot;$Subfilename done!&quot;&nbsp;&nbsp;<br/>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;cat $Subfilename &gt;&gt; $Newfile&nbsp;&nbsp;<br/>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;i=`expr $i + 1`&nbsp;&nbsp;<br/>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;else&nbsp;&nbsp;<br/>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;echo &quot;Error:$Subfilename does not exist&quot;&nbsp;&nbsp;<br/>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;rm -rf $Newfile&nbsp;&nbsp;<br/>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;exit&nbsp;&nbsp;<br/>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;fi&nbsp;&nbsp;<br/>done&nbsp;&nbsp;<br/>&nbsp;&nbsp;<br/>&nbsp;&nbsp;<br/>echo &quot;Subfiles be merged into $Newfile&quot;&nbsp;&nbsp;<br/>echo &quot;Success!&quot;&nbsp;&nbsp;<br/> <br/>用这两个脚本完成对file的分割、合并：<br/>[python] view plaincopy<br/>[root]# ./ddf.sh file&nbsp;&nbsp; <br/>The file size is 116616 Byte&nbsp;&nbsp;<br/>Plese enter the subfile size(KB):&nbsp;&nbsp;<br/>60&nbsp;&nbsp;<br/>file will be divided into 2&nbsp;&nbsp;<br/>file1&nbsp;&nbsp;<br/>记录了60+0 的读入&nbsp;&nbsp;<br/>记录了60+0 的写出&nbsp;&nbsp;<br/>61440字节(61 kB)已复制，0.0352612 秒，1.7 MB/秒&nbsp;&nbsp;<br/>file2&nbsp;&nbsp;<br/>记录了53+1 的读入&nbsp;&nbsp;<br/>记录了53+1 的写出&nbsp;&nbsp;<br/>55176字节(55 kB)已复制，0.0316272 秒，1.7 MB/秒&nbsp;&nbsp;<br/>file has been divided into 2&nbsp;&nbsp;<br/>Done !&nbsp;&nbsp;<br/>[root]# ls&nbsp;&nbsp;<br/>caf.sh&nbsp;&nbsp;ddf.sh&nbsp;&nbsp;file&nbsp;&nbsp;file1&nbsp;&nbsp;file2&nbsp;&nbsp;<br/>[root]# ./caf.sh&nbsp;&nbsp; <br/>Please enter file name:&nbsp;&nbsp;<br/>file&nbsp;&nbsp;<br/>Please enter the number of subfiles:&nbsp;&nbsp;<br/>2&nbsp;&nbsp;<br/>file1 done!&nbsp;&nbsp;<br/>file2 done!&nbsp;&nbsp;<br/>Subfiles be merged into file.bak&nbsp;&nbsp;<br/>Success!&nbsp;&nbsp;<br/>[root]# ls&nbsp;&nbsp;<br/>caf.sh&nbsp;&nbsp;ddf.sh&nbsp;&nbsp;file&nbsp;&nbsp;file1&nbsp;&nbsp;file2&nbsp;&nbsp;file.bak&nbsp;&nbsp;<br/><br/>来自：http://blog.csdn.net/exbob/article/details/6636255<br/>参考：http://www.linuxeden.com/html/front/20071015/35768.html
]]>
</description>
</item><item>
<link>http://www.jackxiang.com/post//#blogcomment</link>
<title><![CDATA[[评论] [实践OK]DD命令复制磁盘文件，服务器磁盘坏块检查，Linux下分割、合并文件——dd和cat,linux dd指令用法中参数bs,count,linux dd磁盘坏块修复。]]></title> 
<author> &lt;user@domain.com&gt;</author>
<category><![CDATA[评论]]></category>
<pubDate>Thu, 01 Jan 1970 00:00:00 +0000</pubDate> 
<guid>http://www.jackxiang.com/post//#blogcomment</guid> 
<description>
<![CDATA[ 
	
]]>
</description>
</item>
</channel>
</rss>