dmesg gave errors blk_update_request: I/O error, dev xxx, sector xxxxxxxxxx












0















I'm newbie for linux system.



founded errors by performing dmesg, seems like there're something wrong with all of disks. I keep tracking the errors until now. Here're a log from dmesg.



[Wed Mar 13 17:12:26 2019] blk_update_request: I/O error, dev sdc, sector 573685760
[Wed Mar 13 17:12:28 2019] blk_update_request: I/O error, dev sdl, sector 11288110080
[Wed Mar 13 17:12:29 2019] blk_update_request: I/O error, dev sdf, sector 7774949376
[Wed Mar 13 17:12:31 2019] blk_update_request: I/O error, dev sdf, sector 7775613952
[Wed Mar 13 17:12:41 2019] blk_update_request: I/O error, dev sdg, sector 7653041152
[Wed Mar 13 17:12:45 2019] blk_update_request: I/O error, dev sdn, sector 244398080
[Wed Mar 13 17:12:49 2019] blk_update_request: I/O error, dev sdd, sector 2220809216
[Wed Mar 13 17:12:50 2019] blk_update_request: I/O error, dev sdp, sector 4293958656
[Wed Mar 13 17:12:51 2019] blk_update_request: I/O error, dev sdp, sector 4294248056
[Wed Mar 13 17:12:55 2019] blk_update_request: I/O error, dev sdo, sector 2329909248
[Wed Mar 13 17:12:56 2019] blk_update_request: I/O error, dev sdc, sector 591905792
[Wed Mar 13 17:13:00 2019] blk_update_request: I/O error, dev sdo, sector 2318767104
[Wed Mar 13 17:13:39 2019] blk_update_request: I/O error, dev sdd, sector 2105034752
[Wed Mar 13 17:13:43 2019] blk_update_request: I/O error, dev sdj, sector 667691008
[Wed Mar 13 17:13:50 2019] blk_update_request: I/O error, dev sde, sector 3346320384
[Wed Mar 13 17:14:07 2019] blk_update_request: I/O error, dev sdc, sector 593794048
[Wed Mar 13 17:14:08 2019] blk_update_request: I/O error, dev sdi, sector 3204312064
[Wed Mar 13 17:14:10 2019] blk_update_request: I/O error, dev sdf, sector 11714625536
[Wed Mar 13 17:14:13 2019] blk_update_request: I/O error, dev sdj, sector 134696960
[Wed Mar 13 17:14:15 2019] blk_update_request: I/O error, dev sdl, sector 11315831808
[Wed Mar 13 17:14:18 2019] blk_update_request: I/O error, dev sdd, sector 2299802624
[Wed Mar 13 17:14:28 2019] blk_update_request: I/O error, dev sdd, sector 2297375744
[Wed Mar 13 17:14:33 2019] blk_update_request: I/O error, dev sde, sector 3407077376
[Wed Mar 13 17:14:38 2019] blk_update_request: I/O error, dev sdi, sector 9447327744
[Wed Mar 13 17:14:48 2019] blk_update_request: I/O error, dev sde, sector 2752748544
[Wed Mar 13 17:14:57 2019] blk_update_request: I/O error, dev sdc, sector 9496791040
[Wed Mar 13 17:15:07 2019] blk_update_request: I/O error, dev sdc, sector 615070720
[Wed Mar 13 17:15:12 2019] blk_update_request: I/O error, dev sdj, sector 383865856
[Wed Mar 13 17:15:12 2019] blk_update_request: I/O error, dev sdj, sector 384624640
[Wed Mar 13 17:22:14 2019] blk_update_request: I/O error, dev sdn, sector 7205202944
[Wed Mar 13 17:37:47 2019] blk_update_request: I/O error, dev sdh, sector 5723347968
[Wed Mar 13 17:37:51 2019] blk_update_request: I/O error, dev sdj, sector 3897670552
[Wed Mar 13 18:11:23 2019] blk_update_request: I/O error, dev sdj, sector 2752643456
[Wed Mar 13 18:16:05 2019] blk_update_request: I/O error, dev sdl, sector 11686973160
[Wed Mar 13 18:28:20 2019] blk_update_request: I/O error, dev sdg, sector 5801116672
[Wed Mar 13 18:32:16 2019] blk_update_request: I/O error, dev sdo, sector 4698261088
[Wed Mar 13 18:35:59 2019] blk_update_request: I/O error, dev sdm, sector 6010393600
[Wed Mar 13 18:37:56 2019] blk_update_request: I/O error, dev sdc, sector 2038415360
[Wed Mar 13 18:56:45 2019] blk_update_request: I/O error, dev sdh, sector 8178621592
[Wed Mar 13 18:56:45 2019] blk_update_request: I/O error, dev sdd, sector 4276064384
[Wed Mar 13 19:22:48 2019] blk_update_request: I/O error, dev sdk, sector 7586044832
[Wed Mar 13 19:24:10 2019] blk_update_request: I/O error, dev sdi, sector 6823062512
[Wed Mar 13 19:24:49 2019] blk_update_request: I/O error, dev sdb, sector 588349864
[Wed Mar 13 19:33:30 2019] blk_update_request: I/O error, dev sdl, sector 8421146656
[Wed Mar 13 19:33:35 2019] blk_update_request: I/O error, dev sde, sector 10002190440
[Wed Mar 13 19:35:00 2019] blk_update_request: I/O error, dev sdi, sector 10178364784
[Wed Mar 13 19:36:43 2019] blk_update_request: I/O error, dev sdj, sector 5582077128
[Wed Mar 13 19:54:39 2019] blk_update_request: I/O error, dev sdp, sector 2875791736
[Wed Mar 13 19:55:19 2019] blk_update_request: I/O error, dev sdh, sector 969805632
[Wed Mar 13 19:56:18 2019] blk_update_request: I/O error, dev sdl, sector 7231314336
[Wed Mar 13 19:56:40 2019] blk_update_request: I/O error, dev sdd, sector 63581656
[Wed Mar 13 19:58:05 2019] blk_update_request: I/O error, dev sdg, sector 9960299296
[Wed Mar 13 20:04:39 2019] blk_update_request: I/O error, dev sde, sector 7195128064
[Wed Mar 13 20:05:07 2019] blk_update_request: I/O error, dev sdc, sector 1558854656
[Wed Mar 13 20:10:22 2019] blk_update_request: I/O error, dev sdk, sector 11337512016
[Wed Mar 13 20:11:00 2019] blk_update_request: I/O error, dev sdj, sector 5019986680
[Wed Mar 13 20:13:53 2019] blk_update_request: I/O error, dev sdc, sector 10881031976
[Wed Mar 13 20:14:32 2019] blk_update_request: I/O error, dev sdk, sector 8960667904
[Wed Mar 13 20:17:04 2019] blk_update_request: I/O error, dev sdd, sector 10162448920
[Wed Mar 13 21:33:12 2019] blk_update_request: I/O error, dev sde, sector 8287529984
[Wed Mar 13 22:24:52 2019] blk_update_request: I/O error, dev sdl, sector 707870320
[Wed Mar 13 23:26:49 2019] blk_update_request: I/O error, dev sdo, sector 6834953944
[Wed Mar 13 23:44:11 2019] blk_update_request: I/O error, dev sdo, sector 3859546984
[Wed Mar 13 23:50:24 2019] blk_update_request: I/O error, dev sdb, sector 4940592152
[Thu Mar 14 00:45:17 2019] blk_update_request: I/O error, dev sdo, sector 11427215360
[Thu Mar 14 04:03:13 2019] blk_update_request: I/O error, dev sdl, sector 10425306360
[Thu Mar 14 04:20:34 2019] blk_update_request: I/O error, dev sdc, sector 9905921360
[Thu Mar 14 04:25:04 2019] blk_update_request: I/O error, dev sdp, sector 2438172672
[Thu Mar 14 04:35:44 2019] blk_update_request: I/O error, dev sde, sector 10189918280
[Thu Mar 14 05:33:08 2019] blk_update_request: I/O error, dev sdf, sector 7456407856
[Thu Mar 14 05:52:39 2019] blk_update_request: I/O error, dev sdn, sector 10601913816
[Thu Mar 14 05:53:28 2019] blk_update_request: I/O error, dev sdl, sector 5244034456
[Thu Mar 14 05:53:28 2019] blk_update_request: I/O error, dev sdm, sector 5004255512
[Thu Mar 14 05:53:47 2019] blk_update_request: I/O error, dev sdg, sector 11449884968
[Thu Mar 14 05:54:17 2019] blk_update_request: I/O error, dev sdm, sector 4928738040
[Thu Mar 14 05:54:33 2019] blk_update_request: I/O error, dev sdh, sector 4947387880
[Thu Mar 14 05:57:09 2019] blk_update_request: I/O error, dev sdg, sector 181969744
[Thu Mar 14 05:57:19 2019] blk_update_request: I/O error, dev sdg, sector 191782352
[Thu Mar 14 05:57:20 2019] blk_update_request: I/O error, dev sdp, sector 4488780920
[Thu Mar 14 05:59:08 2019] blk_update_request: I/O error, dev sdg, sector 10890166576
[Thu Mar 14 05:59:08 2019] blk_update_request: I/O error, dev sdk, sector 5814053216
[Thu Mar 14 06:01:37 2019] blk_update_request: I/O error, dev sdh, sector 4456248536
[Thu Mar 14 06:02:40 2019] blk_update_request: I/O error, dev sdk, sector 6023428600
[Thu Mar 14 06:02:49 2019] blk_update_request: I/O error, dev sdf, sector 11573913960
[Thu Mar 14 06:03:03 2019] blk_update_request: I/O error, dev sdp, sector 4976394224
[Thu Mar 14 06:03:03 2019] blk_update_request: I/O error, dev sdh, sector 5141368856
[Thu Mar 14 06:18:58 2019] blk_update_request: I/O error, dev sdh, sector 5568277336
[Thu Mar 14 06:21:44 2019] blk_update_request: I/O error, dev sdj, sector 7696349184
[Thu Mar 14 06:46:29 2019] blk_update_request: I/O error, dev sdn, sector 3307626496
[Thu Mar 14 06:46:37 2019] blk_update_request: I/O error, dev sdk, sector 6311800832
[Thu Mar 14 06:47:46 2019] blk_update_request: I/O error, dev sdj, sector 5994693592
[Thu Mar 14 06:48:16 2019] blk_update_request: I/O error, dev sdp, sector 2772352000
[Thu Mar 14 06:48:21 2019] blk_update_request: I/O error, dev sdo, sector 10622710704
[Thu Mar 14 06:48:35 2019] blk_update_request: I/O error, dev sdm, sector 5921376784
[Thu Mar 14 06:54:38 2019] blk_update_request: I/O error, dev sdk, sector 6312236032
[Thu Mar 14 06:55:18 2019] blk_update_request: I/O error, dev sdl, sector 11570793288
[Thu Mar 14 06:56:33 2019] blk_update_request: I/O error, dev sdc, sector 6796612608
[Thu Mar 14 07:09:30 2019] blk_update_request: I/O error, dev sdo, sector 10860347304
[Thu Mar 14 07:17:08 2019] blk_update_request: I/O error, dev sdk, sector 3973260288
[Thu Mar 14 07:20:25 2019] blk_update_request: I/O error, dev sdk, sector 3975413760
[Thu Mar 14 07:45:07 2019] blk_update_request: I/O error, dev sdm, sector 11583453264
[Thu Mar 14 07:45:44 2019] blk_update_request: I/O error, dev sdh, sector 8425250816
[Thu Mar 14 07:48:33 2019] blk_update_request: I/O error, dev sdf, sector 504787888
[Thu Mar 14 07:53:13 2019] blk_update_request: I/O error, dev sdc, sector 6438806272
[Thu Mar 14 07:58:50 2019] blk_update_request: I/O error, dev sdf, sector 1596355920
[Thu Mar 14 07:59:25 2019] blk_update_request: I/O error, dev sdk, sector 4699144192
[Thu Mar 14 08:00:39 2019] blk_update_request: I/O error, dev sdi, sector 7864738816
[Thu Mar 14 08:00:39 2019] EXT4-fs warning (device sdi): ext4_end_bio:316: I/O error -5 writing to inode 76743178 (offset 654311424 size 8388608 starting block 983092480)
[Thu Mar 14 08:00:39 2019] Buffer I/O error on device sdi, logical block 983092352
[Thu Mar 14 08:00:39 2019] Buffer I/O error on device sdi, logical block 983092353
[Thu Mar 14 08:00:39 2019] Buffer I/O error on device sdi, logical block 983092354
[Thu Mar 14 08:00:39 2019] Buffer I/O error on device sdi, logical block 983092355
[Thu Mar 14 08:00:39 2019] Buffer I/O error on device sdi, logical block 983092356
[Thu Mar 14 08:00:39 2019] Buffer I/O error on device sdi, logical block 983092357
[Thu Mar 14 08:00:39 2019] Buffer I/O error on device sdi, logical block 983092358
[Thu Mar 14 08:00:39 2019] Buffer I/O error on device sdi, logical block 983092359
[Thu Mar 14 08:00:39 2019] Buffer I/O error on device sdi, logical block 983092360
[Thu Mar 14 08:00:39 2019] Buffer I/O error on device sdi, logical block 983092361
[Thu Mar 14 08:08:39 2019] blk_update_request: I/O error, dev sde, sector 8333908128
[Thu Mar 14 08:10:49 2019] blk_update_request: I/O error, dev sdg, sector 11392036592
[Thu Mar 14 08:11:04 2019] blk_update_request: I/O error, dev sde, sector 9026698320
[Thu Mar 14 08:14:02 2019] blk_update_request: I/O error, dev sdn, sector 6259879936
[Thu Mar 14 08:14:05 2019] blk_update_request: I/O error, dev sdg, sector 332910216
[Thu Mar 14 08:16:44 2019] blk_update_request: I/O error, dev sdk, sector 6839443456
[Thu Mar 14 08:33:24 2019] blk_update_request: I/O error, dev sdf, sector 11568233320
[Thu Mar 14 08:38:02 2019] blk_update_request: I/O error, dev sdf, sector 8846133248
[Thu Mar 14 08:38:10 2019] blk_update_request: I/O error, dev sdp, sector 9390738808
[Thu Mar 14 08:45:14 2019] blk_update_request: I/O error, dev sdf, sector 1804330272
[Thu Mar 14 08:55:24 2019] blk_update_request: I/O error, dev sdn, sector 4962636800
[Thu Mar 14 09:00:07 2019] blk_update_request: I/O error, dev sdm, sector 4942112768
[Thu Mar 14 09:03:57 2019] blk_update_request: I/O error, dev sde, sector 2004416744
[Thu Mar 14 09:03:57 2019] blk_update_request: I/O error, dev sdk, sector 11151543576
[Thu Mar 14 09:03:59 2019] blk_update_request: I/O error, dev sdb, sector 9141955824
[Thu Mar 14 09:30:19 2019] blk_update_request: I/O error, dev sdo, sector 190925440
[Thu Mar 14 09:33:17 2019] blk_update_request: I/O error, dev sdc, sector 6784547536
[Thu Mar 14 09:34:11 2019] blk_update_request: I/O error, dev sdb, sector 8378552848
[Thu Mar 14 09:36:42 2019] blk_update_request: I/O error, dev sdi, sector 4072348536
[Thu Mar 14 09:36:43 2019] blk_update_request: I/O error, dev sdj, sector 3905785352
[Thu Mar 14 09:36:44 2019] blk_update_request: I/O error, dev sdb, sector 5607689656
[Thu Mar 14 09:36:44 2019] blk_update_request: I/O error, dev sdj, sector 10801129192
[Thu Mar 14 09:36:46 2019] blk_update_request: I/O error, dev sdc, sector 5683881760
[Thu Mar 14 09:36:46 2019] blk_update_request: I/O error, dev sdi, sector 4078841184
[Thu Mar 14 09:38:03 2019] blk_update_request: I/O error, dev sdl, sector 2653407232
[Thu Mar 14 09:40:56 2019] blk_update_request: I/O error, dev sdo, sector 6559526912
[Thu Mar 14 09:41:06 2019] blk_update_request: I/O error, dev sdo, sector 6559876096
[Thu Mar 14 09:42:48 2019] blk_update_request: I/O error, dev sdk, sector 7296224200
[Thu Mar 14 09:42:50 2019] blk_update_request: I/O error, dev sdk, sector 7298670632
[Thu Mar 14 09:43:01 2019] blk_update_request: I/O error, dev sdf, sector 9532311552
[Thu Mar 14 09:47:51 2019] blk_update_request: I/O error, dev sdo, sector 11505383208
[Thu Mar 14 09:48:26 2019] blk_update_request: I/O error, dev sdl, sector 6810332184
[Thu Mar 14 09:52:38 2019] blk_update_request: I/O error, dev sdm, sector 9522262016
[Thu Mar 14 09:56:53 2019] blk_update_request: I/O error, dev sdb, sector 361288368
[Thu Mar 14 09:56:57 2019] blk_update_request: I/O error, dev sdg, sector 157264288
[Thu Mar 14 09:58:29 2019] blk_update_request: I/O error, dev sdk, sector 4990681720
[Thu Mar 14 10:00:37 2019] blk_update_request: I/O error, dev sdo, sector 11505749272
[Thu Mar 14 10:03:59 2019] blk_update_request: I/O error, dev sdl, sector 1422636680
[Thu Mar 14 10:09:49 2019] blk_update_request: I/O error, dev sdk, sector 4688443792
[Thu Mar 14 10:17:51 2019] blk_update_request: I/O error, dev sdb, sector 4287825920
[Thu Mar 14 10:18:06 2019] blk_update_request: I/O error, dev sdc, sector 6442002432
[Thu Mar 14 10:20:18 2019] blk_update_request: I/O error, dev sdj, sector 11357437976
[Thu Mar 14 10:23:41 2019] blk_update_request: I/O error, dev sdc, sector 5910204416
[Thu Mar 14 10:24:07 2019] blk_update_request: I/O error, dev sdd, sector 4931613624
[Thu Mar 14 10:24:50 2019] blk_update_request: I/O error, dev sdg, sector 11454225184
[Thu Mar 14 10:25:20 2019] blk_update_request: I/O error, dev sdg, sector 628817480
[Thu Mar 14 10:25:22 2019] blk_update_request: I/O error, dev sdp, sector 4952914696
[Thu Mar 14 10:26:31 2019] blk_update_request: I/O error, dev sdi, sector 8204927480
[Thu Mar 14 10:26:58 2019] blk_update_request: I/O error, dev sdb, sector 6325656136
[Thu Mar 14 10:27:45 2019] blk_update_request: I/O error, dev sdb, sector 11306080528
[Thu Mar 14 10:27:57 2019] blk_update_request: I/O error, dev sdf, sector 5522990080
[Thu Mar 14 10:28:00 2019] blk_update_request: I/O error, dev sdb, sector 8337659192
[Thu Mar 14 10:28:40 2019] blk_update_request: I/O error, dev sdd, sector 4633868936
[Thu Mar 14 10:31:51 2019] blk_update_request: I/O error, dev sdh, sector 547837048
[Thu Mar 14 10:31:59 2019] blk_update_request: I/O error, dev sdj, sector 7494419792
[Thu Mar 14 10:33:23 2019] blk_update_request: I/O error, dev sdn, sector 2453028864
[Thu Mar 14 10:34:17 2019] blk_update_request: I/O error, dev sdj, sector 7414340816
[Thu Mar 14 10:34:18 2019] blk_update_request: I/O error, dev sdf, sector 8075539152
[Thu Mar 14 10:36:14 2019] blk_update_request: I/O error, dev sdc, sector 1084731280
[Thu Mar 14 10:36:18 2019] blk_update_request: I/O error, dev sdb, sector 3356220400
[Thu Mar 14 10:38:59 2019] blk_update_request: I/O error, dev sdf, sector 7486777808
[Thu Mar 14 10:39:00 2019] blk_update_request: I/O error, dev sdn, sector 8620632856
[Thu Mar 14 10:39:10 2019] blk_update_request: I/O error, dev sde, sector 7873372584
[Thu Mar 14 10:39:55 2019] blk_update_request: I/O error, dev sde, sector 10750726688
[Thu Mar 14 10:40:15 2019] blk_update_request: I/O error, dev sdd, sector 11357432352
[Thu Mar 14 10:41:13 2019] blk_update_request: I/O error, dev sdi, sector 6836535296
[Thu Mar 14 10:41:17 2019] blk_update_request: I/O error, dev sdi, sector 6836552008
[Thu Mar 14 10:43:35 2019] blk_update_request: I/O error, dev sdb, sector 307348480
[Thu Mar 14 10:44:20 2019] blk_update_request: I/O error, dev sdf, sector 1781563392
[Thu Mar 14 10:44:26 2019] blk_update_request: I/O error, dev sdd, sector 6410786592
[Thu Mar 14 10:45:45 2019] blk_update_request: I/O error, dev sdl, sector 9154662960
[Thu Mar 14 10:45:46 2019] blk_update_request: I/O error, dev sdj, sector 6619819200
[Thu Mar 14 10:49:08 2019] blk_update_request: I/O error, dev sdn, sector 10767812936
[Thu Mar 14 10:53:41 2019] blk_update_request: I/O error, dev sdo, sector 9716759432
[Thu Mar 14 10:53:50 2019] blk_update_request: I/O error, dev sdc, sector 7983572992


But smartctl gave no error



[root@mtg8-dt-18 ~]# smartctl -C -a /dev/sdg
smartctl 6.2 2017-02-27 r4394 [x86_64-linux-3.10.0-693.el7.x86_64] (local build)
Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Vendor: HP
Product: MB6000JVYZD
Revision: HPD1
User Capacity: 6,001,175,126,016 bytes [6.00 TB]
Logical block size: 512 bytes
Physical block size: 4096 bytes
Lowest aligned LBA: 0
Rotation Rate: 7200 rpm
Form Factor: 3.5 inches
Logical Unit id: 0x5000c50094558e07
Serial number: ZAD204PV0000C8015S23
Device type: disk
Transport protocol: SAS
Local Time is: Thu Mar 14 11:00:24 2019 +07
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
Temperature Warning: Enabled

=== START OF READ SMART DATA SECTION ===
SMART Health Status: OK

Current Drive Temperature: 29 C
Drive Trip Temperature: 60 C

Manufactured in week 30 of year 2017
Specified cycle count over device lifetime: 10000
Accumulated start-stop cycles: 78
Specified load-unload count over device lifetime: 300000
Accumulated load-unload cycles: 632
Elements in grown defect list: 0

Vendor (Seagate) cache information
Blocks sent to initiator = 1467516240
Blocks received from initiator = 168658064
Blocks read from cache and sent to initiator = 3698801821
Number of read and write commands whose size <= segment size = 62258636
Number of read and write commands whose size > segment size = 2134931

Vendor (Seagate/Hitachi) factory information
number of hours powered up = 12178.78
number of minutes until next internal SMART test = 7

Error counter log:
Errors Corrected by Total Correction Gigabytes Total
ECC rereads/ errors algorithm processed uncorrected
fast | delayed rewrites corrected invocations [10^9 bytes] errors
read: 0 0 0 0 0 77717.182 0
write: 0 0 0 0 0 63896.737 0

Non-medium error count: 954

No self-tests have been logged


any advices would be great! I really appreciate.









share



























    0















    I'm newbie for linux system.



    founded errors by performing dmesg, seems like there're something wrong with all of disks. I keep tracking the errors until now. Here're a log from dmesg.



    [Wed Mar 13 17:12:26 2019] blk_update_request: I/O error, dev sdc, sector 573685760
    [Wed Mar 13 17:12:28 2019] blk_update_request: I/O error, dev sdl, sector 11288110080
    [Wed Mar 13 17:12:29 2019] blk_update_request: I/O error, dev sdf, sector 7774949376
    [Wed Mar 13 17:12:31 2019] blk_update_request: I/O error, dev sdf, sector 7775613952
    [Wed Mar 13 17:12:41 2019] blk_update_request: I/O error, dev sdg, sector 7653041152
    [Wed Mar 13 17:12:45 2019] blk_update_request: I/O error, dev sdn, sector 244398080
    [Wed Mar 13 17:12:49 2019] blk_update_request: I/O error, dev sdd, sector 2220809216
    [Wed Mar 13 17:12:50 2019] blk_update_request: I/O error, dev sdp, sector 4293958656
    [Wed Mar 13 17:12:51 2019] blk_update_request: I/O error, dev sdp, sector 4294248056
    [Wed Mar 13 17:12:55 2019] blk_update_request: I/O error, dev sdo, sector 2329909248
    [Wed Mar 13 17:12:56 2019] blk_update_request: I/O error, dev sdc, sector 591905792
    [Wed Mar 13 17:13:00 2019] blk_update_request: I/O error, dev sdo, sector 2318767104
    [Wed Mar 13 17:13:39 2019] blk_update_request: I/O error, dev sdd, sector 2105034752
    [Wed Mar 13 17:13:43 2019] blk_update_request: I/O error, dev sdj, sector 667691008
    [Wed Mar 13 17:13:50 2019] blk_update_request: I/O error, dev sde, sector 3346320384
    [Wed Mar 13 17:14:07 2019] blk_update_request: I/O error, dev sdc, sector 593794048
    [Wed Mar 13 17:14:08 2019] blk_update_request: I/O error, dev sdi, sector 3204312064
    [Wed Mar 13 17:14:10 2019] blk_update_request: I/O error, dev sdf, sector 11714625536
    [Wed Mar 13 17:14:13 2019] blk_update_request: I/O error, dev sdj, sector 134696960
    [Wed Mar 13 17:14:15 2019] blk_update_request: I/O error, dev sdl, sector 11315831808
    [Wed Mar 13 17:14:18 2019] blk_update_request: I/O error, dev sdd, sector 2299802624
    [Wed Mar 13 17:14:28 2019] blk_update_request: I/O error, dev sdd, sector 2297375744
    [Wed Mar 13 17:14:33 2019] blk_update_request: I/O error, dev sde, sector 3407077376
    [Wed Mar 13 17:14:38 2019] blk_update_request: I/O error, dev sdi, sector 9447327744
    [Wed Mar 13 17:14:48 2019] blk_update_request: I/O error, dev sde, sector 2752748544
    [Wed Mar 13 17:14:57 2019] blk_update_request: I/O error, dev sdc, sector 9496791040
    [Wed Mar 13 17:15:07 2019] blk_update_request: I/O error, dev sdc, sector 615070720
    [Wed Mar 13 17:15:12 2019] blk_update_request: I/O error, dev sdj, sector 383865856
    [Wed Mar 13 17:15:12 2019] blk_update_request: I/O error, dev sdj, sector 384624640
    [Wed Mar 13 17:22:14 2019] blk_update_request: I/O error, dev sdn, sector 7205202944
    [Wed Mar 13 17:37:47 2019] blk_update_request: I/O error, dev sdh, sector 5723347968
    [Wed Mar 13 17:37:51 2019] blk_update_request: I/O error, dev sdj, sector 3897670552
    [Wed Mar 13 18:11:23 2019] blk_update_request: I/O error, dev sdj, sector 2752643456
    [Wed Mar 13 18:16:05 2019] blk_update_request: I/O error, dev sdl, sector 11686973160
    [Wed Mar 13 18:28:20 2019] blk_update_request: I/O error, dev sdg, sector 5801116672
    [Wed Mar 13 18:32:16 2019] blk_update_request: I/O error, dev sdo, sector 4698261088
    [Wed Mar 13 18:35:59 2019] blk_update_request: I/O error, dev sdm, sector 6010393600
    [Wed Mar 13 18:37:56 2019] blk_update_request: I/O error, dev sdc, sector 2038415360
    [Wed Mar 13 18:56:45 2019] blk_update_request: I/O error, dev sdh, sector 8178621592
    [Wed Mar 13 18:56:45 2019] blk_update_request: I/O error, dev sdd, sector 4276064384
    [Wed Mar 13 19:22:48 2019] blk_update_request: I/O error, dev sdk, sector 7586044832
    [Wed Mar 13 19:24:10 2019] blk_update_request: I/O error, dev sdi, sector 6823062512
    [Wed Mar 13 19:24:49 2019] blk_update_request: I/O error, dev sdb, sector 588349864
    [Wed Mar 13 19:33:30 2019] blk_update_request: I/O error, dev sdl, sector 8421146656
    [Wed Mar 13 19:33:35 2019] blk_update_request: I/O error, dev sde, sector 10002190440
    [Wed Mar 13 19:35:00 2019] blk_update_request: I/O error, dev sdi, sector 10178364784
    [Wed Mar 13 19:36:43 2019] blk_update_request: I/O error, dev sdj, sector 5582077128
    [Wed Mar 13 19:54:39 2019] blk_update_request: I/O error, dev sdp, sector 2875791736
    [Wed Mar 13 19:55:19 2019] blk_update_request: I/O error, dev sdh, sector 969805632
    [Wed Mar 13 19:56:18 2019] blk_update_request: I/O error, dev sdl, sector 7231314336
    [Wed Mar 13 19:56:40 2019] blk_update_request: I/O error, dev sdd, sector 63581656
    [Wed Mar 13 19:58:05 2019] blk_update_request: I/O error, dev sdg, sector 9960299296
    [Wed Mar 13 20:04:39 2019] blk_update_request: I/O error, dev sde, sector 7195128064
    [Wed Mar 13 20:05:07 2019] blk_update_request: I/O error, dev sdc, sector 1558854656
    [Wed Mar 13 20:10:22 2019] blk_update_request: I/O error, dev sdk, sector 11337512016
    [Wed Mar 13 20:11:00 2019] blk_update_request: I/O error, dev sdj, sector 5019986680
    [Wed Mar 13 20:13:53 2019] blk_update_request: I/O error, dev sdc, sector 10881031976
    [Wed Mar 13 20:14:32 2019] blk_update_request: I/O error, dev sdk, sector 8960667904
    [Wed Mar 13 20:17:04 2019] blk_update_request: I/O error, dev sdd, sector 10162448920
    [Wed Mar 13 21:33:12 2019] blk_update_request: I/O error, dev sde, sector 8287529984
    [Wed Mar 13 22:24:52 2019] blk_update_request: I/O error, dev sdl, sector 707870320
    [Wed Mar 13 23:26:49 2019] blk_update_request: I/O error, dev sdo, sector 6834953944
    [Wed Mar 13 23:44:11 2019] blk_update_request: I/O error, dev sdo, sector 3859546984
    [Wed Mar 13 23:50:24 2019] blk_update_request: I/O error, dev sdb, sector 4940592152
    [Thu Mar 14 00:45:17 2019] blk_update_request: I/O error, dev sdo, sector 11427215360
    [Thu Mar 14 04:03:13 2019] blk_update_request: I/O error, dev sdl, sector 10425306360
    [Thu Mar 14 04:20:34 2019] blk_update_request: I/O error, dev sdc, sector 9905921360
    [Thu Mar 14 04:25:04 2019] blk_update_request: I/O error, dev sdp, sector 2438172672
    [Thu Mar 14 04:35:44 2019] blk_update_request: I/O error, dev sde, sector 10189918280
    [Thu Mar 14 05:33:08 2019] blk_update_request: I/O error, dev sdf, sector 7456407856
    [Thu Mar 14 05:52:39 2019] blk_update_request: I/O error, dev sdn, sector 10601913816
    [Thu Mar 14 05:53:28 2019] blk_update_request: I/O error, dev sdl, sector 5244034456
    [Thu Mar 14 05:53:28 2019] blk_update_request: I/O error, dev sdm, sector 5004255512
    [Thu Mar 14 05:53:47 2019] blk_update_request: I/O error, dev sdg, sector 11449884968
    [Thu Mar 14 05:54:17 2019] blk_update_request: I/O error, dev sdm, sector 4928738040
    [Thu Mar 14 05:54:33 2019] blk_update_request: I/O error, dev sdh, sector 4947387880
    [Thu Mar 14 05:57:09 2019] blk_update_request: I/O error, dev sdg, sector 181969744
    [Thu Mar 14 05:57:19 2019] blk_update_request: I/O error, dev sdg, sector 191782352
    [Thu Mar 14 05:57:20 2019] blk_update_request: I/O error, dev sdp, sector 4488780920
    [Thu Mar 14 05:59:08 2019] blk_update_request: I/O error, dev sdg, sector 10890166576
    [Thu Mar 14 05:59:08 2019] blk_update_request: I/O error, dev sdk, sector 5814053216
    [Thu Mar 14 06:01:37 2019] blk_update_request: I/O error, dev sdh, sector 4456248536
    [Thu Mar 14 06:02:40 2019] blk_update_request: I/O error, dev sdk, sector 6023428600
    [Thu Mar 14 06:02:49 2019] blk_update_request: I/O error, dev sdf, sector 11573913960
    [Thu Mar 14 06:03:03 2019] blk_update_request: I/O error, dev sdp, sector 4976394224
    [Thu Mar 14 06:03:03 2019] blk_update_request: I/O error, dev sdh, sector 5141368856
    [Thu Mar 14 06:18:58 2019] blk_update_request: I/O error, dev sdh, sector 5568277336
    [Thu Mar 14 06:21:44 2019] blk_update_request: I/O error, dev sdj, sector 7696349184
    [Thu Mar 14 06:46:29 2019] blk_update_request: I/O error, dev sdn, sector 3307626496
    [Thu Mar 14 06:46:37 2019] blk_update_request: I/O error, dev sdk, sector 6311800832
    [Thu Mar 14 06:47:46 2019] blk_update_request: I/O error, dev sdj, sector 5994693592
    [Thu Mar 14 06:48:16 2019] blk_update_request: I/O error, dev sdp, sector 2772352000
    [Thu Mar 14 06:48:21 2019] blk_update_request: I/O error, dev sdo, sector 10622710704
    [Thu Mar 14 06:48:35 2019] blk_update_request: I/O error, dev sdm, sector 5921376784
    [Thu Mar 14 06:54:38 2019] blk_update_request: I/O error, dev sdk, sector 6312236032
    [Thu Mar 14 06:55:18 2019] blk_update_request: I/O error, dev sdl, sector 11570793288
    [Thu Mar 14 06:56:33 2019] blk_update_request: I/O error, dev sdc, sector 6796612608
    [Thu Mar 14 07:09:30 2019] blk_update_request: I/O error, dev sdo, sector 10860347304
    [Thu Mar 14 07:17:08 2019] blk_update_request: I/O error, dev sdk, sector 3973260288
    [Thu Mar 14 07:20:25 2019] blk_update_request: I/O error, dev sdk, sector 3975413760
    [Thu Mar 14 07:45:07 2019] blk_update_request: I/O error, dev sdm, sector 11583453264
    [Thu Mar 14 07:45:44 2019] blk_update_request: I/O error, dev sdh, sector 8425250816
    [Thu Mar 14 07:48:33 2019] blk_update_request: I/O error, dev sdf, sector 504787888
    [Thu Mar 14 07:53:13 2019] blk_update_request: I/O error, dev sdc, sector 6438806272
    [Thu Mar 14 07:58:50 2019] blk_update_request: I/O error, dev sdf, sector 1596355920
    [Thu Mar 14 07:59:25 2019] blk_update_request: I/O error, dev sdk, sector 4699144192
    [Thu Mar 14 08:00:39 2019] blk_update_request: I/O error, dev sdi, sector 7864738816
    [Thu Mar 14 08:00:39 2019] EXT4-fs warning (device sdi): ext4_end_bio:316: I/O error -5 writing to inode 76743178 (offset 654311424 size 8388608 starting block 983092480)
    [Thu Mar 14 08:00:39 2019] Buffer I/O error on device sdi, logical block 983092352
    [Thu Mar 14 08:00:39 2019] Buffer I/O error on device sdi, logical block 983092353
    [Thu Mar 14 08:00:39 2019] Buffer I/O error on device sdi, logical block 983092354
    [Thu Mar 14 08:00:39 2019] Buffer I/O error on device sdi, logical block 983092355
    [Thu Mar 14 08:00:39 2019] Buffer I/O error on device sdi, logical block 983092356
    [Thu Mar 14 08:00:39 2019] Buffer I/O error on device sdi, logical block 983092357
    [Thu Mar 14 08:00:39 2019] Buffer I/O error on device sdi, logical block 983092358
    [Thu Mar 14 08:00:39 2019] Buffer I/O error on device sdi, logical block 983092359
    [Thu Mar 14 08:00:39 2019] Buffer I/O error on device sdi, logical block 983092360
    [Thu Mar 14 08:00:39 2019] Buffer I/O error on device sdi, logical block 983092361
    [Thu Mar 14 08:08:39 2019] blk_update_request: I/O error, dev sde, sector 8333908128
    [Thu Mar 14 08:10:49 2019] blk_update_request: I/O error, dev sdg, sector 11392036592
    [Thu Mar 14 08:11:04 2019] blk_update_request: I/O error, dev sde, sector 9026698320
    [Thu Mar 14 08:14:02 2019] blk_update_request: I/O error, dev sdn, sector 6259879936
    [Thu Mar 14 08:14:05 2019] blk_update_request: I/O error, dev sdg, sector 332910216
    [Thu Mar 14 08:16:44 2019] blk_update_request: I/O error, dev sdk, sector 6839443456
    [Thu Mar 14 08:33:24 2019] blk_update_request: I/O error, dev sdf, sector 11568233320
    [Thu Mar 14 08:38:02 2019] blk_update_request: I/O error, dev sdf, sector 8846133248
    [Thu Mar 14 08:38:10 2019] blk_update_request: I/O error, dev sdp, sector 9390738808
    [Thu Mar 14 08:45:14 2019] blk_update_request: I/O error, dev sdf, sector 1804330272
    [Thu Mar 14 08:55:24 2019] blk_update_request: I/O error, dev sdn, sector 4962636800
    [Thu Mar 14 09:00:07 2019] blk_update_request: I/O error, dev sdm, sector 4942112768
    [Thu Mar 14 09:03:57 2019] blk_update_request: I/O error, dev sde, sector 2004416744
    [Thu Mar 14 09:03:57 2019] blk_update_request: I/O error, dev sdk, sector 11151543576
    [Thu Mar 14 09:03:59 2019] blk_update_request: I/O error, dev sdb, sector 9141955824
    [Thu Mar 14 09:30:19 2019] blk_update_request: I/O error, dev sdo, sector 190925440
    [Thu Mar 14 09:33:17 2019] blk_update_request: I/O error, dev sdc, sector 6784547536
    [Thu Mar 14 09:34:11 2019] blk_update_request: I/O error, dev sdb, sector 8378552848
    [Thu Mar 14 09:36:42 2019] blk_update_request: I/O error, dev sdi, sector 4072348536
    [Thu Mar 14 09:36:43 2019] blk_update_request: I/O error, dev sdj, sector 3905785352
    [Thu Mar 14 09:36:44 2019] blk_update_request: I/O error, dev sdb, sector 5607689656
    [Thu Mar 14 09:36:44 2019] blk_update_request: I/O error, dev sdj, sector 10801129192
    [Thu Mar 14 09:36:46 2019] blk_update_request: I/O error, dev sdc, sector 5683881760
    [Thu Mar 14 09:36:46 2019] blk_update_request: I/O error, dev sdi, sector 4078841184
    [Thu Mar 14 09:38:03 2019] blk_update_request: I/O error, dev sdl, sector 2653407232
    [Thu Mar 14 09:40:56 2019] blk_update_request: I/O error, dev sdo, sector 6559526912
    [Thu Mar 14 09:41:06 2019] blk_update_request: I/O error, dev sdo, sector 6559876096
    [Thu Mar 14 09:42:48 2019] blk_update_request: I/O error, dev sdk, sector 7296224200
    [Thu Mar 14 09:42:50 2019] blk_update_request: I/O error, dev sdk, sector 7298670632
    [Thu Mar 14 09:43:01 2019] blk_update_request: I/O error, dev sdf, sector 9532311552
    [Thu Mar 14 09:47:51 2019] blk_update_request: I/O error, dev sdo, sector 11505383208
    [Thu Mar 14 09:48:26 2019] blk_update_request: I/O error, dev sdl, sector 6810332184
    [Thu Mar 14 09:52:38 2019] blk_update_request: I/O error, dev sdm, sector 9522262016
    [Thu Mar 14 09:56:53 2019] blk_update_request: I/O error, dev sdb, sector 361288368
    [Thu Mar 14 09:56:57 2019] blk_update_request: I/O error, dev sdg, sector 157264288
    [Thu Mar 14 09:58:29 2019] blk_update_request: I/O error, dev sdk, sector 4990681720
    [Thu Mar 14 10:00:37 2019] blk_update_request: I/O error, dev sdo, sector 11505749272
    [Thu Mar 14 10:03:59 2019] blk_update_request: I/O error, dev sdl, sector 1422636680
    [Thu Mar 14 10:09:49 2019] blk_update_request: I/O error, dev sdk, sector 4688443792
    [Thu Mar 14 10:17:51 2019] blk_update_request: I/O error, dev sdb, sector 4287825920
    [Thu Mar 14 10:18:06 2019] blk_update_request: I/O error, dev sdc, sector 6442002432
    [Thu Mar 14 10:20:18 2019] blk_update_request: I/O error, dev sdj, sector 11357437976
    [Thu Mar 14 10:23:41 2019] blk_update_request: I/O error, dev sdc, sector 5910204416
    [Thu Mar 14 10:24:07 2019] blk_update_request: I/O error, dev sdd, sector 4931613624
    [Thu Mar 14 10:24:50 2019] blk_update_request: I/O error, dev sdg, sector 11454225184
    [Thu Mar 14 10:25:20 2019] blk_update_request: I/O error, dev sdg, sector 628817480
    [Thu Mar 14 10:25:22 2019] blk_update_request: I/O error, dev sdp, sector 4952914696
    [Thu Mar 14 10:26:31 2019] blk_update_request: I/O error, dev sdi, sector 8204927480
    [Thu Mar 14 10:26:58 2019] blk_update_request: I/O error, dev sdb, sector 6325656136
    [Thu Mar 14 10:27:45 2019] blk_update_request: I/O error, dev sdb, sector 11306080528
    [Thu Mar 14 10:27:57 2019] blk_update_request: I/O error, dev sdf, sector 5522990080
    [Thu Mar 14 10:28:00 2019] blk_update_request: I/O error, dev sdb, sector 8337659192
    [Thu Mar 14 10:28:40 2019] blk_update_request: I/O error, dev sdd, sector 4633868936
    [Thu Mar 14 10:31:51 2019] blk_update_request: I/O error, dev sdh, sector 547837048
    [Thu Mar 14 10:31:59 2019] blk_update_request: I/O error, dev sdj, sector 7494419792
    [Thu Mar 14 10:33:23 2019] blk_update_request: I/O error, dev sdn, sector 2453028864
    [Thu Mar 14 10:34:17 2019] blk_update_request: I/O error, dev sdj, sector 7414340816
    [Thu Mar 14 10:34:18 2019] blk_update_request: I/O error, dev sdf, sector 8075539152
    [Thu Mar 14 10:36:14 2019] blk_update_request: I/O error, dev sdc, sector 1084731280
    [Thu Mar 14 10:36:18 2019] blk_update_request: I/O error, dev sdb, sector 3356220400
    [Thu Mar 14 10:38:59 2019] blk_update_request: I/O error, dev sdf, sector 7486777808
    [Thu Mar 14 10:39:00 2019] blk_update_request: I/O error, dev sdn, sector 8620632856
    [Thu Mar 14 10:39:10 2019] blk_update_request: I/O error, dev sde, sector 7873372584
    [Thu Mar 14 10:39:55 2019] blk_update_request: I/O error, dev sde, sector 10750726688
    [Thu Mar 14 10:40:15 2019] blk_update_request: I/O error, dev sdd, sector 11357432352
    [Thu Mar 14 10:41:13 2019] blk_update_request: I/O error, dev sdi, sector 6836535296
    [Thu Mar 14 10:41:17 2019] blk_update_request: I/O error, dev sdi, sector 6836552008
    [Thu Mar 14 10:43:35 2019] blk_update_request: I/O error, dev sdb, sector 307348480
    [Thu Mar 14 10:44:20 2019] blk_update_request: I/O error, dev sdf, sector 1781563392
    [Thu Mar 14 10:44:26 2019] blk_update_request: I/O error, dev sdd, sector 6410786592
    [Thu Mar 14 10:45:45 2019] blk_update_request: I/O error, dev sdl, sector 9154662960
    [Thu Mar 14 10:45:46 2019] blk_update_request: I/O error, dev sdj, sector 6619819200
    [Thu Mar 14 10:49:08 2019] blk_update_request: I/O error, dev sdn, sector 10767812936
    [Thu Mar 14 10:53:41 2019] blk_update_request: I/O error, dev sdo, sector 9716759432
    [Thu Mar 14 10:53:50 2019] blk_update_request: I/O error, dev sdc, sector 7983572992


    But smartctl gave no error



    [root@mtg8-dt-18 ~]# smartctl -C -a /dev/sdg
    smartctl 6.2 2017-02-27 r4394 [x86_64-linux-3.10.0-693.el7.x86_64] (local build)
    Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org

    === START OF INFORMATION SECTION ===
    Vendor: HP
    Product: MB6000JVYZD
    Revision: HPD1
    User Capacity: 6,001,175,126,016 bytes [6.00 TB]
    Logical block size: 512 bytes
    Physical block size: 4096 bytes
    Lowest aligned LBA: 0
    Rotation Rate: 7200 rpm
    Form Factor: 3.5 inches
    Logical Unit id: 0x5000c50094558e07
    Serial number: ZAD204PV0000C8015S23
    Device type: disk
    Transport protocol: SAS
    Local Time is: Thu Mar 14 11:00:24 2019 +07
    SMART support is: Available - device has SMART capability.
    SMART support is: Enabled
    Temperature Warning: Enabled

    === START OF READ SMART DATA SECTION ===
    SMART Health Status: OK

    Current Drive Temperature: 29 C
    Drive Trip Temperature: 60 C

    Manufactured in week 30 of year 2017
    Specified cycle count over device lifetime: 10000
    Accumulated start-stop cycles: 78
    Specified load-unload count over device lifetime: 300000
    Accumulated load-unload cycles: 632
    Elements in grown defect list: 0

    Vendor (Seagate) cache information
    Blocks sent to initiator = 1467516240
    Blocks received from initiator = 168658064
    Blocks read from cache and sent to initiator = 3698801821
    Number of read and write commands whose size <= segment size = 62258636
    Number of read and write commands whose size > segment size = 2134931

    Vendor (Seagate/Hitachi) factory information
    number of hours powered up = 12178.78
    number of minutes until next internal SMART test = 7

    Error counter log:
    Errors Corrected by Total Correction Gigabytes Total
    ECC rereads/ errors algorithm processed uncorrected
    fast | delayed rewrites corrected invocations [10^9 bytes] errors
    read: 0 0 0 0 0 77717.182 0
    write: 0 0 0 0 0 63896.737 0

    Non-medium error count: 954

    No self-tests have been logged


    any advices would be great! I really appreciate.









    share

























      0












      0








      0








      I'm newbie for linux system.



      founded errors by performing dmesg, seems like there're something wrong with all of disks. I keep tracking the errors until now. Here're a log from dmesg.



      [Wed Mar 13 17:12:26 2019] blk_update_request: I/O error, dev sdc, sector 573685760
      [Wed Mar 13 17:12:28 2019] blk_update_request: I/O error, dev sdl, sector 11288110080
      [Wed Mar 13 17:12:29 2019] blk_update_request: I/O error, dev sdf, sector 7774949376
      [Wed Mar 13 17:12:31 2019] blk_update_request: I/O error, dev sdf, sector 7775613952
      [Wed Mar 13 17:12:41 2019] blk_update_request: I/O error, dev sdg, sector 7653041152
      [Wed Mar 13 17:12:45 2019] blk_update_request: I/O error, dev sdn, sector 244398080
      [Wed Mar 13 17:12:49 2019] blk_update_request: I/O error, dev sdd, sector 2220809216
      [Wed Mar 13 17:12:50 2019] blk_update_request: I/O error, dev sdp, sector 4293958656
      [Wed Mar 13 17:12:51 2019] blk_update_request: I/O error, dev sdp, sector 4294248056
      [Wed Mar 13 17:12:55 2019] blk_update_request: I/O error, dev sdo, sector 2329909248
      [Wed Mar 13 17:12:56 2019] blk_update_request: I/O error, dev sdc, sector 591905792
      [Wed Mar 13 17:13:00 2019] blk_update_request: I/O error, dev sdo, sector 2318767104
      [Wed Mar 13 17:13:39 2019] blk_update_request: I/O error, dev sdd, sector 2105034752
      [Wed Mar 13 17:13:43 2019] blk_update_request: I/O error, dev sdj, sector 667691008
      [Wed Mar 13 17:13:50 2019] blk_update_request: I/O error, dev sde, sector 3346320384
      [Wed Mar 13 17:14:07 2019] blk_update_request: I/O error, dev sdc, sector 593794048
      [Wed Mar 13 17:14:08 2019] blk_update_request: I/O error, dev sdi, sector 3204312064
      [Wed Mar 13 17:14:10 2019] blk_update_request: I/O error, dev sdf, sector 11714625536
      [Wed Mar 13 17:14:13 2019] blk_update_request: I/O error, dev sdj, sector 134696960
      [Wed Mar 13 17:14:15 2019] blk_update_request: I/O error, dev sdl, sector 11315831808
      [Wed Mar 13 17:14:18 2019] blk_update_request: I/O error, dev sdd, sector 2299802624
      [Wed Mar 13 17:14:28 2019] blk_update_request: I/O error, dev sdd, sector 2297375744
      [Wed Mar 13 17:14:33 2019] blk_update_request: I/O error, dev sde, sector 3407077376
      [Wed Mar 13 17:14:38 2019] blk_update_request: I/O error, dev sdi, sector 9447327744
      [Wed Mar 13 17:14:48 2019] blk_update_request: I/O error, dev sde, sector 2752748544
      [Wed Mar 13 17:14:57 2019] blk_update_request: I/O error, dev sdc, sector 9496791040
      [Wed Mar 13 17:15:07 2019] blk_update_request: I/O error, dev sdc, sector 615070720
      [Wed Mar 13 17:15:12 2019] blk_update_request: I/O error, dev sdj, sector 383865856
      [Wed Mar 13 17:15:12 2019] blk_update_request: I/O error, dev sdj, sector 384624640
      [Wed Mar 13 17:22:14 2019] blk_update_request: I/O error, dev sdn, sector 7205202944
      [Wed Mar 13 17:37:47 2019] blk_update_request: I/O error, dev sdh, sector 5723347968
      [Wed Mar 13 17:37:51 2019] blk_update_request: I/O error, dev sdj, sector 3897670552
      [Wed Mar 13 18:11:23 2019] blk_update_request: I/O error, dev sdj, sector 2752643456
      [Wed Mar 13 18:16:05 2019] blk_update_request: I/O error, dev sdl, sector 11686973160
      [Wed Mar 13 18:28:20 2019] blk_update_request: I/O error, dev sdg, sector 5801116672
      [Wed Mar 13 18:32:16 2019] blk_update_request: I/O error, dev sdo, sector 4698261088
      [Wed Mar 13 18:35:59 2019] blk_update_request: I/O error, dev sdm, sector 6010393600
      [Wed Mar 13 18:37:56 2019] blk_update_request: I/O error, dev sdc, sector 2038415360
      [Wed Mar 13 18:56:45 2019] blk_update_request: I/O error, dev sdh, sector 8178621592
      [Wed Mar 13 18:56:45 2019] blk_update_request: I/O error, dev sdd, sector 4276064384
      [Wed Mar 13 19:22:48 2019] blk_update_request: I/O error, dev sdk, sector 7586044832
      [Wed Mar 13 19:24:10 2019] blk_update_request: I/O error, dev sdi, sector 6823062512
      [Wed Mar 13 19:24:49 2019] blk_update_request: I/O error, dev sdb, sector 588349864
      [Wed Mar 13 19:33:30 2019] blk_update_request: I/O error, dev sdl, sector 8421146656
      [Wed Mar 13 19:33:35 2019] blk_update_request: I/O error, dev sde, sector 10002190440
      [Wed Mar 13 19:35:00 2019] blk_update_request: I/O error, dev sdi, sector 10178364784
      [Wed Mar 13 19:36:43 2019] blk_update_request: I/O error, dev sdj, sector 5582077128
      [Wed Mar 13 19:54:39 2019] blk_update_request: I/O error, dev sdp, sector 2875791736
      [Wed Mar 13 19:55:19 2019] blk_update_request: I/O error, dev sdh, sector 969805632
      [Wed Mar 13 19:56:18 2019] blk_update_request: I/O error, dev sdl, sector 7231314336
      [Wed Mar 13 19:56:40 2019] blk_update_request: I/O error, dev sdd, sector 63581656
      [Wed Mar 13 19:58:05 2019] blk_update_request: I/O error, dev sdg, sector 9960299296
      [Wed Mar 13 20:04:39 2019] blk_update_request: I/O error, dev sde, sector 7195128064
      [Wed Mar 13 20:05:07 2019] blk_update_request: I/O error, dev sdc, sector 1558854656
      [Wed Mar 13 20:10:22 2019] blk_update_request: I/O error, dev sdk, sector 11337512016
      [Wed Mar 13 20:11:00 2019] blk_update_request: I/O error, dev sdj, sector 5019986680
      [Wed Mar 13 20:13:53 2019] blk_update_request: I/O error, dev sdc, sector 10881031976
      [Wed Mar 13 20:14:32 2019] blk_update_request: I/O error, dev sdk, sector 8960667904
      [Wed Mar 13 20:17:04 2019] blk_update_request: I/O error, dev sdd, sector 10162448920
      [Wed Mar 13 21:33:12 2019] blk_update_request: I/O error, dev sde, sector 8287529984
      [Wed Mar 13 22:24:52 2019] blk_update_request: I/O error, dev sdl, sector 707870320
      [Wed Mar 13 23:26:49 2019] blk_update_request: I/O error, dev sdo, sector 6834953944
      [Wed Mar 13 23:44:11 2019] blk_update_request: I/O error, dev sdo, sector 3859546984
      [Wed Mar 13 23:50:24 2019] blk_update_request: I/O error, dev sdb, sector 4940592152
      [Thu Mar 14 00:45:17 2019] blk_update_request: I/O error, dev sdo, sector 11427215360
      [Thu Mar 14 04:03:13 2019] blk_update_request: I/O error, dev sdl, sector 10425306360
      [Thu Mar 14 04:20:34 2019] blk_update_request: I/O error, dev sdc, sector 9905921360
      [Thu Mar 14 04:25:04 2019] blk_update_request: I/O error, dev sdp, sector 2438172672
      [Thu Mar 14 04:35:44 2019] blk_update_request: I/O error, dev sde, sector 10189918280
      [Thu Mar 14 05:33:08 2019] blk_update_request: I/O error, dev sdf, sector 7456407856
      [Thu Mar 14 05:52:39 2019] blk_update_request: I/O error, dev sdn, sector 10601913816
      [Thu Mar 14 05:53:28 2019] blk_update_request: I/O error, dev sdl, sector 5244034456
      [Thu Mar 14 05:53:28 2019] blk_update_request: I/O error, dev sdm, sector 5004255512
      [Thu Mar 14 05:53:47 2019] blk_update_request: I/O error, dev sdg, sector 11449884968
      [Thu Mar 14 05:54:17 2019] blk_update_request: I/O error, dev sdm, sector 4928738040
      [Thu Mar 14 05:54:33 2019] blk_update_request: I/O error, dev sdh, sector 4947387880
      [Thu Mar 14 05:57:09 2019] blk_update_request: I/O error, dev sdg, sector 181969744
      [Thu Mar 14 05:57:19 2019] blk_update_request: I/O error, dev sdg, sector 191782352
      [Thu Mar 14 05:57:20 2019] blk_update_request: I/O error, dev sdp, sector 4488780920
      [Thu Mar 14 05:59:08 2019] blk_update_request: I/O error, dev sdg, sector 10890166576
      [Thu Mar 14 05:59:08 2019] blk_update_request: I/O error, dev sdk, sector 5814053216
      [Thu Mar 14 06:01:37 2019] blk_update_request: I/O error, dev sdh, sector 4456248536
      [Thu Mar 14 06:02:40 2019] blk_update_request: I/O error, dev sdk, sector 6023428600
      [Thu Mar 14 06:02:49 2019] blk_update_request: I/O error, dev sdf, sector 11573913960
      [Thu Mar 14 06:03:03 2019] blk_update_request: I/O error, dev sdp, sector 4976394224
      [Thu Mar 14 06:03:03 2019] blk_update_request: I/O error, dev sdh, sector 5141368856
      [Thu Mar 14 06:18:58 2019] blk_update_request: I/O error, dev sdh, sector 5568277336
      [Thu Mar 14 06:21:44 2019] blk_update_request: I/O error, dev sdj, sector 7696349184
      [Thu Mar 14 06:46:29 2019] blk_update_request: I/O error, dev sdn, sector 3307626496
      [Thu Mar 14 06:46:37 2019] blk_update_request: I/O error, dev sdk, sector 6311800832
      [Thu Mar 14 06:47:46 2019] blk_update_request: I/O error, dev sdj, sector 5994693592
      [Thu Mar 14 06:48:16 2019] blk_update_request: I/O error, dev sdp, sector 2772352000
      [Thu Mar 14 06:48:21 2019] blk_update_request: I/O error, dev sdo, sector 10622710704
      [Thu Mar 14 06:48:35 2019] blk_update_request: I/O error, dev sdm, sector 5921376784
      [Thu Mar 14 06:54:38 2019] blk_update_request: I/O error, dev sdk, sector 6312236032
      [Thu Mar 14 06:55:18 2019] blk_update_request: I/O error, dev sdl, sector 11570793288
      [Thu Mar 14 06:56:33 2019] blk_update_request: I/O error, dev sdc, sector 6796612608
      [Thu Mar 14 07:09:30 2019] blk_update_request: I/O error, dev sdo, sector 10860347304
      [Thu Mar 14 07:17:08 2019] blk_update_request: I/O error, dev sdk, sector 3973260288
      [Thu Mar 14 07:20:25 2019] blk_update_request: I/O error, dev sdk, sector 3975413760
      [Thu Mar 14 07:45:07 2019] blk_update_request: I/O error, dev sdm, sector 11583453264
      [Thu Mar 14 07:45:44 2019] blk_update_request: I/O error, dev sdh, sector 8425250816
      [Thu Mar 14 07:48:33 2019] blk_update_request: I/O error, dev sdf, sector 504787888
      [Thu Mar 14 07:53:13 2019] blk_update_request: I/O error, dev sdc, sector 6438806272
      [Thu Mar 14 07:58:50 2019] blk_update_request: I/O error, dev sdf, sector 1596355920
      [Thu Mar 14 07:59:25 2019] blk_update_request: I/O error, dev sdk, sector 4699144192
      [Thu Mar 14 08:00:39 2019] blk_update_request: I/O error, dev sdi, sector 7864738816
      [Thu Mar 14 08:00:39 2019] EXT4-fs warning (device sdi): ext4_end_bio:316: I/O error -5 writing to inode 76743178 (offset 654311424 size 8388608 starting block 983092480)
      [Thu Mar 14 08:00:39 2019] Buffer I/O error on device sdi, logical block 983092352
      [Thu Mar 14 08:00:39 2019] Buffer I/O error on device sdi, logical block 983092353
      [Thu Mar 14 08:00:39 2019] Buffer I/O error on device sdi, logical block 983092354
      [Thu Mar 14 08:00:39 2019] Buffer I/O error on device sdi, logical block 983092355
      [Thu Mar 14 08:00:39 2019] Buffer I/O error on device sdi, logical block 983092356
      [Thu Mar 14 08:00:39 2019] Buffer I/O error on device sdi, logical block 983092357
      [Thu Mar 14 08:00:39 2019] Buffer I/O error on device sdi, logical block 983092358
      [Thu Mar 14 08:00:39 2019] Buffer I/O error on device sdi, logical block 983092359
      [Thu Mar 14 08:00:39 2019] Buffer I/O error on device sdi, logical block 983092360
      [Thu Mar 14 08:00:39 2019] Buffer I/O error on device sdi, logical block 983092361
      [Thu Mar 14 08:08:39 2019] blk_update_request: I/O error, dev sde, sector 8333908128
      [Thu Mar 14 08:10:49 2019] blk_update_request: I/O error, dev sdg, sector 11392036592
      [Thu Mar 14 08:11:04 2019] blk_update_request: I/O error, dev sde, sector 9026698320
      [Thu Mar 14 08:14:02 2019] blk_update_request: I/O error, dev sdn, sector 6259879936
      [Thu Mar 14 08:14:05 2019] blk_update_request: I/O error, dev sdg, sector 332910216
      [Thu Mar 14 08:16:44 2019] blk_update_request: I/O error, dev sdk, sector 6839443456
      [Thu Mar 14 08:33:24 2019] blk_update_request: I/O error, dev sdf, sector 11568233320
      [Thu Mar 14 08:38:02 2019] blk_update_request: I/O error, dev sdf, sector 8846133248
      [Thu Mar 14 08:38:10 2019] blk_update_request: I/O error, dev sdp, sector 9390738808
      [Thu Mar 14 08:45:14 2019] blk_update_request: I/O error, dev sdf, sector 1804330272
      [Thu Mar 14 08:55:24 2019] blk_update_request: I/O error, dev sdn, sector 4962636800
      [Thu Mar 14 09:00:07 2019] blk_update_request: I/O error, dev sdm, sector 4942112768
      [Thu Mar 14 09:03:57 2019] blk_update_request: I/O error, dev sde, sector 2004416744
      [Thu Mar 14 09:03:57 2019] blk_update_request: I/O error, dev sdk, sector 11151543576
      [Thu Mar 14 09:03:59 2019] blk_update_request: I/O error, dev sdb, sector 9141955824
      [Thu Mar 14 09:30:19 2019] blk_update_request: I/O error, dev sdo, sector 190925440
      [Thu Mar 14 09:33:17 2019] blk_update_request: I/O error, dev sdc, sector 6784547536
      [Thu Mar 14 09:34:11 2019] blk_update_request: I/O error, dev sdb, sector 8378552848
      [Thu Mar 14 09:36:42 2019] blk_update_request: I/O error, dev sdi, sector 4072348536
      [Thu Mar 14 09:36:43 2019] blk_update_request: I/O error, dev sdj, sector 3905785352
      [Thu Mar 14 09:36:44 2019] blk_update_request: I/O error, dev sdb, sector 5607689656
      [Thu Mar 14 09:36:44 2019] blk_update_request: I/O error, dev sdj, sector 10801129192
      [Thu Mar 14 09:36:46 2019] blk_update_request: I/O error, dev sdc, sector 5683881760
      [Thu Mar 14 09:36:46 2019] blk_update_request: I/O error, dev sdi, sector 4078841184
      [Thu Mar 14 09:38:03 2019] blk_update_request: I/O error, dev sdl, sector 2653407232
      [Thu Mar 14 09:40:56 2019] blk_update_request: I/O error, dev sdo, sector 6559526912
      [Thu Mar 14 09:41:06 2019] blk_update_request: I/O error, dev sdo, sector 6559876096
      [Thu Mar 14 09:42:48 2019] blk_update_request: I/O error, dev sdk, sector 7296224200
      [Thu Mar 14 09:42:50 2019] blk_update_request: I/O error, dev sdk, sector 7298670632
      [Thu Mar 14 09:43:01 2019] blk_update_request: I/O error, dev sdf, sector 9532311552
      [Thu Mar 14 09:47:51 2019] blk_update_request: I/O error, dev sdo, sector 11505383208
      [Thu Mar 14 09:48:26 2019] blk_update_request: I/O error, dev sdl, sector 6810332184
      [Thu Mar 14 09:52:38 2019] blk_update_request: I/O error, dev sdm, sector 9522262016
      [Thu Mar 14 09:56:53 2019] blk_update_request: I/O error, dev sdb, sector 361288368
      [Thu Mar 14 09:56:57 2019] blk_update_request: I/O error, dev sdg, sector 157264288
      [Thu Mar 14 09:58:29 2019] blk_update_request: I/O error, dev sdk, sector 4990681720
      [Thu Mar 14 10:00:37 2019] blk_update_request: I/O error, dev sdo, sector 11505749272
      [Thu Mar 14 10:03:59 2019] blk_update_request: I/O error, dev sdl, sector 1422636680
      [Thu Mar 14 10:09:49 2019] blk_update_request: I/O error, dev sdk, sector 4688443792
      [Thu Mar 14 10:17:51 2019] blk_update_request: I/O error, dev sdb, sector 4287825920
      [Thu Mar 14 10:18:06 2019] blk_update_request: I/O error, dev sdc, sector 6442002432
      [Thu Mar 14 10:20:18 2019] blk_update_request: I/O error, dev sdj, sector 11357437976
      [Thu Mar 14 10:23:41 2019] blk_update_request: I/O error, dev sdc, sector 5910204416
      [Thu Mar 14 10:24:07 2019] blk_update_request: I/O error, dev sdd, sector 4931613624
      [Thu Mar 14 10:24:50 2019] blk_update_request: I/O error, dev sdg, sector 11454225184
      [Thu Mar 14 10:25:20 2019] blk_update_request: I/O error, dev sdg, sector 628817480
      [Thu Mar 14 10:25:22 2019] blk_update_request: I/O error, dev sdp, sector 4952914696
      [Thu Mar 14 10:26:31 2019] blk_update_request: I/O error, dev sdi, sector 8204927480
      [Thu Mar 14 10:26:58 2019] blk_update_request: I/O error, dev sdb, sector 6325656136
      [Thu Mar 14 10:27:45 2019] blk_update_request: I/O error, dev sdb, sector 11306080528
      [Thu Mar 14 10:27:57 2019] blk_update_request: I/O error, dev sdf, sector 5522990080
      [Thu Mar 14 10:28:00 2019] blk_update_request: I/O error, dev sdb, sector 8337659192
      [Thu Mar 14 10:28:40 2019] blk_update_request: I/O error, dev sdd, sector 4633868936
      [Thu Mar 14 10:31:51 2019] blk_update_request: I/O error, dev sdh, sector 547837048
      [Thu Mar 14 10:31:59 2019] blk_update_request: I/O error, dev sdj, sector 7494419792
      [Thu Mar 14 10:33:23 2019] blk_update_request: I/O error, dev sdn, sector 2453028864
      [Thu Mar 14 10:34:17 2019] blk_update_request: I/O error, dev sdj, sector 7414340816
      [Thu Mar 14 10:34:18 2019] blk_update_request: I/O error, dev sdf, sector 8075539152
      [Thu Mar 14 10:36:14 2019] blk_update_request: I/O error, dev sdc, sector 1084731280
      [Thu Mar 14 10:36:18 2019] blk_update_request: I/O error, dev sdb, sector 3356220400
      [Thu Mar 14 10:38:59 2019] blk_update_request: I/O error, dev sdf, sector 7486777808
      [Thu Mar 14 10:39:00 2019] blk_update_request: I/O error, dev sdn, sector 8620632856
      [Thu Mar 14 10:39:10 2019] blk_update_request: I/O error, dev sde, sector 7873372584
      [Thu Mar 14 10:39:55 2019] blk_update_request: I/O error, dev sde, sector 10750726688
      [Thu Mar 14 10:40:15 2019] blk_update_request: I/O error, dev sdd, sector 11357432352
      [Thu Mar 14 10:41:13 2019] blk_update_request: I/O error, dev sdi, sector 6836535296
      [Thu Mar 14 10:41:17 2019] blk_update_request: I/O error, dev sdi, sector 6836552008
      [Thu Mar 14 10:43:35 2019] blk_update_request: I/O error, dev sdb, sector 307348480
      [Thu Mar 14 10:44:20 2019] blk_update_request: I/O error, dev sdf, sector 1781563392
      [Thu Mar 14 10:44:26 2019] blk_update_request: I/O error, dev sdd, sector 6410786592
      [Thu Mar 14 10:45:45 2019] blk_update_request: I/O error, dev sdl, sector 9154662960
      [Thu Mar 14 10:45:46 2019] blk_update_request: I/O error, dev sdj, sector 6619819200
      [Thu Mar 14 10:49:08 2019] blk_update_request: I/O error, dev sdn, sector 10767812936
      [Thu Mar 14 10:53:41 2019] blk_update_request: I/O error, dev sdo, sector 9716759432
      [Thu Mar 14 10:53:50 2019] blk_update_request: I/O error, dev sdc, sector 7983572992


      But smartctl gave no error



      [root@mtg8-dt-18 ~]# smartctl -C -a /dev/sdg
      smartctl 6.2 2017-02-27 r4394 [x86_64-linux-3.10.0-693.el7.x86_64] (local build)
      Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org

      === START OF INFORMATION SECTION ===
      Vendor: HP
      Product: MB6000JVYZD
      Revision: HPD1
      User Capacity: 6,001,175,126,016 bytes [6.00 TB]
      Logical block size: 512 bytes
      Physical block size: 4096 bytes
      Lowest aligned LBA: 0
      Rotation Rate: 7200 rpm
      Form Factor: 3.5 inches
      Logical Unit id: 0x5000c50094558e07
      Serial number: ZAD204PV0000C8015S23
      Device type: disk
      Transport protocol: SAS
      Local Time is: Thu Mar 14 11:00:24 2019 +07
      SMART support is: Available - device has SMART capability.
      SMART support is: Enabled
      Temperature Warning: Enabled

      === START OF READ SMART DATA SECTION ===
      SMART Health Status: OK

      Current Drive Temperature: 29 C
      Drive Trip Temperature: 60 C

      Manufactured in week 30 of year 2017
      Specified cycle count over device lifetime: 10000
      Accumulated start-stop cycles: 78
      Specified load-unload count over device lifetime: 300000
      Accumulated load-unload cycles: 632
      Elements in grown defect list: 0

      Vendor (Seagate) cache information
      Blocks sent to initiator = 1467516240
      Blocks received from initiator = 168658064
      Blocks read from cache and sent to initiator = 3698801821
      Number of read and write commands whose size <= segment size = 62258636
      Number of read and write commands whose size > segment size = 2134931

      Vendor (Seagate/Hitachi) factory information
      number of hours powered up = 12178.78
      number of minutes until next internal SMART test = 7

      Error counter log:
      Errors Corrected by Total Correction Gigabytes Total
      ECC rereads/ errors algorithm processed uncorrected
      fast | delayed rewrites corrected invocations [10^9 bytes] errors
      read: 0 0 0 0 0 77717.182 0
      write: 0 0 0 0 0 63896.737 0

      Non-medium error count: 954

      No self-tests have been logged


      any advices would be great! I really appreciate.









      share














      I'm newbie for linux system.



      founded errors by performing dmesg, seems like there're something wrong with all of disks. I keep tracking the errors until now. Here're a log from dmesg.



      [Wed Mar 13 17:12:26 2019] blk_update_request: I/O error, dev sdc, sector 573685760
      [Wed Mar 13 17:12:28 2019] blk_update_request: I/O error, dev sdl, sector 11288110080
      [Wed Mar 13 17:12:29 2019] blk_update_request: I/O error, dev sdf, sector 7774949376
      [Wed Mar 13 17:12:31 2019] blk_update_request: I/O error, dev sdf, sector 7775613952
      [Wed Mar 13 17:12:41 2019] blk_update_request: I/O error, dev sdg, sector 7653041152
      [Wed Mar 13 17:12:45 2019] blk_update_request: I/O error, dev sdn, sector 244398080
      [Wed Mar 13 17:12:49 2019] blk_update_request: I/O error, dev sdd, sector 2220809216
      [Wed Mar 13 17:12:50 2019] blk_update_request: I/O error, dev sdp, sector 4293958656
      [Wed Mar 13 17:12:51 2019] blk_update_request: I/O error, dev sdp, sector 4294248056
      [Wed Mar 13 17:12:55 2019] blk_update_request: I/O error, dev sdo, sector 2329909248
      [Wed Mar 13 17:12:56 2019] blk_update_request: I/O error, dev sdc, sector 591905792
      [Wed Mar 13 17:13:00 2019] blk_update_request: I/O error, dev sdo, sector 2318767104
      [Wed Mar 13 17:13:39 2019] blk_update_request: I/O error, dev sdd, sector 2105034752
      [Wed Mar 13 17:13:43 2019] blk_update_request: I/O error, dev sdj, sector 667691008
      [Wed Mar 13 17:13:50 2019] blk_update_request: I/O error, dev sde, sector 3346320384
      [Wed Mar 13 17:14:07 2019] blk_update_request: I/O error, dev sdc, sector 593794048
      [Wed Mar 13 17:14:08 2019] blk_update_request: I/O error, dev sdi, sector 3204312064
      [Wed Mar 13 17:14:10 2019] blk_update_request: I/O error, dev sdf, sector 11714625536
      [Wed Mar 13 17:14:13 2019] blk_update_request: I/O error, dev sdj, sector 134696960
      [Wed Mar 13 17:14:15 2019] blk_update_request: I/O error, dev sdl, sector 11315831808
      [Wed Mar 13 17:14:18 2019] blk_update_request: I/O error, dev sdd, sector 2299802624
      [Wed Mar 13 17:14:28 2019] blk_update_request: I/O error, dev sdd, sector 2297375744
      [Wed Mar 13 17:14:33 2019] blk_update_request: I/O error, dev sde, sector 3407077376
      [Wed Mar 13 17:14:38 2019] blk_update_request: I/O error, dev sdi, sector 9447327744
      [Wed Mar 13 17:14:48 2019] blk_update_request: I/O error, dev sde, sector 2752748544
      [Wed Mar 13 17:14:57 2019] blk_update_request: I/O error, dev sdc, sector 9496791040
      [Wed Mar 13 17:15:07 2019] blk_update_request: I/O error, dev sdc, sector 615070720
      [Wed Mar 13 17:15:12 2019] blk_update_request: I/O error, dev sdj, sector 383865856
      [Wed Mar 13 17:15:12 2019] blk_update_request: I/O error, dev sdj, sector 384624640
      [Wed Mar 13 17:22:14 2019] blk_update_request: I/O error, dev sdn, sector 7205202944
      [Wed Mar 13 17:37:47 2019] blk_update_request: I/O error, dev sdh, sector 5723347968
      [Wed Mar 13 17:37:51 2019] blk_update_request: I/O error, dev sdj, sector 3897670552
      [Wed Mar 13 18:11:23 2019] blk_update_request: I/O error, dev sdj, sector 2752643456
      [Wed Mar 13 18:16:05 2019] blk_update_request: I/O error, dev sdl, sector 11686973160
      [Wed Mar 13 18:28:20 2019] blk_update_request: I/O error, dev sdg, sector 5801116672
      [Wed Mar 13 18:32:16 2019] blk_update_request: I/O error, dev sdo, sector 4698261088
      [Wed Mar 13 18:35:59 2019] blk_update_request: I/O error, dev sdm, sector 6010393600
      [Wed Mar 13 18:37:56 2019] blk_update_request: I/O error, dev sdc, sector 2038415360
      [Wed Mar 13 18:56:45 2019] blk_update_request: I/O error, dev sdh, sector 8178621592
      [Wed Mar 13 18:56:45 2019] blk_update_request: I/O error, dev sdd, sector 4276064384
      [Wed Mar 13 19:22:48 2019] blk_update_request: I/O error, dev sdk, sector 7586044832
      [Wed Mar 13 19:24:10 2019] blk_update_request: I/O error, dev sdi, sector 6823062512
      [Wed Mar 13 19:24:49 2019] blk_update_request: I/O error, dev sdb, sector 588349864
      [Wed Mar 13 19:33:30 2019] blk_update_request: I/O error, dev sdl, sector 8421146656
      [Wed Mar 13 19:33:35 2019] blk_update_request: I/O error, dev sde, sector 10002190440
      [Wed Mar 13 19:35:00 2019] blk_update_request: I/O error, dev sdi, sector 10178364784
      [Wed Mar 13 19:36:43 2019] blk_update_request: I/O error, dev sdj, sector 5582077128
      [Wed Mar 13 19:54:39 2019] blk_update_request: I/O error, dev sdp, sector 2875791736
      [Wed Mar 13 19:55:19 2019] blk_update_request: I/O error, dev sdh, sector 969805632
      [Wed Mar 13 19:56:18 2019] blk_update_request: I/O error, dev sdl, sector 7231314336
      [Wed Mar 13 19:56:40 2019] blk_update_request: I/O error, dev sdd, sector 63581656
      [Wed Mar 13 19:58:05 2019] blk_update_request: I/O error, dev sdg, sector 9960299296
      [Wed Mar 13 20:04:39 2019] blk_update_request: I/O error, dev sde, sector 7195128064
      [Wed Mar 13 20:05:07 2019] blk_update_request: I/O error, dev sdc, sector 1558854656
      [Wed Mar 13 20:10:22 2019] blk_update_request: I/O error, dev sdk, sector 11337512016
      [Wed Mar 13 20:11:00 2019] blk_update_request: I/O error, dev sdj, sector 5019986680
      [Wed Mar 13 20:13:53 2019] blk_update_request: I/O error, dev sdc, sector 10881031976
      [Wed Mar 13 20:14:32 2019] blk_update_request: I/O error, dev sdk, sector 8960667904
      [Wed Mar 13 20:17:04 2019] blk_update_request: I/O error, dev sdd, sector 10162448920
      [Wed Mar 13 21:33:12 2019] blk_update_request: I/O error, dev sde, sector 8287529984
      [Wed Mar 13 22:24:52 2019] blk_update_request: I/O error, dev sdl, sector 707870320
      [Wed Mar 13 23:26:49 2019] blk_update_request: I/O error, dev sdo, sector 6834953944
      [Wed Mar 13 23:44:11 2019] blk_update_request: I/O error, dev sdo, sector 3859546984
      [Wed Mar 13 23:50:24 2019] blk_update_request: I/O error, dev sdb, sector 4940592152
      [Thu Mar 14 00:45:17 2019] blk_update_request: I/O error, dev sdo, sector 11427215360
      [Thu Mar 14 04:03:13 2019] blk_update_request: I/O error, dev sdl, sector 10425306360
      [Thu Mar 14 04:20:34 2019] blk_update_request: I/O error, dev sdc, sector 9905921360
      [Thu Mar 14 04:25:04 2019] blk_update_request: I/O error, dev sdp, sector 2438172672
      [Thu Mar 14 04:35:44 2019] blk_update_request: I/O error, dev sde, sector 10189918280
      [Thu Mar 14 05:33:08 2019] blk_update_request: I/O error, dev sdf, sector 7456407856
      [Thu Mar 14 05:52:39 2019] blk_update_request: I/O error, dev sdn, sector 10601913816
      [Thu Mar 14 05:53:28 2019] blk_update_request: I/O error, dev sdl, sector 5244034456
      [Thu Mar 14 05:53:28 2019] blk_update_request: I/O error, dev sdm, sector 5004255512
      [Thu Mar 14 05:53:47 2019] blk_update_request: I/O error, dev sdg, sector 11449884968
      [Thu Mar 14 05:54:17 2019] blk_update_request: I/O error, dev sdm, sector 4928738040
      [Thu Mar 14 05:54:33 2019] blk_update_request: I/O error, dev sdh, sector 4947387880
      [Thu Mar 14 05:57:09 2019] blk_update_request: I/O error, dev sdg, sector 181969744
      [Thu Mar 14 05:57:19 2019] blk_update_request: I/O error, dev sdg, sector 191782352
      [Thu Mar 14 05:57:20 2019] blk_update_request: I/O error, dev sdp, sector 4488780920
      [Thu Mar 14 05:59:08 2019] blk_update_request: I/O error, dev sdg, sector 10890166576
      [Thu Mar 14 05:59:08 2019] blk_update_request: I/O error, dev sdk, sector 5814053216
      [Thu Mar 14 06:01:37 2019] blk_update_request: I/O error, dev sdh, sector 4456248536
      [Thu Mar 14 06:02:40 2019] blk_update_request: I/O error, dev sdk, sector 6023428600
      [Thu Mar 14 06:02:49 2019] blk_update_request: I/O error, dev sdf, sector 11573913960
      [Thu Mar 14 06:03:03 2019] blk_update_request: I/O error, dev sdp, sector 4976394224
      [Thu Mar 14 06:03:03 2019] blk_update_request: I/O error, dev sdh, sector 5141368856
      [Thu Mar 14 06:18:58 2019] blk_update_request: I/O error, dev sdh, sector 5568277336
      [Thu Mar 14 06:21:44 2019] blk_update_request: I/O error, dev sdj, sector 7696349184
      [Thu Mar 14 06:46:29 2019] blk_update_request: I/O error, dev sdn, sector 3307626496
      [Thu Mar 14 06:46:37 2019] blk_update_request: I/O error, dev sdk, sector 6311800832
      [Thu Mar 14 06:47:46 2019] blk_update_request: I/O error, dev sdj, sector 5994693592
      [Thu Mar 14 06:48:16 2019] blk_update_request: I/O error, dev sdp, sector 2772352000
      [Thu Mar 14 06:48:21 2019] blk_update_request: I/O error, dev sdo, sector 10622710704
      [Thu Mar 14 06:48:35 2019] blk_update_request: I/O error, dev sdm, sector 5921376784
      [Thu Mar 14 06:54:38 2019] blk_update_request: I/O error, dev sdk, sector 6312236032
      [Thu Mar 14 06:55:18 2019] blk_update_request: I/O error, dev sdl, sector 11570793288
      [Thu Mar 14 06:56:33 2019] blk_update_request: I/O error, dev sdc, sector 6796612608
      [Thu Mar 14 07:09:30 2019] blk_update_request: I/O error, dev sdo, sector 10860347304
      [Thu Mar 14 07:17:08 2019] blk_update_request: I/O error, dev sdk, sector 3973260288
      [Thu Mar 14 07:20:25 2019] blk_update_request: I/O error, dev sdk, sector 3975413760
      [Thu Mar 14 07:45:07 2019] blk_update_request: I/O error, dev sdm, sector 11583453264
      [Thu Mar 14 07:45:44 2019] blk_update_request: I/O error, dev sdh, sector 8425250816
      [Thu Mar 14 07:48:33 2019] blk_update_request: I/O error, dev sdf, sector 504787888
      [Thu Mar 14 07:53:13 2019] blk_update_request: I/O error, dev sdc, sector 6438806272
      [Thu Mar 14 07:58:50 2019] blk_update_request: I/O error, dev sdf, sector 1596355920
      [Thu Mar 14 07:59:25 2019] blk_update_request: I/O error, dev sdk, sector 4699144192
      [Thu Mar 14 08:00:39 2019] blk_update_request: I/O error, dev sdi, sector 7864738816
      [Thu Mar 14 08:00:39 2019] EXT4-fs warning (device sdi): ext4_end_bio:316: I/O error -5 writing to inode 76743178 (offset 654311424 size 8388608 starting block 983092480)
      [Thu Mar 14 08:00:39 2019] Buffer I/O error on device sdi, logical block 983092352
      [Thu Mar 14 08:00:39 2019] Buffer I/O error on device sdi, logical block 983092353
      [Thu Mar 14 08:00:39 2019] Buffer I/O error on device sdi, logical block 983092354
      [Thu Mar 14 08:00:39 2019] Buffer I/O error on device sdi, logical block 983092355
      [Thu Mar 14 08:00:39 2019] Buffer I/O error on device sdi, logical block 983092356
      [Thu Mar 14 08:00:39 2019] Buffer I/O error on device sdi, logical block 983092357
      [Thu Mar 14 08:00:39 2019] Buffer I/O error on device sdi, logical block 983092358
      [Thu Mar 14 08:00:39 2019] Buffer I/O error on device sdi, logical block 983092359
      [Thu Mar 14 08:00:39 2019] Buffer I/O error on device sdi, logical block 983092360
      [Thu Mar 14 08:00:39 2019] Buffer I/O error on device sdi, logical block 983092361
      [Thu Mar 14 08:08:39 2019] blk_update_request: I/O error, dev sde, sector 8333908128
      [Thu Mar 14 08:10:49 2019] blk_update_request: I/O error, dev sdg, sector 11392036592
      [Thu Mar 14 08:11:04 2019] blk_update_request: I/O error, dev sde, sector 9026698320
      [Thu Mar 14 08:14:02 2019] blk_update_request: I/O error, dev sdn, sector 6259879936
      [Thu Mar 14 08:14:05 2019] blk_update_request: I/O error, dev sdg, sector 332910216
      [Thu Mar 14 08:16:44 2019] blk_update_request: I/O error, dev sdk, sector 6839443456
      [Thu Mar 14 08:33:24 2019] blk_update_request: I/O error, dev sdf, sector 11568233320
      [Thu Mar 14 08:38:02 2019] blk_update_request: I/O error, dev sdf, sector 8846133248
      [Thu Mar 14 08:38:10 2019] blk_update_request: I/O error, dev sdp, sector 9390738808
      [Thu Mar 14 08:45:14 2019] blk_update_request: I/O error, dev sdf, sector 1804330272
      [Thu Mar 14 08:55:24 2019] blk_update_request: I/O error, dev sdn, sector 4962636800
      [Thu Mar 14 09:00:07 2019] blk_update_request: I/O error, dev sdm, sector 4942112768
      [Thu Mar 14 09:03:57 2019] blk_update_request: I/O error, dev sde, sector 2004416744
      [Thu Mar 14 09:03:57 2019] blk_update_request: I/O error, dev sdk, sector 11151543576
      [Thu Mar 14 09:03:59 2019] blk_update_request: I/O error, dev sdb, sector 9141955824
      [Thu Mar 14 09:30:19 2019] blk_update_request: I/O error, dev sdo, sector 190925440
      [Thu Mar 14 09:33:17 2019] blk_update_request: I/O error, dev sdc, sector 6784547536
      [Thu Mar 14 09:34:11 2019] blk_update_request: I/O error, dev sdb, sector 8378552848
      [Thu Mar 14 09:36:42 2019] blk_update_request: I/O error, dev sdi, sector 4072348536
      [Thu Mar 14 09:36:43 2019] blk_update_request: I/O error, dev sdj, sector 3905785352
      [Thu Mar 14 09:36:44 2019] blk_update_request: I/O error, dev sdb, sector 5607689656
      [Thu Mar 14 09:36:44 2019] blk_update_request: I/O error, dev sdj, sector 10801129192
      [Thu Mar 14 09:36:46 2019] blk_update_request: I/O error, dev sdc, sector 5683881760
      [Thu Mar 14 09:36:46 2019] blk_update_request: I/O error, dev sdi, sector 4078841184
      [Thu Mar 14 09:38:03 2019] blk_update_request: I/O error, dev sdl, sector 2653407232
      [Thu Mar 14 09:40:56 2019] blk_update_request: I/O error, dev sdo, sector 6559526912
      [Thu Mar 14 09:41:06 2019] blk_update_request: I/O error, dev sdo, sector 6559876096
      [Thu Mar 14 09:42:48 2019] blk_update_request: I/O error, dev sdk, sector 7296224200
      [Thu Mar 14 09:42:50 2019] blk_update_request: I/O error, dev sdk, sector 7298670632
      [Thu Mar 14 09:43:01 2019] blk_update_request: I/O error, dev sdf, sector 9532311552
      [Thu Mar 14 09:47:51 2019] blk_update_request: I/O error, dev sdo, sector 11505383208
      [Thu Mar 14 09:48:26 2019] blk_update_request: I/O error, dev sdl, sector 6810332184
      [Thu Mar 14 09:52:38 2019] blk_update_request: I/O error, dev sdm, sector 9522262016
      [Thu Mar 14 09:56:53 2019] blk_update_request: I/O error, dev sdb, sector 361288368
      [Thu Mar 14 09:56:57 2019] blk_update_request: I/O error, dev sdg, sector 157264288
      [Thu Mar 14 09:58:29 2019] blk_update_request: I/O error, dev sdk, sector 4990681720
      [Thu Mar 14 10:00:37 2019] blk_update_request: I/O error, dev sdo, sector 11505749272
      [Thu Mar 14 10:03:59 2019] blk_update_request: I/O error, dev sdl, sector 1422636680
      [Thu Mar 14 10:09:49 2019] blk_update_request: I/O error, dev sdk, sector 4688443792
      [Thu Mar 14 10:17:51 2019] blk_update_request: I/O error, dev sdb, sector 4287825920
      [Thu Mar 14 10:18:06 2019] blk_update_request: I/O error, dev sdc, sector 6442002432
      [Thu Mar 14 10:20:18 2019] blk_update_request: I/O error, dev sdj, sector 11357437976
      [Thu Mar 14 10:23:41 2019] blk_update_request: I/O error, dev sdc, sector 5910204416
      [Thu Mar 14 10:24:07 2019] blk_update_request: I/O error, dev sdd, sector 4931613624
      [Thu Mar 14 10:24:50 2019] blk_update_request: I/O error, dev sdg, sector 11454225184
      [Thu Mar 14 10:25:20 2019] blk_update_request: I/O error, dev sdg, sector 628817480
      [Thu Mar 14 10:25:22 2019] blk_update_request: I/O error, dev sdp, sector 4952914696
      [Thu Mar 14 10:26:31 2019] blk_update_request: I/O error, dev sdi, sector 8204927480
      [Thu Mar 14 10:26:58 2019] blk_update_request: I/O error, dev sdb, sector 6325656136
      [Thu Mar 14 10:27:45 2019] blk_update_request: I/O error, dev sdb, sector 11306080528
      [Thu Mar 14 10:27:57 2019] blk_update_request: I/O error, dev sdf, sector 5522990080
      [Thu Mar 14 10:28:00 2019] blk_update_request: I/O error, dev sdb, sector 8337659192
      [Thu Mar 14 10:28:40 2019] blk_update_request: I/O error, dev sdd, sector 4633868936
      [Thu Mar 14 10:31:51 2019] blk_update_request: I/O error, dev sdh, sector 547837048
      [Thu Mar 14 10:31:59 2019] blk_update_request: I/O error, dev sdj, sector 7494419792
      [Thu Mar 14 10:33:23 2019] blk_update_request: I/O error, dev sdn, sector 2453028864
      [Thu Mar 14 10:34:17 2019] blk_update_request: I/O error, dev sdj, sector 7414340816
      [Thu Mar 14 10:34:18 2019] blk_update_request: I/O error, dev sdf, sector 8075539152
      [Thu Mar 14 10:36:14 2019] blk_update_request: I/O error, dev sdc, sector 1084731280
      [Thu Mar 14 10:36:18 2019] blk_update_request: I/O error, dev sdb, sector 3356220400
      [Thu Mar 14 10:38:59 2019] blk_update_request: I/O error, dev sdf, sector 7486777808
      [Thu Mar 14 10:39:00 2019] blk_update_request: I/O error, dev sdn, sector 8620632856
      [Thu Mar 14 10:39:10 2019] blk_update_request: I/O error, dev sde, sector 7873372584
      [Thu Mar 14 10:39:55 2019] blk_update_request: I/O error, dev sde, sector 10750726688
      [Thu Mar 14 10:40:15 2019] blk_update_request: I/O error, dev sdd, sector 11357432352
      [Thu Mar 14 10:41:13 2019] blk_update_request: I/O error, dev sdi, sector 6836535296
      [Thu Mar 14 10:41:17 2019] blk_update_request: I/O error, dev sdi, sector 6836552008
      [Thu Mar 14 10:43:35 2019] blk_update_request: I/O error, dev sdb, sector 307348480
      [Thu Mar 14 10:44:20 2019] blk_update_request: I/O error, dev sdf, sector 1781563392
      [Thu Mar 14 10:44:26 2019] blk_update_request: I/O error, dev sdd, sector 6410786592
      [Thu Mar 14 10:45:45 2019] blk_update_request: I/O error, dev sdl, sector 9154662960
      [Thu Mar 14 10:45:46 2019] blk_update_request: I/O error, dev sdj, sector 6619819200
      [Thu Mar 14 10:49:08 2019] blk_update_request: I/O error, dev sdn, sector 10767812936
      [Thu Mar 14 10:53:41 2019] blk_update_request: I/O error, dev sdo, sector 9716759432
      [Thu Mar 14 10:53:50 2019] blk_update_request: I/O error, dev sdc, sector 7983572992


      But smartctl gave no error



      [root@mtg8-dt-18 ~]# smartctl -C -a /dev/sdg
      smartctl 6.2 2017-02-27 r4394 [x86_64-linux-3.10.0-693.el7.x86_64] (local build)
      Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org

      === START OF INFORMATION SECTION ===
      Vendor: HP
      Product: MB6000JVYZD
      Revision: HPD1
      User Capacity: 6,001,175,126,016 bytes [6.00 TB]
      Logical block size: 512 bytes
      Physical block size: 4096 bytes
      Lowest aligned LBA: 0
      Rotation Rate: 7200 rpm
      Form Factor: 3.5 inches
      Logical Unit id: 0x5000c50094558e07
      Serial number: ZAD204PV0000C8015S23
      Device type: disk
      Transport protocol: SAS
      Local Time is: Thu Mar 14 11:00:24 2019 +07
      SMART support is: Available - device has SMART capability.
      SMART support is: Enabled
      Temperature Warning: Enabled

      === START OF READ SMART DATA SECTION ===
      SMART Health Status: OK

      Current Drive Temperature: 29 C
      Drive Trip Temperature: 60 C

      Manufactured in week 30 of year 2017
      Specified cycle count over device lifetime: 10000
      Accumulated start-stop cycles: 78
      Specified load-unload count over device lifetime: 300000
      Accumulated load-unload cycles: 632
      Elements in grown defect list: 0

      Vendor (Seagate) cache information
      Blocks sent to initiator = 1467516240
      Blocks received from initiator = 168658064
      Blocks read from cache and sent to initiator = 3698801821
      Number of read and write commands whose size <= segment size = 62258636
      Number of read and write commands whose size > segment size = 2134931

      Vendor (Seagate/Hitachi) factory information
      number of hours powered up = 12178.78
      number of minutes until next internal SMART test = 7

      Error counter log:
      Errors Corrected by Total Correction Gigabytes Total
      ECC rereads/ errors algorithm processed uncorrected
      fast | delayed rewrites corrected invocations [10^9 bytes] errors
      read: 0 0 0 0 0 77717.182 0
      write: 0 0 0 0 0 63896.737 0

      Non-medium error count: 954

      No self-tests have been logged


      any advices would be great! I really appreciate.







      linux centos dmesg smartctl





      share












      share










      share



      share










      asked 3 mins ago









      Banthita LimwilaiBanthita Limwilai

      12




      12






















          0






          active

          oldest

          votes











          Your Answer








          StackExchange.ready(function() {
          var channelOptions = {
          tags: "".split(" "),
          id: "106"
          };
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function() {
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled) {
          StackExchange.using("snippets", function() {
          createEditor();
          });
          }
          else {
          createEditor();
          }
          });

          function createEditor() {
          StackExchange.prepareEditor({
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: false,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: null,
          bindNavPrevention: true,
          postfix: "",
          imageUploader: {
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          },
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          });


          }
          });














          draft saved

          draft discarded


















          StackExchange.ready(
          function () {
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f506208%2fdmesg-gave-errors-blk-update-request-i-o-error-dev-xxx-sector-xxxxxxxxxx%23new-answer', 'question_page');
          }
          );

          Post as a guest















          Required, but never shown

























          0






          active

          oldest

          votes








          0






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes
















          draft saved

          draft discarded




















































          Thanks for contributing an answer to Unix & Linux Stack Exchange!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid



          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.


          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function () {
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2funix.stackexchange.com%2fquestions%2f506208%2fdmesg-gave-errors-blk-update-request-i-o-error-dev-xxx-sector-xxxxxxxxxx%23new-answer', 'question_page');
          }
          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          サソリ

          広島県道265号伴広島線

          Accessing regular linux commands in Huawei's Dopra Linux