{"id":80184,"date":"2020-05-04T07:42:02","date_gmt":"2020-05-04T05:42:02","guid":{"rendered":"https:\/\/prohoster.info\/blog\/novosti-interneta\/vyyavlena-nesovmestimost-smr-diskov-wd-s-zfs-kotoraya-mozhet-privesti-k-potere-dannyh"},"modified":"2020-05-04T07:42:02","modified_gmt":"2020-05-04T05:42:02","slug":"vyyavlena-nesovmestimost-smr-diskov-wd-s-zfs-kotoraya-mozhet-privesti-k-potere-dannyh","status":"publish","type":"post","link":"https:\/\/prohoster.info\/en\/blog\/news\/vyyavlena-nesovmestimost-smr-diskov-wd-s-zfs-kotoraya-mozhet-privesti-k-potere-dannyh","title":{"rendered":"A compatibility issue has been identified between WD SMR drives and ZFS, which could lead to data loss.","gt_translate_keys":[{"key":"rendered","format":"text"}]},"content":{"rendered":"

The company iXsystems, which develops the FreeNAS project, warned<\/a><\/noindex> has reported serious compatibility issues with ZFS and some new WD Red hard drives produced by Western Digital using SMR (Shingled Magnetic Recording) technology. In the worst-case scenario, using ZFS on problematic drives can lead to data loss. <\/p>\n

Problems occur with WD Red drives ranging from 2 to 6 TB, released since 2018, which utilize recording technology DM-SMR<\/a><\/noindex> (Device-Managed Shingled Magnetic Recording) and are labeled<\/a><\/noindex> with the EFAX tag (for CMR drives, the identifier EFRX is used). Western Digital noted<\/a><\/noindex> in its blog that WD Red SMR drives are intended for use in NAS for home and small businesses, where no more than 8 drives are installed, and the workload is around 180 TB per year, typical for backup and file sharing. The previous generation of WD Red drives and models with capacities of 8 TB and above, as well as drives from the WD Red Pro, WD Gold, and WD Ultrastar lines, continue to be produced based on CMR (Conventional Magnetic Recording) technology and do not pose issues with ZFS.<\/p>\n

The essence of SMR technology involves using a magnetic head that is wider than the track width, resulting in partial overlap when writing to adjacent tracks, meaning any rewrite necessitates re-recording the entire group of tracks. To optimize operations with such drives, zoning<\/a><\/noindex> \u2014 storage space is divided into zones that make up groups of blocks or sectors, where only sequential data additions are permitted, requiring full updates of the entire group of blocks. In general, SMR disks are more efficient in terms of energy consumption, are more affordable, and show a performance gain during sequential data writes, but lag behind when performing random write operations, including tasks such as rebuilding storage arrays. <\/p>\n

DM-SMR implies that zoning and data distribution operations are managed by the disk controller, and to the system, such a disk appears as a classic hard drive that does not require separate manipulation. DM-SMR employs indirect logical block addressing (LBA), similar to logical addressing in SSDs. After each random write operation, a background garbage collection operation needs to be performed, leading to unpredictable performance fluctuations. The system may attempt to apply optimizations to such disks, believing that data will be written to a specified sector, but the information provided by the controller determines only the logical structure, and in practice, the controller will use its algorithms during data distribution, taking into account previously placed data. Therefore, it is recommended to perform a reset operation to restore DM-SMR disks in a ZFS pool to their original state before use.<\/p>\n

The company Western Digital is involved in analyzing the conditions under which problems arise, working alongside iXsystems to find a solution and prepare a firmware update. Before publishing findings on problem resolution, the drives with the new firmware are planned to be tested in high-load storage environments with FreeNAS 11.3 and TrueNAS CORE 12.0. It is claimed that due to the different interpretations of SMR by various manufacturers, some types of SMR disks do not have issues with ZFS; however, iXsystems' testing focuses solely on verifying WD Red disks based on DM-SMR technology. other manufacturers<\/a><\/noindex> requires further investigation.<\/p>\n

Currently, issues with ZFS have been demonstrated and replicated in tests for at least WD Red 4TB WD40EFAX drives with firmware 82.00A82 and are manifested<\/a><\/noindex> entering a failure state under high write load, for example, during the process of rebuilding storage after adding a new drive to the array (resilvering). It is believed that the issue also manifests in other WD Red models with the same firmware. When the problem occurs, the disk starts returning the error code IDNF (Sector ID Not Found) and becomes unusable, which is handled in ZFS as a disk failure and may lead to data loss stored on the disk. In the case of multiple disk failures, data in the vdev or pool may be lost. It is noted that these failures occur quite rarely \u2014 out of approximately a thousand sold FreeNAS Mini systems that came with problematic disks, the issue arose in operational conditions only once.<\/p>\n

<\/a><\/noindex><\/p>\n

Source: opennet.ru<\/a><\/p>","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"excerpt":{"rendered":"

\u041a\u043e\u043c\u043f\u0430\u043d\u0438\u044f iXsystems, \u0440\u0430\u0437\u0440\u0430\u0431\u0430\u0442\u044b\u0432\u0430\u044e\u0449\u0430\u044f \u043f\u0440\u043e\u0435\u043a\u0442 FreeNAS, \u043f\u0440\u0435\u0434\u0443\u043f\u0440\u0435\u0434\u0438\u043b\u0430 \u043e \u0441\u0435\u0440\u044c\u0451\u0437\u043d\u044b\u0445 \u043f\u0440\u043e\u0431\u043b\u0435\u043c\u0430\u0445 \u0441 \u0441\u043e\u0432\u043c\u0435\u0441\u0442\u0438\u043c\u043e\u0441\u0442\u044c\u044e ZFS \u0441 \u043d\u0435\u043a\u043e\u0442\u043e\u0440\u044b\u043c\u0438 \u043d\u043e\u0432\u044b\u043c\u0438 \u0436\u0451\u0441\u0442\u043a\u0438\u043c\u0438 \u0434\u0438\u0441\u043a\u0430\u043c\u0438 WD Red, \u0432\u044b\u043f\u0443\u0441\u043a\u0430\u0435\u043c\u044b\u043c\u0438 \u043a\u043e\u043c\u043f\u0430\u043d\u0438\u0435\u0439 Western Digital \u0441 \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u043d\u0438\u0435\u043c \u0442\u0435\u0445\u043d\u043e\u043b\u043e\u0433\u0438\u0438 SMR (Shingled Magnetic Recording, \u0447\u0435\u0440\u0435\u043f\u0438\u0447\u043d\u0430\u044f \u043c\u0430\u0433\u043d\u0438\u0442\u043d\u0430\u044f \u0437\u0430\u043f\u0438\u0441\u044c). \u041f\u0440\u0438 \u043d\u0430\u0438\u0445\u0443\u0434\u0448\u0435\u043c \u0441\u0446\u0435\u043d\u0430\u0440\u0438\u0438 \u0438\u0441\u043f\u043e\u043b\u044c\u0437\u043e\u0432\u0430\u043d\u0438\u0435 ZFS \u043d\u0430 \u043f\u0440\u043e\u0431\u043b\u0435\u043c\u043d\u044b\u0445 \u043d\u0430\u043a\u043e\u043f\u0438\u0442\u0435\u043b\u044f\u0445 \u043c\u043e\u0436\u0435\u0442 \u043f\u0440\u0438\u0432\u0435\u0441\u0442\u0438 \u043a \u043f\u043e\u0442\u0435\u0440\u0435 \u0434\u0430\u043d\u043d\u044b\u0445. \u041f\u0440\u043e\u0431\u043b\u0435\u043c\u044b \u0432\u043e\u0437\u043d\u0438\u043a\u0430\u044e\u0442 \u0441 \u0434\u0438\u0441\u043a\u0430\u043c\u0438 WD Red \u0451\u043c\u043a\u043e\u0441\u0442\u044c\u044e \u043e\u0442 2 […]<\/p>\n","protected":false,"gt_translate_keys":[{"key":"rendered","format":"html"}]},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[702],"tags":[],"class_list":["post-80184","post","type-post","status-publish","format-standard","hentry","category-news"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\n","aioseo_head_json":{"title":"\ud83e\udd47Incompatibility of WD SMR disks with ZFS identified, which may lead to data loss | ProHoster","description":"The company iXsystems, developing the FreeNAS project, warned of serious issues with.","canonical_url":"https:\/\/prohoster.info\/en\/blog\/news\/vyyavlena-nesovmestimost-smr-diskov-wd-s-zfs-kotoraya-mozhet-privesti-k-potere-dannyh","robots":"max-image-preview:large","keywords":"","webmasterTools":{"miscellaneous":""},"schema":null,"og:locale":"en_US","og:site_name":"ProHoster | \u041a\u0443\u043f\u0438\u0442\u044c \u043d\u0430\u0434\u0435\u0436\u043d\u044b\u0439 \u0445\u043e\u0441\u0442\u0438\u043d\u0433 \u0434\u043b\u044f \u0441\u0430\u0439\u0442\u043e\u0432 \u0441 \u0437\u0430\u0449\u0438\u0442\u043e\u0439 \u043e\u0442 DDoS, VPS VDS \u0441\u0435\u0440\u0432\u0435\u0440\u044b","og:type":"article","og:title":"\ud83e\udd47\u0412\u044b\u044f\u0432\u043b\u0435\u043d\u0430 \u043d\u0435\u0441\u043e\u0432\u043c\u0435\u0441\u0442\u0438\u043c\u043e\u0441\u0442\u044c SMR-\u0434\u0438\u0441\u043a\u043e\u0432 WD \u0441 ZFS, \u043a\u043e\u0442\u043e\u0440\u0430\u044f \u043c\u043e\u0436\u0435\u0442 \u043f\u0440\u0438\u0432\u0435\u0441\u0442\u0438 \u043a \u043f\u043e\u0442\u0435\u0440\u0435 \u0434\u0430\u043d\u043d\u044b\u0445 | ProHoster","og:description":"\u041a\u043e\u043c\u043f\u0430\u043d\u0438\u044f iXsystems, \u0440\u0430\u0437\u0440\u0430\u0431\u0430\u0442\u044b\u0432\u0430\u044e\u0449\u0430\u044f \u043f\u0440\u043e\u0435\u043a\u0442 FreeNAS, \u043f\u0440\u0435\u0434\u0443\u043f\u0440\u0435\u0434\u0438\u043b\u0430 \u043e \u0441\u0435\u0440\u044c\u0451\u0437\u043d\u044b\u0445 \u043f\u0440\u043e\u0431\u043b\u0435\u043c\u0430\u0445 \u0441.","og:url":"https:\/\/prohoster.info\/en\/blog\/news\/vyyavlena-nesovmestimost-smr-diskov-wd-s-zfs-kotoraya-mozhet-privesti-k-potere-dannyh","og:image":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:secure_url":"https:\/\/prohoster.info\/wp-content\/uploads\/2021\/11\/logo-350.jpg","og:image:width":350,"og:image:height":350,"article:published_time":"2020-05-04T05:42:02+00:00","article:modified_time":"2020-05-04T05:42:02+00:00","article:publisher":"https:\/\/www.facebook.com\/prohoster","article:author":"https:\/\/www.facebook.com\/prohoster"},"aioseo_meta_data":{"post_id":"80184","title":null,"description":null,"keywords":null,"keyphrases":null,"primary_term":null,"canonical_url":null,"og_title":null,"og_description":null,"og_object_type":"default","og_image_type":"default","og_image_url":null,"og_image_width":null,"og_image_height":null,"og_image_custom_url":null,"og_image_custom_fields":null,"og_video":null,"og_custom_url":null,"og_article_section":null,"og_article_tags":null,"twitter_use_og":false,"twitter_card":"default","twitter_image_type":"default","twitter_image_url":null,"twitter_image_custom_url":null,"twitter_image_custom_fields":null,"twitter_title":null,"twitter_description":null,"schema":{"blockGraphs":[],"customGraphs":[],"default":{"data":{"Article":[],"Course":[],"Dataset":[],"FAQPage":[],"Movie":[],"Person":[],"Product":[],"ProductReview":[],"Car":[],"Recipe":[],"Service":[],"SoftwareApplication":[],"WebPage":[]},"graphName":"","isEnabled":true},"graphs":[]},"schema_type":null,"schema_type_options":null,"pillar_content":false,"robots_default":true,"robots_noindex":false,"robots_noarchive":false,"robots_nosnippet":false,"robots_nofollow":false,"robots_noimageindex":false,"robots_noodp":false,"robots_notranslate":false,"robots_max_snippet":null,"robots_max_videopreview":null,"robots_max_imagepreview":"large","priority":null,"frequency":null,"local_seo":null,"seo_analyzer_scan_date":null,"breadcrumb_settings":null,"limit_modified_date":false,"reviewed_by":null,"ai":null,"created":"2021-02-28 16:22:49","updated":"2022-10-09 18:25:18","focus_keyword":null,"additional_keywords":null,"truseo_locale":null},"gt_translate_keys":[{"key":"link","format":"url"}],"_links":{"self":[{"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/posts\/80184","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/comments?post=80184"}],"version-history":[{"count":0,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/posts\/80184\/revisions"}],"wp:attachment":[{"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/media?parent=80184"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/categories?post=80184"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prohoster.info\/en\/wp-json\/wp\/v2\/tags?post=80184"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}