Skip to content
HomeVideos
AllLongsCategoriesPlaylists
BooksBlogsPodcasts
HistoryListsWatch laterLiked videosFollowing

The videos, books, blogs and podcasts Hacker News keeps recommending, all in one place.

VideosBooksBlogsPodcastsAboutPrivacySettings

Data from Hacker News, HackerTube, HackerBooks, HackerBlogs and Open Library. Credits · Not affiliated with Y Combinator.

HomeVideosBooksBlogsPodcasts
Ctrl K

    June 2021 FreeBSD Developer Summit: Raid-Z Expansion

    FreeBSD

    2 HN recommenders · recommended in 3 months, 2021–2023

    YouTube

    35:31 · 3.9K views · Jun 28, 2021

    Matt Ahrens presents the FreeBSD Foundation sponsored RAID-Z Expansion project for ZFS at the June 2021 FreeBSD Developer Summit. It explains how a RAID-Z vdev can be grown by adding disks on the fly.

    HN points to it as the video explanation of how RAID-Z expansion works without block pointer rewrite.

    Systems, Networks & SecurityDatabases & storageLinux & open-source ecosystemsOperating systems & kernels
    1. 1:25:25
      OpenZFS Office Hours with Matt AhrensOpenZFS13 years ago
    2. 46:00
      Scaling ZFS for NVMe - Allan Jude - EuroBSDcon 2022EuroBSDCon14K views • 4 years ago
    3. 49:16
      XFS: Recent and Future Adventures in Filesystem Scalability - Dave ChinnerLinux.conf.au 2012 -- Ballarat, Australia29K views • 14 years ago
    4. 49:43
      ZFS Native Encryption by Tom CaputiOpenZFS14K views • 10 years ago
    5. 52:54
      Rust at speed — building a fast concurrent databaseJon Gjengset225K views • 7 years ago
    6. 44:05
      FreeBSD optimizations used by Netflix serving at 800Gb/s - Drew Gallatin - EuroBSDcon 2022EuroBSDCon28K views • 4 years ago
    7. 47:43
      "Turning the database inside out with Apache Samza" by Martin KleppmannStrange Loop Conference206K views • 12 years ago
    8. 1:00:31
      BetrFS: A Right-Optimized Write-Optimized File SystemMicrosoft Research3.1K views • 10 years ago
    9. 15:39
      introducing copyparty, the FOSS file servertripflag614K views • 1 year ago
    10. 1:31:05
      Bryan Cantrill from Joyent on Manta: internet-facing object storage facility that features computeAI Council25K views • 12 years ago
    11. 40:20
      Why We Run FreeBSD current at Netflix – Drew GallatinOpenFest Bulgaria21K views • 2 years ago
    12. 47:18
      The Tragedy of systemdlinux.conf.au1.3M views • 7 years ago
    13. 1:08:17
      How We've Scaled DropboxStanford372K views • 14 years ago
    14. 1:04:04
      LISA11 - Fork Yeah! The Rise and Development of illumosUSENIX310K views • 14 years ago
    15. 1:01:27
      ZFS: The Last Word in File Systems Part 1Deirdré Straughan19K views • 14 years ago
    16. 51:27
      Google I/O 2012 - Go Concurrency PatternsGoogle for Developers894K views • 14 years ago
    17. 41:12
      Run containers on bare metal already!Bryan Cantrill40K views • 10 years ago
    18. 56:53
      A Brief History of the BSD Fast Filesystem by Marshall Kirk McKusickEuroBSDCon879 views • 6 years ago
    19. 1:45:47
      Bryan Cantrill on Jails and Solaris ZonesPapersWeLove34K views • 10 years ago
    20. 35:16
      Filesystem in Rust - Kent OverstreetThe Linux Foundation124K views • 2 years ago

    3 comments from Hacker News

    1. @allanjudeAug 2023· in “OpenZFS – Incremental add of disks to existing RAIDZ”

      That is not how this will work. The reason the parity ratio stays the same, is that all of the references to the data are by DVA (Data Virtual Address, effectively the LBA within the RAID-Z vdev). So the data will occupy the same amount of space and parity as it did before. All stripes in RAID-Z are dynamic, so if your stripe is 5 wide and your array is 6 wide, the 2nd stripe will start on the last disk and wrap around. So if your 5x10 TB disks are 90% full, after the expansion they will contain the same 5.4 TB of data and 3.6 TB of parity, and the pool will now be 10 TB bigger. New writes, will be 4+2 instead, but the old data won't change (they is how this feature is able to work without needing block-pointer rewrite). See this presentation: this video

      RecommendsView on HN
    2. @mrigheleFeb 2022· in “Raid-Z Expansion Feature for ZFS Goes Live”

      For those that like videos more than text, there is a youtube video from last year [1] that explain the feature (unless it's changed since ,but it seems not to be the case). One downside that I see of this approach, if I understand it correctly, is that the data already present on disk will not take advantage of the extra disk per slice. For example, if I have a raidz of 4 disks (so 25% of space "wasted"), and add another disk, new data will be distributed on 5 disks (so 20% of space "wasted") but the old data will keep using stripes of 4 blocks, they will just be reshuffled between the disks. Do I understand it correctly ? [1] this video

      RecommendsView on HN
    3. @vermadenNov 2021· in “Ask HN: What are the best-designed things you've ever used?”

      > AFAIK ZFS pools can't easily be resized > you generally have to recreate them Not anymore. There is RAIDZ Expansion available. Happens on the fly. - this video - [LINK]

      CitesView on HN