1. 26 Jan, 2024 1 commit
  2. 23 Jan, 2024 2 commits
  3. 19 Jan, 2024 1 commit
  4. 17 Jan, 2024 4 commits
  5. 16 Jan, 2024 8 commits
  6. 12 Jan, 2024 10 commits
  7. 09 Jan, 2024 7 commits
  8. 27 Dec, 2023 1 commit
  9. 26 Dec, 2023 1 commit
  10. 21 Dec, 2023 4 commits
  11. 20 Dec, 2023 1 commit
    • Rob N's avatar
      spa: make read/write queues configurable · 6930ecbb
      Rob N authored
      
      We are finding that as customers get larger and faster machines
      (hundreds of cores, large NVMe-backed pools) they keep hitting
      relatively low performance ceilings. Our profiling work almost always
      finds that they're running into bottlenecks on the SPA IO taskqs.
      Unfortunately there's often little we can advise at that point, because
      there's very few ways to change behaviour without patching.
      
      This commit adds two load-time parameters `zio_taskq_read` and
      `zio_taskq_write` that can configure the READ and WRITE IO taskqs
      directly.
      
      This achieves two goals: it gives operators (and those that support
      them) a way to tune things without requiring a custom build of OpenZFS,
      which is often not possible, and it lets us easily try different config
      variations in a variety of environments to inform the development of
      better defaults for these kind of systems.
      
      Because tuning the IO taskqs really requires a fairly deep understanding
      of how IO in ZFS works, and generally isn't needed without a pretty
      serious workload and an ability to identify bottlenecks, only minimal
      documentation is provided. Its expected that anyone using this is going
      to have the source code there as well.
      
      Sponsored-by: Klara, Inc.
      Sponsored-by: Wasabi Technology, Inc.
      Reviewed-by: default avatarBrian Behlendorf <behlendorf1@llnl.gov>
      Signed-off-by: default avatarRob Norris <rob.norris@klarasystems.com>
      Closes #15675 
      6930ecbb