Building a 1pb rig
-
@wimel32 said in Building a 1pb rig:
@haitch said in Building a 1pb rig:
xplotter
I would just rather buy none smr drives then. whats good and affordable?
Personally I would still get the smr drives because they are cheap. but I know the western digital mybooks are 8TB and also around the same price I like like 30$ more or so.
but depending on your hardware you can get around the drives slow write speeds but putting them in a zfs raid array.
you'll lose some space but gain speed and you can still use the cheap drives
-
@manfromafar I'm done with SMR drives. I plotted two WD red 8TBs in under a day, the SMR drives took over 2 weeks. Plotting to the reds then copying to the SMR might be faster, but Windows was still telling me 10 days to copy them over. And besides, I loathe Seagates.
-
@manfromafar I was just doing the math and its cheaper to just buy 5 more pcs and have 10 pcs plotting at once.
-
@haitch said in Building a 1pb rig:
@manfromafar I'm done with SMR drives. I plotted two WD red 8TBs in under a day, the SMR drives took over 2 weeks. Plotting to the reds then copying to the SMR might be faster, but Windows was still telling me 10 days to copy them over. And besides, I loathe Seagates.
¯_(ツ)_/¯ I'm fine with the 500MB/s write and 3GB/s reads from the system but to each their own. SMR isn't so bad if you know how to tame the best.
@wimel32 said in Building a 1pb rig:
@manfromafar I was just doing the math and its cheaper to just buy 5 more pcs and have 10 pcs plotting at once.
Nice I'm waitinf for another 24bay server to go on sale so I can scoop it up for 1k cad get me another 24 Seagate archvie 8TB drives if only cad wasnt so expensive for drives and pcs Q_Q
-
-
-
@wimel32 Around $240 for 8TB, but shop around.
-
@manfromafar whats a good hub? i bought 4 of the anker brand but not so sure.
-
@haitch is it wd 8tb my book hardrive? its $199 on newegg
-
@haitch http://imgur.com/a/p4EQb <- my current servers
freenas-boot 7.44G 663M 6.79G - - 8% 1.00x ONLINE - movies 101T 83.5T 17.5T - 20% 82% 1.00x ONLINE /mntfreenas-boot 7.44G 1.95G 5.48G 16.0E - 26% 1.00x ONLINE - tank 63.5T 31.5T 32.0T - 6% 49% 1.00x ONLINE /mnt vm 131G 107G 23.5G - 71% 82% 1.18x ONLINE /mnt#gettoracks
-
@wimel32 said in Building a 1pb rig:
@manfromafar whats a good hub? i bought 4 of the anker brand but not so sure.
Unfortunately that is not in my wheel house of knowledge but most reputable hubs are fine if your buying the cheapest thing off ebay prepare for crap but generally most are fine
-
@manfromafar I've built a ton of zfs servers, one of my primary miners is a 16 drive zfs chassis. It doesn't have any SMR drives though, so you're saying a zfs server removes the write penalty for random writes on SMR ?
-
@manfromafar very nice! i need that asap.
-
@haitch said in Building a 1pb rig:
@manfromafar I've built a ton of zfs servers, one of my primary miners is a 16 drive zfs chassis. It doesn't have any SMR drives though, so you're saying a zfs server removes the write penalty for random writes on SMR ?
@haitch yes it alleviates some of the write penalties since zfs can cache the writes in ram and write them out to the disks in sequential order and its stripping the data across multiple disks and in new locations so your not having the SMR drive trying to move data on the fly as much since as you would when sequentially writing all the data to the drive. I was able to plot about 8TB in a day over gige to a smr z2 array then copy to another standalone smr drive for actual mining
-
@manfromafar No issues with the COW performance when you got up to about 90% capacity? I've been told that getting over that threshold can be worse than native SMR performance.
-
This post is deleted!
-
@haitch Only if you want to actively use the storage for read and writes. but since your going to be mining burst you can plot away and only ever read from the pool. The reason ZFS gets balls slow over 80% and useless at 90% is ZFS wants to write in long contiguous blocks so trying to find these spots on teh disk gets harder and hard. and since the files get more and more fragmented over time when rewriting it slows down performance as your jumping all over the disk.
OH speaking of 80% I have to move and sorrt somethings on box 2 its over 80% good thing it just houses read material ^>^
-
@manfromafar my zfs miner was built in the early days of burst, so is either wplotgenerator or gpu generator buffer createx, so sequential files. Hadn't considered how the ram/write log cache might affect plotting performance.ight have to reconsider, and replot, Pennywise's design.
-
@haitch If you've already plotted I wouldnt worry about switching since ZFS only helps remove the write penalties. It does nothing for the read speeds except you can read from all disks at once. Since you'll blow through the arc in ram and never actually use that buffering.
-
#derailingthreads one post at a time. ^>^


