Large Scale Burst Mining Operation
-
@nixxda Check to understand optimize: https://forums.burst-team.us/topic/288/plots-101/4
If you optimize after plotting, the target drive will just be written to, while the data get collected from source drive with a lot of drive seeks.
-
@luxe just writing the whole drive sequentially would be perfect. I'll read up on that.......
-
@nixxda Good to hear that! If it doesn't slow down with large files then yeah it may be the drive. The SMR drives are only meant for backups but all Plots should write sequentially. I just don't know how the SMR tracks work. The main thing would be to make sure the drive is completely empty and that you don't write 2 or more plots to one drive. Just fill it once! What happens is the data needs to get reorganized sequentially. There will be 20TB versions of these too since it uses the same head.
I also wonder if Sector Size may help too? 64K for large files not sure on this one.
I just saw other posts of people having a fast start and then the data goes to 30mbps in Linux too. It is most likely a re-org of data that the controller is confused about writing. Since it is Write Once it should not write and rewrite.
-
a few days (plots) later....
It all worked out!
@CryptoNick in short: http://searchstorage.techtarget.com/definition/shingled-magnetic-recording-SMR
formating with 64k cluster size seems to slow them down. I guess the controller does not like that. The 4096 Bytes Standard works fine.what worked best for me is:
1.Plotting in buffer mode to an SMR Disk
2.optimizing from one to another
or
1.Plotting in direct mode to an PMR Disk and- just moving the whole stuff to the SMR Disk
but I guess you already knew that, didn't you!-)
Read speed is not as good as an WD Red but very close!
-
@nixxda Excellent! Thanks for the confirmation. Yep that is what i thought. PlotOptimizer will also optimize as it copies so very good option even if you want to use Direct mode to a standard drive and then Optimize over to SMR.
-
What about the Samsung PM1633a 16TB SSD drives? Okay they're not yet out, but could be a game changer. Have 60 of those rigged up and you have 960 TB in one of those pods.
-
@Baron Sounds like a expensive piece of Hardware?! Maybe around $10,000?!?!
-
@luxe
I'm no expert, but maybe those with the resources should consider other industry solutions (such as broadcast). There's a limit to what can be done with even the most powerful "enthusiast" systems. Fortunately, HHDs use a lot less juice than GPUs.Like the "Storinator", mentioned by others.
http://www.45drives.com/products/cluster/Or, some simpler setups ~ Rack-mount-9U 50-Bay HHD Storage Center Chasis.
http://www.rackmountnet.com/images/products/rm91250/rm91250.pdf

-
@BeholdMiNuggets Well, that picture looks awesome ... but will there ever be a ROI ... big price difference from e.g. custom USB3 setup compared to 'professional' server hardware ... also the requirements of burst mining may be different to normal storage solutions ... all drives get accessed at same time on start next round. Wouldn't say that e.g. Storinator could not handle that, but is is maybe not optimized for that case. However everyone has to make own decisions ...
-
@luxe @BeholdMiNuggets I saw a 'cheap' four bay NAS storage solution the other day for $500. I don't understand why anyone would pay more for a glorified hard drive enclosure when you could just build a whole PC for the same price.

