80TB Plotting and Optimise more efficient way?
-
some numbers UPDATED 29/06/2017
- External Hdd 3.0 /7200 RPM/8Tb
CPU Plot XPlotter 1.0
-
i7 with 8 threads and 16 of RAM - ~10K nonces/min (tested for 6 hours)
Hdd Write average of 10MB/s
one week to finish -
Xeon server with 8 threads and 16 RAM - ~10K nonces/min (usb 2.0) (tested for 6 hours)
GPU Plot gpuPlotGenerator 4.0.3 (4.1.1 do not work, [ERROR] Unable to extend output file: 112)
- Nvidia 1070 X /8G - ~20K nonces/min (~96 hours to finish)
Hdd Write average of 80MB/s with peaks of 100 and low of 60
4 days to finish full tested
FAIL!!!! Corrupt Plot
Conclusion, although the GPU plot is 2x faster did not guarantee plot integrity.
I do not know if I can get better numbers, only 1 week of tests. However based on what I read these numbers are expected to keep the system stable.
Important
Certainly depending on the size of your plot the plotting capacity will decrease over time. With that started at 20k once/min will probably reach half of this speed 50% when reach 50% of Hdd. On an 8TB HddOn GPU plot devices.txt
0 0 1024 128 8192
I will translate in a simpler way, for us more limited people lol
plataforme id 0/ divice id 0/ 1024 amount of GPU memory / 128 Must be less or equal GPU memory/8192 less if your sys craches or freezes.About 128 and not 8192
For some reason I still do not know the GPU memory, in my understanding should be something close to the limit of the graphics card, in fact is far from it. If I increase it the system freezes.
-
Thanks for taking the time to explain your findings so far. As another beginner I found it really helpful.
Happy Mining.
-
@Squares Know which is the biggest problem who develops the tools does not do the proper documentation and testing, I think to keep costs low. But this creates a huge confusion, 95% of the users are lay,amateurs,enthusiasts,kids. Learning through trial and error demands enormous effort and time. When I started few days ago I did not know that were 2 totally different processes GPU/CPU
-
@Rodrigogmail
I'm a little lost on how to make the connection of all HD
-
@Rodrigogmail said in 80TB Plotting and Optimise more efficient way?:
@Squares Know which is the biggest problem who develops the tools does not do the proper documentation and testing, I think to keep costs low. But this creates a huge confusion,
You know, there are so many different configurations out there.
And if you want to plot as fast as you can with your setup, you will have to put some effort into finding out the best parameter set for your setup. Quite simple.The technical background, and I do not mean Burst here, is complicated when you are not a technical person. We're talking about matching
- your GPU's spec (global memory, private memory, number of compute units, number of actually usable compute units, when using this GPU for OS display radically reduce work load, ..)
- your disk configuration (PMR/SMR have very different needs here, how fast can the disk(s) ingest data, what type of filesystem, caching issues)
- your willingness to dedicate a machine to plotting vs. "I still need to work on that box!", RAM available, cores/threads/cycles available, ..
This is way beyond the average users background.
There is the All-In-One Wallet, and it works very well (on Windows). If you want to speed things up beyond that, you need to invest time and effort and learn something along the way.Take this with a grain of salt from someone that started plotting his first 10 Terabytes with the original, java-based plotter. This was 10x slower and needed humongous amounts of RAM - we've come a long way since then.
tldr; stop whining, start to learn about your system.
-
@Rodrigogmail If you think the process today is difficult, you should have been here 3 years ago when I started. The state of Burst mining is so much easier today, Can it be better, yes - but compared to what we started on, today it's relatively easy.
-
In fact I understand the position of you guys, I'm an IT Manager for 25 years and I'm not a developer, but I have the notion of complexity to manage people to deal with. Reminding developers that user does not calculate or should know how much memory he has in kilobyte has on the computer is something repetitive.
Who does it is the software, the information is already there. Make an application that the user needs to deal with dozens of parameters and variables, where the software itself can recognise and manage it, something is wrong with the project, come back and do it right. User only consumes.GPU plot almost hit, unfortunately the parameters do not work.
Very good start my dog can do ... 0 0 3 9 Q ready!
Then the disaster of having to play with guessing numbers and see what works ... implement a micro benchmark and you're done!We live in capitalist countries, it is normal to charge for your work, no problem in that. Good example is the Awesome Miner, it is far from being a great app, but with the money he earns he is improving very fast.
Check this out, basic its what happening, quite normal http://www.techrepublic.com/blog/10-things/10-signs-that-you-arent-cut-out-to-be-a-developer/
Lets see if this plot work 8Tb by 20K nonces/min in 30 hours...
TIP
On Device Manger/disk drives/ disk properties/policies/removal policy
change to Better performance
-
@Rodrigogmail The tools are improving: xplotter will automatically calculate how much drive to plot, will use sensible thread/mem settings that you can override. It's not long since being able to plot/mine required intimate knowledge of the coin; tools like xplotter and the AIO have made it much better, and improvements will continue
-
@haitch I read about it thinking that even today I should do it, imagine how much time I lost. Again, lots of conflicting information for lack of documentation. If you improve the tool and not publish it correctly generates what we see in the forums. Tons of misunderstood. Communication between the developer and user is as important as the tool itself in my opinion.
-
@Rodrigogmail The conflicting information you find on the forums is, I think, most likely due to technically ignorant rookie users.
There is the AIO, it works.And then the exact thing you just did;
"TIP
On Device Manger/disk drives/ disk properties/policies/removal policy
change to Better performance"Without giving technical background on what this does exactly AND why this benefits (which) scenario, you have a pile of tips that is, in the end, useless and counter-productive.
-
@Rodrigogmail said in 80TB Plotting and Optimise more efficient way?:
...Reminding developers that user does not calculate or should know how much memory he has in kilobyte has on the computer is something repetitive.
Who does it is the software, the information is already there. Make an application that the user needs to deal with dozens of parameters and variables, where the software itself can recognise and manage it, something is wrong with the project, come back and do it right. User only consumes.
...
GPU plot almost hit, unfortunately the parameters do not work.
Very good start my dog can do ... 0 0 3 9 Q ready!
Then the disaster of having to play with guessing numbers and see what works ... implement a micro benchmark and you're done!
...
Lets see if this plot work 8Tb by 20K nonces/min in 30 hours...The software does not know about the specific goal this user has.
Can the plotter take ALL cores and ALL of available memory ? And even if you build two buttons (be nice or rock it hard) then there is this gem:
https://forums.burst-team.us/topic/6672/tried-this-for-a-few-days-calling-it-quits/25
Complaints that plotting takes too long. It is the core concept of this coin that the hard work is in plotting and not mining the plots. When users are not willing to read about the basic concept then nobody can help them.
Posted it before somehwere else, still applies:
The AIO works, use it.
If you want to streamline your setup you will have to invest some effort and learn about your setup and how it can be improved. No Software can do that for you, as there are way too many different goal sets and technical considerations.tldr;
You want to be with the hip tech-savvy guys and plot with GPU ?
Then don't complain you don't know shit about your system.(a little rough, maybe)
-
UPDATED 29/06/2017
- External Hdd 3.0 /7200 RPM/8Tb
CPU Plot XPlotter 1.0
-
i7 with 8 threads and 16 of RAM - ~10K nonces/min
tested for 6 hours
Hdd Write average of 10MB/s
one week to finish
Plot not tested yet -
Xeon server with 8 threads and 16 RAM - ~10K nonces/min
usb 2.0
Windows server 2016
os do not show write speed
tested for 6 hours
Plot not tested yet
GPU Plot gpuPlotGenerator 4.0.3 (4.1.1 do not work, [ERROR] Unable to extend output file: 112)
- Nvidia 1070 X /8G - ~20K nonces/min (~96 hours to finish)
Hdd Write average of 80MB/s with peaks of 100 and low of 60
4 days to finish full tested
FAIL!!!! Corrupt Plot
Conclusion, although the GPU plot is 2x faster did not guarantee plot integrity.
