Plotting and Mining on Amazon Cloud Drive
-
@RichBC Thanks for the help. Have you started to mine yet or are you still plotting?
-
@gersey I will be plotting until the end of next week. Then the hire of the VPS comes to an end and I am going to start mining experiments in earnest, without the risk that Uploading and downloading at the same time causes. Currently at about 30TB
Still big risks on can you read fast enough, will the read error problems stop the miner, will Amazon shut it down etc. :-)
Rich
-
@RichBC
Whats your connection speed like Rich? Upload/Download speeds?
Will you be mining from your home PC or using an Amazon AWS instance or other?
-
@machasm Home (2) is 80Mb/s Down 20Mb/s up. Not fast enough I know, but that is where I will do my first tests. Next test will be from an EC2 Free instance which about 3 x that speed, still not fast enough but there are actually other problems, as listed, to get out of the way before speed is the only issue. After that I am unsure I am uncertain if there is a cost effective solution to 1000Mb/s
Rich
-
I've been following this thread for about a week and started doing some tests myself with the free Amazon AWS (t2.micro).
This thing, however insanely fast on the upload side of things does not have enough time-credits to plot the files in a sustained manner. There has to be some inactivity to bank up CPU time...which is not what we're looking for to upload the plots obviously. Might work just fine to mine afterwards though. In case that goes south, a good candidate for the mining phase might be (depending on the necessary bandwidth) a small Linode.com VPS.So I got a VPS at NeuPrime.com ... the 4€/month promo for: 1 core 2.3Ghz, 1Gb of Ram, 30GB SSD which is about the same as the AWS.
One problem I have, is with NetDrive, more specifically the cache it is uing:
After a file is uploaded it stays in the cache for a very long time (as described here) which off course ends up saturating the disk at some point depending on the size of the plots that are being uploaded.
I suppose you got around this in one way or another ?
-
@Kahana82
I am not using Netdrive to upload. I am using rclone.
Netdrive is only being used when mining. As you have stated the t2.micro instance isn't much good for uploading but is sufficient for mining.
I haven't observed any problems with Netdrive when mining due to cache?
-
@Kahana82 I have set the Cache size in options down to 1GB, but like machasm only use it for Mining / Download.
Rich
-
@RichBC I know this is a stupid question but in the Batch file for
set account= I am guess that is your burstcoin Numeric Account # ?
-
@gersey Yes correct you will of course need to replace it with your numeric ID :-)
Rich
-
Naa I'll just leave yours ;] thanks your the help! I'll send you some coins for a beer after I start mining.
-
My time on the VPS has come to an end. I have 30TB of Plots uploaded, so time to move to the Mining Phase.
Initially I am Mining from Home with the 80Mb/s download speed. Am just using the lates files I uploaded. There are 8 Folders each with 80 25GB files in, so a total of 16TB.
It needs 8 Minutes to read all the Plots, so rarely get's through them all. I may reduce the number of files being read as I would like there to be some breaks in accessing the files as I think continuous reading is possibly one action that sounds alarm Bells?
I will let it run with the 16TB for a couple of hours and see how it goes.
Rich
-
@RichBC
Thanks for keeping us updated Rich.
Unlocking the ACD has become quite regular for me I am afraid.
It is unlocked fairly easily using the online chat line to CS but it is a pain having to keep tabs on it all the time.
At least once a day it will lock out.
Although the CS team give me various reasons why it might be locking out, I suspect that it is due to the high activity with the constant downloading every time a new block is read.
I keep going nonetheless and will see how the returns are after a month or so.
I have also separated the files into 5TB groups at the moment and experimenting with the optimum size to download ratio.
-
@machasm Interesting, that you use the online chat, have been making a phone call but will try chat.
What are your stats. TB, Download speed, Read Time for the full plot etc? What do you get in the way of breaks in the Download?
Rich
-
@RichBC
Reading a 5.8TB plot at 9.53Mb/s takes 153 secs on a T2.micro instance. (don't really have a fast enough connection at home to mine remotely).
Sometimes, for no reason that I can make out, the downloads will slow significantly with occasional read errors.
I don't think that this is down to the T2 instance but probably down to the ACD download speed being throttled at some point (don't know why) as I have another T2 instance which exhibits the same problem at the same time.
Its pretty hard to figure out what is going on with so many variables!
Using the chat bypasses all the verification process as you initiate the chat once you are logged in.
-
@machasm With that TB & Download speed you must get some reasonable breaks in downloading, so disappointing that you are getting locked. Which Miner are you using? I am on Blago at the Moment and so far no read errors.
Here are my Break between Blocks for the last Blocks, there have been some slow ones.
0,0,0,0,0,2m,10s,0,3m,0,30s,0,0,0
The phone call is done on a call back, which is instant, so also no verification
Spoke too soon just had a couple of error ReadFile
Rich
Just had a 7min 21sec Deadline thought I was going to win the Block, but went to 5min 28 sec......
-
@RichBC
Yep using Blago here too.
The last three blocks were all within a minute of each other which means the plots didn't finish reading.
Most of the reads take between two to three minutes on 5-6 TB so as long as the block takes longer than that to solve then I get a portion of the share.
Only problem that I can see is if you get a short deadline (say around 30-40secs) but it is at the end of the plot read (about 120Secs from start) not sure what would happen here?
Would the DL be ignored or does it still count?
Meant to ask also which pool are you using?
-
@machasm In terms of getting a share all that matters is have you submitted a Deadline, where it is in the plots is irrelevant. If so you will get a share proportional to your Deadline v all the other Deadlines on the Pool. That then builds in your Historic Share and will become "real" when a Block is hit by the Pool.
Which Pool are you on? I am on pool.ccminer.net:8080 because that is where my main 80TB miner is at the moment, so I can keep an eye on them both. It is geared towards larger miners (deadlines < 24Hr) so I am only hitting occasional deadline, but this is testing so does not matter.
Rich
-
@RichBC
I have been having quite good payouts on pool.burstcoin.sk BUT they have had some server issues recently with it getting stuck on a block or worse, being unavailable altogether!
That said it is up and running now and I have three miners running there
BURST-H4NE-J5SQ-9FNZ-HMYTF
BURST-GGYR-VRZY-6BMT-ET5HQ
and
BURST-FBRW-6NKH-W3L6-5UXA5
Also forged a couple of blocks there!!
-
@machasm Have had a couple of Hours from Home and got a measure on how things are going, so have switched to the Free EC2 Instance for a comparison.
So it runs fine but immediately ran into the string of error Readfile. It is endless and you have to stop and restart the miner

RichOdd thing is that if I restart on the same Block I get the error again at the same 80% point in the file?
Rich
-
@RichBC
Yes I have had a couple of those. It is related to network performance I think.
You may find that this problem will dissappear and then reappear.
I can see that this is happening after restarting the miner as there is no way you are getting 57.32Mb/s from tha instance!!
What speed are you getting btw on the t2?
