Plotting and Mining on Amazon Cloud Drive
-
@RichBC Ok, found the size parameter in the .ini file too...I'll try that out.
@machasm Thx I will try rclone to do the uploading instead of NetDrive2 or the native ACD desktop app...Scripts got quite complicated with those because of the waiting for the cache to get purged.
Have you taken a look at the small Linode.com VPS offerings to do the mining (I'm not there yet) ?
They state 40Gbps Network In for 5 bucks a month ...
-
Everything was fine as reported for about 10 Hours yesterday then started getting these errors and the Download speed dropped right down.
Both readFile, and error opening. Tried restarting the miner and closing and reopening rdrive but no improvement. Checked the internet speed and my end and it was fine.
Eventually gave in and stopped Mining, restarted first thing this Morning and everything fine again for the last 5 Hours. So do not know if it's a time of day thing or if Amazon start throttling after some constant downloading?
Rich
-
@RichBC
I have found that there seems to be a point in time (normally evening here in the UK) when things slow down from ACD.
I have verified this problem running on two AWS instances an TWO ACD drives and it seams to happen on both at around the same time so maybe a global problem with ACD?
Also noted that on occasion the T2.mcro instance can grind to a very low speed but as soon as I change to another instance on the same cloud drive the speed picks back up. Could this be down to CPU cycles being throttled on the AWS instance perhaps?
-
@machasm OK could be the same problem, am in the UK as well. That log above is just before 7 Oclock, and it was still bad at 9 oclock.
Rich
-
@machasm Just coming up to 18:00 and speed is dropping. Not a hard cap type speed drop, but very variable. I suspect we will go down hill from here.
Rich
-
@RichBC yep seeing a slow down here too. Was running at around 8Mb/s now dropping to between 5-6.
-
@machasm OK looks like it's the Amazon end that slows things, here's a graph showing the change from a Bandwidth at my end limited download to a very ragged variable one.
Looks to me more like increased traffic at Amazon restricting available Bandwidth rather than a Cap?
It's now gone from bad to worse, so will shut down for the night.
Rich
-
UGH! well thats not good new :[ so do you its worth the time ? or is it unusable?
-
@gersey There are a lot of problems. Some have been found and resolved, some we have no solution to at the moment and some we have yet to find. However my feeling is that there is still a future for Cloud Mining, but we are not there yet.
The good news is that apart from time, the costs involved are quite low, and it's a fun challenge to be working on.
Rich
-
I agree! So ill just keep my upload rolling for now hope to join in the cloud mining funny shortly!
-
I was going to ask if anyone looked into google drive but scene its 99 bucks a month for 10TB not really a option
-
Amazon cloud drive account locked out again!
I am beginning to think that this might not be worth the hassle after all.
Its definately automated as I have two ACD accounts and they were both locked at the same time at around 19:00 British time
-
@machasm Interesting, so I might have got logged out just in time :-)
Spoke too soon, just checked my account and I am locked out as well, despite having no activity for the last Hour......
Rich
-
@RichBC ChatEnd ChatSound
Me: Hi I have just got a message that my Amazon Drive has been locked. Can you help?
Thanks
You're now connected to Karthik from Amazon.co.uk
Karthik: Hello, my name is Karthik. I'll be happy to help you.
Am I chatting with Rich?
Me: Yes
Karthik: Hey Rich, I'll surely help you in this regard.
Me: Thank You
Karthik: I'll right away unlock this for you Rich.
I've successfully unlocked the drive on your account.
You should be able to use it now.
I hope I was able to help you in this regard.
Me: OK thank you. It has been locked before, do you know why?
Karthik: Accounts may be closed when we've noticed unusual activity, including users accessing Amazon Drive from many devices and above normal frequency levels.
this is when the drive gets locked.
Me: Yes that's great it's fine now. Yes I did use it a lot Today but only from a single device. Thank You
Karthik: You're most welcome Rich.:-)
Looks to me that they log usage / IP's etc but only Lock people out after data has been gathered over a 24Hr - 48Hr and as @machasm says it smacks to me of being an automated process, rather than someone examining the logs?
-
How have the speeds been tonight? Still all over the place?
-
@gersey I stopped Mining 19 Hrs ago and then with the lock out left it that way until Morning in the UK.
Have just restarted, with just 8TB being scanned as I want to see how big the breaks need to be to not get shut down. Could be that mining with any small amount of TB is no good because of the regular reads 24/7 ?
What is interesting is that I uploaded Plots for virtually 2 Months without a problem. I guess that might have been ok because on the VPS the time that it took to plot and optimise made for made for a typical sequence of 2 Hours plotting and Optimising then 40 Minutes uploading, albeit 24/7
Anyway we are running again with now only 8TB maxing out my Bandwidth on the Download.Read time is 4 Minutes, so will still be a high proportion of the time reading.
There are breaks now, but it's all down to the Block times. Let's see how this goes?
Rich
-
Thanks for the update @RichBC fingers crossed that today goes well for you.
-
@gersey
Unlocked my accounts straight away and started mining again immediately.
Speeds were back to normal (around 8Mbps on a T2 instance) and have been mining all night without a problem. I fully expect my accounts to get locked out again this evening.
-
@machasm it seems at least for now it is going to just be part of the mining process. once my uploads are done I am going to start mining with the intent of trying to figure out the amount of time that sets off the lock process and then see if random intermittent breaks help and if so how many and how long
-
@gersey
That may take quite a long time to figure out but I wish you the best of luck.
It will be interesting to see your findings.
I wrote an e-mail to the managing director e-mail address of amazon and it was passed to the "executive team" (who knows what is actually going on behind the scenes!) asking why my accoount was being continuously locked.
You will laugh at the reply I got quoted below.**Dear xxxxxx,
I hope you're doing fine. Thanks for your patience while I looked into this case. The engineers and the team in charge of Cloud Drive have determined that your account has been getting closed because it exceeds 200TB of data per day, even though there's less than 5TB of data in the account, the entire content of your account is being downloaded dozens of times per day.
Unfortunately, NetDrive is being shared with dozens or hundreds of users on the Internet, which doesn't comply with our terms of use, and puts excessive stress on our system. I just wanted to give you a quick update on the investigation process we've initiated to determine the reason why your account was closed many time. We're currently working on a final resolution, I'll get back to you as soon as I have more information.
Thank you for taking the time to write to us.**
What a load of BS. There is no way in hell that me or anyone else is downloading 200TB of data in a 24Hr period.
if the plots are a total of 5TB then I would be downloading about 1.2GB per block. How many blocks in a day? About 360 or so? so that would be at worse around 1/2 TB a day.



