[ANN] Mining on Amazon Cloud
-
@CoinBuster Glad I have understood, would be great to see a description of how you have set up the EC2 side of things, as I think this is a very neat solution.
Rich
-
@RichBC I will free some time to do the tutorial soon. In the meantime you can open a free instance on EC2 either with Windows or Ubuntu. If you need assistance let me know.
-
@CoinBuster I have got as far as opening an Instance to Windows Server 2008 R2 and opening a Remote Desktop Connection. ran out of play time at that point.....
Rich
-
@RichBC That's a good start. Beware that the free instances have "Burstable performance" (no pun intended, this is how they actually named). This mean that on a t2.micro you are getting 6 cpu points an hour. When your cpu consumption reaches over 20%, they are taking away points. I was mining on this account before so I see no problem, but at higher TB it could drain the points quickly.
If you notice that the mining speed go substantially down or the instance work very slow, check the monitoring tab for the amount of cpu credit left.
-
@CoinBuster Thanks for the heads up, although I will be chuffed to bits if i get something running. Am way outside my experience & comfort zone, so need to do a lot of reading, playing and learning at the moment....
Rich
I have loads of questions which can wait till after the Tutorial, but.... which of the various services have you used to map the Amazon Cloud drive as if it was a network drive?
OK found the answer in the Chat NetDrive2
-
finally got an answer from Amazon about them locking my account!
What it's basicly saying (in german) is that my "Download activity is widely differing from normal usage" !
does this make sense in english?!Unfortunately I have no Idea what "normal" is!-/
-
@nixxda I also had my account locked. made a phone call and the Agent asked no questions and just said he had unlocked it. I chose at this point not to ask why it had been locked. I only have 2TB of plots.
Rich
-
@RichBC for me it was the second time! that's why they wanted to check back with an technician.
-
@nixxda OK understood. I am having a problem with my uploads using Netdrive2 in that the upload goes fine until it shows 5 Seconds to go, monitoring the Internet the transfer stops / is complete. Then if left some minutes later a second popup appears saying "An unexpected error is keeping you from copying the file" etc. Try again does nothing so I press cancel and the file disapears at the other end.
Now the strange bit, usually but not always some time later (15 Mins I can't remember) the file is then there.
Wonder if you have seen the same thing or what technique you are using for the uploads?
Rich
-
@RichBC your Disk is probably full!!?
I had no luck uploading with Netdrive2 2!-) It just fills up the Netdrive/cache with no respect to size limit! But for reading big and fast cache is good.I use "GoodSync" for uploading. It will still through some timeout error (504 or 405) at the end of each upload but the files will be there after a while!
sometimes I can upload 20 48GB files until it starts reuploading the files it just finished, sometimes less. Then you'll have to restart the program and wait a bit.
It seams to be an common problem with ACD and file sizes close to max upload size.But GoodSync has been very good to me!-)
I get 40-90Mb/s with two simultaneous uploads.....
-
@nixxda Yes I also had the cache problem, it was causing my miner to stop, took a while to work out what was consuming all the disk space :-) Turned the cache down to 1GB but...
So that is a problem but not the problem.I will try GoodSync and see how I get on with that. I guess the delay must mean that Amazon caches things at there end?
Rich
-
@RichBC I think they did a fix in the newest Netdrive version. but I did not bother any more..... just used GoodSync
Uploading big files is a problem with every program. You can read it in quite a few forums.
But at least with those "verified" Programs you dont get the "in development" speed restriction. unlike "adc-cli", "dokany" and what have you.....btw. best readspeed for mining I get when packing around 10 files into a separate folder each. I guess Blago miner and also jminer are splitting up processes.
good luck!-) (to me to)
-
@nixxda said in [ANN] Mining on Amazon Cloud:
btw. best readspeed for mining I get when packing around 10 files into a separate folder each. I guess Blago miner and also jminer are splitting up processes.
Yes I have something similar, but most of my time has been spent sorting or not the upload process. I am using blago as no GPU on the server I am using. My 2TB run through at 30Mb/s at the moment.
Just downloaded GS so trying geting to grips with that now.
Rich
-
@RichBC GS is really nice! So nice that I'm actually think about paying for it!-)
you only get one sync profile after the 1 Month eval period. So its not really necessary.
Netdrive2 you have to buy! Speed restriction after eval!
-
@nixxda OK GS seems to be working, only thing is it seems a bit slow, only getting 0.8Mb/s as opposed to about 1.9Mb/s?
Rich
-
@RichBC said in [ANN] Mining on Amazon Cloud:
@nixxda OK GS seems to be working, only thing is it seems a bit slow, only getting 0.8Mb/s as opposed to about 1.9Mb/s?
Rich
try uploading 2 files at once. only way I can nearly max out my connection.
and maybe wait a bit. evenings seem to be bad! everybody backing up their server and stuff.
-
@nixxda How do you do 2? I just selected a folder and it started on the first file?
-
@RichBC said in [ANN] Mining on Amazon Cloud:
@nixxda How do you do 2? I just selected a folder and it started on the first file?
-
@RichBC you don't upload via net drive right after plotting from pc you use the Amazon drive to upload it 49 Gb plots max
Net drives use here is mounting the drive locally to mine after its all done the is my understanding so far I've successfully uploaded two plots in my burst folder on the acd
-
@dagentlemang I don't think there is a right or wrong way of doing the upload, it's just a matter of finding what works best for you. I am using netdrive2 to map the drive for mining but have also had succesfull uploads by just doing a file copy to the Amazon Drive folder just the same as if it was on the local machine.
I am now trying GoodSync which was running quite slowly last night, however at the moment, 6:30 in the UK it is maxing my upload connection, which is only 20Mb/s, so it's a slow process.
I have also plotted and uploaded from Amazon EC2 which then gives me a much faster upload, 400Mb/s but it is proving too costly to use with the cost of paying for the Instance and then with a Data transfer fee on top of that.
I am however using the Free t2 micro instance for mining, it is however unsuitable for plotting or uploading as you do not have the memory or disk space needed.
The approach I have had no succes with is using either the "Official" Amazon Deskop or App for the upload!
I think this will be successful, so long as Amazon does not stop this mode of use. My account has now for the second time been locked, but was again unlocked without question. There is obviously something in the Amazon automated system that does not like the usage pattern. I assume this is the mining aspect not the uploads?
Rich


