in no way was this your fault.

Hell this shit happened at amazon before-

https://aws.amazon.com/message/680587/

Last I remember- guy is still there. Very similar situation.

This company didn't back up their databases? They suck at life.

Legal my ass- they failed to implement any best practice.

My way overpowered gaming computer / workstation hybrid. I started working full time shorty after and don't have time to play games anymore. Maybe 4 hours every two weeks.

At least it's crunching for BOINC in the winter months and heating my office, so yay.

Edit: Added link.

from the ToS:

>57.10 Acceptable Use; Safety-Critical Systems. Your use of the Lumberyard Materials must comply with the AWS Acceptable Use Policy. The Lumberyard Materials are not intended for use with life-critical or safety-critical systems, such as use in operation of medical equipment, automated transportation systems, autonomous vehicles, aircraft or air traffic control, nuclear facilities, manned spacecraft, or military use in connection with live combat. However, this restriction will not apply in the event of the occurrence (certified by the United States Centers for Disease Control or successor body) of a widespread viral infection transmitted via bites or contact with bodily fluids that causes human corpses to reanimate and seek to consume living human flesh, blood, brain or nerve tissue and is likely to result in the fall of organized civilization.

For those wondering F@H is Folding@Home, you basically help scientists simulate extremely complex interactions with proteins and stuff by installing a program. When your computer is not in use it'll be tasked with performing calculations for the project.

But Netflix runs entirely on Amazon's cloud (AWS) (edit: sources [1] and [2]). It's an interesting relationship to say the least.

This tutorial will help you set up an OpenVPN instance on an Ubuntu Linux machine (it's written for 14.04 but still works in 16.04 for me). It'll walk you through all of the steps to set up the vpn instance although it assumes you already have some knowledge with a headless Linux server and the command line. Hopefully that helps!

Edit: For people worried about DigitalOcean's imo okay privacy policy, this will work on any Ubuntu Machine/VM regardless of where you get it.

Stuff like Elastic Load Balancing is definitely a thing though. You don't have to buy a fuck ton of servers to support load spokes any more.

Like you said though, nothing is ever simple in software engineering. If they weren't already using something like AWS, it's not the easiest to move.

From the page I linked:
>Elastic Load Balancing automatically scales its request handling capacity to meet the demands of application traffic. Additionally, Elastic Load Balancing offers integration with Auto Scaling to ensure that you have back-end capacity to meet varying levels of traffic levels without requiring manual intervention.

Nope. That's Adobe's ExtendScript for things like After Effects and Photoshop with some shell jibberish added in.

Things to note:

Extendscript

• toComp()
• sub(targetBox, boxAnchor) - Anchors are used on all elements in an AE composition.
• xDistanceToEdge - obvious XY two dimensional coordinate in relation to some outer edge (not a bounding box, vector, or an area)

Bash/Shell

• MKDIR BKUP
• MYCONFIGPROGRAM,SH
• CREATE_SAMPLE_FILES,SH
• ./backup
• <code>FIND -INAME</code>...

Amazon actually have a service called AWS Snowball which you can use to import massive amounts (upto petabyes) of data into AWS without having to upload it, by shipping it to them physically.

They ship 80TB ruggedised specialized NAS drives to your location, you plug them into your network with 10Gbps connectivity, upload your data, ship them back to Amazon and they put your data into your AWS S3 storage.

>Take for example Titanfall right. I heard mixed reviews so saying good some bad not the point EA said nope not our country because our infrastructure was to bad. Which is total horse crap because we get Battlefield Mp just fine.

No, it's not horse crap. Titanfall relies on Microsoft Azure servers. If you look here, you'll see that Microsoft does not have any data centers in South Africa. So naturally they shouldn't sell it there.

This is actually just reddit being mismanaged. They use Amazon AWS cloud for hosting; it should automatically be scaling the number of servers and load balancing on its own, depending on the traffic pressure.

In the price tier that Reddit is in (aka the major tech website price tier) Amazon even provides a dedicated team of specialists to keep the site up. The only plausible explanation is Reddit is managed completely incompetently and/or the software is written poorly.

I mean, Facebook and Twitter use cloud hosting and have way more traffic but don't get annihilated like Reddit does. There's literally no social media website out there that crashes and burns like this, aside from Reddit.

source: working on my own social media thing in the cloud, develop software for a living too

edit: just my opinion - it's not just unacceptable, it's just flatly ridiculous that a user needs to refresh 10-12 times to see any content.

In this case you can always use your own VPS to host a VPN for yourself, it may not give you the “hide in the masses” advantage but still gives you some sort of bypass to censorship.

Now, I can hear people say that most people don’t have the technical know-how on how to do this, but I’m pretty sure there are many guides out there and there are some who gives “out-of-the-box” VPNs for you to use to set up in a VPS.

A guide to set things up manually in a VPS using OpenVPN: https://www.digitalocean.com/community/tutorials/how-to-set-up-an-openvpn-server-on-ubuntu-16-04

Out-of-the-box experience: Algo: https://nomadgate.com/10-min-vpn-server/

Ok, I gotta admit that I’ve not used Algo before, because I set up my server manually with openvpn, but then again, I’m a newbie so take whatever I’m saying with a pinch of salt

Pressure them to buy servers from companies that have ACTUAL, EFFECTIVE DDOS protection to start. This is now a multi billion dollar game, there’s no excuse to be renting servers from companies with terrible/non-existent DDOS protections when DDOSing has proven to be such a problem with this game. When I ran servers I rented from OVH and their DDOS protection was amazing, double digit Gbit/s attacks were unnoticeable when they occurred. They even tell you exactly how their DDOS protection works right here: https://www.ovh.com/world/anti-ddos/

Firstly, you can write e. g. {0:.2f} to specify a float with 2 decimals, see e. g. https://www.digitalocean.com/community/tutorials/how-to-use-string-formatters-in-python-3

Secondly, the best formatting method is f-strings, see e. g. https://www.blog.pythonlibrary.org/2018/03/13/python-3-an-intro-to-f-strings/

I'm not an OVH customer anymore (still a few servers but not production) due to various stuff, but I still like how detailed their incident reports are (for major stuff). Like for this incident (in French) with a cooling system that killed a drive bay:
https://www.ovh.com/fr/blog/hebergements-web-post-mortem-incident-29-juin-2017/

Also, as in AWS developer, if anyone is interested in doing anything similar, it uses services that are open to the public:

For speech recognition it uses transcribe: https://aws.amazon.com/transcribe/
For detecting the emotion of something it uses comprehend: https://aws.amazon.com/comprehend/

Actual text from terms of service of AWS/Lumberyard: (emphasis mine)

57.10 Acceptable Use; Safety-Critical Systems. Your use of the Lumberyard Materials must comply with the AWS Acceptable Use Policy. The Lumberyard Materials are not intended for use with life-critical or safety-critical systems, such as use in operation of medical equipment, automated transportation systems, autonomous vehicles, aircraft or air traffic control, nuclear facilities, manned spacecraft, or military use in connection with live combat. However, this restriction will not apply in the event of the occurrence (certified by the United States Centers for Disease Control or successor body) of a widespread viral infection transmitted via bites or contact with bodily fluids that causes human corpses to reanimate and seek to consume living human flesh, blood, brain or nerve tissue and is likely to result in the fall of organized civilization.

Digital Ocean has some great guides to set it up for Ubuntu

https://www.digitalocean.com/community/tutorials/how-to-secure-nginx-with-let-s-encrypt-on-ubuntu-14-04 https://www.digitalocean.com/community/tutorials/how-to-secure-nginx-with-let-s-encrypt-on-ubuntu-16-04

With the same technology you can all help find the highest cactus in Minecraft by using your PC's processing power

https://minecraftathome.com/minecrafthome/

Alternatively you can use this to help find a cure for cancer or whatever

https://foldingathome.org/

https://www.digitalocean.com/community/tutorials/new-droplet-plans-frequently-asked-questions > In order to decrease impact on existing applications and workflows, these plans are being introduced as completely new plans. This means there is no impact to your current Droplet and these changes will only impact newly created Droplets.

So the pricing changes aren't automatically applied to existing droplets. But you should be able to resize an existing droplet into one of the new plans to get the discount/upgrade.

AWS rents out GPU based instances:

https://aws.amazon.com/ec2/Elastic-GPUs/

p2.16xlarge -- 16 GPUs in one instance. A SHA-1 computation farm is within anyone's reach, you don't have to be a government or even a large corporation.

If you have good bandwidth and you’re willing to help others you could “donate” compute time like for example SETI or other open source projects like AI. I am not talking about crypto mining but actual scientific projects.

https://boinc.berkeley.edu/

https://en.wikipedia.org/wiki/List_of_distributed_computing_projects

Ik heb het gemaakt met Amazon Connect, een ding dat eigenlijk bedoeld is voor telefonische helpdesk-achtige frutsels ('heeft u een vraag over betalen, toets 4').

In feite heb ik gewoon op de plek waar normaal het "dit is de klantenservice van ..." hoort het Wilhelmus neergezet, et voila!

If you plan to host different services/sub domains on the same ports (such as 80 and 443) take a look at NGINX reverse proxy, I followed this DigitalOcean guide and got my reverse proxy and Lets Encrypt certs done real quick.

https://aws.amazon.com/about-aws/global-infrastructure/

Blizzard uses Amazon servers, and they simply don't have one in Africa at the moment. It's not up to Blizzard to add some, it's on Amazon. Looks like they're getting a server in Bahrain soon, maybe that will help.

My post from yesterday about just such scenarios seems highly relevant right now:

What's interesting is that many of the even worse events seem to boil down to systemic issues that a single employee gets blamed (scapegoated?) for.

For example, data with no backups, that's an issue that was going to reveal itself sooner or later. Just so happened that they'll blame the employee for it rather than WannaCry. But the result is ultimately the same. They lacked the systems and policies to correctly protect key information.

Or this:

> an authorized S3 team member using an established playbook executed a command which was intended to remove a small number of servers for one of the S3 subsystems that is used by the S3 billing process. Unfortunately, one of the inputs to the command was entered incorrectly and a larger set of servers was removed than intended.

And while credit to Amazon, they didn't scapegoat anyone (that we know of), it just goes to show that a lot of "big deal" problems are systemic in nature. Just quietly waiting to be brought out in a big way.

This is why I think we could all learn a lot from the NTSB's investigations into aircraft crashes. When they look into these things they aren't looking for an individual or scapegoat, they boil the problem down to how the system put that individual into a position where they could screw up (be it poor procedures, poor training, poor equipment, or a million other issues).

Every time a colleague or subordinate makes a mistake, the first question that should get asked is: How could broader department policy have prevented or mitigated this?

https://www.digitalocean.com/community/articles/how-to-protect-ssh-with-two-factor-authentication

[Edit] It mentions in the article, but since so many people have upvoted this, I feel I should mention, it is EXTREMELY important that you make sure you take note of those emergency codes that are generated and keep them somewhere safe. If, for example, your phone is stolen, those emergency tokens are the only thing that will let you back into your system. Please take care to store those somewhere safe.

I work for DigitalOcean, what kind of logs?

We don't log traffic, if that's what you're asking. We log things like Droplet Creates, Destroys, etc — activity within the control panel. We don't log anything that happens on your droplet, with one exception: metrics.

We collect your general bandwidth usage (speed in/out and how much data), CPU usage, and disk I/O usage. If you have our monitoring agent installed, we collect things like your disk space usage, memory usage, etc. We don't see any specific data — the metrics are only collected in order to (A) ensure the platform is healthy and (B) provide the information to you.

If some crazy law was passed and we were required to log that network activity, the only logs would be from that point forward, and it'd probably take us a long time to even be able to technically implement something like that on such a large scale. The storage alone would be extremely expensive.

Also, knowing our executive team, we'd fight such legislation tooth and nail, as would pretty much every other provider.

Keep in mind that you have control over the logs on your droplet itself. If you're in legal trouble and we receive a subpoena for that data, we'd be legally obligated to provide it. If it's encrypted or if it doesn't exist, ¯\_(ツ)_/¯

https://www.digitalocean.com/legal/privacy/ and https://www.digitalocean.com/legal/enforcement/ have all the legalese, but are worth reading.

Reddit runs on AWS, and the AWS acceptable use policy forbids various types of content including content that may be harmful to Amazon's reputation.

https://aws.amazon.com/aup/

So the real question is: why is Amazon Web Services hosting hate speech, promoting white nationalism, and enabling radical right wing terror and murder?

OpenVPN is what you're looking for. Link is for doing it at Digital Ocean, but it should apply anywhere that offers Ubuntu server (which is any hosting company, really). Some knowledge of Linux command line helps, but really if you're even kinda technical you should be able to get by with copy paste and figure it out.

https://www.digitalocean.com/community/tutorials/how-to-set-up-an-openvpn-server-on-ubuntu-16-04

One thing to note is that this is not a good solution for doing illicit things. Your home ip will not be tracked, no, but your server ip will be. That server is yours and linked to you personally. Great for Netflix, not for torrents.

AWS baby, thats the magic of it. If I remember correctly Netflix is the same way as its running purely in AWS last I heard.

Between route53, ELB, auto scaling, and health checks there is no real need for network gear in this enviroment. AWS pretty much manages all of the connectivity between all the services themselves in the regions. However this really isnt a surprised as its just a public website being hosted somewhere else.

For those who arent aware, there are Cisco virtual routers you can run if you have the need for it so dont be too dishearten

https://aws.amazon.com/marketplace/pp/B00EV8VWWM

and there is some network knowledge you need to have when working with VPN connections and direct connect

https://aws.amazon.com/directconnect/

Never use GoDaddy. For anything. Ever.

Use Digital Ocean. Far cheaper than anything GoDaddy offers, FAR FAR better for any real RoR app or any real web app at all.

GoDaddy has AWFUL ethics, AWFUL security and AWFUL...well everything.

There was the time GoDaddy supported SOPA.

Digital Ocean is $5 a month for a VPS, way better.

If you're feeling generous, here is a referral link.

If you're not feeling generous here is a regular link.

Usually I get trainees to install a LAMP stack:

https://www.digitalocean.com/community/tutorials/how-to-install-linux-apache-mysql-php-lamp-stack-on-ubuntu-16-04

It's a good way to get them to understand certain concepts, utilities, services and packages. It certainly also lets them explore how it all works together to provide a solution and see how bash / the cli works.

It's not too difficult, and can be quite fun.

I'm also suggesting this, as this was my very first project that got me into Linux and even into a Junior Sysadmin job!

Holy crap, I was trying to figure out how to report it to Amazon...

Edit: Still an issue, but only for Postgresql

Edit2: I tweeted @awscloud letting them know.

> Q. Can I take Lumberyard and make my own game engine and distribute it?

>No. While you may maintain an internal version of Lumberyard that you have modified, you may not distribute that modified version in source code form, or as a freestanding game engine to third parties. You also may not use Lumberyard to distribute your own game engine, to make improvements to another game engine, or otherwise compete with Lumberyard or Amazon GameLift.

https://aws.amazon.com/lumberyard/faq/

This is what I used:

https://www.digitalocean.com/community/tutorials/how-to-set-up-an-openvpn-server-on-ubuntu-16-04

Got an account, fired up an Ubuntu Server VM, used Putty to connect and followed instructions. Took a bit of fiddling and this ain't my first rodeo. Be glad to help.

Best thing is; once you have it working you can simply install OpenVPN on any PC and copy the config file. It just works. Wife wanted it on her PC. No problem. Install OpenVPN and copy the config file to the appropriate directory. Works like a champ.

I currently work in NYC in the tech sector and work about 40-45 hours a week and it's been that way for the 2 1/2 years I've been here. A good work/home life balance is important not only for your mental health but also your productivity.

Anyone else putting in massive hours in tech in NYC (or anywhere else, we're 40% remote) should check us out: DigitalOcean Careers

Hi deadbunny! We actually do have a team of in-house writers (I'm one of them!), in addition to the great work our editors do with community authors. I actually got the job after writing as a community author for a little while, and it was a great experience.

If anybody reading this knows some interesting tech and wants to get paid to write about it while working with some wonderful editors, give our Write for DOnations program a look. We recently revamped our payouts and also added in a donation to a tech-focused charity of your choice.

We’re in the process of getting DHCP failover configured. Just setup NTP for accurate time. Trying to figure out some of the options in the dhcpd.conf file.

We’re using instructions from the following sites. 1. DHCP Failover Example 2. NTP Server on Ubuntu

https://aws.amazon.com/aup/

> Prohibited activities or content include:

> [...]

> Offensive Content. Content that is defamatory, obscene, abusive, invasive of privacy, or otherwise objectionable, including content that constitutes child pornography, relates to bestiality, or depicts non-consensual sex acts.

> If you become aware of any violation of this Policy, you will immediately notify us and provide us with assistance, as requested, to stop or remedy the violation. To report any violation of this Policy, please follow our abuse reporting process.

The tech is used for all kinds of things now. Protein folding, cancer research, etc. I think there is a site somewhere you can see all the programs you could help out. Any search for distributed computer research should get you there.

Edit: I went looking. Here you go. https://boinc.berkeley.edu/

Derek, I'm gonna let you in on a secret. Every major publisher launches multiplayer games on AWS. EVERY single one. If it wasn't saving them money, they wouldn't do it! I can't mention exact ones because I legit AM under NDA and happen to like my job, but I oversee large system launches as part of my job. Did you notice how many sites went down with the S3 outage? More runs on AWS than half the AWS employees even know. Again, you are an idiot and don't know what you're talking about. But please show us how colocating servers that run idle for years since your "games" don't even make it to the bargain bin is more cost effective.

Edit: also wanted to point out that lots of indie small games have launched on AWS, along with a huge number of mobile games and game for all platforms. Do they all spend big like the big publishers? Of course not. They don't need to. But you better let them know how much cheaper colocating some "Dell Xeon" servers are! Save us from ourselves again Derek!

Edit 2: Derek! Look at all these industry idiots using AWS for games! This was years ago admittedly,but maybe one of us shitizens will let you borrow our time machine so you can go warn them. https://aws.amazon.com/gaming/reinvent-2014-slides/

Yes, I have. A few tips:

• Use spot instances since they're much cheaper for GPU instances but make sure to snapshot your model, otherwise you might lose training time and have to start over. You can save the snapshots to S3 (depending on the size of the model).
• Spot instances get a 2 minute notice before being shut down. You can use boto to check the timestamp for when that will occur.
• Make sure to create an AMI with all dependencies pre-installed so you don't waste time installing those when the instance spins up.
• Pick a price that has been steady for a while (I usually get away with $0.10/hr for a few days, continuously.) You can view price graphs for the instance type in the AWS console: http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/using-spot-instances-history.html
• There are several AMIs with everything you need for Torch (from Facebook) or Theano as well as CUDA pre-installed but installing from scratching isn't too bad.
• For very large datasets use their EBS (https://aws.amazon.com/ebs/pricing/). It's basically an on-demand SSD you can attach to instances when they spin up.

IMO, a better way to do this is by setting up a SSH certificate authority and avoiding authorized_keys files completely. Then when you sign your friends key you could specify an expiration time. The following example would give a friend access to your server for the next 2 weeks:

ssh-keygen -s ca_key -I user_friend -n friend -V +2w id_rsa.friend.pub

His/her login would be valid on all servers using this CA where the unix user "friend" exists and has login permissions. More info.

It seems as though Boinc can use Nvidia, AMD, or Intel, but certain projects are developed to only support one or another (or all). The Minecraft project developer probably has an Nvidia card and just programmed the code for it, rather than targeting AMD as well.

https://boinc.berkeley.edu/wiki/GPU_computing

i'm suprised nobody yet mentioned algo. it let's you set up your own vpn gateway with many cloud providers. and amazon web services even offers an ec2 instance for a year free of charge.

algo self description:

"Today we’re introducing Algo, a self-hosted personal VPN server designed for ease of deployment and security. Algo automatically deploys an on-demand VPN service in the cloud that is not shared with other users, relies on only modern protocols and ciphers, and includes only the minimal software you need."

Given how cucked reddit is I wouldn't be surprised if that wasn't a front for various spy organisations.

e.g. 'Hey guys, try out XYZ VPN, they take no logs and are totally free speech man!'- then full pipe your data straight to the NSA.

Learn how to set up your own VPN's and proxies. It's easy. Example. Chain a few together and you should be able to dodge casual snooping.

If things get properlly bad, you're going to need that kinda info and more.

That said, I hope it's not required.

Trump 2016

https://www.digitalocean.com/community/tutorials/sqlite-vs-mysql-vs-postgresql-a-comparison-of-relational-database-management-systems

Here's a good overview. Ignoring Nosql and sqllite, you should be looking at mysql and postgres. The gist of that article is that postgres is better in almost every single way except speed.

• Postgres supports concurrency while still staying acid
• Great user/security system
• Amazing schema system
• slightly slower for small workloads

Each Snowmobile includes a network cable connected to a high-speed switch capable of supporting 1 Tb/second of data transfer spread across multiple 40 Gb/second connections. Assuming that your existing network can transfer data at that rate, you can fill a Snowmobile in about 10 days.

https://aws.amazon.com/blogs/aws/aws-snowmobile-move-exabytes-of-data-to-the-cloud-in-weeks/

Not that I expect streamers to understand this, but that's not how AWS works.

With AWS, you don't typically purchase hosts and then add instances to that single host. You can do that through the Dedicated Hosts service, but that's far from typical and is much more difficult to manage as you need to employ people familiar with its nuances. Usually dedicated hosts are used when an organization has some weird licensing issue; for example, if your Oracle license costs $X per CPU that it could possibly run on (yes, that is one of their pricing models) you may want to use a dedicated host to control that CPU count.

Usually you simply purchase instances and allow Amazon to decide which host they will run on. This makes it essentially impossible for you to run into an overcrowding issue.

The only problem I could see with AWS that would match what you described is if Bluehole was using undersized instance types. They could have used oversized instances for the closed alpha, and since they were only running a few servers the extra cost wasn't a problem. For the EA launch, though, they probably would have switched to instances with a tighter tolerance in order to save money. Those instances are probably just barely powerful enough to accommodate the game server, but they cost a lot less. If you're going to launch an autoscaling infrastructure you want to get the cost just right, because paying an extra $0.10 per hour per server across 200 servers costs you $14,400 a month that you don't need to spend -- but sometimes that 200 scales up to 2,000 or even 20,000, which is good because it means your game is popular, but it's also bad because you're spending a ton of extra money.

TL;DR: it's possible that the AWS instances are undersized, but the streamers probably don't know what they're talking about.

I'll honestly be surprised if Amazon can not. I mean they have an infrastructure in place for content delivery. I would be really worried if they are not able to do a 10/10 stream.

https://aws.amazon.com/cloudfront/

You're right that it's not as simple as I made it sound. That said, if you're using a VPN that has no surveillance reciprocity with your home country (i.e. not in the 5/14 eyes for US citizens) then you're better off than you would be otherwise.

Also, you'll note that that table has several columns devoted to each VPN's logging practices.

Also, for the sake of completeness, here is a pretty user friendly guide to setting up your own VPN: https://www.digitalocean.com/community/tutorials/how-to-set-up-an-openvpn-server-on-ubuntu-16-04

If you're really worried you can host your own VPN server and burn it down every few months.

Save up for a decent PC, or look into subscribing to Shadow Cloud Streaming. Playing Battefront 2 with mods has been an amazing experience, this is coming from a strictly console player.

I work for DigitalOcean. We absolutely let you export your data, dns, etc - just not backups and snapshots. This is because they wouldn't really be of any use to you - they're customized for our system. We even have a published tutorial about backing up outside of DigitalOcean

Check out our API - https://developers.digitalocean.com/documentation/v2/. You can export your DNS, firewall settings, etc from there. Want to move to another provider? Use our API to get your DO settings and then the new provider's API to set them up.

Digitalocean had a pretty good article about the history of Apache and Nginx, as well as some considerations to take that helped me when I was starting out. Link

Netflix runs on Amazon's services to run their servers anyways. https://aws.amazon.com/solutions/case-studies/netflix/

EDIT: I know everybody uses AWS. Just pointing it out for people who don't know.

The first thing you need to do is make sure you've turned off the service completely. AWS won't offer a refund for anything that's still running.

Next, contact support and tell them what happened. They're the only ones who can sort this out.

Check out Macie's pricing here, they have an example of what real world usage would cost: https://aws.amazon.com/macie/pricing/

It's a lot easier and enjoyable than you'd imagine. If you're completely new to it, I'd recommend DigitalOcean. They have full tutorials on setting up various stacks and environments.

e.g. LAMP or MEAN

Most hosting sites don't let you execute processes but instead give you access to a folder where you can create files that get parsed and served by an Apache type server. This allows you to easily make a website out of html files which just get served to the browser or php files which get parsed and run generating a static file which gets served to the browser. NodeJS apps run as their own process and need to be executed differently resulting in the need for other hosting sites like nodejitsu.

I highly recommend using Digital Ocean as it not only lets you run nodejs apps but it gives you access to your own virtual private server which is a machine that you can install whatever os you want on. You can then ssh into in and run nodeJS apps as if you were on your own computer. It's also cheaper than most of the other hosting companies I have seen since the starting price is only $5/month. Virtual private servers also teach you more because you learn how to setup your app yourself.

Fun fact $750,180,000 of that comes from maxing out Machine Learning 1 billion predictions and 1 hour per prediction, the second part is prorated so it won't cost nearly that much, it's still not cheap but you're basically buying 114,155 compute years (a month!!!) if my math checks out.

Source: http://azure.microsoft.com/en-us/documentation/articles/machine-learning-faq/

The rest of the cost comes from buying a small data center's worth of servers of high specs.

I think OW uses Amazon Web Services for their servers. There is no infrastructure in Africa.

https://aws.amazon.com/about-aws/global-infrastructure/

It's up to Amazon to develop servers in Africa in order for Blizzard to use them.

I'm an owner of multiple websites, including one that hosts a 45GB torrent (with a web seed, the files are hosted and downloaded off of our servers). All I can say is that to host a VPK website, it might take a lot of work, but it will take neither web space nor bandwidth, considering you guys all use mega.nz and google drive. This means you can easily use Vultr or DigitalOcean, for example, to host your own website for typically less than $10 a month. There is absolutely no reason why you need either ads or the horribly atrocious adfly links. These will only help your pockets, not to mention degrade the website's performance (how can adding ads to a website increase it's performance???).

Not strictly true, cloud servers usually have multiple pricing options, and the longer the lease you sign, the cheaper the server.

See https://aws.amazon.com/ec2/pricing/ - scroll down to 'reserved instances'

Sounds interesting!

But I'll warn you: Amazon is already using the term "Glacier" for "cold storage" of data: https://aws.amazon.com/glacier

If I were you, I'd strongly consider changing the name to avoid any trademark issues; legally you may very well be OK, but lawsuits are expensive even if you're in the right.

You do actually use Amazon products, you just don't know. https://aws.amazon.com/solutions/case-studies/all/

Netflix Workday AirBNB Belkin Citrix Coursera Duolingo FT IMDB King County (their website/services) Naughty Dog

You might not use their retail services, but that's not even their largest money maker any more.

Assuming you're already reasonably comfortable on a Bash/sh prompt: The best place? Your own server! If you don't have one and don't want to pay for something with AWS, digital ocean or whatever you can just run virtual machines on your own computer just fine most likely. VMware player is free and makes it easy to get a virtual machine going.

Ubuntu and its derivatives have the most help available online through questions asked to try and work it out yourself. DigitalOcean in particular has some good docs to help you like this one. Outside of Apache+PHP you generally need to setup a module or a second application server to run code. Nginx, for example, is meant to serve your static content like .css and .js very quickly, but defer the work to something like gunicorn to actually interpret and run python to generate the page if you're using Django or something.

If you aren't comfortable on the shell, yet, well you'll want to get that down first.

Pay per usage is fine if the cost is reasonable. Consider what Amazon charges for IO. The most is $0.09 per GB for data transferred to the internet. I am perfectly willing to pay that or more + a flat fee for infrastructure maintenance for my home internet connection.

Just don't lock me to 300 GB, or something.

> metric fuck ton of IRL silicon and budgets in the tens of millions

Have you heard about our lord and saviour AWS?

Far more importantly; You can run an AI on consumer grade GPUs, if more slowly, which can be bought of the shelf; so unless all GPUs from all of time are regulated, you cannot block, only limit in scope.

As a side note: Artificially inteligent virus that hyjacks cryptomining rigs? Infinite GPU compute for cheaps.

I wouldn't say they are trying to be a tech company. Amazon is by far the biggest player in cloud hosting and the fact that Re:Invent sold out so early compared to last year kinda proves how fast AWS is still growing. Netflix, League of Legends, Adobe, the MLB, and a bunch of other companies all use AWS in some capacity[Source].

I would be very comfortable in saying that Amazon is one of the biggest players in technology

Dropbox has been in a weird position for a long time. They are essentially entirely dependent on Amazon S3 as their storage backend, which means their storage costs are always going to be more than a competitor like Google or Amazon who don't have to pay a premium for storage.

Dropbox has managed to at least partially get off of Amazon for bandwidth by getting a Amazon DirectConnect connection and buying (some of their) bandwidth wholesale. And if they want to they could colocate servers in a datacenter near their Direct Connect connection and do all the server-side hashing work on their own systems. But for storage, which is probably their largest expense, they're kinda stuck.

But at the end of the day, they're not going to be able to compete with Amazon and Google on storage allowances without significantly restructuring their infrastructure at a large expense.

Install Ubuntu + LAMP stack onto a spare computer, make a WordPress site.

https://www.digitalocean.com/community/tutorials/how-to-install-wordpress-with-lamp-on-ubuntu-16-04

Develop the site out, make another site if you can. Make a blog and a real webpage, YouTube a few of those 2+ hour videos on intro WordPress sites, you have the time. Devote a week or two to those and boom you have a portfolio and marketable skills, go forth and work.

Don't beat yourself up if you don't pick it up on the first try, do it again and again, learn from mistakes, don't ignore success, and be patient with yourself, this is the hard part.

https://www.digitalocean.com/community/tutorials/how-to-set-up-ssh-keys--2

Take a look there. It's pretty straightforward once you get it going. Basically you

1. Generate the key. You'll get two - an id_rsa (the private one) and an id_rsa.pub (the public one) file.
2. Put the contents of the .pub file into the ~/.ssh/ folder under the authorized_keys file of whatever user you want to login as on the machine you want to login to.
3. Put the id_rsa into your ~/.ssh/ folder as id_rsa.
4. Try to ssh into said server from your computer and viola.

Keep the id_rsa one secret. Disable the password login ability of your SSH server and now even if anyone gets both your username and password, they still can't login - since they don't have your key.

As far as fail2ban - the most basic level of getting it up and running is:

sudo apt install fail2ban

That's about it. All it basically does is scan your logs and look for IPs that fail to login a certain number of times over a certain time period. If so, it bans them for (I think the default is) 3 days. Even if they have the right credentials in that 3 day period, that IP is getting dropped until unbanned.

Glad to be of help, and thank you! If you're interested in setting up SPF records on your current or future domains, there's a fairly in-depth, yet approachable, tutorial at this page. You can set them with virtually any DNS provider, and it can be a good step to take.

> Never underestimate the bandwidth of a station wagon full of tapes hurtling down the highway.

You can even ship a drive to AWS. Often the fastest way to get a few terabytes of data into/out of S3

The Java example is the very first Java example provided though. The problem is that there is no simple Java example that doesn't use the Flow Framework. So your very first Java example linked from the SWF tutorial listing is this ridiculously complex sample that unfortunately isn't great for learning SWF.

>The praising of the C# Tutorial is a non-sequitur as well, as there is no such thing, it's a blog post that's not linked to from the SWF documentation at all.

It's a blog post but it's linked right below the above discussed Java example in the listing of tutorials - &quot;See the AWS SDK Team's blog on getting started with a sample Amazon SWF application using the AWS .NET SDK.&quot;

Their SLA policy is here:

https://aws.amazon.com/s3/sla/

TL;DR: you're entitled to a 10% S3 service credit for this billing cycle. To claim it, you need to submit a ticket to support with logs showing that you were impacted by the outage.

I ran a large-ish gaming community a few years back. We would get skiddiots try to DDoS us every few weeks because we banned them for breaking the rules. The average age of the aforementioned skiddiots was about 14. It was amusing to watch them get really mad when they realised that our provider's DDoS mitigation system was splatting their requests before they even hit our server.

It's a platform/client to run projects like Folding@Home, but you can chose from dozens and run them simultaneously if you so chose. So you can decide what cause you want to donate to, or go by what project would use your hardware most efficiently.

A popular one is World Community Grid (by IBM) which is itself an umbrella project with (varying) projects from finding cures to ebola to improving solar tech.

https://boinc.berkeley.edu/

> Case in point, I am considering using the service for remote backups, but would want to retrieve the majority at once in case of need... Now I need to redo my sums ;)

You should consider the Infrequent Access Storage Option on S3. It's somewhere between S3 and Glacier:

• Price is $0.0125 per GB (Glacier is $0.007 and S3 is $0.030 per GB)
• You don't have to wait hours to retrieve your data.
• You just pay $0.01 per GB more for retrieval than on S3, request pricing is also a bit higher.
• You pay for a minimum 30 days of storage when you upload something, even if you immediately delete it. Also files smaller than 128 KB are treated like 128 KB files. So your backup program should merge small files into larger archives.

The main good thing about Infrequent Access Storage is that it's not as complicated as Glacier and easier to calculate.

Reddit runs on AWS, and the AWS acceptable use policy forbids various types of content including content that may be harmful to Amazon's reputation.

https://aws.amazon.com/aup/

So the real question is: why is Amazon Web Services hosting hate speech, promoting white nationalism, and enabling radical right wing terror and murder?

I use digital ocean

I think you get $10 credit with my link

https://www.digitalocean.com/?refcode=6de208ecb9dc

Set up the $5 per month Ubuntu LAMP stack.

Install Putty (windows) to connect to your VPS IP address.

sudo apt-get install python-pip

Then you can run Flask if you want

https://www.digitalocean.com/community/tutorials/how-to-deploy-a-flask-application-on-an-ubuntu-vps

Use WinSCP to manage your files.

Here's the real reason. There's no server hosts in SEA that Valve works with yet.

Explanation: I worked at a large company that used a lot of computing. It was actually cheaper to use cloud host services by Amazon, since they do a great job at it. Thus we didn't need to keep physical servers and can scale up or down with ease. So places that have Amazon servers usually have dota servers at their location, since it's pretty easy to set up.

https://aws.amazon.com/about-aws/global-infrastructure/

Philippines does not have a AWS (Amazon Web Services) location. Japan and Aussie does. Valve needs to start hunting for server hosts in Philippines.

To add on to this--Amazon offers a service known as Snowball, which is essentially a giant hard drive that's rugged enough to be shipped in the mail, used to upload several terabytes of data into the Amazon cloud.

They also offer what's known as a Snowmobile, which is a giant trailer truck with the capacity of 100PB.

For me, the biggest upside out of banano is since it doesn't require mining, you can still "mine" banano with your home computer while participating in medical research through https://foldingathome.org/. The project is called https://bananominer.com/ and rewards banano. For example you can currently give your computer power for research against COVID.

AWS Import/Export Snowball >Snowball is a petabyte-scale data transport solution that uses secure appliances to transfer large amounts of data into and out of the AWS cloud.

Each record is say 100 bytes comprising source, destination, time stamp, and duration. That is about 8TB uncompressed, which could be stored in RAM on 5 X1 EC2 instances.

They could maybe load it into their in house Graph Database.

BTW for AWS you can have dedicated instances. If you have a single point of failure I would suggest using a dedicated instance. In this case your instance is just like any other managed server provider. https://aws.amazon.com/ec2/purchasing-options/dedicated-instances/

I've been testing this out, and while it does work (surprisingly well actually), there's still enough of a latency lag that it starts to give me motion sickness... That said, this technology is SOO close to being perfect and I can't wait until we can play flawless high-end VR games on lower-end hardware because of cloud computing + streaming...

&#x200B;

Shadow.tech is delivery some amazing streaming technology, I hope they partner up with Virtual Desktop or maybe start offering their own solution to VR streaming. Going to be a really interesting couple of years! Can't wait!

I recommend using Amazon EC2 instances and the AWS Cloud 9 IDE.

Basically what you can do is teach your students to create AWS EC2 instances, or just create them on your own, and then use those as the computers. The Cloud 9 IDE has a shell session into the instances so they'll not only have a text editor but full bash shell access (for things like compiling C, getting familiar with *NIX commands, etc).

I've set up a number of coding workshops using this stack so please feel free to DM if you want more details or some help with EC2.

The nice thing about using EC2 instances is that you only pay for them when they're running - during class time or while students are practicing/working. All other times they can stop the instance, leaving them and their disks/data around, but not pay for it. Depending on your specific experience and needs you may be able to just use free-tier instances and not pay for anything.

Ninja-edit: keep in mind this requires internet access to use at all, so maybe not perfect if students don't have the ability to access the internet while they're coding. Should be more than fine on library computers with a reasonably modern browser, though. Also, since it'll all be fully browser based library computer IT shouldn't be an issue.

Lack of moderation? Not sure what the process is.

Edit: Admins/Devs if you're reading, you should check out AWS Rekognition - And the newish Image Moderation part of it, which picked up this picture had revealing clothes. At the very least it'd let you put things on a manual approval queue.

remember last year when Folding@Home became the first exascale supercomputer through millions of people donating their computers processing time and now there is a potential shelf-stable COVID cure on the horizon as a direct result of both that and the open-source, nonprofit nature of the endeavor? Imagine what these could do for humanity

Finally a science question that fits my knowledge!

TL;DR: I think it wouldn't be terribly useful, and if you wanted to do something like this for a SETI@home setup, you would do better to collect machines that are recently discarded.

Making a cluster out of the old computers like that would be pretty awful. One of the last Pentium 4s made was sucking down 115 Watts. That was for a single core with 2 threads and 2MB of cache. You can fit 2 Ryzen 2400 chips in that power envelope. That gets you 12 cores with 24 threads and 32MB cache. This is a bit of an extreme example, but it's to demonstrate that there is an upper limit to the worth of dumpster diving for hardware. Eventually your power bill will be eye wateringly large for very weak compute. Sucking down those coal powered electrons. Even on a clean power setup, you will be much better served with modern commodity parts to consume less power.

You would also be restricted in what problems could be solved. Usually if you're throwing a problem at a cluster, it's because the problem is too big to solve on a beefy work station with multiple GPUs. To that end, your cluster needs top end networking hardware. Low latency and high bandwidth. The cluster of left over computers will probably have 100mb Ethernet nics. That is on the far opposite end of what you want.

Now, if you're looking make better use of modern hardware to volunteer it for a cluster, check this out. https://boinc.berkeley.edu

If you're doing this professionally and want to save tons of time, consider renting a server. Even AWS, as expensive as it is, it's pennies compared to your hourly rate. For instance, you can rent c4.8xlarge, which runs on 18 cores, 36 vCPU, 60GB RAM, and it's only $0.4131 per hour (spot pricing).

At work we use google workspace. It is a paid service, but gives a lot more space + shared drives. Although I have to say that I work in manufacturing, not in game dev. We use it to share documents, project files like CAD models and stuff.

> nice is PostgreSQL had a way of auto-tuning these values based on actual measured performance at runtime

Such projects exist.

• A simple, minimal one: https://git.postgresql.org/gitweb/?p=pgtune.git
• A complex, awesome one: https://aws.amazon.com/blogs/ai/tuning-your-dbms-automatically-with-machine-learning/

Well AWS is the largest cloud provider and having hundreds of extra servers available shouldn't be a big deal for them, considering Auto Scaling is one of the core features of any cloud provider these days.

I'm just surprised AWS is having trouble with their demand for servers.

The best is to disable password authentication and use a key-file (https://www.digitalocean.com/community/tutorials/how-to-configure-ssh-key-based-authentication-on-a-linux-server). If you don't want to then your new password must be at least 10 characters long and not subject to dictionary attacks.

Signed host keys with an ssh ca. There are a bunch of ways to do this, but you basically need one line of @cert-authority in your known_hosts and never have to update it again.

You also might want to look into cashier.

Het is jammer dat NPO geld hiervoor vraagt maar het is niet zo zeer de content waar ze geld om vragen maar de kosten voor de extra bandbreedte.

Feiten op een rijtje:

• Gemiddelde kijktijd televisie in 2016 per dag: 183 min (http://www.mediaonderzoek.nl/7816/kijktijd-tv-daalt-2016/ )
• Youtube 1080p (full-hd) video 4mbit/s, zo'n 1.8GB per uur
• Bandbreedte CDN amazon zo'n €0.018 ($0.02 bij Amazon per GB: https://aws.amazon.com/cloudfront/pricing/)

Stel een gemiddelde (internet) televisie kijker kijkt voor 25% naar NPO kanalen.

percentage NPO * dagen in maand * aantal uur per dag * GB per uur kijktijd in full-hd * kosten per GB

0.25 * 30 * (183 / 60) * 1.8 * (€0.018) = €0.74 per gebruiker per maand

Uiteraard is het overdreven dat de gemiddelde gebruiker zo veel via het internet naar NPO zou kijken. Daarom denk ik dat een bedrag van bijvoorbeeld €0.07 per gebruiker veel realistischer is. Maar zelfs dan is de bandbreedte niet gratis.

I did the math.

An easy way of going about it. Probably won't work on mobile devices though - that's what led me to set up OpenVPN. It really is not that much of a big deal if you follow a decent guide.

edit: So DigitalOcean is now also blocked. Shit.