Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse

isurg

  1. Home
  2. Uncategorized
  3. A single point of failure triggered the Amazon outage affecting millions

A single point of failure triggered the Amazon outage affecting millions

Scheduled Pinned Locked Moved Uncategorized
technology
11 Posts 8 Posters 0 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • T themachinestops@lemmy.dbzer0.com

    We need more cloud services.

    M This user is from outside of this forum
    M This user is from outside of this forum
    mspencer712@programming.dev
    wrote last edited by
    #2

    We also need more individuals paying for “business” Internet connections at home. We need self-hosters to be able to feel comfortable running public services from their homes. And so we need a set of practices and recipes to follow, so a self-hoster can feel confident that, if one thing gets broken into, the other few dozen things they’re hosting will stay safe.

    The “family nerd” hosting things for the family needs to be a thing again. Sorry, friends, I know family tech support sucks. It’ll suck so much more when it’s a web site down and nobody can reach their kid’s softball team page, and there’s a game next weekend, etc. But we’ve seen what happens when we abdicate our responsibilities and let for-profit companies handle it for us.

    (I wish so hard that I had a solution ready, a corporate LAN in a box, that someone can just install and use. I’m working on something, but I’m pretty sure I over-complicated it. It doesn’t need to be Fort Knox, it just needs to be pretty good. And I suck at ops stuff.)

    0 1 Reply Last reply
    0
    • M mspencer712@programming.dev

      We also need more individuals paying for “business” Internet connections at home. We need self-hosters to be able to feel comfortable running public services from their homes. And so we need a set of practices and recipes to follow, so a self-hoster can feel confident that, if one thing gets broken into, the other few dozen things they’re hosting will stay safe.

      The “family nerd” hosting things for the family needs to be a thing again. Sorry, friends, I know family tech support sucks. It’ll suck so much more when it’s a web site down and nobody can reach their kid’s softball team page, and there’s a game next weekend, etc. But we’ve seen what happens when we abdicate our responsibilities and let for-profit companies handle it for us.

      (I wish so hard that I had a solution ready, a corporate LAN in a box, that someone can just install and use. I’m working on something, but I’m pretty sure I over-complicated it. It doesn’t need to be Fort Knox, it just needs to be pretty good. And I suck at ops stuff.)

      0 This user is from outside of this forum
      0 This user is from outside of this forum
      0tan0d@lemmy.world
      wrote last edited by
      #3

      Homes should come with a static IP address.

      P 1 Reply Last reply
      0
      • T themachinestops@lemmy.dbzer0.com

        We need more cloud services.

        dudeimmacgyver@kbin.earthD This user is from outside of this forum
        dudeimmacgyver@kbin.earthD This user is from outside of this forum
        dudeimmacgyver@kbin.earth
        wrote last edited by
        #4

        We need to ditch cloud entirety and go in house again.

        P 1 Reply Last reply
        0
        • R This user is from outside of this forum
          R This user is from outside of this forum
          rumba@lemmy.zip
          wrote last edited by
          #5

          I certainly don't miss dealing with air conditioning, dry fire protection, and redundant internet connections.

          I also don't miss trying to deal with aging servers out and bringing new hardware in.

          D 1 Reply Last reply
          0
          • R rumba@lemmy.zip

            I certainly don't miss dealing with air conditioning, dry fire protection, and redundant internet connections.

            I also don't miss trying to deal with aging servers out and bringing new hardware in.

            D This user is from outside of this forum
            D This user is from outside of this forum
            dubyakay@lemmy.ca
            wrote last edited by
            #6

            That work is still being done by someone in a data centre. But all these jobs went from in-house positions to the centres.

            P 1 Reply Last reply
            0
            • dudeimmacgyver@kbin.earthD dudeimmacgyver@kbin.earth

              We need to ditch cloud entirety and go in house again.

              P This user is from outside of this forum
              P This user is from outside of this forum
              partial_accumen@lemmy.world
              wrote last edited by
              #7

              We need to ditch cloud entirety and go in house again.

              For many many companies that would be returning to the bad-old-days.

              I don't miss getting an emergency page during the Thanksgiving meal because there's excessive temperature being reported in the in-house datacenter. Going into the office and finding the CRAC failed and its now 105 degree F. And you knew the CRAC preventive maintenance was overdue and management wouldn't approve the cost to get it serviced even though you've been asking for it for more than 6 months. You also know with this high temp event, you're going to have an increased rate of hard drive failures over the next year.

              No thank you.

              C 1 Reply Last reply
              0
              • D dubyakay@lemmy.ca

                That work is still being done by someone in a data centre. But all these jobs went from in-house positions to the centres.

                P This user is from outside of this forum
                P This user is from outside of this forum
                partial_accumen@lemmy.world
                wrote last edited by
                #8

                That work is still being done by someone in a data centre. But all these jobs went from in-house positions to the centres.

                The difference is scale. When in-house, the person responsible for managing the glycol loop is also responsible for the other CRACs, possibly the power rails, and likely the fire suppression. In a giant provider, each one of those is its own team with dozens or hundreds of people that specialize in only their area. They can spend 100% on their one area of responsibilty instead of having to wear multiple hats. The small the company, the more hats people have to wear, and the worse to overall result is because of being spread to thin.

                1 Reply Last reply
                0
                • 0 0tan0d@lemmy.world

                  Homes should come with a static IP address.

                  P This user is from outside of this forum
                  P This user is from outside of this forum
                  partial_accumen@lemmy.world
                  wrote last edited by
                  #9

                  Homes should come with a static IP address.

                  Web Advertising companies, data harvesting companies, oppressive governments have entered the chat "I fully support this proposal. Every home should have a static IP address."

                  1 Reply Last reply
                  0
                  • P partial_accumen@lemmy.world

                    We need to ditch cloud entirety and go in house again.

                    For many many companies that would be returning to the bad-old-days.

                    I don't miss getting an emergency page during the Thanksgiving meal because there's excessive temperature being reported in the in-house datacenter. Going into the office and finding the CRAC failed and its now 105 degree F. And you knew the CRAC preventive maintenance was overdue and management wouldn't approve the cost to get it serviced even though you've been asking for it for more than 6 months. You also know with this high temp event, you're going to have an increased rate of hard drive failures over the next year.

                    No thank you.

                    C This user is from outside of this forum
                    C This user is from outside of this forum
                    corsicanguppy@lemmy.ca
                    wrote last edited by
                    #10

                    There's a huge gulf between pub clowd and shitty on-prem. My daytime contract is with an organization almost completely on-prem for privacy, although on-prem to them means priv-cloud. Space has been rented. Redundant everything piped in. Redundant everything set up. We run VMs by terraform. Wheeeeee

                    Point is, posing shitty on-prem as the alternative to the clowd is moving the goalposts a bit.

                    P 1 Reply Last reply
                    0
                    • C corsicanguppy@lemmy.ca

                      There's a huge gulf between pub clowd and shitty on-prem. My daytime contract is with an organization almost completely on-prem for privacy, although on-prem to them means priv-cloud. Space has been rented. Redundant everything piped in. Redundant everything set up. We run VMs by terraform. Wheeeeee

                      Point is, posing shitty on-prem as the alternative to the clowd is moving the goalposts a bit.

                      P This user is from outside of this forum
                      P This user is from outside of this forum
                      partial_accumen@lemmy.world
                      wrote last edited by
                      #11

                      There’s a huge gulf between pub clowd and shitty on-prem.

                      We agree on this.

                      Redundant everything piped in. Redundant everything set up. We run VMs by terraform. Wheeeeee

                      For that customer of yours, is that a single datacenter or does is represent multiple datacenters separated by a large distance across a nation, or perhaps even across national borders?

                      Point is, posing shitty on-prem as the alternative to the clowd is moving the goalposts a bit.

                      I think ignoring that shitty on-prem represented a large part of IT infrastructure prior cloud providers is ignoring a critical point. Was it possible to have well-run enterprise IT data centers prior to cloud? Sure. Was everyone doing that? Absolutely not, I'd argue the majority had at least a certain level of jank in their infra and that that floor is raised with cloud providers. Just the basic facilities is enterprise grade irrespective of the server or app config.

                      1 Reply Last reply
                      0
                      Reply
                      • Reply as topic
                      Log in to reply
                      • Oldest to Newest
                      • Newest to Oldest
                      • Most Votes


                      • Login

                      • Don't have an account? Register

                      • Login or register to search.
                      • First post
                        Last post
                      0
                      • Categories
                      • Recent
                      • Tags
                      • Popular
                      • World
                      • Users
                      • Groups