Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (Darkly)
  • No Skin
Collapse

Chebucto Regional Softball Club

  1. Home
  2. Uncategorized
  3. Here is a good overview on trends in datacenters.
A forum for discussing and organizing recreational softball and baseball games and leagues in the greater Halifax area.

Here is a good overview on trends in datacenters.

Scheduled Pinned Locked Moved Uncategorized
16 Posts 4 Posters 0 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • myrmepropagandistF myrmepropagandist

    Here is a good overview on trends in datacenters. (Did you know they are planning on firing up 3 mile island again? Truly, we live in a 1970s revival)

    myrmepropagandistF This user is from outside of this forum
    myrmepropagandistF This user is from outside of this forum
    myrmepropagandist
    wrote last edited by
    #2

    Another overlapping perspective. There is an AI bubble. The "High Yield" video makes these data centers sound inevitable and unstoppable. But, what if all of this infrastructure isn't really producing any value? Or enough value?

    OpenAI has only a handful of customers and most of them are using it to do their homework for them. We discussed "Vibe Coding" last week and no one can agree on if it saves any time or not.

    Ed Zitro makes the case for the bubble on MR.

    myrmepropagandistF 🚲D 2 Replies Last reply
    0
    • myrmepropagandistF myrmepropagandist

      Another overlapping perspective. There is an AI bubble. The "High Yield" video makes these data centers sound inevitable and unstoppable. But, what if all of this infrastructure isn't really producing any value? Or enough value?

      OpenAI has only a handful of customers and most of them are using it to do their homework for them. We discussed "Vibe Coding" last week and no one can agree on if it saves any time or not.

      Ed Zitro makes the case for the bubble on MR.

      myrmepropagandistF This user is from outside of this forum
      myrmepropagandistF This user is from outside of this forum
      myrmepropagandist
      wrote last edited by
      #3

      i am the goblin who eats the homework feed me! nom nom nom

      Hugo MillsD 1 Reply Last reply
      0
      • myrmepropagandistF myrmepropagandist

        i am the goblin who eats the homework feed me! nom nom nom

        Hugo MillsD This user is from outside of this forum
        Hugo MillsD This user is from outside of this forum
        Hugo Mills
        wrote last edited by
        #4

        @futurebird Unfortunately, you are also the goblin who has to mark the homework.

        myrmepropagandistF 1 Reply Last reply
        0
        • Hugo MillsD Hugo Mills

          @futurebird Unfortunately, you are also the goblin who has to mark the homework.

          myrmepropagandistF This user is from outside of this forum
          myrmepropagandistF This user is from outside of this forum
          myrmepropagandist
          wrote last edited by
          #5

          @darkling

          yeah... 😕

          1 Reply Last reply
          0
          • myrmepropagandistF myrmepropagandist

            Another overlapping perspective. There is an AI bubble. The "High Yield" video makes these data centers sound inevitable and unstoppable. But, what if all of this infrastructure isn't really producing any value? Or enough value?

            OpenAI has only a handful of customers and most of them are using it to do their homework for them. We discussed "Vibe Coding" last week and no one can agree on if it saves any time or not.

            Ed Zitro makes the case for the bubble on MR.

            🚲D This user is from outside of this forum
            🚲D This user is from outside of this forum
            🚲
            wrote last edited by
            #6

            @futurebird OpenAI only has a handful of customers? Loooots of companies building them in as a core part of their stack these days (which is itself terrifying on several levels).

            myrmepropagandistF 1 Reply Last reply
            0
            • 🚲D 🚲

              @futurebird OpenAI only has a handful of customers? Loooots of companies building them in as a core part of their stack these days (which is itself terrifying on several levels).

              myrmepropagandistF This user is from outside of this forum
              myrmepropagandistF This user is from outside of this forum
              myrmepropagandist
              wrote last edited by
              #7

              @dx

              Compared to the level of investment there just aren't as many people diving in. And some who dive in will find out it's not doing much and pull out.

              🚲D 1 Reply Last reply
              0
              • myrmepropagandistF myrmepropagandist

                @dx

                Compared to the level of investment there just aren't as many people diving in. And some who dive in will find out it's not doing much and pull out.

                🚲D This user is from outside of this forum
                🚲D This user is from outside of this forum
                🚲
                wrote last edited by
                #8

                @futurebird That’s fair. I think there is a bubble. But OpenAI calls are getting tossed into all sorts of software these days. Not to mention the large swath of startups that are basically just wrappers on top of OpenAI

                myrmepropagandistF 1 Reply Last reply
                0
                • 🚲D 🚲

                  @futurebird That’s fair. I think there is a bubble. But OpenAI calls are getting tossed into all sorts of software these days. Not to mention the large swath of startups that are basically just wrappers on top of OpenAI

                  myrmepropagandistF This user is from outside of this forum
                  myrmepropagandistF This user is from outside of this forum
                  myrmepropagandist
                  wrote last edited by
                  #9

                  @dx

                  what happens when they raise the price? are they indispensable? or all these things "chat bots" that try to talk to you while you use a website that could be easily scrapped?

                  🚲D 1 Reply Last reply
                  0
                  • myrmepropagandistF myrmepropagandist

                    @dx

                    what happens when they raise the price? are they indispensable? or all these things "chat bots" that try to talk to you while you use a website that could be easily scrapped?

                    🚲D This user is from outside of this forum
                    🚲D This user is from outside of this forum
                    🚲
                    wrote last edited by
                    #10

                    @futurebird They’re mostly *not* chatbots. They’re mostly stuff like “look through this data and pull out these parts and format it as a json file”

                    🚲D myrmepropagandistF 2 Replies Last reply
                    0
                    • 🚲D 🚲

                      @futurebird They’re mostly *not* chatbots. They’re mostly stuff like “look through this data and pull out these parts and format it as a json file”

                      🚲D This user is from outside of this forum
                      🚲D This user is from outside of this forum
                      🚲
                      wrote last edited by
                      #11

                      @futurebird The expectation among c levels is that prices will fall, not rise.

                      myrmepropagandistF 1 Reply Last reply
                      0
                      • 🚲D 🚲

                        @futurebird They’re mostly *not* chatbots. They’re mostly stuff like “look through this data and pull out these parts and format it as a json file”

                        myrmepropagandistF This user is from outside of this forum
                        myrmepropagandistF This user is from outside of this forum
                        myrmepropagandist
                        wrote last edited by
                        #12

                        @dx

                        Is that what’s making all the terrible websites that come up in search?

                        1 Reply Last reply
                        0
                        • 🚲D 🚲

                          @futurebird The expectation among c levels is that prices will fall, not rise.

                          myrmepropagandistF This user is from outside of this forum
                          myrmepropagandistF This user is from outside of this forum
                          myrmepropagandist
                          wrote last edited by
                          #13

                          @dx

                          I am but a simple school teacher, so perhaps I’m missing something these businesses-folk see that I do not— however: why do they think the price would go down? I thought this stage of the AI business model was like the early days of uber and amazon wherein they corner the market, addict the consumer and then the hammer comes down and big profits emerge (or not)

                          🚲D 1 Reply Last reply
                          0
                          • myrmepropagandistF myrmepropagandist

                            @dx

                            I am but a simple school teacher, so perhaps I’m missing something these businesses-folk see that I do not— however: why do they think the price would go down? I thought this stage of the AI business model was like the early days of uber and amazon wherein they corner the market, addict the consumer and then the hammer comes down and big profits emerge (or not)

                            🚲D This user is from outside of this forum
                            🚲D This user is from outside of this forum
                            🚲
                            wrote last edited by
                            #14

                            @futurebird Moore’s law adjacent reasons. They expect compute to become cheaper and for models to become more efficient. In the 15 years I’ve been doing this stuff, so far this has held. Models that were too big to fit on one gpu now train easily on a normal laptop that is sipping power. The LLMs of today are inconceivably large compared to models from not that many years ago.

                            toerrorT 1 Reply Last reply
                            0
                            • 🚲D 🚲

                              @futurebird Moore’s law adjacent reasons. They expect compute to become cheaper and for models to become more efficient. In the 15 years I’ve been doing this stuff, so far this has held. Models that were too big to fit on one gpu now train easily on a normal laptop that is sipping power. The LLMs of today are inconceivably large compared to models from not that many years ago.

                              toerrorT This user is from outside of this forum
                              toerrorT This user is from outside of this forum
                              toerror
                              wrote last edited by
                              #15

                              @dx @futurebird The only thing they'll be able to retain in the new data centers they are making to run this stuff is the floor space ( if the hardware becomes obsolete ) , so at the very least, most of the current investment has to be paid for in addition to the new moore's lawed hardware before they can reach profitability. Assuming that it is indeed possible to scale the processor capabilities without linearly increasing costs.

                              🚲D 1 Reply Last reply
                              0
                              • toerrorT toerror

                                @dx @futurebird The only thing they'll be able to retain in the new data centers they are making to run this stuff is the floor space ( if the hardware becomes obsolete ) , so at the very least, most of the current investment has to be paid for in addition to the new moore's lawed hardware before they can reach profitability. Assuming that it is indeed possible to scale the processor capabilities without linearly increasing costs.

                                🚲D This user is from outside of this forum
                                🚲D This user is from outside of this forum
                                🚲
                                wrote last edited by
                                #16

                                @toerror @futurebird To be clear, I do think a bubble is coming. I think the data centre investment is *insane*. But it’s important to understand these models are not merely being used for end user applications like chat and code completion. They are absolutely getting integrated into major features. It makes me skin crawl that folks wiring in a 3rd party api in some of the things I’ve seen, but it is happening. Many, many companies will have a reckoning if costs balloon or if OpenAI implodes.

                                1 Reply Last reply
                                0
                                • myrmepropagandistF myrmepropagandist shared this topic

                                Reply
                                • Reply as topic
                                Log in to reply
                                • Oldest to Newest
                                • Newest to Oldest
                                • Most Votes


                                • Login

                                • Don't have an account? Register

                                • Login or register to search.
                                Powered by NodeBB Contributors
                                • First post
                                  Last post
                                0
                                • Categories
                                • Recent
                                • Tags
                                • Popular
                                • World
                                • Users
                                • Groups