Convopage
See the entire conversation
DHH
@dhh
Programmers worrying about whether their architecture will Web Scale is like buying a lottery coupon and fretting about which yacht to buy.
71 replies and sub-replies as of Jul 13 2017
Aye!
@YungAmazing
Strong advocates of the Law of attraction lol
Russ Peterson
@internetoftubes
Clients are also guilty of this - worrying if their totally new & unheard of platform will cope with the 100k users that they don't have yet
Devlob
@devlob
This is so true. You are wise!
Owen Cooney
@owencooney
When you scale, it's because you're prepared, there's no need to worry! If you're worried, don't, because you won't scale until u prepare
Marvin Ferreira
@marvinferreira
OMG! The best of the day.
Ioan Vancea
@vio4n
programmers NEVER worry about being webscale. If it works on their workstation it will work anywhere ;)
Daniel Levy
@justsml
Don't fret, just use
#FunctionalJavaScript
, immutable data, and promise.then(buyYacht) to unlock
#FutureScale
😂
The Almikey
@TheAlmikey
given that a post on reddit can bring a flash mob,isn't it worthwhile to have proper skills to milk them.With awareness attention is fickle
The Almikey
@TheAlmikey
especially with how some things are ephemeral like calls to action like the present net neutrality thing, fads, games-they still matter
The Almikey
@TheAlmikey
i don't think it's crazy with market entrance being so hard to enter coz of the big fish
tinyurl.com/y986xjky
whose main weapon is scale
The end of the internet startup
We haven't had a major new technology company in more than 10 years.
vox.com
Nate Berkopec
@nateberkopec
front paged on Reddit, HN and Product Hunt simultaneously last week and peaked at 10 pageviews/sec. Social traffic isn't that big
Nate Berkopec
@nateberkopec
Also he did it with PHP *shudder*
Pieter Levels @ 🇺🇸
@levelsio
Yep, this week I was
@ProductHunt
#1,
@newsyc
#1 and
@reddit
frontpage with
hoodmaps.com
; it was 3 page requests per second max
Hoodmaps 🗺 Neighborhood Maps
hoodmaps.com
Pieter Levels @ 🇺🇸
@levelsio
Making pages static kept the site up. Took 5 mins to write script that generated cached pages. One-man-band!
Pieter Levels @ 🇺🇸
@levelsio
For reference: a properly configured VPS can do 1M reqs/s
Khoa Nguyen
@khoanguyenme
Do you serve it with nginx/apache directly or it has to go through php level? I love to hear more
Pieter Levels @ 🇺🇸
@levelsio
First served NGINX -> PHP then too many requests cuz
@reddit
frontpage, then cached PHP > HTML, then NGINX -> HTML fast
Khoa Nguyen
@khoanguyenme
Yup. That is what I have in mind if I ever need to serve that much traffic, thank you
Julian B
@MrJulianB
Think this is a big key: ensure the server is configured to handle the requests.
Julian B
@MrJulianB
Most Aus sites/providers I've seen the back end of aren't ready to handle a Reddit load because they haven't experienced near those numbers.
Denis Duster
@dusterio
1M as in one million right? One TCP server cannot serve this many by design
Denis
@DenisOne
returning 502 Bad Gateway and stuck at loading as we speak
Aleksandr Kopelevitc
@kopelevitch
Yep. Same here.
The Almikey
@TheAlmikey
wow😅
The Almikey
@TheAlmikey
i think i may be misinformed by some articles i've come across about sites crashing under heavy load due to sudden hype
Pieter Levels @ 🇺🇸
@levelsio
They do crash under sudden load. That's why most sites don't even reach
@reddit
frontpage. But making site static HTML quickly fixes it!
Nate Berkopec
@nateberkopec
Yeah it's the gradient, not the total load. Scaling w/in minutes requires horizontal scaling & shared-nothing architecture, like Rails.
Christopher Pedersen
@CrispyTx87
The Hyperion, obviously.
Michael Hill
@orffy
Depends on where they work
BearLOL
@bearlolol
exactly. code now and get it working. when you run into scaling issues (a good problem to have), get funding and hire ppl to scale it.
The Big K
@thebigk
$this
technical navigator
@agile_geek
I think there's a difference between over engineering for scale prematurely & making design decisions that don't paint u into a corner later
Ray ((Frankenstein))
@agileklzkittens
The slowest software is the one that no one wants to use.
mmccaff
@mmccaff
Although it's good to be aware of potential problems. The art is spending the right amount of time on the right problems at the right time.
mmccaff
@mmccaff
That said I agree, in general many devs would be better off if they could let go of fear of things that 99.99% likely will not happen.
yopolymer
@yopolymer
a guy failed to withdraw his winning bcz of citizenship. Had he declared two weeks later money would have been in his account
Sash Zats
@zats
Do you agree Peter?🙂
Peter Steinberger
@steipete
Yeap. Been there made that mistake.
Sash Zats
@zats
to make sure I understand was that an argument for "worrying about architecture once you have a problem?"
Shai Mishali
@freak4pc
This seems to be for "if you're big enough to worry about scale, you can figure out the 'perfect' architecture later". But I don't ...
Shai Mishali
@freak4pc
... agree with this totally. If you can, be good as possible to begin with. But not at the cost of time waste if it's just a PoC, forexample
Sash Zats
@zats
seems reasonable, that's why I wanted to make sure I understand the author :)
Patrick Dockhorn
@panondo
You build for today's customers first and worry about tomorrow's customer tomorrow. No point scaling a dead sheep.
Machiel KG 🖖🏻
@machielg
Wise words
@panondo
. Also you don't know the bottlenecks you'll have at that time. Could be in a part you didn't event build yet
Alan Cohen
@acexperience
Especially in the prototype phase. If / when it's time to scale, you should be able to hire the correct team.
Alex Forbes-Reed
@0xdeafcafe
Until you get to the stage where you do need to scale and have to spend 6-12 months re-writing everything out of RoR.
Alfonso Adriasola
@aadriasola
when it's time, know ye that rails can be made to grow huge. dcos mesos docker containers yes rails can run there too
Miracle Anyanwu
@PolymathWhiz
A lot of people do this! Doing an overkill of tech for a platform of 20 people!
David Becerra
@DavidVII
I feel that programmers worrying about web scale are more like that one pig who used brick to build his house.
David Granado
@DavidGranado
That's preparing for a known, likely situation. This would be more like if he built a nuke bunker when he only had a wolf to worry about.
David Becerra
@DavidVII
Things are only as complicated as you want them to be. You can prepare for a level of scale without having to prepare for the worst case.
David Granado
@DavidGranado
That's the point, right? Someone who is starting something from scratch and preparing for Facebook-level traffic is likely wasting time.
Andrey Savchenko
@Rarst
literally put it in the FAQs now... :)
Rarst/release-belt
release-belt - Composer repository for ZIPs
github.com
Diego R. B.
@DiegoRBaquero
(No comment)
Bry Davidson
@BrysonDave
I CAN DREAM CANT I
Diogo Machado
@diogojoma
tell that to that pokemon guys = )
Sorin Gheata
@invisioner
What kind of programmers are we talking about here? It actually matters.
Jan Vissers
@Jan_Vissers
+1 for Sorin. Context matters here (as usual)
Max Schumacher
@mxschumacher
rewatched this recently, straight to the point:
Episode 1 - Mongo DB Is Web Scale
Q&A discussion discussing the merits of No SQL and relational databases.
youtube.com
dawehner
@da_wehner
I like though how people worry about maintenance costs as well, and sometimes having smaller services for example helps with that.
Walker Kinne
@wkinne0425
This is really really good!
Σͷriϕuξ M. τλlλverλ
@kiquetal
(No comment)
Esteban Utz
@estebanutz
TRUE! lol
Andrew Shatnyy
@AndrewShatnyy
The fucked up part is: almost every startup with 0 customers now interviews devs like they already have 1m rps.
Matt Newell
@matthewnewell
Wait, I spend a lot of time fretting about which lotto yacht to buy. Is that not normal? Maybe I'm just a boat person ...
Machiel KG 🖖🏻
@machielg
Programmers have no idea what a shitload of traffic you can serve from a single box.
Sean Roberts
@DevelopSean
Fwiw, there is a major difference between having scalable arch out the gate and not coding yourself in a corner for the future/having a plan
M
@khun_emz
They are worrying about which programming language is the best one !!
Mark Imbriaco
@markimbriaco
And they bought the lottery ticket with a credit card.
Allen Xavier Romero
@romerotron
i love that thought! ... 100% agree that unfortunately mostly wasted thoughts as never reach (or come close) to that point :/
c s meiklejohn
@cmeik
...what precisely is web scale? Sounds like an ambiguous, and dated term, that doesn't characterize what most large-scale apps are: mobile.