Convopage
See the entire conversation
This seems to have gone mostly unnoticed.
All readable streams in Node.js v10 are async iterators. This is really, really, big deal.
for await (let c of fs.createReadStream(filename) { console.log(c) }
π₯π₯π₯π₯π₯π₯π₯π₯π₯π₯π₯
18 replies and sub-replies as of May 09 2018
minipass just got a .collect() method and ability to iterate either sync or async
npm: minipass
minimal implementation of a PassThrough stream
npmjs.com
Love it!
I even made a thing that lets you ‘pipe’ them to other streams!
twitter.com/rappidmatt/sta…
I made a @nodejs thing today, thanks to async iterators in v10.
Introducing async-stream-generator: pipe your async generators through Node.js streams!
streamify(generator(stream)).pipe(dest);
npmjs.com/package/async-…
Currently only works if it’s the first in the chain. I have a protype that turns your generator into a duplex/transform stream, but it needs a bit of polish still.
It made my day when I read about it for the first time
Hah, yes, I was exposing this in our coding channel the other day, it's super cool! Async iterators are so nice.
I’m looking for more examples of where these can be used?
Async iterators? They're pretty useful anywhere streams have been used.
The fact that Node 10 streams are magically iterators means that you can just implement things in terms of streams and get them for free w/ backwards compat.
But yeah, object streams in particular, so I'm thinking result sets from database libraries are a big obvious use case. Output from parsers too.
I’m so glad you like it ;). Can you provide some feedback on github.com/nodejs/readabl…? I’d like to remove that warning asap.
ReadableStream[Symbol.asyncIterator] path to stability · Issue #333 · nodejs/readable-stream
Hey, As after landing unhandledRejection I'd like to investigate and gather some community feedback about our API for Symbol.asyncIterator as well as identify possible problems before we make t...
github.com
In using it a ton, I'll tell you if I find any bugs :)
Experimentally, but yeah, that happened
Hmm I could use this with a data analytics assignment im working on. Wonder how it’ll handle reading a 200k line JSON file of data π€ I guess as a stream it doesn’t matter the size as long as I step through properly and close the stream when I’m done.
I'm reading millions of lines of CSV with it ;)
Omg I think im in love π
I've been trying this on HTTP requests and responses to gather their bodies, but it doesn't seem to work for them (I get back an empty string/buffer). Do some streams need special handling to make it work?
Nice! This is how I always build my streams systems. Too bad it had the overhead of supporting the legacy APis. Maybe I'll make a minimal version for people who only use the iterator interface.