Message from JavaScript discussions
February 2018
— Well, using json you'd have to load it all into node at once first
But yeah, that's the idea, using a simpler format you can load the records one-at-a-time, and write each to the response stream
— That makes it possible to send 1M records without ever keeping 1M in memory at once
— You'll be receiving data from DB and at the same time writing data to the response stream
— Pumping it through
— Woaa.. That sounds awesome.. I need learn these things deeper.. Do you have any recommendations for reading materials?
— Https://nodejs.org/api/ is a must
— Also the book Node.js Design Patterns
— Also ^
— (For general language stuff, also some node stuff there)
— Streams aren't that difficult, and since you're already familiar with another programming language, the node docs should be pretty readable for you
— Yea.. I have developed a few apps with node for the past year as practice since am still a university student, but I don't have that 1st hand experience with real data and such stuff.. It's just doing simple classroom projects and having say 10 or 20 records in the dB.. So topics like streaming of data sounds new