Stream: bulk data
Topic: Avro
Grahame Grieve (Mar 14 2018 at 19:10):
FYI: GF#15775
Jeff Graham (May 02 2018 at 14:38):
Agree that we should evolve from ndjson to avro. This will also facilitate moving to stream processing.
Josh Mandel (May 02 2018 at 14:49):
Evolve meaning "eventually we should drop ndjson" or "eventually we should support multiple formats"?
Jeff Graham (May 02 2018 at 14:57):
The latter. Totally agree with starting with ndjson, but you'll quickly run out of runway when dealing with larger populations.
Josh Mandel (May 02 2018 at 14:57):
Thanks!
Grahame Grieve (May 06 2018 at 03:58):
jeff- why Avro and not parquet?
Last updated: Apr 12 2022 at 19:14 UTC
