Photo by Chris Peeters from Pexels

vroom

When reading it uses a quick initial indexing step, then reads the values lazily ,so only the data you actually use needs to be read. The writer formats the data in parallel and writes to disk asynchronously from formatting.

vroom excels at text heavy datasets, in some cases exceeding 1 Gb per second reading time on commodity laptops.

Avatar
Jim Hester
Software Engineer

I'm a Software Engineer at RStudio and R package developer.

Posts

A tour of the recently released vroom package (http://vroom.r-lib.org/)

Today I am going to be submitting my vroom package to CRAN, so I thought it would be fun to do it as a live demo.

Talks

File import in R could be considered a solved problem, with multiple widely used packages (data.table, readr, and others) providing …

File import in R could be considered a solved problem, with multiple widely used packages (data.table, readr, and others) providing …