[datatable-help] fread for bin file?

Alan Kwan alanpaulkwan at gmail.com
Tue Aug 19 22:03:17 CEST 2014


I hope this isn't a bone-headed question in either sense of what or how I
am asking, but would it be in principle possible to adapt fread to read
fixed record binary .bin files?

I guess this is more of a feature request, although it's a help request if
someone's figured it out already.

TAQ bin files would be a major usage case, for instance. These are 60 gig
files that are usually 30-33 characters * 600M rows long.

An example would be reading a fixed record length, so imagine something like

 bidsiz<-readBin(qin,what='integer',size=4,n=1,endian='little')
  ofrsiz<-readBin(qin,what='integer',size=4,n=1,endian='little')
  mode<-readBin(qin,what='integer',size=2,n=1,endian='little')
  ex<-readBin(qin,  what='character',size=1,n=1,endian='little')

- Alan
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.r-forge.r-project.org/pipermail/datatable-help/attachments/20140819/a9c2f5e2/attachment.html>


More information about the datatable-help mailing list