<html>
<head>
<meta content="text/html; charset=ISO-8859-1"
http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<div class="moz-cite-prefix">Hi Michael,<br>
<br>
It happens automatically. See NEWS for v1.9.2 :<br>
<br>
<meta http-equiv="content-type" content="text/html;
charset=ISO-8859-1">
<pre style="margin: 0px 0px 1em; padding: 0px; font-family: monospace; line-height: 11.050000190734863px; color: rgb(0, 0, 0); font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: left; text-indent: 0px; text-transform: none; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: rgb(255, 255, 255);">o New optimization: GForce. Rather than grouping the data, the group locations are passed into
grouped versions of sum and mean (gsum and gmean) which then compute the result for all groups
in a single sequential pass through the column for cache efficiency. Further, since the g*
function is called just once, we don't need to find ways to speed up calling sum or mean
repetitively for each group. Plan is to add gmin, gmax, gsd, gprod, gwhich.min and gwhich.max.
Examples where GForce applies now :
DT[,sum(x,na.rm=),by=...] # yes
DT[,list(sum(x,na.rm=),mean(y,na.rm=)),by=...] # yes
DT[,lapply(.SD,sum,na.rm=),by=...] # yes
DT[,list(sum(x),min(y)),by=...] # no. gmin not yet available, only sum and mean so far.
GForce is a level 2 optimization. To turn it off: options(datatable.optimize=1)
Reminder: to see the optimizations and other info, set verbose=TRUE
</pre>
Matt<br>
<br>
On 12/06/14 03:44, Michael Smith wrote:<br>
</div>
<blockquote cite="mid:539913F4.2090102@gmail.com" type="cite">
<pre wrap="">Hi Matt,
You mention GForce in your slides. Is this something that happens behind
the scenes, or is it something the user should take care of? (I couldn't
find it in the current docs.)
Thanks,
M
On 06/12/2014 04:22 AM, Matt Dowle wrote:
</pre>
<blockquote type="cite">
<pre wrap="">
Draft slides are now online for the 3 hour data.table tutorial at useR!
on Monday 30 June.
user2014.stat.ucla.edu/#tutorials
Is there something fundamental that you wished had been explained in a
tutorial like this? If so, please let me know.
I'm doing another of these long tutorials, jointly with Arun, in London
on Monday 15th September :
<a class="moz-txt-link-freetext" href="http://www.earl-conference.com/Speakers/Workshop1_DataTable.html">http://www.earl-conference.com/Speakers/Workshop1_DataTable.html</a>
Matt
_______________________________________________
datatable-help mailing list
<a class="moz-txt-link-abbreviated" href="mailto:datatable-help@lists.r-forge.r-project.org">datatable-help@lists.r-forge.r-project.org</a>
<a class="moz-txt-link-freetext" href="https://lists.r-forge.r-project.org/cgi-bin/mailman/listinfo/datatable-help">https://lists.r-forge.r-project.org/cgi-bin/mailman/listinfo/datatable-help</a>
</pre>
</blockquote>
<pre wrap="">
</pre>
</blockquote>
<br>
</body>
</html>