<html><head></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">Thanks Renaud,<div><br></div><div>Turning shared memory off seems to work. The following was run in the Mac terminal. The run with the error was copied from yesterday's screen output. The run that follows is from today. I'm happy to work with you offline (or on line) to clarify what's happening on OS X, or to make a binary Mac package. Just let me know what I can do. </div><div><br></div><div><div>> res <- nmf(esGolub,3,seed=123456,nrun=5,.options='v')</div><div>NMF algorithm: 'brunet'</div><div>Multiple runs: 5</div><div>Mode: parallel (7/8 core(s))</div><div>Runs: |==================================================| 100%</div><div>Error: NMF::nmf - 5/5 fit(s) threw an error.</div><div><font class="Apple-style-span" color="#ff4013"># Error(s) thrown:</font></div><div><font class="Apple-style-span" color="#ff4013"> - run #1: Fatal error in attach: big.matrix could not be attached.</font></div><div><font class="Apple-style-span" color="#ff4013">Timing stopped at: 13.673 0.579 4.927 </font></div><div><br></div><div>> nmf.options(shared.memory=FALSE)</div><div>> res <- nmf(esGolub,3,seed=123456,nrun=5,.options='v')</div><div>NMF algorithm: 'brunet'</div><div>Multiple runs: 5</div><div>Mode: parallel (7/8 core(s))</div><div>Runs: |==================================================| 100%</div><div>System time:</div><div> user system elapsed </div><div> 12.603 0.576 4.540 </div><div><br></div><div><div>> sessionInfo()</div><div>R version 3.0.0 (2013-04-03)</div><div>Platform: x86_64-apple-darwin10.8.0 (64-bit)</div><div><br></div><div>locale:</div><div>[1] en_CA.UTF-8/en_CA.UTF-8/en_CA.UTF-8/C/en_CA.UTF-8/en_CA.UTF-8</div><div><br></div><div>attached base packages:</div><div>[1] parallel grid stats graphics grDevices utils datasets </div><div>[8] methods base </div><div><br></div><div>other attached packages:</div><div> [1] doParallel_1.0.1 iterators_1.0.6 foreach_1.4.0 </div><div> [4] RColorBrewer_1.0-5 NMF_0.16.2 synchronicity_1.1.0</div><div> [7] bigmemory_4.4.3 BH_1.51.0-0 bigmemory.sri_0.1.2</div><div>[10] Biobase_2.20.0 BiocGenerics_0.6.0 digest_0.6.3 </div><div>[13] rngtools_1.2 pkgmaker_0.15.2 registry_0.2 </div><div><br></div><div>loaded via a namespace (and not attached):</div><div>[1] codetools_0.2-8 colorspace_1.2-1 compiler_3.0.0 gridBase_0.4-6 </div><div>[5] stringr_0.6.2 tools_3.0.0 xtable_1.7-1 </div></div><div><br></div><div>G</div><div apple-content-edited="true">
<div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">--</div><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">Gordon Robertson<br>Michael Smith Genome Sciences Centre</div><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">BC Cancer Agency<br>Vancouver BC Canada<br><a href="http://www.bcgsc.ca">www.bcgsc.ca</a><br><br></div></div>
</div>
<br><div><div>On 2013-04-07, at 12:58 AM, Renaud Gaujoux wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite"><div dir="ltr"><div><div><div><div><div><div><div><div>Hi,<br><br></div>I saw this error on CRAN's Mac check logs as well. This seems to be linked with the shared.memory feature when running parallel computations, on Mac only.<br>
I have no Mac to thoroughly check and asked the author of bigmemory to see if he could reproduce the error: he could not when running the example in an R console, but got an error when running the checks.<br></div>So this will need further investigations.<br>
<br></div>Did you reinstall all packages, specially bigmemory, after upgrading to R-3.0.0?<br><br></div>You should still be able to run parallel computations but disabling shared.memory by:<br><br></div>nmf.options(shared.memory=FALSE)<br>
<br></div>If you do not want to remember/type this every time you load NMF, you could simply uninstall the synchronicity package, which you probably do not need otherwise. The shared memory feature will then be disabled for good.<br>
<br></div>Bests,<br></div>Renaud<br><div><div><div><div><div><div><div><br><br></div></div></div></div></div></div></div></div><div class="gmail_extra"><br><br><div class="gmail_quote">2013/4/7 Gordon Robertson <span dir="ltr"><<a href="mailto:grobertson@bcgsc.ca" target="_blank">grobertson@bcgsc.ca</a>></span><br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word"><div>Renaud,</div><div><br></div>With R 3.0.0, I get an error when I try to run a test. I'm likely missing something simple. Could you help me resolve this?<div>
<br></div><div><div>> library(NMF)</div><div>Loading required package: pkgmaker</div><div>Loading required package: registry</div><div><br></div><div>Attaching package: ‘pkgmaker’</div><div><br></div><div>The following object is masked from ‘package:utils’:</div>
<div><br></div><div> packageName</div><div><br></div><div>Loading required package: rngtools</div><div>Loading required package: digest</div><div>Loading required package: grid</div><div>NMF - BioConductor layer [OK] | Shared memory capabilities [OK] | Cores 7/8</div>
<div>> library(RColorBrewer)</div><div>> n <- 100; counts <- c(10, 5, 8); p <- sum(counts) </div><div>> V <- syntheticNMF(n, counts, noise=TRUE)</div><div>> groups <- as.factor(do.call('c', lapply(seq(3), function(x) rep(x, counts[x]))))</div>
<div>> res <- nmf(V, 3, nrun=100)</div><div><font color="#db5127">Error: NMF::nmf - 100/100 fit(s) threw an error.</font></div><div><font color="#db5127"># Error(s) thrown:</font></div><div><font color="#db5127"> - run #1: Fatal error in attach: big.matrix could not be attached.</font></div>
<div>Timing stopped at: 31.804 1.025 5.987 </div><div><br></div><div>> sessionInfo()</div><div>R version 3.0.0 (2013-04-03)</div><div>Platform: x86_64-apple-darwin10.8.0 (64-bit)</div><div><br></div><div>locale:</div><div>
[1] en_CA.UTF-8/en_CA.UTF-8/en_CA.UTF-8/C/en_CA.UTF-8/en_CA.UTF-8</div><div><br></div><div>attached base packages:</div><div>[1] parallel grid stats graphics grDevices utils datasets </div><div>[8] methods base </div>
<div><br></div><div>other attached packages:</div><div> [1] doParallel_1.0.1 iterators_1.0.6 foreach_1.4.0 </div><div> [4] RColorBrewer_1.0-5 NMF_0.16.2 synchronicity_1.1.0</div><div> [7] bigmemory_4.4.3 BH_1.51.0-0 bigmemory.sri_0.1.2</div>
<div>[10] Biobase_2.20.0 BiocGenerics_0.6.0 digest_0.6.3 </div><div>[13] rngtools_1.2 pkgmaker_0.15.2 registry_0.2 </div><div><br></div><div>loaded via a namespace (and not attached):</div><div>
[1] codetools_0.2-8 colorspace_1.2-1 compiler_3.0.0 gridBase_0.4-6 </div><div>[5] stringr_0.6.2 xtable_1.7-1 </div><div><br></div><div>--</div><div>I'm able to run simple jobs. </div><div><div>> x <- rmatrix(20,10)</div>
<div>> res <- nmf(x, 2)</div><div>> res <- nmf(x, 2, 'lee')</div><div><br></div></div><div>--</div><div>But possibly larger jobs hit the error?</div><div><div>> data(esGolub)</div><div>> res <- nmf(esGolub,3,seed=123456)</div>
<div>> res <- nmf(esGolub,3,seed=123456,nrun=20)</div><div><font color="#db5127">Error: NMF::nmf - 20/20 fit(s) threw an error.</font></div><div><font color="#db5127"># Error(s) thrown:</font></div><div><font color="#db5127"> - run #1: Fatal error in attach: big.matrix could not be attached.</font></div>
<div>Timing stopped at: 71.596 1.011 14.788 </div><div><div><br></div><div>> res <- nmf(esGolub,3,seed=123456,nrun=5,.options='v')</div><div>NMF algorithm: 'brunet'</div><div>Multiple runs: 5</div><div>
Mode: parallel (7/8 core(s))</div><div>Runs: |==================================================| 100%</div><div><font color="#c03917">Error: NMF::nmf - 5/5 fit(s) threw an error.</font></div><div><font color="#c03917"># Error(s) thrown:</font></div>
<div><font color="#c03917"> - run #1: Fatal error in attach: big.matrix could not be attached.</font></div><div>Timing stopped at: 13.673 0.579 4.927 </div></div></div><div><br></div><div><br></div><div>Thank you,</div><div>
<br></div><div>G</div><div>
<div style="word-wrap:break-word"><div style="word-wrap:break-word">--</div><div style="word-wrap:break-word">Gordon Robertson<br>Michael Smith Genome Sciences Centre</div><div style="word-wrap:break-word">BC Cancer Agency<br>
Vancouver BC Canada<br><a href="http://www.bcgsc.ca/" target="_blank">www.bcgsc.ca</a><br><br></div></div>
</div>
<br><div><div>On 2013-04-06, at 12:47 PM, Gordon Robertson wrote:</div><br><blockquote type="cite"><div style="word-wrap:break-word">Hi Renaud,<div><br></div><div>I thought I'd send these notes on the chance that they'd be helpful to others. I installed NMF, but have not yet run it. The one thing that was a bit odd is the warning (...is not available (for R version 3.0.0)). </div>
<div><br></div><div>I've been using v0.9 for some time on R v2.15.x, on OS X 10.7.5. Today I updated R to v3.0.0, and got an error message when installing from the v0.9 .tgz from the latest RStudio (which is how I'd installed NMF on v2.15.x). </div>
<div><br></div><div>RStudio did not recognize that v0.16.2 was available at CRAN (seeing only NMFN available, but not NMF), and after trying to install a few .tar.gz versions from your CRAN-like web page (but failing to achieve a loadable library), a Google search suggested I look at CRAN. From there I downloaded v0.16.2's tar.gz, and installed it from RStudio's GUI installer. All seemed OK. </div>
<div><div><br></div><div>> install.packages("~/software/clustering/NMF/R/NMF/v0.16.2/NMF_0.16.2.tar.gz", repos = NULL, type = "source")</div><div><font color="#db5127">Warning in install.packages :</font></div>
<div><font color="#db5127"> package ‘~/software/clustering/NMF/R/NMF/v0.16.2/NMF_0.16.2.tar.gz’ is not available (for R version 3.0.0)</font></div></div><div>...</div><div><div>> library(NMF)</div><div>Loading required package: pkgmaker</div>
<div>Loading required package: registry</div><div><br></div><div>Attaching package: ‘pkgmaker’</div><div><br></div><div>The following object is masked from ‘package:utils’:</div><div><br></div><div> packageName</div><div>
<br></div><div>Loading required package: rngtools</div><div>Loading required package: digest</div><div>Loading required package: grid</div><div>NMF - BioConductor layer [OK] | Shared memory capabilities [NO: synchronicity] | Cores 7/8</div>
<div> To enable shared memory capabilities, try: install.extras('NMF')</div><div><br></div><div>> install.extras('NMF')</div><div>Loaded extra package: bigmemory</div><div>trying URL '<a href="http://cran.stat.sfu.ca/bin/macosx/contrib/3.0/synchronicity_1.1.0.tgz'" target="_blank">http://cran.stat.sfu.ca/bin/macosx/contrib/3.0/synchronicity_1.1.0.tgz'</a></div>
<div>Content type 'application/x-gzip' length 206844 bytes (201 Kb)</div><div>opened URL</div><div>==================================================</div><div>downloaded 201 Kb</div><div><br></div><div><br></div>
<div>The downloaded binary packages are in</div><div><span style="white-space:pre-wrap"> </span>/var/folders/x5/l6f5m2j91vdd99wy2gchtld40000gn/T//RtmpLXt3yC/downloaded_packages</div><div>Loading required package: synchronicity</div>
<div>Loaded extra package: Biobase</div></div><div><br></div><div><div>> sessionInfo()</div><div>R version 3.0.0 (2013-04-03)</div><div>Platform: x86_64-apple-darwin10.8.0 (64-bit)</div><div><br></div><div>locale:</div>
<div>[1] en_CA.UTF-8/en_CA.UTF-8/en_CA.UTF-8/C/en_CA.UTF-8/en_CA.UTF-8</div><div><br></div><div>attached base packages:</div><div>[1] parallel grid stats graphics grDevices utils datasets methods base </div>
<div><br></div><div>other attached packages:</div><div> [1] synchronicity_1.1.0 NMF_0.16.2 bigmemory_4.4.3 BH_1.51.0-0 bigmemory.sri_0.1.2 </div><div> [6] Biobase_2.20.0 BiocGenerics_0.6.0 digest_0.6.3 rngtools_1.2 pkgmaker_0.15.2 </div>
<div>[11] registry_0.2 BiocInstaller_1.10.0</div><div><br></div><div>loaded via a namespace (and not attached):</div><div> [1] codetools_0.2-8 colorspace_1.2-1 doParallel_1.0.1 foreach_1.4.0 gridBase_0.4-6 </div>
<div> [6] iterators_1.0.6 RColorBrewer_1.0-5 stringr_0.6.2 tools_3.0.0 xtable_1.7-1 </div></div><div><br></div><div><br></div><div>Gordon<span class="HOEnZb"><font color="#888888"><br><div>
<div style="word-wrap:break-word"><div style="word-wrap:break-word">--</div><div style="word-wrap:break-word">Gordon Robertson<br>Michael Smith Genome Sciences Centre</div><div style="word-wrap:break-word">BC Cancer Agency<br>
Vancouver BC Canada<br><a href="http://www.bcgsc.ca/" target="_blank">www.bcgsc.ca</a><br><br></div></div>
</div>
<br></font></span></div></div></blockquote></div><br></div></div><br>_______________________________________________<br>
nmf-user mailing list<br>
<a href="mailto:nmf-user@lists.r-forge.r-project.org">nmf-user@lists.r-forge.r-project.org</a><br>
<a href="https://lists.r-forge.r-project.org/cgi-bin/mailman/listinfo/nmf-user" target="_blank">https://lists.r-forge.r-project.org/cgi-bin/mailman/listinfo/nmf-user</a><br></blockquote></div><br><br clear="all"><br>-- <br>
<pre cols="72">Renaud Gaujoux
Computational Biology - University of Cape Town
South Africa</pre>
</div>
</blockquote></div><br></div></body></html>