<div dir="ltr"><div><div>Nice. This might be called "meta-linking." One problem that linkers solve for C++ is that<br></div>the same function may be defined more than once (because more than one source file<br>may include the header containing the definition). What happens is that weak defs are<br>
</div>written to the object files, and the linker removes the multiple defs and does not<br>complain about multiple definitions. This does not seem to be necessary with<br>meta-linking.<br></div><div class="gmail_extra"><br>
<br><div class="gmail_quote">On Tue, Oct 8, 2013 at 11:30 AM, Romain Francois <span dir="ltr"><<a href="mailto:romain@r-enthusiasts.com" target="_blank">romain@r-enthusiasts.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Le 08/10/13 17:12, Dominick Samperi a écrit :<div class="im"><br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
That is interesting Romain, but the linking complexity remains<br>
for derived packages like RcppOctave, and especially for derived<br>
packages that export their C/C++ functions to clients (unless<br>
these derived packages can also place all C++ code in header files).<br>
</blockquote>
<br></div>
Sure. There is always the issue of linking against R, etc ... but this would eliminate the need for linking against Rcpp.<br>
<br>
As for placing the client package in headers, not everything has to go there, I have e.g. some functions in Rcpp11 that are only defined in Rcpp11's .cpp file.<br>
<br>
For example:<br>
<br>
const char * type2name__impl(int sexp_type);<br>
<br>
What I've done is making it so that Rcpp11's headers calls this one instead:<br>
<br>
inline const char* type2name(int sexp_type){<br>
GET_CALLABLE(type2name__impl, sexp_type)<br>
}<br>
<br>
and all the magic is in the GET_CALLABLE macro:<br>
<br>
#if defined(COMPILING_RCPP11)<br>
#define GET_CALLABLE(__FUN__, ...) return __FUN__( __VA_ARGS__ ) ;<br>
#else<br>
#define GET_CALLABLE(__FUN__, ...) \<br>
typedef decltype(__FUN__)* Fun ; \<br>
static Fun fun = (Fun)R_GetCCallable( "Rcpp11", #__FUN__) ; \<br>
return fun(__VA_ARGS__) ;<br>
#endif<br>
<br>
So if we are compiling Rcpp11 (which is true only for .cpp files in Rcpp11), then type2name would directly call type2name__impl, otherwise we first get the function pointer with :<br>
<br>
static Fun fun = (Fun)R_GetCCallable( "Rcpp11", "type2name__impl" ) ;<br>
<br>
and then call fun.<br>
<br>
Writing this, I do realize that this in fact uses some C++11 features: variadic macros and decltype. It does not mean we could not do it in Rcpp, but it would be harder and would involve macro bloat (we would need something like GET_CALLABLE_0, GET_CALLABLE_1, GET_CALLABLE_2, ...<br>
<br>
Then, when Rcpp11 dynamic library is loaded by R, the __impl function is registered:<br>
<br>
#define REGISTER(__FUN__) R_RegisterCCallable( "Rcpp11", #__FUN__ "__impl", (DL_FUNC)__FUN__ ## __impl );<br>
<br>
REGISTER(type2name)<br>
<br>
This allows me to have all in headers and use R's mechanism for "linking". Not really linking as it just involves resolving the function pointer.<br>
<br>
I find this more maintainable than depending on each platform's linker.<br>
<br>
Anyway, just saying a client package could use something similar so that it does not have to actually link.<br>
<br>
Romain<br>
<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div class="im">
On Tue, Oct 8, 2013 at 9:58 AM, Romain Francois<br></div><div><div class="h5">
<<a href="mailto:romain@r-enthusiasts.com" target="_blank">romain@r-enthusiasts.com</a> <mailto:<a href="mailto:romain@r-enthusiasts.com" target="_blank">romain@r-enthusiasts.<u></u>com</a>>> wrote:<br>
<br>
Hello,<br>
<br>
I've only been following that thread from a distance. There is<br>
always so much I can do when it comes to windows.<br>
<br>
Anyway, in Rcpp11 I'm experimenting with completely letting go of<br>
the whole linking against the Rcpp library and all the issues it has<br>
brought to the table over the years (should it be static linking,<br>
how to call Rcpp:::LdFlags, need for a Makevars and a Makevars.win,<br>
...).<br>
<br>
With Rcpp11, the only thing you'll ever need will be: LinkingTo: Rcpp11<br>
<br>
This was made possible by moving quite a big chunk of code into<br>
headers, and for the rest using the R mechanism (R_GetCCallable,<br>
R_RegisterCCallable) as described in WRE.<br>
<br>
Now, I have no idea yet if Rcpp11 works on windows. Right now I'm<br>
fearcely developping it, so I don't have time for playing games with<br>
windows. But that time will come.<br>
<br>
None of the techniques I'm using for that are depending on C++11,<br>
which would make it possible to use the same strategy for Rcpp too.<br>
But I fear that because too many depend on the current setting<br>
(Makevars, Makevars.win, making a library and non portably link<br>
against it) it is not likely to happen.<br>
<br>
Romain<br>
<br>
Le 08/10/13 15:47, Dominick Samperi a écrit :<br>
<br>
I just installed the binary with Rtools not on my path (but with<br>
R in PATH)<br>
and the first time I tried to load/unload RcppOctave I got the<br>
obscure<br>
Windows load error (app terminated "in an unusual way"), but now I<br>
cannot reproduce it! If you are linking to the static Rcpp lib there<br>
should be no problems.<br>
<br>
I guess the source distribution is not in sync with the binary?<br>
<br>
<br>
On Tue, Oct 8, 2013 at 2:11 AM, Renaud <<a href="mailto:getoxxx@gmail.com" target="_blank">getoxxx@gmail.com</a><br>
<mailto:<a href="mailto:getoxxx@gmail.com" target="_blank">getoxxx@gmail.com</a>><br></div></div><div><div class="h5">
<mailto:<a href="mailto:getoxxx@gmail.com" target="_blank">getoxxx@gmail.com</a> <mailto:<a href="mailto:getoxxx@gmail.com" target="_blank">getoxxx@gmail.com</a>>>> wrote:<br>
<br>
Good. Still wondering why path to Rcpp.dll is needed when<br>
installing<br>
the binary package since RcppOctave.dll is linked static to<br>
Rcpp.a<br>
with full path specified. Most users will use the binary<br>
and not<br>
build it from source (which requires Rtools and possibly<br>
more config.<br>
<br>
Did you try installing the binary directly from the repo<br>
(with only<br>
octave bin/ in the path, not Rtools nor R)?<br>
<br>
Renaud<br>
<br>
<br>
On Monday, October 7, 2013, Dominick Samperi wrote:<br>
<br>
I don't think you need to worry about linking against<br>
the .dll<br>
files, as the<br>
import libraries (.dll.a files) contain all of the<br>
information<br>
that the linker needs,<br>
and you PATH will tell Windows where to find the<br>
corresponding<br>
dll's.<br>
It is possible to link against the dll's without using<br>
import libs,<br>
but then various tricks have to be used to specify what is<br>
exported from each dll.<br>
<br>
I downloaded the source for 0.10.1 and it seems to<br>
build and install<br>
ok provided I place Rcpp.dll on PATH. It would save the<br>
user some<br>
trouble if PATH could be updated automatically, but it is<br>
probably not<br>
a good idea to have R package installation or startup<br>
update the<br>
users<br>
environment...<br>
<br>
<br>
<br>
On Mon, Oct 7, 2013 at 10:52 AM, Renaud Gaujoux<br>
<<a href="mailto:renaud@mancala.cbio.uct.ac.za" target="_blank">renaud@mancala.cbio.uct.ac.za</a><br></div></div><div class="im">
<mailto:<a href="mailto:renaud@mancala.cbio.uct.ac.za" target="_blank">renaud@mancala.cbio.<u></u>uct.ac.za</a>>__> wrote:<br>
<br>
Thanks for the details Dominick.<br>
I think I got it working now, by ad Octave bin<br>
directory to<br>
the path prior loading RcppOctave library.<br>
I tested it by renaming the Octave root directory into<br>
something different than at building time.<br>
<br>
I added the option to specify Octave path via option<br>
octave.path (e.g., see ?OctaveInit), so that the<br>
package<br>
loads fine even if Octave is not installed/found.<br>
The user<br>
can also define this option in the .Rprofile if<br>
Octave is<br>
not installed in the path by default.<br>
<br>
Please let me know if it works for you:<br>
<br>
install.packages('RcppOctave', repos =<br>
c(getOption('repos'),<br></div>
'<a href="http://web.cbio.uct.ac.za/~__renaud/CRAN" target="_blank">http://web.cbio.uct.ac.za/~__<u></u>renaud/CRAN</a>'<div class="im"><br>
<<a href="http://web.cbio.uct.ac.za/~renaud/CRAN" target="_blank">http://web.cbio.uct.ac.za/~<u></u>renaud/CRAN</a>'>))<br>
library(RcppOctave)<br>
.O$rand()<br>
<br>
Note that this version (0.10.1) was linked against the<br>
.dll.a files, but will load the .dll files... I<br>
will try<br>
later to link against the .dll files as you suggested.<br>
<br>
Bests,<br>
Renaud<br>
<br>
<br>
<br>
On 7 October 2013 16:24, Dominick Samperi<br></div>
<<a href="mailto:djsamperi@gmail.com" target="_blank">djsamperi@gmail.com</a> <mailto:<a href="mailto:djsamperi@gmail.com" target="_blank">djsamperi@gmail.com</a>>><div><div class="h5"><br>
wrote:<br>
<br>
Yes, I placed Octave bin on my path. This is<br>
required to<br>
find its dll's for the same reason<br>
that Rcpp libs (directory containing Rcpp.dll)<br>
needs to<br>
be on PATH. If you enable clients<br>
of RcppOctave.dll to link against functions<br>
provided by<br>
RcppOctave, then these clients<br>
will have to add the RcppOctave libs directory<br>
to their<br>
PATH.<br>
<br>
The Octave dll's must be in its bin directory<br>
due to<br>
another Windows dll search rule:<br>
when you run an executable (like octave.exe) that<br>
depends on dll's, Windows will<br>
resolve the dependencies when the dll's are in<br>
the same<br>
directory as the executable.<br>
<br>
You should be able to link to liboctave-1.dll using<br>
'-loctave-1', provided the bin<br>
directory is on your PATH. The gcc '.dll.a'<br>
suffix means<br>
the file is an import library,<br>
not a static lib or a shared lib. Import libs tell<br>
Windows how to resolve references<br>
in the corresponding dll. Windows uses the<br>
'.lib' suffix<br>
for import libs. For your<br>
purposes you should link against the dll's, not<br>
the dll.a's.<br>
<br>
<br>
<br>
On Mon, Oct 7, 2013 at 4:59 AM, Renaud Gaujoux<br>
<<a href="mailto:renaud@mancala.cbio.uct.ac.za" target="_blank">renaud@mancala.cbio.uct.ac.za</a><br></div></div><div class="im">
<mailto:<a href="mailto:renaud@mancala.cbio.uct.ac.za" target="_blank">renaud@mancala.cbio.<u></u>uct.ac.za</a>>__> wrote:<br>
<br>
Dominick, just to be sure: did you have<br>
Octave bin<br>
directory in your PATH when you tested the<br>
package?<br>
Because Octave dlls are also in that directory.<br>
<br>
I am getting confused on which path/dll is<br>
to be<br>
used where. Currently I build<br>
RcppOctave.dll linking<br>
against the dll.a files found in<br>
<br></div>
"C:\Octave\Octave3.6.4_gcc4.6.<u></u>__2\lib\octave\3.6.4".<div class="im"><br>
But there are .dll files (although named<br>
liboctave-1.dll and not liboctave.dll as I<br>
would<br>
expect) in<br></div>
""C:\Octave\Octave3.6.4_gcc4._<u></u>_6.2\bin"<div class="im"><br>
where octave.exe. and octave-config.exe<br>
also live.<br>
I had tried loading the .dll.a files with<br>
dyn.load<br>
in R but got errors. The -1.dll files load<br>
fine, and<br>
might be the ones I could load manually in<br>
.onLoad.<br>
<br>
Now, should I also link using the bin/ path<br>
and the<br>
-1.dll files?<br>
<br>
Renaud<br>
</div></blockquote><div class="HOEnZb"><div class="h5">
<br>
<br>
-- <br>
Romain Francois<br>
Professional R Enthusiast<br>
<a href="tel:%2B33%280%29%206%2028%2091%2030%2030" value="+33628913030" target="_blank">+33(0) 6 28 91 30 30</a><br>
<br>
</div></div></blockquote></div><br></div>