Hi Louise-<div><br></div><div>I see.</div><div><br></div><div>You mentioned rbounds several times, by which I presume you mean the Stata module. Thats for sensitivity to random assignment of the treatment. Our sensitivity analysis is to the sequential ignorability assumption, bc. we are doing mediation analysis rather than just estimating treatment effects. You probably know this, but I just want to be clear.</div>
<div><br></div><div>dt</div><div><br clear="all">Dustin Tingley<br>Government Department<br>Harvard University<br><a href="http://scholar.harvard.edu/dtingley" target="_blank">http://scholar.harvard.edu/dtingley</a><br>
<br><br><div class="gmail_quote">On Mon, Dec 12, 2011 at 9:36 AM, Glew, Louise <span dir="ltr"><<a href="mailto:Louise.Glew@wwfus.org">Louise.Glew@wwfus.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div lang="EN-US" link="blue" vlink="purple">
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Hi Dustin,<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Thanks for the suggestion. Unfortunately, I have a really nasty non-linear component which cycles on an irregular basis. Unless I ignore the underlying assumptions,
I can’t fit a linear model to the data. The other alternative is to ignore the serial dependence, chop the data into a series of matched pairs (one at each time-step) and to run a sensitivity analysis on a Wilcoxon Matched Pairs test, as in rbounds. Either
way, ignoring the underlying structure of the data seems to risk inflating Type I error, and finding the estimates of impact overly sensitive to a hidden bias. In theory I could report this as the maximum sensitivity to hidden bias, acknowledging the (unknown)
probability of a false positive but I suspect reviewers will foam at the mouth at this approach….
<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Thanks so much for the response, very much appreciated!
<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Louise<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<div style="border:none;border-top:solid #b5c4df 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> dustin tingley [mailto:<a href="mailto:dustin.tingley@gmail.com" target="_blank">dustin.tingley@gmail.com</a>]
<br>
<b>Sent:</b> Sunday, December 11, 2011 10:55 PM<br>
<b>To:</b> Kosuke Imai<br>
<b>Cc:</b> Glew, Louise; <a href="mailto:mediation-information@r-forge.wu-wien.ac.at" target="_blank">mediation-information@r-forge.wu-wien.ac.at</a><br>
<b>Subject:</b> Re: [Mediation-information] Sensitivity analysis for a GAM<u></u><u></u></span></p>
</div><div><div class="h5">
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Hi Louise-<u></u><u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Great question. <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Yes, doing sensitivity analysis with GAM's as Kosuke mentioned is beyond what we can do right now. Its possible in theory, we think, but would be a major undertaking to figure out how to do. Our Stata package does not do this either (currently
it supports a smaller set of models compared to our R package).<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Let me make another suggestion. When you estimate things with the GAM's, are you uncovering highly non-linear relationships (graph things out like what we do in the Psychological Methods paper). If you aren't, perhaps Mr. Linear is your
friend, and you can report the sensitivity analysis based on the linear model as the robustness check?<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">best,<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Dustin<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">PS: as an aside, we're so psyched someone from the WWF is using our software! Really cool!<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br clear="all">
Dustin Tingley<br>
Government Department<br>
Harvard University<br>
<a href="http://scholar.harvard.edu/dtingley" target="_blank">http://scholar.harvard.edu/dtingley</a><br>
<br>
<u></u><u></u></p>
<div>
<p class="MsoNormal">On Sun, Dec 11, 2011 at 10:35 PM, Kosuke Imai <<a href="mailto:kimai@princeton.edu" target="_blank">kimai@princeton.edu</a>> wrote:<u></u><u></u></p>
<p class="MsoNormal">Hi Louise,<br>
<br>
Thanks for your email. Unfortunately, our software, mediation, does not have sensitivity analysis for GAM. We hope to expand the capability of the software in the future, though. However, you should still be able to use GAM to calculate mediation effects.<br>
<br>
Best,<br>
Kosuke<br>
<br>
Department of Politics<br>
Princeton University<br>
<a href="http://imai.princeton.edu" target="_blank">http://imai.princeton.edu</a><br>
<br>
<br>
On Dec 10, 2011, at 11:54 AM, Glew, Louise wrote:<br>
<br>
> Dr. Imai,<br>
><br>
> I’m working on a series of quasi-experimental assessments of the impact of biodiversity conservation interventions. I was wondering if I could ask your advice on how best to conduct a sensitivity analysis on a generalized additive mixed model.<br>
><br>
> I’m analyzing a time-series of remotely-sensed imagery, to explore the impact of a series of conservation interventions against matched controls in northern Kenya. The properties of the data have precluded using a GLMM, and are particularly challenging as
they are both spatially auto-correlated and serially-dependent.<br>
><br>
> When working with less complex data, I have used the ‘rbounds’ and the ‘mediation’ package to compute Rosenbaum’s sensitivity bounds. Reading the documentation for the mediation package, it became apparent that the current function can only handle linear
models. The GAMM I’ve fit to the data is technically a penalized linear model, but the errors are not normally distributed (due to the spatial and temporal correlation). I was wondering if you could advise me of any alternative sensitivity analysis methods
which may be able to cope with non-linear data please?<br>
><br>
> Thank you,<br>
><br>
> Best wishes,<br>
><br>
> Louise<br>
><br>
> Louise Glew (MEnvSci)<br>
> Monitoring and Evaluation Specialist<br>
> Conservation Science Program<br>
> World Wildlife Fund<br>
> 1250 24th Street, NW<br>
> Washington, DC 20037-1193<br>
> Office: <a href="tel:202-495-4184" target="_blank">202-495-4184</a><br>
> Skype: louise.glew<br>
> <a href="mailto:Louise.Glew@wwfus.org" target="_blank">Louise.Glew@wwfus.org</a><br>
> <a href="http://worldwildlife.org" target="_blank">worldwildlife.org</a><br>
><br>
> <image001.gif><br>
><br>
<br>
<br>
_______________________________________________<br>
Mediation-information mailing list<br>
<a href="mailto:Mediation-information@lists.r-forge.r-project.org" target="_blank">Mediation-information@lists.r-forge.r-project.org</a><br>
<a href="https://lists.r-forge.r-project.org/cgi-bin/mailman/listinfo/mediation-information" target="_blank">https://lists.r-forge.r-project.org/cgi-bin/mailman/listinfo/mediation-information</a><u></u><u></u></p>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div></div></div>
</div>
</blockquote></div><br></div>