Francesc-<div><br></div><div>The practical relationship between causal mediation analysis and IV is important.</div><div><br></div><div>At one level this turns on whether you are interested in the causal effect of the treatment, or, if you are using something as an instrument, whether you care about the effect of that instrument (most economists do not). My biggest concern is people who actually care about the effects of the exogenous variable, but who use IV to identify its effect under the exclusion restriction assumption.</div>
<div><br></div><div>I would also refer you to Booil Jo's paper that we cite so you can contrast our approach to one that is more in line with IV methods you appear more familiar with (we discuss this a bit in the PM paper). Key is keeping track of the assumptions you are making across the two procedures.</div>
<div><br></div><div>Perhaps my co-authors can add anything.</div><div><br></div><div>Dustin</div><div><br clear="all">Dustin Tingley<br>Government Department<br>Harvard University<br><a href="http://scholar.harvard.edu/dtingley" target="_blank">http://scholar.harvard.edu/dtingley</a><br>
<br>
<br><br><div class="gmail_quote">On Thu, Sep 8, 2011 at 1:18 PM, Francesc AMAT <span dir="ltr"><<a href="mailto:Francesc.Amat@nuffield.ox.ac.uk">Francesc.Amat@nuffield.ox.ac.uk</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;">
Dustin,<br>
<br>
How can we really distinguish an "exogenous causal effect" (as we refer to them in the traditional IV frameworks) from an "indirect effect" int he causal mediation analysis framework?<br>
<br>
My trouble is that inn the causal mediation analysis the mediator M is also assumed to be causally prior to the outcome Y.<br>
<br>
But doing the analogy to the IV framework, if the mediator is endogneized using T as an instrument then a standard economsit would say that has found an exogenous effect of M on Y, right?<br>
<br>
best,<br>
<div class="im"><br>
Francesc<br>
-----------------------------------------<br>
Francesc Amat<br>
University of Oxford<br>
Nuffield College<br>
<a href="mailto:francesc.amat@nuffield.ox.ac.uk">francesc.amat@nuffield.ox.ac.uk</a><br>
________________________________________<br>
From: dustin tingley [<a href="mailto:dtingley@gov.harvard.edu">dtingley@gov.harvard.edu</a>]<br>
</div><div class="im">Sent: 26 August 2011 13:25<br>
To: Francesc AMAT; Teppei Yamamoto<br>
</div><div class="im">Subject: Re: Question when applying Causal Mediation Analysis<br>
<br>
</div><div class="im">Hi-<br>
I'm not sure. Can you provide the code for the mediator, outcome model, and when you run mediate as well. Teppei, have you see this?<br>
best,<br>
Dustin<br>
<br>
Dustin Tingley<br>
Government Department<br>
Harvard University<br>
<a href="http://scholar.harvard.edu/dtingley" target="_blank">http://scholar.harvard.edu/dtingley</a><br>
<br>
<br>
<br>
</div><div class="im">On Fri, Aug 26, 2011 at 7:57 AM, Francesc AMAT <<a href="mailto:Francesc.Amat@nuffield.ox.ac.uk">Francesc.Amat@nuffield.ox.ac.uk</a><mailto:<a href="mailto:Francesc.Amat@nuffield.ox.ac.uk">Francesc.Amat@nuffield.ox.ac.uk</a>>> wrote:<br>
Dustin,<br>
<br>
<br>
I run the causal mediation R package and when doing sensitivity analysis I encounter an error message after using the "medsens" command.<br>
<br>
<br>
The error message is the following one:<br>
<br>
</div>sens.bout <- medsens(out.y1b, <a href="http://rho.by" target="_blank">rho.by</a><<a href="http://rho.by" target="_blank">http://rho.by</a>>= 0.05, sims = 1000)<br>
<div class="im"><br>
Error in Mmodel.coef.sim * (rho12.sim/sigma.2.sim) %x% t(rep(1, y.k - :<br>
non-conformable arrays<br>
<br>
The mediator is a continuous variable and the outcome is binary. So I use a linear regression model for the mediator model and a probit model for the outcome one. So everything is quite standard.<br>
<br>
Do you know which could be the source of the error?<br>
<br>
Thanks,<br>
<br>
Francesc<br>
<br>
-----------------------------------------<br>
Francesc Amat<br>
University of Oxford<br>
Nuffield College<br>
</div><div class="im"><a href="mailto:francesc.amat@nuffield.ox.ac.uk">francesc.amat@nuffield.ox.ac.uk</a><mailto:<a href="mailto:francesc.amat@nuffield.ox.ac.uk">francesc.amat@nuffield.ox.ac.uk</a>><br>
</div>________________________________________<br>
From: dustin tingley [<a href="mailto:dtingley@gov.harvard.edu">dtingley@gov.harvard.edu</a><mailto:<a href="mailto:dtingley@gov.harvard.edu">dtingley@gov.harvard.edu</a>>]<br>
<div class="im">Sent: 24 August 2011 15:21<br>
To: Francesc AMAT; Kosuke Imai; Teppei Yamamoto; Luke Keele<br>
Subject: Re: Question when applying Causal Mediation Analysis<br>
<br>
Francesc--<br>
<br>
This is a good question, that we often get. If we haven't made it explicit in our APSR paper we might want to (I don't remember).<br>
<br>
At one level, the answer is pretty simple. If the "direct" effect (which might be thought of as other mechanisms you're not interested in) runs in the opposite direction from your mechanisms--even if it is insignificant--then you might see a total effect be insig but the ACME be significant. We're not the first to point this out, a paper by MacKinnon talks about "effect suppression", which is basically this. More generally, this is one reason why we think that just looking at the ATE might be misleading. Of course, you must in our framework be making the SI assumption. So do the sensitivity analyses and report them!<br>
<br>
I'm sure we'd all be interested in your paper when you have one to circulate.<br>
<br>
I cc my co-authors lest they have more to add.<br>
best,<br>
Dustin<br>
<br>
Dustin Tingley<br>
Government Department<br>
Harvard University<br>
<a href="http://scholar.harvard.edu/dtingley" target="_blank">http://scholar.harvard.edu/dtingley</a><br>
<br>
<br>
<br>
</div><div><div></div><div class="h5">On Wed, Aug 24, 2011 at 8:49 AM, Francesc AMAT <<a href="mailto:Francesc.Amat@nuffield.ox.ac.uk">Francesc.Amat@nuffield.ox.ac.uk</a><mailto:<a href="mailto:Francesc.Amat@nuffield.ox.ac.uk">Francesc.Amat@nuffield.ox.ac.uk</a>><mailto:<a href="mailto:Francesc.Amat@nuffield.ox.ac.uk">Francesc.Amat@nuffield.ox.ac.uk</a><mailto:<a href="mailto:Francesc.Amat@nuffield.ox.ac.uk">Francesc.Amat@nuffield.ox.ac.uk</a>>>> wrote:<br>
Dear Prof. Tingley,<br>
<br>
I am applying your R package for doing causal mediation analysis and I´m following your new APSR piece.<br>
<br>
My question is rather simple but it remains unclear to me. In the old Baron and Kenny (1986) framework when doing mediation analysis the first standard requirement was that the treatment (T) should significantly affect the outcome (Y) in the abase of the mediator (M) so that there is an effect to be mediated.<br>
<br>
However, I'm using a natural experiment in which the treatment (T) affects the mediator but not directly the outcome (and even in the absence of the mediator the treatment does not affect the outcome). In other words, when modelling the outcome model when I include the treatment (T) but not the mediator (M) the treatment do not have any significant effect on Y. And indeed, when applying your R package I do find a significant "indirect effect" but a not significant "direct effect".<br>
<br>
So, rather simply, my question is the following. It is necessary as a pre-condition to apply the causal mediation analysis package to find that the treatment significantly affects the outcome in the absence of the mediator -as it seems to me it was the standard in the Baron and Kenny framework)? Or alternatively, it is perfectly fine to use a treatment (T) such that indirectly affects the outcome (Y) but it does not have a direct effect on Y even when no controlling for the mediator?<br>
<br>
I have good theoretical reasons to expect such an indirect effect and no reason to think that the treatment should have a direct effect on Y, even when no controlling for the mediator.<br>
<br>
Many thanks,<br>
<br>
Francesc<br>
<br>
-----------------------------------------<br>
Francesc Amat<br>
University of Oxford<br>
Nuffield College<br>
</div></div><font color="#888888"><a href="mailto:francesc.amat@nuffield.ox.ac.uk">francesc.amat@nuffield.ox.ac.uk</a><mailto:<a href="mailto:francesc.amat@nuffield.ox.ac.uk">francesc.amat@nuffield.ox.ac.uk</a>><mailto:<a href="mailto:francesc.amat@nuffield.ox.ac.uk">francesc.amat@nuffield.ox.ac.uk</a><mailto:<a href="mailto:francesc.amat@nuffield.ox.ac.uk">francesc.amat@nuffield.ox.ac.uk</a>>><br>
<br>
<br>
</font></blockquote></div><br></div>