<div>Hi Fernando,</div><div>Thank you very much for your answer, it is indeed very helpful to me. In the r-script attached you can see how I calculated the amount of overlap (for two randomly generated distributions in this example). When the means and standard deviations are identical, the overlap calculated is about 1, which gives me confidence in this method. I made an error yesterday in calculating the amount of overlap for the posterior distributions of b0 and b1 with the KLDC's of 0.88 and 0.99. In fact they where p=0.40 and p=0.15, respectively. I must be doing something wrong, because clearly a KLDC=0.99 cannot describe divergence of two distributions with 15% overlap, right?</div><div><br></div><div>Actually I am not so interested in a P-value or any hard boundary as such, but I would want to describe how likely the distributions with KLDC=0.99 are differing, and similar for the other two. Can I interpret these KLDC's as actual probabilities? For my data it is important because my treatment effect on b0 and b1 is in the opposite direction, i.e. baseline mort is lower in the group where the age-dependence on mort is stronger. This actually raises another question: when fitting Gompertz, b0 and b1 are not independent. I am interested in whether the treatment effect on b1 (age dependence on mort) is still there when I keep the b0 parameter fixed, lets say to the average of both groups. Can I do this in BaSTA? </div><div><br></div><div>You talked about the possibility of calculating Bayesian p-values. How would I do this?</div><div><br></div><div>Best, Jelle</div><div> </div><div><div><br></div></div>
<p style="color: #A0A0A8;">On Friday, 15 February 2013 at 09:50, Fernando Colchero wrote:</p>
<blockquote type="cite" style="border-left-style:solid;border-width:1px;margin-left:0px;padding-left:10px;">
<span><div><div><meta http-equiv="Content-Type" content="text/html charset=us-ascii">Hi Jelle,<div><br></div><div> Well, you could calculate Bayesian p-values, and their interpretation is, roughly, what you calculated. The KLDC values we have in BaSTA show the mean (calibrated) Kullback-Leibler discrepancies (KL) between both distributions. The issue is that KL values are non-symetrical. For example, if you want to determine the amount of overlap between a distribution P and a distribution D, unless they have the same variance, KL(P, D) is not equal to KL(D, P). I am not sure how you calculated the percentage of overlap, but it is likely that you had one side of the overlap, say P with respect to D, but it is possible that values will be different the other way around. </div><div><br></div><div> I think it is safe to state that your 0.88 and 0.99 values indicate that there is little overlap in the first and almost none in the second, which suggests that both parameters for both groups are different. Still, I understand that it would be handy to have a clear threshold as with traditional p-values. However, if you think about it, such thresholds are somewhat arbitrary and may not apply to a specific system. That is why some Bayesian and even non-Bayesian statisticians prefer to state how likely or how probable is that x and y are related instead of having hard boundaries. </div><div><br></div><div> I hope that this is helpful. Best,</div><div><br></div><div> Fernando</div><div><div apple-content-edited="true">
<div style="color: rgb(0, 0, 0); font-family: Helvetica; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; font-size: 13px; "><div><span style="font-size: 12px; "><br><br></span></div><div><span style="font-size: 12px; "><br></span></div><div><b style="font-size: 12px; ">Fernando Colchero</b></div><div><span style="font-size: 12px; ">Assistant Professor</span></div><div><span style="font-size: 12px; ">Department of Mathematics and Computer Sciences</span></div><div><span style="font-size: 12px; ">Max Planck Odense Center on the Biodemography of Aging</span></div><div><b><i style="font-size: 12px; "><br></i></b></div><div><span style="font-size: 12px; ">Tlf. +45 65 50 46 35</span></div><div><span style="font-size: 12px; ">Email <a href="mailto:colchero@imada.sdu.dk">colchero@imada.sdu.dk</a></span></div><div><span style="font-size: 12px; ">Web <a href="http://www.sdu.dk/staff/colchero">www.sdu.dk/staff/colchero</a></span></div><div><span style="font-size: 12px; ">Pers. web <a href="http://www.sdu.dk/staff/colchero">www.colchero.com</a></span></div><div><span style="font-size: 12px; ">Adr. Campusvej 55, 5230, Odense, Dk</span></div><div><span style="font-size: 12px; "><br></span></div><div><div><b>University of Southern Denmark</b></div><div><b><i style="font-size: 12px; "><br></i></b></div></div></div><div style="color: rgb(0, 0, 0); font-family: Helvetica; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; font-size: 13px; "><span style="font-size: 12px; "><br></span></div><br style="color: rgb(0, 0, 0); font-family: Helvetica; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; font-size: 13px; "><br>
</div>
<br><div><div>On Feb 14, 2013, at 4:36 PM, Jelle Boonekamp <<a href="mailto:jjboonekamp@gmail.com">jjboonekamp@gmail.com</a>> wrote:</div><br><blockquote type="cite"><div><meta http-equiv="Content-Type" content="text/html; charset=utf-8"><div>Dear BaSTA users,</div><div><br></div><div>
I am wrestling a bit with the interpretation of the Kullback-Leibler metric describing the posterior distributions of model parameters. In my example I get KLDC values of 0.88 and 0.99 for the b0 and b1 Gompertz parameters respectively, when comparing two groups of individuals. If I understood correctly then a value of 1 of this calibrated KLD indicates that there is no overlap between distributions, and a value of 0.5 indicates that they are identical. However, when I calculate by hand the percentage of overlapping (which I think can be interpreted as measure of significance since these posterior values are normally distributed) of both distributions I get 0.24 and 0.066 respectively (KLDC 0.88 and 0.99). I would have thought that at least the distributions with KLDC = 0.99, to show less overlap than what I calculated by hand (0.066).
</div><div><br></div><div>Can someone shed some light on this?</div><div><br></div><div>Best, Jelle</div>
<div><div><br></div><div>-- </div><div>Jelle Boonekamp</div><div>Behavioural Biology<br>University of Groningen<br>P.O. Box 11103<br>9700 CC Groningen<br>The Netherlands<br><br>tel: +31.50.363 7853</div><div>Sent with <a href="http://www.sparrowmailapp.com/?sig">Sparrow</a></div><div><br></div></div>
_______________________________________________<br>Basta-users mailing list<br><a href="mailto:Basta-users@lists.r-forge.r-project.org">Basta-users@lists.r-forge.r-project.org</a><br><a href="https://lists.r-forge.r-project.org/cgi-bin/mailman/listinfo/basta-users">https://lists.r-forge.r-project.org/cgi-bin/mailman/listinfo/basta-users</a><br></div></blockquote></div><br></div></div></div></span>
</blockquote>
<div>
<br>
</div>