<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:70.85pt 70.85pt 70.85pt 70.85pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-GB" link="#0563C1" vlink="#954F72">
<div class="WordSection1">
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:12.0pt;mso-fareast-language:EN-GB">Hi everyone<o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:12.0pt;mso-fareast-language:EN-GB">For my PhD-reseach into self-regulation of learners in online nad blended learning environments I try to get more insight
in the events and its sequences that occur when learners use a Moodle learning environment. The dataset consists of 80 learners (id), 60.000 lines of timestamped events (events) and 40 different events (variables). I’m particularly interested in the “seqefsub”
and “seqecmpgroup” functions.<o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:12.0pt;mso-fareast-language:EN-GB">I ran some tests with my data using these functions, everything works fine if I use the command below:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;color:#00B050;mso-fareast-language:EN-GB">fsubseq <- seqefsub(Data.seqe, pMinSupport = 0.05, maxK=2)
<o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:12.0pt;mso-fareast-language:EN-GB">From the moment I want do increase the pMinSupport and/or maxK R (3.2.1-3) crashes. I assumed that this problem occurred
due to the shortage of RAM and general capacity of my computer. Therefore I turned to a HPC solution. If I run the code as shown above it works fine on the HPC as well. If I change the "fsubseq" function parameters to maxK=4 (4 event sequences), leave the
pMinSupport at 0.05 and I run it on the HPC with 20GB of RAM for 10:00:00 hours, no results are show due to the task is killed after this time. As 10h at 20GB of RAM, is quite some calculation power I find it strange that also R seems to jam over there. Especially,
because in the end I would like to evolve to running the "optimal" script involving (more or less) every possible event sequence as shown in "rscript.R" below.<o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:12.0pt;mso-fareast-language:EN-GB">I looked at the problem from different angles (limited, because I do know something about statistics and computers but
not as much as people who are experts in this), but I seem to be stuck for the moment. Therefore I contact you.<o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:12.0pt;mso-fareast-language:EN-GB">I was wondering if you (or researchers you know) ever had experiences with (1) running TraMineR for this kind of (large?)
TimeStamped Event datasets? And (2) running it on such a high performance cluster? <o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:12.0pt;mso-fareast-language:EN-GB">Thank you very much in advance! If there might be additional information needed, please let me know!<o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:12.0pt;mso-fareast-language:EN-GB">Best wishes
<o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:12.0pt;mso-fareast-language:EN-GB">Stijn Van Laer<o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><i><span style="font-size:12.0pt;mso-fareast-language:EN-GB">The my.calc.PBS file to run the job from the HPC looks like:<o:p></o:p></span></i></p>
<p class="MsoNormal"><span style="font-size:10.0pt;color:#00B050;mso-fareast-language:EN-GB">#!/bin/bash -l<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;color:#00B050;mso-fareast-language:EN-GB">module load R<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="ES" style="font-size:10.0pt;color:#00B050;mso-fareast-language:EN-GB">cd $PBS_O_WORKDIR<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="ES" style="font-size:10.0pt;color:#00B050;mso-fareast-language:EN-GB">Rscript --vanilla rscript.R<o:p></o:p></span></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><i><span style="font-size:12.0pt;mso-fareast-language:EN-GB">The rcsript.R file to run in R looks like:<o:p></o:p></span></i></p>
<p class="MsoNormal"><span style="font-size:10.0pt;color:#00B050;mso-fareast-language:EN-GB">#!/usr/bin/Rscript --vanilla --slave<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;color:#00B050;mso-fareast-language:EN-GB">library(TraMineR)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;color:#00B050;mso-fareast-language:EN-GB">Data<-read.csv("sequence_data_cvod.csv",header=TRUE)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;color:#00B050;mso-fareast-language:EN-GB">Labels<-read.csv("clust_cvod.csv",header=TRUE)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;color:#00B050;mso-fareast-language:EN-GB">Data.seqe<-seqecreate(Data,id=Data$Id,timestamp=Data$Timestamp,event=Data$Event)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;color:#00B050;mso-fareast-language:EN-GB">fsubseq <- seqefsub(Data.seqe, pMinSupport = 0.01)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;color:#00B050;mso-fareast-language:EN-GB">sink("fsubseq.txt", split=TRUE)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;color:#00B050;mso-fareast-language:EN-GB">fsubseq<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;color:#00B050;mso-fareast-language:EN-GB">sink()<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;color:#00B050;mso-fareast-language:EN-GB">discrcohort <- seqecmpgroup(fsubseq, group = Labels$cluster, pvalue.limit=0.0005,weighted=TRUE,method = "chisq")<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;color:#00B050;mso-fareast-language:EN-GB">sink("discrcohort.txt", split=TRUE)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;color:#00B050;mso-fareast-language:EN-GB">discrcohort<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;color:#00B050;mso-fareast-language:EN-GB">sink()<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><b><span style="color:#595959;mso-fareast-language:NL-BE">Centrum voor Instructiepsychologie en –Technologie | Center for Instructional Psychology and Technology<o:p></o:p></span></b></p>
<p class="MsoNormal"><span style="color:#595959;mso-fareast-language:NL-BE">Dekenstraat 2 | Post box 3773 | B-3000 Leuven | Room 05.69<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Times New Roman",serif;color:#595959;mso-fareast-language:NL-BE"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="DE" style="color:#595959;mso-fareast-language:NL-BE">Tel.: (+32) (0)16 32 82 76</span><span lang="DE" style="font-family:"Times New Roman",serif;color:#595959;mso-fareast-language:NL-BE"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="DE" style="color:#595959;mso-fareast-language:NL-BE">E-mail:
</span><span lang="NL-BE" style="color:#0070C0;mso-fareast-language:NL-BE"><a href="mailto:Stijn.vanlaer@ppw.kuleuven.be"><span lang="DE" style="color:#0070C0">Stijn.vanlaer@ppw.kuleuven.be</span></a></span><span lang="DE" style="color:#595959;mso-fareast-language:NL-BE"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="NL-BE" style="color:#595959;mso-fareast-language:NL-BE">LinkedIn:
</span><span style="color:#0070C0;mso-fareast-language:EN-GB"><a href="https://www.linkedin.com/in/stijnvanlaer"><span lang="NL-BE" style="color:#0070C0">https://www.linkedin.com/in/stijnvanlaer</span></a></span><span lang="NL-BE" style="color:#0070C0;mso-fareast-language:EN-GB"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="NL-BE" style="color:#595959;mso-fareast-language:NL-BE">Twitter:
</span><span style="color:#0070C0;mso-fareast-language:EN-GB"><a href="https://twitter.com/Stijn_Van_Laer"><span lang="NL-BE" style="color:#0070C0">https://twitter.com/Stijn_Van_Laer</span></a></span><span style="color:#595959;mso-fareast-language:EN-GB">
</span><span lang="NL-BE" style="font-family:"Times New Roman",serif;color:#595959;mso-fareast-language:NL-BE"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="NL-BE" style="color:#595959;mso-fareast-language:NL-BE">Url:
</span><span lang="NL-BE" style="color:#0070C0;mso-fareast-language:NL-BE"><a href="http://ppw.kuleuven.be/home/english/research/etrg/CIPT"><span style="color:#0070C0">http://ppw.kuleuven.be/home/english/research/etrg/CIPT</span></a></span><span lang="NL-BE" style="color:#595959;mso-fareast-language:NL-BE">
<o:p></o:p></span></p>
</div>
</body>
</html>