climateprediction.net home page
Task 18116772

Task 18116772

Name hadam3prm3pm2t_eu_rsx0_2002_1_009642103_0
Workunit 9716437
Created 13 Mar 2015, 15:24:08 UTC
Sent 31 Mar 2015, 17:08:27 UTC
Report deadline 12 Mar 2016, 22:28:27 UTC
Received 20 Apr 2015, 7:25:42 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1349287
Run time 9 days 20 hours 46 min 53 sec
CPU time 9 days 9 hours 33 min 38 sec
Validate state Invalid
Credit 7,174.84
Device peak FLOPS 2.65 GFLOPS
Application version UK Met Office HadAM3P and HadRM3P model with MOSES II and TRIFFID Europe v7.01
i686-pc-linux-gnu
Stderr
<core_client_version>7.2.42</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
00:36:24 (3284): called boinc_finish
Signal 15 received, exiting...
00:36:24 (3285): called boinc_finish
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
[0xf776f400]
/lib/i386-linux-gnu/libc.so.6(getenv+0x72)[0xf7467852]
/lib/i386-linux-gnu/libc.so.6(+0xa775e)[0xf74dc75e]
/lib/i386-linux-gnu/libc.so.6(+0xa7aaf)[0xf74dcaaf]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x2b)[0xf74db1ab]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
[0xf776f400]
[0xf776f430]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x46)[0xf74ea826]
/lib/i386-linux-gnu/libc.so.6(usleep+0x3d)[0xf751988d]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80507b3]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f63]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf744ea83]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
22:57:49 (2453): called boinc_finish
Signal 15 received, exiting...
22:57:49 (2454): called boinc_finish
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
[0xf77d5400]
/lib/i386-linux-gnu/libc.so.6(getenv+0x72)[0xf74cd852]
/lib/i386-linux-gnu/libc.so.6(+0xa775e)[0xf754275e]
/lib/i386-linux-gnu/libc.so.6(+0xa7aaf)[0xf7542aaf]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x2b)[0xf75411ab]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
[0xf77d5400]
[0xf77d5430]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x46)[0xf7550826]
/lib/i386-linux-gnu/libc.so.6(usleep+0x3d)[0xf757f88d]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80507b3]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f63]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf74b4a83]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (16 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
[0xf7710400]
/lib/i386-linux-gnu/libc.so.6(getenv+0x72)[0xf7408852]
/lib/i386-linux-gnu/libc.so.6(+0xa775e)[0xf747d75e]
/lib/i386-linux-gnu/libc.so.6(+0xa7aaf)[0xf747daaf]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x2b)[0xf747c1ab]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
[0xf7710400]
[0xf7710430]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x46)[0xf748b826]
/lib/i386-linux-gnu/libc.so.6(usleep+0x3d)[0xf74ba88d]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c5884]
/lib/i386-linux-gnu/libpthread.so.0(+0x6f70)[0xf76dcf70]
/lib/i386-linux-gnu/libc.so.6(clone+0x5e)[0xf74c1bee]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
20:56:31 (3286): called boinc_finish
Signal 15 received, exiting...
20:56:31 (3287): called boinc_finish
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
16:02:12 (2509): called boinc_finish
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (16 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
[0xf7716400]
/lib/i386-linux-gnu/libc.so.6(getenv+0x72)[0xf740e852]
/lib/i386-linux-gnu/libc.so.6(+0xa775e)[0xf748375e]
/lib/i386-linux-gnu/libc.so.6(+0xa7aaf)[0xf7483aaf]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x2b)[0xf74821ab]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
[0xf7716400]
[0xf7716430]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x46)[0xf7491826]
/lib/i386-linux-gnu/libc.so.6(usleep+0x3d)[0xf74c088d]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c5884]
/lib/i386-linux-gnu/libpthread.so.0(+0x6f70)[0xf76e2f70]
/lib/i386-linux-gnu/libc.so.6(clone+0x5e)[0xf74c7bee]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (19 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
[0xf770e400]
/lib/i386-linux-gnu/libc.so.6(getenv+0x72)[0xf7406852]
/lib/i386-linux-gnu/libc.so.6(+0xa775e)[0xf747b75e]
/lib/i386-linux-gnu/libc.so.6(+0xa7aaf)[0xf747baaf]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x2b)[0xf747a1ab]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
[0xf770e400]
[0xf770e430]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x46)[0xf7489826]
/lib/i386-linux-gnu/libc.so.6(usleep+0x3d)[0xf74b888d]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80507b3]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f63]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf73eda83]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
Signal 15 received, exiting...
23:12:30 (2502): called boinc_finish
23:12:30 (2501): called boinc_finish
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
[0xf7764400]
/lib/i386-linux-gnu/libc.so.6(getenv+0x72)[0xf745c852]
/lib/i386-linux-gnu/libc.so.6(+0xa775e)[0xf74d175e]
/lib/i386-linux-gnu/libc.so.6(+0xa7aaf)[0xf74d1aaf]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x2b)[0xf74d01ab]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
[0xf7764400]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c46a0]
[0xf7764400]
[0xf7764430]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x46)[0xf74df826]
/lib/i386-linux-gnu/libc.so.6(usleep+0x3d)[0xf750e88d]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80507b3]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f63]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf7443a83]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
23:55:36 (2517): called boinc_finish
Signal 15 received, exiting...
23:55:36 (2518): called boinc_finish
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
00:26:42 (2436): called boinc_finish
Signal 15 received, exiting...
00:26:42 (2437): called boinc_finish
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (16 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
[0xf7703400]
/lib/i386-linux-gnu/libc.so.6(getenv+0x72)[0xf73fb852]
/lib/i386-linux-gnu/libc.so.6(+0xa775e)[0xf747075e]
/lib/i386-linux-gnu/libc.so.6(+0xa7aaf)[0xf7470aaf]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x2b)[0xf746f1ab]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
[0xf7703400]
[0xf7703430]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x46)[0xf747e826]
/lib/i386-linux-gnu/libc.so.6(usleep+0x3d)[0xf74ad88d]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c5884]
/lib/i386-linux-gnu/libpthread.so.0(+0x6f70)[0xf76cff70]
/lib/i386-linux-gnu/libc.so.6(clone+0x5e)[0xf74b4bee]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
Signal 15 received, exiting...
00:39:17 (2751): called boinc_finish
00:39:17 (2752): called boinc_finish
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
00:37:46 (2550): called boinc_finish
Signal 15 received, exiting...
00:37:46 (2551): called boinc_finish
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (21 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
[0xf772d400]
/lib/i386-linux-gnu/libc.so.6(getenv+0x72)[0xf7425852]
/lib/i386-linux-gnu/libc.so.6(+0xa775e)[0xf749a75e]
/lib/i386-linux-gnu/libc.so.6(+0xa7aaf)[0xf749aaaf]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x2b)[0xf74991ab]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
[0xf772d400]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c46a0]
[0xf772d400]
[0xf772d430]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x46)[0xf74a8826]
/lib/i386-linux-gnu/libc.so.6(usleep+0x3d)[0xf74d788d]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80507b3]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f63]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf740ca83]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
00:40:07 (2777): called boinc_finish
Signal 15 received, exiting...
00:40:07 (2778): called boinc_finish
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
23:55:31 (2748): called boinc_finish
Signal 15 received, exiting...
23:55:31 (2747): called boinc_finish
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2747, selfPID=2748, iMonCtr=1
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
00:17:06 (2518): called boinc_finish
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (16 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
[0xf76e6400]
/lib/i386-linux-gnu/libc.so.6(getenv+0x72)[0xf73de852]
/lib/i386-linux-gnu/libc.so.6(+0xa775e)[0xf745375e]
/lib/i386-linux-gnu/libc.so.6(+0xa7aaf)[0xf7453aaf]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x2b)[0xf74521ab]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
[0xf76e6400]
[0xf76e6430]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x46)[0xf7461826]
/lib/i386-linux-gnu/libc.so.6(usleep+0x3d)[0xf749088d]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c5884]
/lib/i386-linux-gnu/libpthread.so.0(+0x6f70)[0xf76b2f70]
/lib/i386-linux-gnu/libc.so.6(clone+0x5e)[0xf7497bee]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
Signal 15 received, exiting...
18:04:14 (2531): called boinc_finish
18:04:14 (2530): called boinc_finish
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
23:36:52 (2516): called boinc_finish
Signal 15 received, exiting...
23:36:52 (2517): called boinc_finish
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (16 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
[0xf76e7400]
/lib/i386-linux-gnu/libc.so.6(getenv+0x72)[0xf73df852]
/lib/i386-linux-gnu/libc.so.6(+0xa775e)[0xf745475e]
/lib/i386-linux-gnu/libc.so.6(+0xa7aaf)[0xf7454aaf]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x2b)[0xf74531ab]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
[0xf76e7400]
[0xf76e7430]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x46)[0xf7462826]
/lib/i386-linux-gnu/libc.so.6(usleep+0x3d)[0xf749188d]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c5884]
/lib/i386-linux-gnu/libpthread.so.0(+0x6f70)[0xf76b3f70]
/lib/i386-linux-gnu/libc.so.6(clone+0x5e)[0xf7498bee]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (16 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
[0xf771c400]
/lib/i386-linux-gnu/libc.so.6(getenv+0x72)[0xf7414852]
/lib/i386-linux-gnu/libc.so.6(+0xa775e)[0xf748975e]
/lib/i386-linux-gnu/libc.so.6(+0xa7aaf)[0xf7489aaf]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x2b)[0xf74881ab]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
[0xf771c400]
[0xf771c430]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x46)[0xf7497826]
/lib/i386-linux-gnu/libc.so.6(usleep+0x3d)[0xf74c688d]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c5884]
/lib/i386-linux-gnu/libpthread.so.0(+0x6f70)[0xf76e8f70]
/lib/i386-linux-gnu/libc.so.6(clone+0x5e)[0xf74cdbee]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
00:13:27 (2522): BOINC client no longer exists - exiting
00:13:27 (2522): timer handler: client dead, exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
23:50:46 (2519): called boinc_finish
Signal 15 received, exiting...
23:50:46 (2520): called boinc_finish
Signal 15 received, exiting...
SIGSEGV: segmentation violation
Stack trace (16 frames):
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf]
[0xf7708400]
/lib/i386-linux-gnu/libc.so.6(getenv+0x72)[0xf7400852]
/lib/i386-linux-gnu/libc.so.6(+0xa775e)[0xf747575e]
/lib/i386-linux-gnu/libc.so.6(+0xa7aaf)[0xf7475aaf]
/lib/i386-linux-gnu/libc.so.6(localtime_r+0x2b)[0xf74741ab]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6]
[0xf7708400]
[0xf7708430]
/lib/i386-linux-gnu/libc.so.6(nanosleep+0x46)[0xf7483826]
/lib/i386-linux-gnu/libc.so.6(usleep+0x3d)[0xf74b288d]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0]
../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c5884]
/lib/i386-linux-gnu/libpthread.so.0(+0x6f70)[0xf76d4f70]
/lib/i386-linux-gnu/libc.so.6(clone+0x5e)[0xf74b9bee]

Exiting...
Signal 3 received, exiting...
10:21:57 (2523): called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
18 Apr 2015 10:08:31 1349287 18116772 hadam3prm3pm2t_eu_rsx0_2002_1_009642103_0 103,979 740,709 7.1236
16 Apr 2015 08:18:04 1349287 18116772 hadam3prm3pm2t_eu_rsx0_2002_1_009642103_0 92,459 659,431 7.1321
14 Apr 2015 14:26:08 1349287 18116772 hadam3prm3pm2t_eu_rsx0_2002_1_009642103_0 80,939 578,652 7.1492
13 Apr 2015 06:57:29 1349287 18116772 hadam3prm3pm2t_eu_rsx0_2002_1_009642103_0 69,419 496,956 7.1588
11 Apr 2015 07:54:02 1349287 18116772 hadam3prm3pm2t_eu_rsx0_2002_1_009642103_0 57,899 414,909 7.1661
09 Apr 2015 13:40:35 1349287 18116772 hadam3prm3pm2t_eu_rsx0_2002_1_009642103_0 46,379 332,320 7.1653
07 Apr 2015 14:41:34 1349287 18116772 hadam3prm3pm2t_eu_rsx0_2002_1_009642103_0 34,859 249,364 7.1535
05 Apr 2015 08:25:09 1349287 18116772 hadam3prm3pm2t_eu_rsx0_2002_1_009642103_0 23,339 166,869 7.1498
02 Apr 2015 10:16:59 1349287 18116772 hadam3prm3pm2t_eu_rsx0_2002_1_009642103_0 11,819 84,670 7.1639


©2024 cpdn.org