Task 21919951

Name	hadam4h_a1qr_209811_4_861_011983374_1
Workunit	11983374
Created	17 Mar 2020, 18:38:02 UTC
Sent	17 Mar 2020, 18:41:31 UTC
Report deadline	28 Feb 2021, 0:01:31 UTC
Received	15 Apr 2020, 14:42:51 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1499735
Run time	23 days 0 hours 53 min 13 sec
CPU time	22 days 22 hours 45 min 42 sec
Validate state	Valid
Credit	27,115.14
Device peak FLOPS	2.85 GFLOPS
Application version	UK Met Office HadAM4 at N216 resolution v8.52 i686-pc-linux-gnu
Peak working set size	1,369.08 MB
Peak swap size	3,432.80 MB
Peak disk usage	150.80 MB
Stderr	<core_client_version>7.9.3</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (19 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f30b70] /lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7a90a69] /lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7b10468] /lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7b10835] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7b0edb2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f30b70] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f30b59] /lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7b201cb] /lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7b52be1] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7a79e81] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (19 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fa7b70] /lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7b07a69] /lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7b87468] /lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7b87835] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7b85db2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7fa7b70] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7fa7b59] /lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7b971cb] /lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7bc9be1] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7af0e81] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (19 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f89b70] /lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7ae9a69] /lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7b69468] /lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7b69835] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7b67db2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f89b70] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f89b59] /lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7b791cb] /lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7babbe1] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7ad2e81] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... SIGILL: illegal instruction Stack trace (14 frames): /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x83d8117] linux-gate.so.1(__kernel_sigreturn+0x0)[0x2a9b3b70] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81ff800] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81f5809] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x819f862] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x8084efa] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81f2308] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x808b160] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x806bc09] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x807f7e5] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81ddb4f] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81e121b] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x836e63f] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0x2a6a0e81] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1385, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (19 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f56b70] /lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7ab6a69] /lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7b36468] /lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7b36835] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7b34db2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f56b70] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f56b59] /lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7b461cb] /lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7b78be1] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7a9fe81] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (19 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7efdb70] /lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7a5da69] /lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7add468] /lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7add835] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7adbdb2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7efdb70] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7efdb59] /lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7aed1cb] /lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7b1fbe1] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7a46e81] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... 21:08:51 (3952): called boinc_finish(193) SIGILL: illegal instruction Stack trace (14 frames): /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x83d8117] linux-gate.so.1(__kernel_sigreturn+0x0)[0x2a99eb70] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81ff800] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81f5809] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x819f8d7] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x8084efa] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81f2308] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x808b160] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x806bc09] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x807f7e5] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81ddb4f] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81e121b] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x836e63f] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0x2a68be81] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1367, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (19 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f23b70] /lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7a83a69] /lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7b03468] /lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7b03835] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7b01db2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f23b70] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f23b59] /lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7b131cb] /lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7b45be1] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7a6ce81] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... SIGSEGV: segmentation violation Stack trace (15 frames): /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x83d8117] linux-gate.so.1(__kernel_sigreturn+0x0)[0x2aa1cb70] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81ff810] [0x3f88389f] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81f5809] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x819f862] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x8084efa] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81f2308] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x808b160] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x806bc09] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x807f7e5] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81ddb4f] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81e121b] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x836e63f] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0x2a709e81] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=15413, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (19 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f61b70] /lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7ac1a69] /lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7b41468] /lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7b41835] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7b3fdb2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f61b70] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f61b59] /lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7b511cb] /lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7b83be1] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7aaae81] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... SIGSEGV: segmentation violation Stack trace (3 frames): /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x83d8117] linux-gate.so.1(__kernel_sigreturn+0x0)[0x2a9c3b70] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81ff805] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1421, iMonCtr=1 Model crash detected, will try to restart... Signal 15 received: Software termination signal from kill Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (19 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7faeb70] /lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7b0ea69] /lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7b8e468] /lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7b8e835] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7b8cdb2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7faeb70] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7faeb59] /lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7b9e1cb] /lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7bd0be1] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7af7e81] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... SIGSEGV: segmentation violation Stack trace (3 frames): /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x83d8117] linux-gate.so.1(__kernel_sigreturn+0x0)[0x2a99eb70] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81ff805] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2113, iMonCtr=1 Model crash detected, will try to restart... SIGILL: illegal instruction Stack trace (14 frames): /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x83d8117] linux-gate.so.1(__kernel_sigreturn+0x0)[0x2aa75b70] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81ff800] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81f5809] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x819fa0d] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x8084efa] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81f2308] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x808b160] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x806bc09] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x807f7e5] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81ddb4f] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81e121b] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x836e63f] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0x2a762e81] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2113, iMonCtr=1 Model crash detected, will try to restart... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (19 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f62b70] /lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7ac2a69] /lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7b42468] /lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7b42835] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7b40db2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f62b70] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f62b59] /lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7b521cb] /lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7b84be1] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7aabe81] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... SIGSEGV: segmentation violation Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1396, iMonCtr=1 Model crash detected, will try to restart... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... 19:38:17 (13432): called boinc_finish(193) Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... Signal 15 received: Software termination signal from kill Signal 15 received: Abnormal termination triggered by abort call Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (19 frames): ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x80d4cf7] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f28b70] /lib/i386-linux-gnu/libc.so.6(getenv+0x99)[0xf7a88a69] /lib/i386-linux-gnu/libc.so.6(+0xaf468)[0xf7b08468] /lib/i386-linux-gnu/libc.so.6(+0xaf835)[0xf7b08835] /lib/i386-linux-gnu/libc.so.6(localtime_r+0x12)[0xf7b06db2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d01b2] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d0900] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80d09f1] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7f28b70] linux-gate.so.1(__kernel_vsyscall+0x9)[0xf7f28b59] /lib/i386-linux-gnu/libc.so.6(nanosleep+0x4b)[0xf7b181cb] /lib/i386-linux-gnu/libc.so.6(usleep+0x41)[0xf7b4abe1] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80e78a5] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x80503e8] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051b13] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x8051d8b] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0xf7a71e81] ../../projects/climateprediction.net/hadam4_8.52_i686-pc-linux-gnu[0x804cd21] Exiting... SIGSEGV: segmentation violation Stack trace (14 frames): /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu(boinc_catch_signal+0x67)[0x83d8117] linux-gate.so.1(__kernel_sigreturn+0x0)[0x2a9e7b70] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81ff801] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81f5809] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x819f862] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x8084efa] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81f2308] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x808b160] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x806bc09] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x807f7e5] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81ddb4f] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x81e121b] /var/lib/boinc-client/projects/climateprediction.net/hadam4_um_8.52_i686-pc-linux-gnu[0x836e63f] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0x2a6d4e81] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1492, iMonCtr=1 Model crash detected, will try to restart... 09:42:13 (1492): called boinc_finish(0) </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Apr 2020 12:28:03	1499735	21919951	hadam4h_a1qr_209811_4_861_011983374_1	34,763	1,978,140	56.9036
09 Apr 2020 08:32:05	1499735	21919951	hadam4h_a1qr_209811_4_861_011983374_1	26,123	1,483,682	56.7960
01 Apr 2020 10:24:30	1499735	21919951	hadam4h_a1qr_209811_4_861_011983374_1	17,483	984,035	56.2852
01 Apr 2020 09:19:42	1499735	21919951	hadam4h_a1qr_209811_4_861_011983374_1	8,843	495,075	55.9850