Name | hadcm3n_zk7s_1880_40_008252922_2 |
Workunit | 8408046 |
Created | 24 Nov 2012, 2:26:55 UTC |
Sent | 24 Nov 2012, 2:28:09 UTC |
Report deadline | 23 Feb 2013, 9:55:20 UTC |
Received | 14 Jan 2013, 19:47:34 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 193 (0x000000C1) EXIT_SIGNAL |
Computer ID | 1228540 |
Run time | 32 days 4 hours 16 min 2 sec |
CPU time | 30 days 7 hours 43 min 58 sec |
Validate state | Invalid |
Credit | 12,441.60 |
Device peak FLOPS | 1.94 GFLOPS |
Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu |
Stderr | <core_client_version>7.0.29</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> 05:44:38 (13941): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:47:20 (19525): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:50:04 (19579): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:52:35 (19643): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:54:33 (19691): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:56:34 (19745): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:59:25 (19792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:52:17 (12829): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:52:18 (12829): No heartbeat from core client for 30 sec - exiting 18:52:19 (12829): No heartbeat from core client for 30 sec - exiting 18:52:20 (12829): No heartbeat from core client for 30 sec - exiting 18:52:21 (12829): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 19:03:54 (23184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:17:48 (23283): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: free(): invalid next size (normal): 0x087db778 *** ======= Backtrace: ========= /lib32/libc.so.6(+0x77620)[0xf74c7620] /usr/lib/gcc/x86_64-pc-linux-gnu/4.6.3/32/libstdc++.so.6(_ZdlPv+0x1f)[0xf76f17bf] /usr/lib/gcc/x86_64-pc-linux-gnu/4.6.3/32/libstdc++.so.6(_ZdaPv+0x1b)[0xf76f183b] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib32/libc.so.6(__libc_start_main+0xf3)[0xf746c953] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] ======= Memory map: ======== 08048000-080e3000 r-xp 00000000 fc:06 16777876 /var/lib/boinc/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e3000-080e4000 rw-p 0009b000 fc:06 16777876 /var/lib/boinc/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e4000-0813b000 rw-p 00000000 00:00 0 08717000-08817000 rw-p 00000000 00:00 0 [heap] f6fd1000-f6fd2000 rw-p 00000000 00:00 0 f6fd2000-f744d000 rw-s 00000000 fc:06 16780098 /var/lib/boinc/slots/13/137310 f744d000-f7450000 rw-p 00000000 00:00 0 f7450000-f75f3000 r-xp 00000000 fc:01 1118945 /lib32/libc-2.15.so f75f3000-f75f5000 r--p 001a3000 fc:01 1118945 /lib32/libc-2.15.so f75f5000-f75f6000 rw-p 001a5000 fc:01 1118945 /lib32/libc-2.15.so f75f6000-f75f9000 rw-p 00000000 00:00 0 f75f9000-f7614000 r-xp 00000000 fc:01 983787 /usr/lib64/gcc/x86_64-pc-linux-gnu/4.6.3/32/libgcc_s.so.1 f7614000-f7615000 r--p 0001a000 fc:01 983787 /usr/lib64/gcc/x86_64-pc-linux-gnu/4.6.3/32/libgcc_s.so.1 f7615000-f7616000 rw-p 0001b000 fc:01 983787 /usr/lib64/gcc/x86_64-pc-linux-gnu/4.6.3/32/libgcc_s.so.1 f7616000-f7640000 r-xp 00000000 fc:01 1114875 /lib32/libm-2.15.so f7640000-f7641000 r--p 00029000 fc:01 1114875 /lib32/libm-2.15.so f7641000-f7642000 rw-p 0002a000 fc:01 1114875 /lib32/libm-2.15.so f7642000-f7643000 rw-p 00000000 00:00 0 f7643000-f7725000 r-xp 00000000 fc:01 983766 /usr/lib64/gcc/x86_64-pc-linux-gnu/4.6.3/32/libstdc++.so.6.0.16 f7725000-f7729000 r--p 000e2000 fc:01 983766 /usr/lib64/gcc/x86_64-pc-linux-gnu/4.6.3/32/libstdc++.so.6.0.16 f7729000-f772a000 rw-p 000e6000 fc:01 983766 /usr/lib64/gcc/x86_64-pc-linux-gnu/4.6.3/32/libstdc++.so.6.0.16 f772a000-f7731000 rw-p 00000000 00:00 0 f7731000-f7734000 r-xp 00000000 fc:01 1117542 /lib32/libdl-2.15.so f7734000-f7735000 r--p 00002000 fc:01 1117542 /lib32/libdl-2.15.so f7735000-f7736000 rw-p 00003000 fc:01 1117542 /lib32/libdl-2.15.so f7736000-f774e000 r-xp 00000000 fc:01 1117753 /lib32/libpthread-2.15.so f774e000-f774f000 r--p 00017000 fc:01 1117753 /lib32/libpthread-2.15.so f774f000-f7750000 rw-p 00018000 fc:01 1117753 /lib32/libpthread-2.15.so f7750000-f7752000 rw-p 00000000 00:00 0 f7776000-f7777000 rw-p 00000000 00:00 0 f7777000-f7778000 ---p 00000000 00:00 0 f7778000-f777b000 rw-p 00000000 00:00 0 [stack:3485] f777b000-f777d000 rw-s 00000000 fc:06 16780091 /var/lib/boinc/slots/13/boinc_mmap_file f777d000-f777e000 rw-p 00000000 00:00 0 f777e000-f779e000 r-xp 00000000 fc:01 1116708 /lib32/ld-2.15.so f779e000-f779f000 r-xp 00000000 00:00 0 [vdso] f779f000-f77a0000 r--p 00020000 fc:01 1116708 /lib32/ld-2.15.so f77a0000-f77a1000 rw-p 00021000 fc:01 1116708 /lib32/ld-2.15.so ffdf9000-ffe6a000 rw-p 00000000 00:00 0 [stack] SIGABRT: abort called Stack trace (17 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf779e400] linux-gate.so.1(__kernel_vsyscall+0x5)[0xf779e425] /lib32/libc.so.6(gsignal+0x47)[0xf7481907] /lib32/libc.so.6(abort+0x186)[0xf7483126] /lib32/libc.so.6(+0x70d85)[0xf74c0d85] /lib32/libc.so.6(+0x77620)[0xf74c7620] /usr/lib/gcc/x86_64-pc-linux-gnu/4.6.3/32/libstdc++.so.6(_ZdlPv+0x1f)[0xf76f17bf] /usr/lib/gcc/x86_64-pc-linux-gnu/4.6.3/32/libstdc++.so.6(_ZdaPv+0x1b)[0xf76f183b] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib32/libc.so.6(__libc_start_main+0xf3)[0xf746c953] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
14 Jan 2013 19:48:19 | 1228540 | 15459798 | hadcm3n_zk7s_1880_40_008252922_2 | 1,036,800 | 2,619,833 | 2.5268 |
01 Jan 2013 15:20:55 | 1228540 | 15459798 | hadcm3n_zk7s_1880_40_008252922_2 | 1,010,880 | 2,556,617 | 2.5291 |
31 Dec 2012 21:18:11 | 1228540 | 15459798 | hadcm3n_zk7s_1880_40_008252922_2 | 984,960 | 2,491,634 | 2.5297 |
31 Dec 2012 03:02:15 | 1228540 | 15459798 | hadcm3n_zk7s_1880_40_008252922_2 | 959,040 | 2,425,658 | 2.5293 |
28 Dec 2012 12:50:17 | 1228540 | 15459798 | hadcm3n_zk7s_1880_40_008252922_2 | 933,120 | 2,360,514 | 2.5297 |
27 Dec 2012 18:07:44 | 1228540 | 15459798 | hadcm3n_zk7s_1880_40_008252922_2 | 907,200 | 2,293,440 | 2.5280 |
26 Dec 2012 22:17:01 | 1228540 | 15459798 | hadcm3n_zk7s_1880_40_008252922_2 | 881,280 | 2,222,655 | 2.5221 |
26 Dec 2012 03:17:46 | 1228540 | 15459798 | hadcm3n_zk7s_1880_40_008252922_2 | 855,360 | 2,154,377 | 2.5187 |
25 Dec 2012 07:32:13 | 1228540 | 15459798 | hadcm3n_zk7s_1880_40_008252922_2 | 829,440 | 2,085,739 | 2.5146 |
24 Dec 2012 10:53:22 | 1228540 | 15459798 | hadcm3n_zk7s_1880_40_008252922_2 | 803,520 | 2,011,523 | 2.5034 |
23 Dec 2012 16:59:58 | 1228540 | 15459798 | hadcm3n_zk7s_1880_40_008252922_2 | 777,600 | 1,947,118 | 2.5040 |
22 Dec 2012 22:20:36 | 1228540 | 15459798 | hadcm3n_zk7s_1880_40_008252922_2 | 751,680 | 1,880,065 | 2.5012 |
21 Dec 2012 19:57:33 | 1228540 | 15459798 | hadcm3n_zk7s_1880_40_008252922_2 | 725,760 | 1,813,500 | 2.4988 |
20 Dec 2012 23:47:49 | 1228540 | 15459798 | hadcm3n_zk7s_1880_40_008252922_2 | 699,840 | 1,746,124 | 2.4950 |
20 Dec 2012 02:24:54 | 1228540 | 15459798 | hadcm3n_zk7s_1880_40_008252922_2 | 673,920 | 1,678,430 | 2.4905 |
19 Dec 2012 04:51:15 | 1228540 | 15459798 | hadcm3n_zk7s_1880_40_008252922_2 | 648,000 | 1,611,592 | 2.4870 |
17 Dec 2012 17:36:24 | 1228540 | 15459798 | hadcm3n_zk7s_1880_40_008252922_2 | 622,080 | 1,543,060 | 2.4805 |
15 Dec 2012 18:21:35 | 1228540 | 15459798 | hadcm3n_zk7s_1880_40_008252922_2 | 596,160 | 1,472,792 | 2.4705 |
14 Dec 2012 12:30:26 | 1228540 | 15459798 | hadcm3n_zk7s_1880_40_008252922_2 | 570,240 | 1,401,641 | 2.4580 |
14 Dec 2012 05:56:59 | 1228540 | 15459798 | hadcm3n_zk7s_1880_40_008252922_2 | 544,320 | 1,331,753 | 2.4466 |
©2024 cpdn.org