climateprediction.net home page
Task 15305529

Task 15305529

Name hadcm3n_zlcj_1880_40_008198313_4
Workunit 8353437
Created 23 Sep 2012, 17:55:50 UTC
Sent 23 Sep 2012, 17:56:06 UTC
Report deadline 24 Dec 2012, 1:23:17 UTC
Received 5 Oct 2012, 21:51:25 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1149630
Run time 7 days 1 hours 38 min 40 sec
CPU time 6 days 18 hours 16 min 1 sec
Validate state Invalid
Credit 3,110.40
Device peak FLOPS 2.31 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.12.33</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
19:45:03 (1349): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:46:25 (4047): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:47:49 (4054): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:54:35 (4060): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:56:01 (4066): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:58:12 (4071): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:59:38 (4075): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:01:04 (4080): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:03:05 (4085): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:04:31 (4089): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:05:57 (4094): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:08:18 (4099): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:09:44 (4103): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:11:10 (4108): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:13:26 (4113): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:14:52 (4117): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:16:18 (4122): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:18:15 (4130): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:19:41 (4134): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:21:07 (4139): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:23:13 (4144): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:24:59 (4148): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:26:25 (4154): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:28:41 (4159): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:30:07 (4163): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:31:33 (4168): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:33:49 (4173): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:35:15 (4177): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:36:41 (4182): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:38:42 (4187): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:40:38 (4191): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:42:04 (4208): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:44:16 (4213): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:45:42 (4217): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:47:43 (4222): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:49:09 (4227): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:50:35 (4231): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:52:36 (4236): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:54:07 (4241): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:55:33 (4477): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:57:45 (4531): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:59:25 (4686): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:15:23 (4690): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:19:33 (4700): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:20:55 (4709): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:26:31 (4751): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:19:41 (4870): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
00:22:34 (5271): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
00:23:55 (5280): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
00:45:12 (5285): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:53:55 (5308): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:03:12 (5316): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:21:43 (5323): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:23:09 (5338): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:35:09 (5342): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:36:36 (5350): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:58:47 (5356): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:05:04 (5379): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:11:27 (5385): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:22:00 (5391): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:32:18 (5402): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:47:27 (5410): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:00:21 (5451): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:02:27 (5461): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:04:38 (5465): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:06:39 (5471): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:12:47 (5475): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:18:54 (5481): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:35:09 (5489): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:57:04 (5501): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:26:16 (5526): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:32:31 (5543): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:38:32 (5549): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09242a60 ***
======= Backtrace: =========
/lib/i386-linux-gnu/libc.so.6(+0x6ff22)[0x38bf22]
/lib/i386-linux-gnu/libc.so.6(+0x70bc2)[0x38cbc2]
/lib/i386-linux-gnu/libc.so.6(cfree+0x6d)[0x38fcad]
/usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdlPv+0x1f)[0x90480f]
/usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdaPv+0x1b)[0x90486b]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x335113]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
00214000-00230000 r-xp 00000000 08:01 12583153   /lib/i386-linux-gnu/libgcc_s.so.1
00230000-00231000 r--p 0001b000 08:01 12583153   /lib/i386-linux-gnu/libgcc_s.so.1
00231000-00232000 rw-p 0001c000 08:01 12583153   /lib/i386-linux-gnu/libgcc_s.so.1
002f2000-0031a000 r-xp 00000000 08:01 12583245   /lib/i386-linux-gnu/libm-2.13.so
0031a000-0031b000 r--p 00028000 08:01 12583245   /lib/i386-linux-gnu/libm-2.13.so
0031b000-0031c000 rw-p 00029000 08:01 12583245   /lib/i386-linux-gnu/libm-2.13.so
0031c000-00494000 r-xp 00000000 08:01 12583241   /lib/i386-linux-gnu/libc-2.13.so
00494000-00496000 r--p 00178000 08:01 12583241   /lib/i386-linux-gnu/libc-2.13.so
00496000-00497000 rw-p 0017a000 08:01 12583241   /lib/i386-linux-gnu/libc-2.13.so
00497000-0049a000 rw-p 00000000 00:00 0 
00857000-00935000 r-xp 00000000 08:01 6948093    /usr/lib/i386-linux-gnu/libstdc++.so.6.0.16
00935000-00936000 ---p 000de000 08:01 6948093    /usr/lib/i386-linux-gnu/libstdc++.so.6.0.16
00936000-0093a000 r--p 000de000 08:01 6948093    /usr/lib/i386-linux-gnu/libstdc++.so.6.0.16
0093a000-0093b000 rw-p 000e2000 08:01 6948093    /usr/lib/i386-linux-gnu/libstdc++.so.6.0.16
0093b000-00942000 rw-p 00000000 00:00 0 
0096b000-0096e000 r-xp 00000000 08:01 12583244   /lib/i386-linux-gnu/libdl-2.13.so
0096e000-0096f000 r--p 00002000 08:01 12583244   /lib/i386-linux-gnu/libdl-2.13.so
0096f000-00970000 rw-p 00003000 08:01 12583244   /lib/i386-linux-gnu/libdl-2.13.so
00a3c000-00a5a000 r-xp 00000000 08:01 12583154   /lib/i386-linux-gnu/ld-2.13.so
00a5a000-00a5b000 r--p 0001d000 08:01 12583154   /lib/i386-linux-gnu/ld-2.13.so
00a5b000-00a5c000 rw-p 0001e000 08:01 12583154   /lib/i386-linux-gnu/ld-2.13.so
00bb7000-00bb8000 r-xp 00000000 00:00 0          [vdso]
00e75000-00e8c000 r-xp 00000000 08:01 12583255   /lib/i386-linux-gnu/libpthread-2.13.so
00e8c000-00e8d000 r--p 00016000 08:01 12583255   /lib/i386-linux-gnu/libpthread-2.13.so
00e8d000-00e8e000 rw-p 00017000 08:01 12583255   /lib/i386-linux-gnu/libpthread-2.13.so
00e8e000-00e90000 rw-p 00000000 00:00 0 
08048000-080e3000 r-xp 00000000 08:01 25952616   /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:01 25952616   /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
091ed000-09252000 rw-p 00000000 00:00 0          [heap]
b7100000-b7121000 rw-p 00000000 00:00 0 
b7121000-b7200000 ---p 00000000 00:00 0 
b72cf000-b774a000 rw-s 00000000 08:01 29884441   /var/lib/boinc-client/slots/0/139415
b774a000-b774e000 rw-p 00000000 00:00 0 
b775a000-b775b000 rw-p 00000000 00:00 0 
b775b000-b775c000 ---p 00000000 00:00 0 
b775c000-b775f000 rw-p 00000000 00:00 0 
b775f000-b7761000 rw-s 00000000 08:01 29884437   /var/lib/boinc-client/slots/0/boinc_mmap_file
b7761000-b7763000 rw-p 00000000 00:00 0 
bfa92000-bfb01000 rw-p 00000000 00:00 0          [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xbb7400]
[0xbb7416]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0x349c8f]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0x34d2b5]
/lib/i386-linux-gnu/libc.so.6(+0x6515c)[0x38115c]
/lib/i386-linux-gnu/libc.so.6(+0x6ff22)[0x38bf22]
/lib/i386-linux-gnu/libc.so.6(+0x70bc2)[0x38cbc2]
/lib/i386-linux-gnu/libc.so.6(cfree+0x6d)[0x38fcad]
/usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdlPv+0x1f)[0x90480f]
/usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdaPv+0x1b)[0x90486b]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x335113]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
05 Oct 2012 21:39:26 1149630 15305529 hadcm3n_zlcj_1880_40_008198313_4 259,200 584,157 2.2537
05 Oct 2012 04:21:33 1149630 15305529 hadcm3n_zlcj_1880_40_008198313_4 233,280 526,901 2.2587
04 Oct 2012 10:13:25 1149630 15305529 hadcm3n_zlcj_1880_40_008198313_4 207,360 468,751 2.2606
03 Oct 2012 16:43:27 1149630 15305529 hadcm3n_zlcj_1880_40_008198313_4 181,440 410,323 2.2615
02 Oct 2012 23:19:34 1149630 15305529 hadcm3n_zlcj_1880_40_008198313_4 155,520 352,006 2.2634
02 Oct 2012 06:26:32 1149630 15305529 hadcm3n_zlcj_1880_40_008198313_4 129,600 293,467 2.2644
01 Oct 2012 13:21:21 1149630 15305529 hadcm3n_zlcj_1880_40_008198313_4 103,680 234,770 2.2644
30 Sep 2012 19:46:37 1149630 15305529 hadcm3n_zlcj_1880_40_008198313_4 77,760 175,934 2.2625
30 Sep 2012 03:00:29 1149630 15305529 hadcm3n_zlcj_1880_40_008198313_4 51,840 117,396 2.2646
28 Sep 2012 21:12:56 1149630 15305529 hadcm3n_zlcj_1880_40_008198313_4 25,920 58,658 2.2630


©2024 cpdn.org