Task 16572480

Name	hadam3pm2_e8br_1991_10_008713834_0
Workunit	8860308
Created	19 Apr 2014, 9:22:13 UTC
Sent	1 May 2014, 12:45:32 UTC
Report deadline	13 Apr 2015, 18:05:32 UTC
Received	29 May 2014, 1:00:52 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1294024
Run time	18 days 15 hours 4 min 35 sec
CPU time	16 days 6 hours 15 min 10 sec
Validate state	Invalid
Credit	8,151.64
Device peak FLOPS	2.05 GFLOPS
Application version	UK Met Office HadAM3P (global only) with MOSES II landsurface scheme v7.03 i686-pc-linux-gnu
Stderr	<core_client_version>7.0.27</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> oa.pc\|1dec.nc oa.pc\|2jan.nc oa.pc\|2feb.nc oa.pc\|2mar.nc oa.pc\|2apr.nc oa.pc\|2may.nc oa.pc\|2jun.nc oa.pc\|2jul.nc oa.pc\|2aug.nc oa.pc\|2sep.nc oa.pc\|2oct.nc oa.pc\|2nov.nc oa.pe\|1dec.nc oa.pe\|2jan.nc oa.pe\|2feb.nc oa.pe\|2mar.nc oa.pe\|2apr.nc oa.pe\|2may.nc oa.pe\|2jun.nc oa.pe\|2jul.nc oa.pe\|2aug.nc oa.pe\|2sep.nc oa.pe\|2oct.nc oa.pe\|2nov.nc oa.pc\|2dec.nc oa.pc\|3jan.nc oa.pc\|3feb.nc oa.pc\|3mar.nc oa.pc\|3apr.nc oa.pc\|3may.nc oa.pc\|3jun.nc oa.pc\|3jul.nc oa.pc\|3aug.nc oa.pc\|3sep.nc oa.pc\|3oct.nc oa.pc\|3nov.nc oa.pe\|2dec.nc oa.pe\|3jan.nc oa.pe\|3feb.nc oa.pe\|3mar.nc oa.pe\|3apr.nc oa.pe\|3may.nc oa.pe\|3jun.nc oa.pe\|3jul.nc oa.pe\|3aug.nc oa.pe\|3sep.nc oa.pe\|3oct.nc oa.pe\|3nov.nc oa.pc\|3dec.nc oa.pc\|4jan.nc oa.pc\|4feb.nc oa.pc\|4mar.nc oa.pc\|4apr.nc oa.pc\|4may.nc oa.pc\|4jun.nc oa.pc\|4jul.nc oa.pc\|4aug.nc oa.pc\|4sep.nc oa.pc\|4oct.nc oa.pc\|4nov.nc oa.pe\|3dec.nc oa.pe\|4jan.nc oa.pe\|4feb.nc oa.pe\|4mar.nc oa.pe\|4apr.nc oa.pe\|4may.nc oa.pe\|4jun.nc oa.pe\|4jul.nc oa.pe\|4aug.nc oa.pe\|4sep.nc oa.pe\|4oct.nc oa.pe\|4nov.nc 05:41:43 (24485): No heartbeat from client for 30 sec - exiting 05:41:46 (24485): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:41:47 (24485): No heartbeat from client for 30 sec - exiting 05:41:47 (24485): timer handler: client dead, exiting 05:41:48 (24485): No heartbeat from client for 30 sec - exiting 05:41:48 (24485): timer handler: client dead, exiting 05:41:49 (24485): No heartbeat from client for 30 sec - exiting 05:41:52 (24485): timer handler: client dead, exiting 05:41:53 (24485): No heartbeat from client for 30 sec - exiting 05:41:56 (24485): timer handler: client dead, exiting 05:41:57 (24485): No heartbeat from client for 30 sec - exiting 05:41:57 (24485): timer handler: client dead, exiting 05:41:58 (24485): No heartbeat from client for 30 sec - exiting 05:42:00 (24485): timer handler: client dead, exiting 05:42:01 (24485): No heartbeat from client for 30 sec - exiting 05:42:03 (24485): timer handler: client dead, exiting 05:42:04 (24485): No heartbeat from client for 30 sec - exiting 05:42:08 (24485): timer handler: client dead, exiting 05:42:09 (24485):05:53:30 (3578): No heartbeat from client for 30 sec - exiting 05:53:41 (3578): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:16:50 (6440): No heartbeat from client for 30 sec - exiting 02:16:50 (6440): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... oa.pc\|5dec.nc oa.pc\|6jan.nc oa.pc\|6feb.nc oa.pc\|6mar.nc oa.pc\|6apr.nc oa.pc\|6may.nc oa.pc\|6jun.nc oa.pc\|6jul.nc oa.pc\|6aug.nc oa.pc\|6sep.nc oa.pc\|6oct.nc oa.pc\|6nov.nc oa.pe\|5dec.nc oa.pe\|6jan.nc oa.pe\|6feb.nc oa.pe\|6mar.nc oa.pe\|6apr.nc oa.pe\|6may.nc oa.pe\|6jun.nc oa.pe\|6jul.nc oa.pe\|6aug.nc oa.pe\|6sep.nc oa.pe\|6oct.nc oa.pe\|6nov.nc oa.pc\|6dec.nc oa.pc\|7jan.nc oa.pc\|7feb.nc oa.pc\|7mar.nc oa.pc\|7apr.nc oa.pc\|7may.nc oa.pc\|7jun.nc oa.pc\|7jul.nc oa.pc\|7aug.nc oa.pc\|7sep.nc oa.pc\|7oct.nc oa.pc\|7nov.nc oa.pe\|6dec.nc oa.pe\|7jan.nc oa.pe\|7feb.nc oa.pe\|7mar.nc oa.pe\|7apr.nc oa.pe\|7may.nc oa.pe\|7jun.nc oa.pe\|7jul.nc oa.pe\|7aug.nc oa.pe\|7sep.nc oa.pe\|7oct.nc oa.pe\|7nov.nc oa.pc\|7dec.nc oa.pc\|8jan.nc oa.pc\|8feb.nc oa.pc\|8mar.nc oa.pc\|8apr.nc oa.pc\|8may.nc oa.pc\|8jun.nc oa.pc\|8jul.nc oa.pc\|8aug.nc oa.pc\|8sep.nc oa.pc\|8oct.nc oa.pc\|8nov.nc oa.pe\|7dec.nc oa.pe\|8jan.nc oa.pe\|8feb.nc oa.pe\|8mar.nc oa.pe\|8apr.nc oa.pe\|8may.nc oa.pe\|8jun.nc oa.pe\|8jul.nc oa.pe\|8aug.nc oa.pe\|8sep.nc oa.pe\|8oct.nc oa.pe\|8nov.nc oa.pc\|8dec.nc oa.pc\|9jan.nc oa.pc\|9feb.nc oa.pc\|9mar.nc oa.pc\|9apr.nc oa.pc\|9may.nc oa.pc\|9jun.nc oa.pc\|9jul.nc oa.pc\|9aug.nc oa.pc\|9sep.nc oa.pc\|9oct.nc oa.pc\|9nov.nc oa.pe\|8dec.nc oa.pe\|9jan.nc oa.pe\|9feb.nc oa.pe\|9mar.nc oa.pe\|9apr.nc oa.pe\|9may.nc oa.pe\|9jun.nc oa.pe\|9jul.nc oa.pe\|9aug.nc oa.pe\|9sep.nc oa.pe\|9oct.nc oa.pe\|9nov.nc 05:52:44 (15880): No heartbeat from client for 30 sec - exiting 05:53:09 (15880): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Model crashed: (null) Model crashed: æM Model crashed: æM Model crashed: æM Model crashed: æM Model crashed: æM Sorry, too many model crashes! :-( 01:57:44 (21844): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 May 2014 23:39:21	1294024	16572480	hadam3pm2_e8br_1991_10_008713834_0	282,308	1,395,219	4.9422
26 May 2014 19:39:51	1294024	16572480	hadam3pm2_e8br_1991_10_008713834_0	279,428	1,381,074	4.9425
26 May 2014 11:28:31	1294024	16572480	hadam3pm2_e8br_1991_10_008713834_0	273,668	1,352,646	4.9427
26 May 2014 07:22:46	1294024	16572480	hadam3pm2_e8br_1991_10_008713834_0	270,788	1,338,317	4.9423
26 May 2014 03:22:03	1294024	16572480	hadam3pm2_e8br_1991_10_008713834_0	267,908	1,323,936	4.9418
25 May 2014 23:16:15	1294024	16572480	hadam3pm2_e8br_1991_10_008713834_0	265,028	1,309,717	4.9418
25 May 2014 19:15:03	1294024	16572480	hadam3pm2_e8br_1991_10_008713834_0	262,148	1,295,441	4.9416
25 May 2014 15:12:07	1294024	16572480	hadam3pm2_e8br_1991_10_008713834_0	259,268	1,281,162	4.9415
25 May 2014 11:06:58	1294024	16572480	hadam3pm2_e8br_1991_10_008713834_0	256,388	1,266,874	4.9412
25 May 2014 07:11:18	1294024	16572480	hadam3pm2_e8br_1991_10_008713834_0	253,508	1,252,681	4.9414
25 May 2014 03:10:29	1294024	16572480	hadam3pm2_e8br_1991_10_008713834_0	250,628	1,238,625	4.9421
24 May 2014 22:59:33	1294024	16572480	hadam3pm2_e8br_1991_10_008713834_0	247,748	1,224,303	4.9417
24 May 2014 19:03:46	1294024	16572480	hadam3pm2_e8br_1991_10_008713834_0	244,868	1,210,221	4.9423
24 May 2014 11:47:07	1294024	16572480	hadam3pm2_e8br_1991_10_008713834_0	239,108	1,182,018	4.9434
24 May 2014 07:06:12	1294024	16572480	hadam3pm2_e8br_1991_10_008713834_0	236,228	1,167,770	4.9434
24 May 2014 03:10:24	1294024	16572480	hadam3pm2_e8br_1991_10_008713834_0	233,348	1,153,517	4.9433
23 May 2014 23:04:23	1294024	16572480	hadam3pm2_e8br_1991_10_008713834_0	230,468	1,139,312	4.9435
23 May 2014 19:03:27	1294024	16572480	hadam3pm2_e8br_1991_10_008713834_0	227,588	1,125,041	4.9433
23 May 2014 15:15:04	1294024	16572480	hadam3pm2_e8br_1991_10_008713834_0	224,708	1,110,796	4.9433
23 May 2014 11:25:59	1294024	16572480	hadam3pm2_e8br_1991_10_008713834_0	221,828	1,096,484	4.9429