Task 13126733

Name	hadcm3n_ym1p_1900_40_007361431_0
Workunit	7558861
Created	6 Jul 2011, 15:19:09 UTC
Sent	7 Jul 2011, 14:51:58 UTC
Report deadline	6 Oct 2011, 22:19:09 UTC
Received	9 Aug 2011, 6:34:17 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	942621
Run time	6 days 11 hours 34 min 40 sec
CPU time	3 days 22 hours 48 min 38 sec
Validate state	Invalid
Credit	2,488.32
Device peak FLOPS	3.45 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.6.36</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:11:33 (40349): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:42:44 (47069): No heartbeat from core client for 30 sec - exiting 10:42:46 (47069): No heartbeat from core client for 30 sec - exiting 10:42:47 (47069): No heartbeat from core client for 30 sec - exiting 10:42:48 (47069): No heartbeat from core client for 30 sec - exiting 10:42:49 (47069): No heartbeat from core client for 30 sec - exiting 10:42:50 (47069): No heartbeat from core client for 30 sec - exiting 10:42:51 (47069): No heartbeat from core client for 30 sec - exiting 10:42:52 (47069): No heartbeat from core client for 30 sec - exiting 10:42:53 (47069): No heartbeat from core client for 30 sec - exiting 10:42:54 (47069): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:45:36 (49263): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:57:49 (50935): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:23:41 (54472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... OPEN: File Creation Failed: No space left on device OPEN: Unable to Open File dataout/ym1pko.daa3co0 for Read/Write Model crashed: DUMPCTL : Fail to open output dump - may already exist tmp/pipe_dummy 2048 forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_ym1p_1900_40_007361431/dataout/stdout_um.txt Image PC Routine Line Source hadcm3n_um_6.07_i 0042E622 Unknown Unknown Unknown hadcm3n_um_6.07_i 0042D0EB Unknown Unknown Unknown hadcm3n_um_6.07_i 003EF4DD Unknown Unknown Unknown hadcm3n_um_6.07_i 003A66F5 Unknown Unknown Unknown hadcm3n_um_6.07_i 003A5E57 Unknown Unknown Unknown hadcm3n_uController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=58817, iMonCtr=1 Model crash detected, will try to restart... forrtl: No space left on device forrtl: severe (38): error during write, unit -1, file stdout Image PC Routine Line Source hadcm3n_um_6.07_i 0042E622 Unknown Unknown Unknown hadcm3n_um_6.07_i 0042D0EB Unknown Unknown Unknown hadcm3n_um_6.07_i 003EF4DD Unknown Unknown Unknown hadcm3n_um_6.07_i 003A66F5 Unknown Unknown Unknown hadcm3n_um_6.07_i 003A5E57 Unknown Unknown Unknown hadcm3n_um_6.07_i 003E1BF7 Unknown Unknown Unknown hadcm3n_um_6.07_i 000FEDA0 Unknown Unknown Unknown hadcm3n_um_6.07_i 0020B19B Unknown Unknown Unknown hadcm3n_um_6.07_i 00160E7A Unknown Unknown Unknown hadcm3n_um_6.07_i 00164453 Unknown Unknown Unknown hadcm3n_um_6.07_i 0038CE7D Unknown Unknown Unknown hadcm3n_um_6.07_i 0038A1ED Unknown Unknown Unknown hadcm3n_um_6.07_i 000048E1 Unknown Unknown Unknown hadcm3n_um_6.07_i 000027FB Unknown Unknown Unknown hadcm3n_um_6.07_i 00002729 Unknown Unknown Unknown Unknown 00000003 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=58817, iMonCtr=1 Model crash detected, will try to restart... forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_ym1p_1900_40_007361431/dataout/stdout_um.txt Image PC Routine Line Source hadcm3n_um_6.07_i 0042E622 Unknown Unknown Unknown hadcm3n_um_6.07_i 0042D0EB Unknown Unknown Unknown hadcm3n_um_6.07_i 003EF4DD Unknown Unknown Unknown hadcm3n_um_6.07_i 003A66F5 Unknown Unknown Unknown hadcm3n_um_6.07_i 003A5E57 Unknown Unknown Unknown hadcm3n_um_6.07_i 003E1BF7 Unknown Unknown Unknown hadcm3n_um_6.07_i 003DF4CC Unknown Unknown Unknown hadcm3n_um_6.07_i 0020BEDF Unknown Unknown Unknown hadcm3n_um_6.07_i 00160E7A Unknown Unknown Unknown hadcm3n_um_6.07_i 00164453 Unknown Unknown Unknown hadcm3n_um_6.07_i 0038CE7D Unknown Unknown Unknown hadcm3n_um_6.07_i 0038A1ED Unknown Unknown Unknown hadcm3n_um_6.07_i 000048E1 Unknown Unknown Unknown hadcm3n_um_6.07_i 000027FB Unknown Unknown Unknown hadcm3n_um_6.07_i 00002729 Unknown Unknown Unknown Unknown 00000003 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=58817, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:00:27 (49530): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 07:03:07 (52441): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... SIGSEGV: segmentation violation 07:10:09 (52461): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:10:10 (52461): No heartbeat from core client for 30 sec - exiting 07:10:11 (52461): No heartbeat from core client for 30 sec - exiting 07:10:12 (52461): No heartbeat from core client for 30 sec - exiting 07:31:41 (52566): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:06:39 (53338): No heartbeat from core client for 30 sec - exiting 08:06:42 (53338): No heartbeat from core client for 30 sec - exiting 08:06:43 (53338): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/ym1pko.pja4c10 is not a valid UM file. Error converting file to netcdf: dataout/ym1pko.pja4c10 Error: Input file: dataout/ym1pko.pia4c10 is not a valid UM file. Error converting file to netcdf: dataout/ym1pko.pia4c10 Error: Input file: dataout/ym1pko.pfa4c10 is not a valid UM file. Error converting file to netcdf: dataout/ym1pko.pfa4c10 Error: Input file: dataout/ym1pka.pha4c10 is not a valid UM file. Error converting file to netcdf: dataout/ym1pka.pha4c10 Error: Input file: dataout/ym1pka.pga4c10 is not a valid UM file. Error converting file to netcdf: dataout/ym1pka.pga4c10 Error: Input file: dataout/ym1pka.pea4c10 is not a valid UM file. Error converting file to netcdf: dataout/ym1pka.pea4c10 Error: Input file: dataout/ym1pka.pda4c10 is not a valid UM file. Error converting file to netcdf: dataout/ym1pka.pda4c10 CPDN Monitor - Quit request from BOINC... 18:28:42 (61923): No heartbeat from core client for 30 sec - exiting 18:28:44 (61923): No heartbeat from core client for 30 sec - exiting 18:28:45 (61923): No heartbeat from core client for 30 sec - exiting 18:28:46 (61923): No heartbeat from core client for 30 sec - exiting 18:28:47 (61923): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 21:34:45 (61938): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:34:46 (61938): No heartbeat from core client for 30 sec - exiting 22:36:02 (64455): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:36:03 (64455): No heartbeat from core client for 30 sec - exiting 22:36:04 (64455): No heartbeat from core client for 30 sec - exiting 22:36:05 (64455): No heartbeat from core client for 30 sec - exiting 22:36:06 (64455): No heartbeat from core client for 30 sec - exiting 22:36:07 (64455): No heartbeat from core client for 30 sec - exiting 22:36:08 (64455): No heartbeat from core client for 30 sec - exiting 22:36:09 (64455): No heartbeat from core client for 30 sec - exiting 22:36:10 (64455): No heartbeat from core client for 30 sec - exiting 22:36:11 (64455): No heartbeat from core client for 30 sec - exiting 22:36:12 (64455): No heartbeat from core client for 30 sec - exiting 22:36:13 (64455): No heartbeat from core client for 30 sec - exiting 22:36:14 (64455): No heartbeat from core client for 30 sec - exiting 22:39:11 (65288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:13:05 (31865): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:38:45 (35156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:38:46 (35156): No heartbeat from core client for 30 sec - exiting 06:38:47 (35156): No heartbeat from core client for 30 sec - exiting 06:38:48 (35156): No heartbeat from core client for 30 sec - exiting 06:38:50 (35156): No heartbeat from core client for 30 sec - exiting 06:38:51 (35156): No heartbeat from core client for 30 sec - exiting 06:38:52 (35156): No heartbeat from core client for 30 sec - exiting 06:38:53 (35156): No heartbeat from core client for 30 sec - exiting 06:38:54 (35156): No heartbeat from core client for 30 sec - exiting 06:38:55 (35156): No heartbeat from core client for 30 sec - exiting 06:38:56 (35156): No heartbeat from core client for 30 sec - exiting 06:38:57 (35156): No heartbeat from core client for 30 sec - exiting 06:38:58 (35156): No heartbeat from core client for 30 sec - exiting 06:38:59 (35156): No heartbeat from core client for 30 sec - exiting 06:39:00 (35156): No heartbeat from core client for 30 sec - exiting 06:39:01 (35156): No heartbeat from core client for 30 sec - exiting 06:39:02 (35156): No heartbeat from core client for 30 sec - exiting 06:39:03 (35156): No heartbeat from core client for 30 sec - exiting 06:39:04 (35156): No heartbeat from core client for 30 sec - exiting 06:39:05 (35156): No heartbeat from core client for 30 sec - exiting 06:39:06 (35156): No heartbeat from core client for 30 sec - exiting 06:39:07 (35156): No heartbeat from core client for 30 sec - exiting 06:39:08 (35156): No heartbeat from core client for 30 sec - exiting 06:39:09 (35156): No heartbeat from core client for 30 sec - exiting 06:39:10 (35156): No heartbeat from core client for 30 sec - exiting 06:39:11 (35156): No heartbeat from core client for 30 sec - exiting 06:39:12 (35156): No heartbeat from core client for 30 sec - exiting 06:39:13 (35156): No heartbeat from core client for 30 sec - exiting 06:39:14 (35156): No heartbeat from core client for 30 sec - exiting 06:39:15 (35156): No heartbeat from core client for 30 sec - exiting 06:39:16 (35156): No heartbeat from core client for 30 sec - exiting 06:39:17 (35156): No heartbeat from core client for 30 sec - exiting 06:39:18 (35156): No heartbeat from core client for 30 sec - exiting 06:39:19 (35156): No heartbeat from core client for 30 sec - exiting 06:39:20 (35156): No heartbeat from core client for 30 sec - exiting 06:39:21 (35156): No heartbeat from core client for 30 sec - exiting 06:39:22 (35156): No heartbeat from core client for 30 sec - exiting 06:39:23 (35156): No heartbeat from core client for 30 sec - exiting 06:39:24 (35156): No heartbeat from core client for 30 sec - exiting 06:39:25 (35156): No heartbeat from core client for 30 sec - exiting 06:39:26 (35156): No heartbeat from core client for 30 sec - exiting 06:39:27 (35156): No heartbeat from core client for 30 sec - exiting 06:39:28 (35156): No heartbeat from core client for 30 sec - exiting 06:39:29 (35156): No heartbeat from core client for 30 sec - exiting 06:39:30 (35156): No heartbeat from core client for 30 sec - exiting 06:39:31 (35156): No heartbeat from core client for 30 sec - exiting 06:39:32 (35156): No heartbeat from core client for 30 sec - exiting 06:39:33 (35156): No heartbeat from core client for 30 sec - exiting 06:39:34 (35156): No heartbeat from core client for 30 sec - exiting 06:39:35 (35156): No heartbeat from core client for 30 sec - exiting 06:39:36 (35156): No heartbeat from core client for 30 sec - exiting 06:39:37 (35156): No heartbeat from core client for 30 sec - exiting 06:39:38 (35156): No heartbeat from core client for 30 sec - exiting 06:39:39 (35156): No heartbeat from core client for 30 sec - exiting 06:39:40 (35156): No heartbeat from core client for 30 sec - exiting 06:39:41 (35156): No heartbeat from core client for 30 sec - exiting 06:39:42 (35156): No heartbeat from core client for 30 sec - exiting 06:39:43 (35156): No heartbeat from core client for 30 sec - exiting 06:39:44 (35156): No heartbeat from core client for 30 sec - exiting 06:39:45 (35156): No heartbeat from core client for 30 sec - exiting 06:39:46 (35156): No heartbeat from core client for 30 sec - exiting 06:39:47 (35156): No heartbeat from core client for 30 sec - exiting 06:39:48 (35156): No heartbeat from core client for 30 sec - exiting 06:39:49 (35156): No heartbeat from core client for 30 sec - exiting 06:39:50 (35156): No heartbeat from core client for 30 sec - exiting 06:39:51 (35156): No heartbeat from core client for 30 sec - exiting 06:39:52 (35156): No heartbeat from core client for 30 sec - exiting 06:39:53 (35156): No heartbeat from core client for 30 sec - exiting 06:39:54 (35156): No heartbeat from core client for 30 sec - exiting 06:39:55 (35156): No heartbeat from core client for 30 sec - exiting 06:39:56 (35156): No heartbeat from core client for 30 sec - exiting 06:39:57 (35156): No heartbeat from core client for 30 sec - exiting 06:39:59 (35156): No heartbeat from core client for 30 sec - exiting 06:40:00 (35156): No heartbeat from core client for 30 sec - exiting 06:40:01 (35156): No heartbeat from core client for 30 sec - exiting 06:40:02 (35156): No heartbeat from core client for 30 sec - exiting 06:40:03 (35156): No heartbeat from core client for 30 sec - exiting 06:40:04 (35156): No heartbeat from core client for 30 sec - exiting 06:40:05 (35156): No heartbeat from core client for 30 sec - exiting 06:40:06 (35156): No heartbeat from core client for 30 sec - exiting 06:40:07 (35156): No heartbeat from core client for 30 sec - exiting 06:40:08 (35156): No heartbeat from core client for 30 sec - exiting 06:40:09 (35156): No heartbeat from core client for 30 sec - exiting 06:40:10 (35156): No heartbeat from core client for 30 sec - exiting 06:40:11 (35156): No heartbeat from core client for 30 sec - exiting 06:40:12 (35156): No heartbeat from core client for 30 sec - exiting 06:40:13 (35156): No heartbeat from core client for 30 sec - exiting 06:40:14 (35156): No heartbeat from core client for 30 sec - exiting 06:40:15 (35156): No heartbeat from core client for 30 sec - exiting 06:40:16 (35156): No heartbeat from core client for 30 sec - exiting 06:40:17 (35156): No heartbeat from core client for 30 sec - exiting 06:40:18 (35156): No heartbeat from core client for 30 sec - exiting 06:40:19 (35156): No heartbeat from core client for 30 sec - exiting 06:40:20 (35156): No heartbeat from core client for 30 sec - exiting 06:40:21 (35156): No heartbeat from core client for 30 sec - exiting 06:40:22 (35156): No heartbeat from core client for 30 sec - exiting 06:40:23 (35156): No heartbeat from core client for 30 sec - exiting 06:40:24 (35156): No heartbeat from core client for 30 sec - exiting 06:40:25 (35156): No heartbeat from core client for 30 sec - exiting 06:40:26 (35156): No heartbeat from core client for 30 sec - exiting 06:40:27 (35156): No heartbeat from core client for 30 sec - exiting 06:40:28 (35156): No heartbeat from core client for 30 sec - exiting 06:40:29 (35156): No heartbeat from core client for 30 sec - exiting 06:40:30 (35156): No heartbeat from core client for 30 sec - exiting 06:40:31 (35156): No heartbeat from core client for 30 sec - exiting 06:40:32 (35156): No heartbeat from core client for 30 sec - exiting 06:40:33 (35156): No heartbeat from core client for 30 sec - exiting 06:40:34 (35156): No heartbeat from core client for 30 sec - exiting 06:40:35 (35156): No heartbeat from core client for 30 sec - exiting 06:40:36 (35156): No heartbeat from core client for 30 sec - exiting 06:40:37 (35156): No heartbeat from core client for 30 sec - exiting 06:40:38 (35156): No heartbeat from core client for 30 sec - exiting 06:40:39 (35156): No heartbeat from core client for 30 sec - exiting 06:40:40 (35156): No heartbeat from core client for 30 sec - exiting 06:40:41 (35156): No heartbeat from core client for 30 sec - exiting 06:40:42 (35156): No heartbeat from core client for 30 sec - exiting 06:40:43 (35156): No heartbeat from core client for 30 sec - exiting 06:40:44 (35156): No heartbeat from core client for 30 sec - exiting 06:40:45 (35156): No heartbeat from core client for 30 sec - exiting 06:40:46 (35156): No heartbeat from core client for 30 sec - exiting 06:40:47 (35156): No heartbeat from core client for 30 sec - exiting 06:40:48 (35156): No heartbeat from core client for 30 sec - exiting 06:40:49 (35156): No heartbeat from core client for 30 sec - exiting 06:40:50 (35156): No heartbeat from core client for 30 sec - exiting 06:40:51 (35156): No heartbeat from core client for 30 sec - exiting 06:40:52 (35156): No heartbeat from core client for 30 sec - exiting 06:40:53 (35156): No heartbeat from core client for 30 sec - exiting 06:40:54 (35156): No heartbeat from core client for 30 sec - exiting 06:40:55 (35156): No heartbeat from core client for 30 sec - exiting 06:40:56 (35156): No heartbeat from core client for 30 sec - exiting 06:40:57 (35156): No heartbeat from core client for 30 sec - exiting 06:40:58 (35156): No heartbeat from core client for 30 sec - exiting 06:40:59 (35156): No heartbeat from core client for 30 sec - exiting 06:41:00 (35156): No heartbeat from core client for 30 sec - exiting 06:41:01 (35156): No heartbeat from core client for 30 sec - exiting 06:41:02 (35156): No heartbeat from core client for 30 sec - exiting 06:41:03 (35156): No heartbeat from core client for 30 sec - exiting 06:41:04 (35156): No heartbeat from core client for 30 sec - exiting 06:41:05 (35156): No heartbeat from core client for 30 sec - exiting 06:41:06 (35156): No heartbeat from core client for 30 sec - exiting 06:41:07 (35156): No heartbeat from core client for 30 sec - exiting 06:41:08 (35156): No heartbeat from core client for 30 sec - exiting 06:41:09 (35156): No heartbeat from core client for 30 sec - exiting 06:41:10 (35156): No heartbeat from core client for 30 sec - exiting 06:41:11 (35156): No heartbeat from core client for 30 sec - exiting 06:41:12 (35156): No heartbeat from core client for 30 sec - exiting 06:41:13 (35156): No heartbeat from core client for 30 sec - exiting 06:41:14 (35156): No heartbeat from core client for 30 sec - exiting 06:41:15 (35156): No heartbeat from core client for 30 sec - exiting 06:41:17 (35156): No heartbeat from core client for 30 sec - exiting 06:41:18 (35156): No heartbeat from core client for 30 sec - exiting 06:41:19 (35156): No heartbeat from core client for 30 sec - exiting 06:41:20 (35156): No heartbeat from core client for 30 sec - exiting 06:41:21 (35156): No heartbeat from core client for 30 sec - exiting 06:41:22 (35156): No heartbeat from core client for 30 sec - exiting 06:41:23 (35156): No heartbeat from core client for 30 sec - exiting 06:41:24 (35156): No heartbeat from core client for 30 sec - exiting 06:41:25 (35156): No heartbeat from core client for 30 sec - exiting 06:41:26 (35156): No heartbeat from core client for 30 sec - exiting 06:41:27 (35156): No heartbeat from core client for 30 sec - exiting 06:41:28 (35156): No heartbeat from core client for 30 sec - exiting 06:41:29 (35156): No heartbeat from core client for 30 sec - exiting 06:41:30 (35156): No heartbeat from core client for 30 sec - exiting 06:41:31 (35156): No heartbeat from core client for 30 sec - exiting 06:41:32 (35156): No heartbeat from core client for 30 sec - exiting 06:41:33 (35156): No heartbeat from core client for 30 sec - exiting 06:41:34 (35156): No heartbeat from core client for 30 sec - exiting 06:41:35 (35156): No heartbeat from core client for 30 sec - exiting 06:41:36 (35156): No heartbeat from core client for 30 sec - exiting 06:41:37 (35156): No heartbeat from core client for 30 sec - exiting 06:41:38 (35156): No heartbeat from core client for 30 sec - exiting 06:41:39 (35156): No heartbeat from core client for 30 sec - exiting 06:41:40 (35156): No heartbeat from core client for 30 sec - exiting 06:41:41 (35156): No heartbeat from core client for 30 sec - exiting 06:41:42 (35156): No heartbeat from core client for 30 sec - exiting 06:41:43 (35156): No heartbeat from core client for 30 sec - exiting 06:41:44 (35156): No heartbeat from core client for 30 sec - exiting 06:41:45 (35156): No heartbeat from core client for 30 sec - exiting 06:41:46 (35156): No heartbeat from core client for 30 sec - exiting 06:41:47 (35156): No heartbeat from core client for 30 sec - exiting 06:41:48 (35156): No heartbeat from core client for 30 sec - exiting 06:41:49 (35156): No heartbeat from core client for 30 sec - exiting 06:41:50 (35156): No heartbeat from core client for 30 sec - exiting 06:41:51 (35156): No heartbeat from core client for 30 sec - exiting 06:41:52 (35156): No heartbeat from core client for 30 sec - exiting 06:41:53 (35156): No heartbeat from core client for 30 sec - exiting 06:41:54 (35156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:37:21 (53803): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 22:39:55 (54355): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 02:39:41 (55343): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:39:42 (55343): No heartbeat from core client for 30 sec - exiting 02:39:43 (55343): No heartbeat from core client for 30 sec - exiting 02:39:44 (55343): No heartbeat from core client for 30 sec - exiting 02:45:28 (58509): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:56:59 (58597): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 03:07:46 (58787): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:15:59 (58948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 03:24:58 (59101): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:25:03 (59101): No heartbeat from core client for 30 sec - exiting 03:39:07 (59286): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:56:04 (59473): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:46:54 (7548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:46:55 (7548): No heartbeat from core client for 30 sec - exiting 02:46:56 (7548): No heartbeat from core client for 30 sec - exiting 02:46:57 (7548): No heartbeat from core client for 30 sec - exiting 02:46:58 (7548): No heartbeat from core client for 30 sec - exiting 02:46:59 (7548): No heartbeat from core client for 30 sec - exiting 02:47:00 (7548): No heartbeat from core client for 30 sec - exiting 02:47:01 (7548): No heartbeat from core client for 30 sec - exiting 02:47:02 (7548): No heartbeat from core client for 30 sec - exiting 02:47:03 (7548): No heartbeat from core client for 30 sec - exiting 02:47:04 (7548): No heartbeat from core client for 30 sec - exiting 02:47:05 (7548): No heartbeat from core client for 30 sec - exiting 02:47:06 (7548): No heartbeat from core client for 30 sec - exiting 02:47:07 (7548): No heartbeat from core client for 30 sec - exiting 02:47:08 (7548): No heartbeat from core client for 30 sec - exiting 02:47:09 (7548): No heartbeat from core client for 30 sec - exiting 02:47:10 (7548): No heartbeat from core client for 30 sec - exiting 02:47:11 (7548): No heartbeat from core client for 30 sec - exiting 02:47:12 (7548): No heartbeat from core client for 30 sec - exiting 02:47:13 (7548): No heartbeat from core client for 30 sec - exiting 02:47:14 (7548): No heartbeat from core client for 30 sec - exiting 02:47:15 (7548): No heartbeat from core client for 30 sec - exiting 02:47:16 (7548): No heartbeat from core client for 30 sec - exiting 02:47:17 (7548): No heartbeat from core client for 30 sec - exiting SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.8 build 10K549 Tue Aug 9 02:50:24 2011 Thread 0 Crashed: 0 libSystem.B.dylib 0x90a0bc5a ___kill + 10 1 libSystem.B.dylib 0x90a9e5a5 _raise + 26 2 libSystem.B.dylib 0x90ab46e4 _abort + 93 3 hadcm3n_um_6.07_i686-apple-darwin 0x00336cff _um_setup + 127 4 hadcm3n_um_6.07_i686-apple-darwin 0x00389b71 _um_shell + 3953 5 hadcm3n_um_6.07_i686-apple-darwin 0x000048e1 _main + 1153 6 hadcm3n_um_6.07_i686-apple-darwin 0x000027fb __start + 209 7 hadcm3n_um_6.07_i686-apple-darwin 0x00002729 start + 41 Thread 1: 0 libSystem.B.dylib 0x909aac0e _mach_wait_until + 10 1 libSystem.B.dylib 0x90a32429 _nanosleep + 345 2 libSystem.B.dylib 0x90a322ca _usleep + 61 3 hadcm3n_um_6.07_i686-apple-darwin 0x00442ec0 __Z11boinc_sleepd + 188 4 hadcm3n_um_6.07_i686-apple-darwin 0x0043865e __Z12timer_threadPv + 78 5 libSystem.B.dylib 0x909d8259 __pthread_start + 345 6 libSystem.B.dylib 0x909d80de _thread_start + 34 Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc9c8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x909aa000 - 0x90b51fff /usr/lib/libSystem.B.dylib 0x92adb000 - 0x92adefff /usr/lib/system/libmathCommon.A.dylib 0x9a940000 - 0x9a94efff /usr/lib/libz.1.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=12811, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.8 build 10K549 Tue Aug 9 02:50:29 2011 Thread 0 Crashed: 0 libSystem.B.dylib 0x90a0bc5a ___kill + 10 1 libSystem.B.dylib 0x90a9e5a5 _raise + 26 2 libSystem.B.dylib 0x90ab46e4 _abort + 93 3 hadcm3n_um_6.07_i686-apple-darwin 0x00336cff _um_setup + 127 4 hadcm3n_um_6.07_i686-apple-darwin 0x00389b71 _um_shell + 3953 5 hadcm3n_um_6.07_i686-apple-darwin 0x000048e1 _main + 1153 6 hadcm3n_um_6.07_i686-apple-darwin 0x000027fb __start + 209 7 hadcm3n_um_6.07_i686-apple-darwin 0x00002729 start + 41 Thread 1: 0 libSystem.B.dylib 0x909aac0e _mach_wait_until + 10 1 libSystem.B.dylib 0x90a32429 _nanosleep + 345 2 libSystem.B.dylib 0x90a322ca _usleep + 61 3 hadcm3n_um_6.07_i686-apple-darwin 0x00442ec0 __Z11boinc_sleepd + 188 4 hadcm3n_um_6.07_i686-apple-darwin 0x0043865e __Z12timer_threadPv + 78 5 libSystem.B.dylib 0x909d8259 __pthread_start + 345 6 libSystem.B.dylib 0x909d80de _thread_start + 34 Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc9c8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x909aa000 - 0x90b51fff /usr/lib/libSystem.B.dylib 0x92adb000 - 0x92adefff /usr/lib/system/libmathCommon.A.dylib 0x9a940000 - 0x9a94efff /usr/lib/libz.1.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=12811, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.8 build 10K549 Tue Aug 9 02:50:32 2011 Thread 0 Crashed: 0 libSystem.B.dylib 0x90a0bc5a ___kill + 10 1 libSystem.B.dylib 0x90a9e5a5 _raise + 26 2 libSystem.B.dylib 0x90ab46e4 _abort + 93 3 hadcm3n_um_6.07_i686-apple-darwin 0x00336cff _um_setup + 127 4 hadcm3n_um_6.07_i686-apple-darwin 0x00389b71 _um_shell + 3953 5 hadcm3n_um_6.07_i686-apple-darwin 0x000048e1 _main + 1153 6 hadcm3n_um_6.07_i686-apple-darwin 0x000027fb __start + 209 7 hadcm3n_um_6.07_i686-apple-darwin 0x00002729 start + 41 Thread 1: 0 libSystem.B.dylib 0x909aac0e _mach_wait_until + 10 1 libSystem.B.dylib 0x90a32429 _nanosleep + 345 2 libSystem.B.dylib 0x90a322ca _usleep + 61 3 hadcm3n_um_6.07_i686-apple-darwin 0x00442ec0 __Z11boinc_sleepd + 188 4 hadcm3n_um_6.07_i686-apple-darwin 0x0043865e __Z12timer_threadPv + 78 5 libSystem.B.dylib 0x909d8259 __pthread_start + 345 6 libSystem.B.dylib 0x909d80de _thread_start + 34 Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc9c8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x909aa000 - 0x90b51fff /usr/lib/libSystem.B.dylib 0x92adb000 - 0x92adefff /usr/lib/system/libmathCommon.A.dylib 0x9a940000 - 0x9a94efff /usr/lib/libz.1.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=12811, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.8 build 10K549 Tue Aug 9 02:50:36 2011 Thread 0 Crashed: CPDN Monitor - Quit request from BOINC... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.8 build 10K549 Tue Aug 9 06:12:18 2011 Thread 0 Crashed: 0 libSystem.B.dylib 0x90a0bc5a ___kill + 10 1 libSystem.B.dylib 0x90a9e5a5 _raise + 26 2 libSystem.B.dylib 0x90ab46e4 _abort + 93 3 hadcm3n_um_6.07_i686-apple-darwin 0x00336cff _um_setup + 127 4 hadcm3n_um_6.07_i686-apple-darwin 0x00389b71 _um_shell + 3953 5 hadcm3n_um_6.07_i686-apple-darwin 0x000048e1 _main + 1153 6 hadcm3n_um_6.07_i686-apple-darwin 0x000027fb __start + 209 7 hadcm3n_um_6.07_i686-apple-darwin 0x00002729 start + 41 Thread 1: 0 libSystem.B.dylib 0x909aac0e _mach_wait_until + 10 1 libSystem.B.dylib 0x90a32429 _nanosleep + 345 2 libSystem.B.dylib 0x90a322ca _usleep + 61 3 hadcm3n_um_6.07_i686-apple-darwin 0x00442ec0 __Z11boinc_sleepd + 188 4 hadcm3n_um_6.07_i686-apple-darwin 0x0043865e __Z12timer_threadPv + 78 5 libSystem.B.dylib 0x909d8259 __pthread_start + 345 6 libSystem.B.dylib 0x909d80de _thread_start + 34 Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc9c8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x909aa000 - 0x90b51fff /usr/lib/libSystem.B.dylib 0x92adb000 - 0x92adefff /usr/lib/system/libmathCommon.A.dylib 0x9a940000 - 0x9a94efff /usr/lib/libz.1.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=20079, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.8 build 10K549 Tue Aug 9 06:12:21 2011 Thread 0 Crashed: 0 libSystem.B.dylib 0x90a0bc5a ___kill + 10 1 libSystem.B.dylib 0x90a9e5a5 _raise + 26 2 libSystem.B.dylib 0x90ab46e4 _abort + 93 3 hadcm3n_um_6.07_i686-apple-darwin 0x00336cff _um_setup + 127 4 hadcm3n_um_6.07_i686-apple-darwin 0x00389b71 _um_shell + 3953 5 hadcm3n_um_6.07_i686-apple-darwin 0x000048e1 _main + 1153 6 hadcm3n_um_6.07_i686-apple-darwin 0x000027fb __start + 209 7 hadcm3n_um_6.07_i686-apple-darwin 0x00002729 start + 41 Thread 1: 0 libSystem.B.dylib 0x909aac0e _mach_wait_until + 10 1 libSystem.B.dylib 0x90a32429 _nanosleep + 345 2 libSystem.B.dylib 0x90a322ca _usleep + 61 3 hadcm3n_um_6.07_i686-apple-darwin 0x00442ec0 __Z11boinc_sleepd + 188 4 hadcm3n_um_6.07_i686-apple-darwin 0x0043865e __Z12timer_threadPv + 78 5 libSystem.B.dylib 0x909d8259 __pthread_start + 345 6 libSystem.B.dylib 0x909d80de _thread_start + 34 Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc9c8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x909aa000 - 0x90b51fff /usr/lib/libSystem.B.dylib 0x92adb000 - 0x92adefff /usr/lib/system/libmathCommon.A.dylib 0x9a940000 - 0x9a94efff /usr/lib/libz.1.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=20079, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.8 build 10K549 Tue Aug 9 06:12:23 2011 Thread 0 Crashed: 0 libSystem.B.dylib 0x90a0bc5a ___kill + 10 1 libSystem.B.dylib 0x90a9e5a5 _raise + 26 2 libSystem.B.dylib 0x90ab46e4 _abort + 93 3 hadcm3n_um_6.07_i686-apple-darwin 0x00336cff _um_setup + 127 4 hadcm3n_um_6.07_i686-apple-darwin 0x00389b71 _um_shell + 3953 5 hadcm3n_um_6.07_i686-apple-darwin 0x000048e1 _main + 1153 6 hadcm3n_um_6.07_i686-apple-darwin 0x000027fb __start + 209 7 hadcm3n_um_6.07_i686-apple-darwin 0x00002729 start + 41 Thread 1: 0 libSystem.B.dylib 0x909aac0e _mach_wait_until + 10 1 libSystem.B.dylib 0x90a32429 _nanosleep + 345 2 libSystem.B.dylib 0x90a322ca _usleep + 61 3 hadcm3n_um_6.07_i686-apple-darwin 0x00442ec0 __Z11boinc_sleepd + 188 4 hadcm3n_um_6.07_i686-apple-darwin 0x0043865e __Z12timer_threadPv + 78 5 libSystem.B.dylib 0x909d8259 __pthread_start + 345 6 libSystem.B.dylib 0x909d80de _thread_start + 34 Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc9c8 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x909aa000 - 0x90b51fff /usr/lib/libSystem.B.dylib 0x92adb000 - 0x92adefff /usr/lib/system/libmathCommon.A.dylib 0x9a940000 - 0x9a94efff /usr/lib/libz.1.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=20079, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Jul 2011 18:49:43	942621	13126733	hadcm3n_ym1p_1900_40_007361431_0	207,360	313,449	1.5116
25 Jul 2011 18:00:40	942621	13126733	hadcm3n_ym1p_1900_40_007361431_0	181,440	270,706	1.4920
25 Jul 2011 17:15:09	942621	13126733	hadcm3n_ym1p_1900_40_007361431_0	155,520	227,091	1.4602
25 Jul 2011 15:57:29	942621	13126733	hadcm3n_ym1p_1900_40_007361431_0	129,600	184,622	1.4246
25 Jul 2011 14:29:32	942621	13126733	hadcm3n_ym1p_1900_40_007361431_0	103,680	145,302	1.4014
25 Jul 2011 13:28:55	942621	13126733	hadcm3n_ym1p_1900_40_007361431_0	77,760	109,026	1.4021
10 Jul 2011 10:57:24	942621	13126733	hadcm3n_ym1p_1900_40_007361431_0	51,840	72,782	1.4040
09 Jul 2011 05:09:01	942621	13126733	hadcm3n_ym1p_1900_40_007361431_0	25,920	40,901	1.5780