Task 11842819

Name	famous_vnrh_1199_200_006716563_0
Workunit	6919816
Created	26 Aug 2010, 18:03:42 UTC
Sent	16 Sep 2010, 5:00:17 UTC
Report deadline	16 Dec 2010, 12:27:28 UTC
Received	19 Sep 2010, 12:40:57 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	904604
Run time
CPU time	21 hours 47 min 3 sec
Validate state	Invalid
Credit	1,451.52
Device peak FLOPS	2.16 GFLOPS
Application version	UK Met Office FAMOUS v6.11 i686-apple-darwin
Stderr	<core_client_version>6.2.18</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting (15310): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (15316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (15316): No heartbeat from core client for 30 sec - exiting (15316): No heartbeat from core client for 30 sec - exiting (15316): No heartbeat from core client for 30 sec - exiting (15316): No heartbeat from core client for 30 sec - exiting (15388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (15388): No heartbeat from core client for 30 sec - exiting (15410): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (15451): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (15451): No heartbeat from core client for 30 sec - exiting (15451): No heartbeat from core client for 30 sec - exiting (15451): No heartbeat from core client for 30 sec - exiting (15451): No heartbeat from core client for 30 sec - exiting (15451): No heartbeat from core client for 30 sec - exiting (15451): No heartbeat from core client for 30 sec - exiting (15451): No heartbeat from core client for 30 sec - exiting (15451): No heartbeat from core client for 30 sec - exiting (15451): No heartbeat from core client for 30 sec - exiting (15464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (15492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (15521): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (15521): No heartbeat from core client for 30 sec - exiting (15544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (15544): No heartbeat from core client for 30 sec - exiting (15544): No heartbeat from core client for 30 sec - exiting (15544): No heartbeat from core client for 30 sec - exiting (15544): No heartbeat from core client for 30 sec - exiting (15544): No heartbeat from core client for 30 sec - exiting (15544): No heartbeat from core client for 30 sec - exiting (15544): No heartbeat from core client for 30 sec - exiting (15544): No heartbeat from core client for 30 sec - exiting (15544): No heartbeat from core client for 30 sec - exiting (15544): No heartbeat from core client for 30 sec - exiting (15544): No heartbeat from core client for 30 sec - exiting (15544): No heartbeat from core client for 30 sec - exiting (15544): No heartbeat from core client for 30 sec - exiting (15544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... (15583): No heartbeat from core client for 30 sec - exiting (15583): No heartbeat from core client for 30 sec - exiting (15583): No heartbeat from core client for 30 sec - exiting (15583): No heartbeat from core client for 30 sec - exiting (15583): No heartbeat from core client for 30 sec - exiting (15583): No heartbeat from core client for 30 sec - exiting (15583): No heartbeat from core client for 30 sec - exiting (15583): No heartbeat from core client for 30 sec - exiting (15583): No heartbeat from core client for 30 sec - exiting (15583): No heartbeat from core client for 30 sec - exiting (15612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... (15684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (15704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (15704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... (15738): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (15768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (15768): No heartbeat from core client for 30 sec - exiting (15768): No heartbeat from core client for 30 sec - exiting (15768): No heartbeat from core client for 30 sec - exiting (15768): No heartbeat from core client for 30 sec - exiting (15768): No heartbeat from core client for 30 sec - exiting (15768): No heartbeat from core client for 30 sec - exiting (15768): No heartbeat from core client for 30 sec - exiting (15768): No heartbeat from core client for 30 sec - exiting (15768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... (15902): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (15902): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... (16060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (16081): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (16081): No heartbeat from core client for 30 sec - exiting (16121): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (16121): No heartbeat from core client for 30 sec - exiting (16121): No heartbeat from core client for 30 sec - exiting (16127): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (16188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (16224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (16247): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (16296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (16296): No heartbeat from core client for 30 sec - exiting (16296): No heartbeat from core client for 30 sec - exiting (16296): No heartbeat from core client for 30 sec - exiting (16296): No heartbeat from core client for 30 sec - exiting (16296): No heartbeat from core client for 30 sec - exiting (16296): No heartbeat from core client for 30 sec - exiting (16296): No heartbeat from core client for 30 sec - exiting (16296): No heartbeat from core client for 30 sec - exiting (16296): No heartbeat from core client for 30 sec - exiting (16296): No heartbeat from core client for 30 sec - exiting (16296): No heartbeat from core client for 30 sec - exiting (16296): No heartbeat from core client for 30 sec - exiting (16296): No heartbeat from core client for 30 sec - exiting (16296): No heartbeat from core client for 30 sec - exiting (16296): No heartbeat from core client for 30 sec - exiting (16333): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (16347): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (16370): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (16370): No heartbeat from core client for 30 sec - exiting (16370): No heartbeat from core client for 30 sec - exiting (16370): No heartbeat from core client for 30 sec - exiting (16370): No heartbeat from core client for 30 sec - exiting (16370): No heartbeat from core client for 30 sec - exiting (16370): No heartbeat from core client for 30 sec - exiting Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vnrh_1199_200_006716563/dataout/vnrhla#pa000001201c1+ Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vnrh_1199_200_006716563/dataout/vnrhla#pb000001201c1+ Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vnrh_1199_200_006716563/dataout/vnrhlo#pi000001201c1+ Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vnrh_1199_200_006716563/dataout/vnrhlo#pj000001201c1+ MainError: 08:04:20 AM No files match the supplied pattern. MainError: 08:04:20 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... (16587): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (16587): No heartbeat from core client for 30 sec - exiting (16587): No heartbeat from core client for 30 sec - exiting (16587): No heartbeat from core client for 30 sec - exiting (16587): No heartbeat from core client for 30 sec - exiting (16587): No heartbeat from core client for 30 sec - exiting (16587): No heartbeat from core client for 30 sec - exiting (16605): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (16605): No heartbeat from core client for 30 sec - exiting (16622): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (16638): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... (16817): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (16836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (16851): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (16851): No heartbeat from core client for 30 sec - exiting (16851): No heartbeat from core client for 30 sec - exiting (16851): No heartbeat from core client for 30 sec - exiting (16851): No heartbeat from core client for 30 sec - exiting (16851): No heartbeat from core client for 30 sec - exiting (16880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (16897): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (16897): No heartbeat from core client for 30 sec - exiting (16897): No heartbeat from core client for 30 sec - exiting (16897): No heartbeat from core client for 30 sec - exiting (16897): No heartbeat from core client for 30 sec - exiting (16897): No heartbeat from core client for 30 sec - exiting (16897): No heartbeat from core client for 30 sec - exiting (16897): No heartbeat from core client for 30 sec - exiting (17192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (17192): No heartbeat from core client for 30 sec - exiting (17192): No heartbeat from core client for 30 sec - exiting (17227): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (17227): No heartbeat from core client for 30 sec - exiting (17336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (17354): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (17354): No heartbeat from core client for 30 sec - exiting (17354): No heartbeat from core client for 30 sec - exiting (17354): No heartbeat from core client for 30 sec - exiting (17354): No heartbeat from core client for 30 sec - exiting (17354): No heartbeat from core client for 30 sec - exiting (17354): No heartbeat from core client for 30 sec - exiting (17354): No heartbeat from core client for 30 sec - exiting (17354): No heartbeat from core client for 30 sec - exiting (17354): No heartbeat from core client for 30 sec - exiting (17354): No heartbeat from core client for 30 sec - exiting (17354): No heartbeat from core client for 30 sec - exiting (17354): No heartbeat from core client for 30 sec - exiting (17354): No heartbeat from core client for 30 sec - exiting (17354): No heartbeat from core client for 30 sec - exiting (17354): No heartbeat from core client for 30 sec - exiting (17354): No heartbeat from core client for 30 sec - exiting (17354): No heartbeat from core client for 30 sec - exiting (17354): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... (17521): No heartbeat from core client for 30 sec - exiting (17521): No heartbeat from core client for 30 sec - exiting (17521): No heartbeat from core client for 30 sec - exiting (17521): No heartbeat from core client for 30 sec - exiting (17521): No heartbeat from core client for 30 sec - exiting (17521): No heartbeat from core client for 30 sec - exiting (17521): No heartbeat from core client for 30 sec - exiting (17521): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... (18422): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (18437): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... (24221): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 (24268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (24268): No heartbeat from core client for 30 sec - exiting (24268): No heartbeat from core client for 30 sec - exiting (24268): No heartbeat from core client for 30 sec - exiting (24268): No heartbeat from core client for 30 sec - exiting (24268): No heartbeat from core client for 30 sec - exiting (24268): No heartbeat from core client for 30 sec - exiting (24268): No heartbeat from core client for 30 sec - exiting (24268): No heartbeat from core client for 30 sec - exiting (24268): No heartbeat from core client for 30 sec - exiting (24268): No heartbeat from core client for 30 sec - exiting (24268): No heartbeat from core client for 30 sec - exiting (24268): No heartbeat from core client for 30 sec - exiting (24268): No heartbeat from core client for 30 sec - exiting (24268): No heartbeat from core client for 30 sec - exiting (24268): No heartbeat from core client for 30 sec - exiting (24268): No heartbeat from core client for 30 sec - exiting (24268): No heartbeat from core client for 30 sec - exiting (24268): No heartbeat from core client for 30 sec - exiting (24268): No heartbeat from core client for 30 sec - exiting (24268): No heartbeat from core client for 30 sec - exiting (24268): No heartbeat from core client for 30 sec - exiting (24268): No heartbeat from core client for 30 sec - exiting (24268): No heartbeat from core client for 30 sec - exiting (24268): No heartbeat from core client for 30 sec - exiting (24268): No heartbeat from core client for 30 sec - exiting (24268): No heartbeat from core client for 30 sec - exiting (24268): No heartbeat from core client for 30 sec - exiting (24268): No heartbeat from core client for 30 sec - exiting (24268): No heartbeat from core client for 30 sec - exiting (24268): No heartbeat from core client for 30 sec - exiting (24268): No heartbeat from core client for 30 sec - exiting (24268): No heartbeat from core client for 30 sec - exiting (24268): No heartbeat from core client for 30 sec - exiting (24268): No heartbeat from core client for 30 sec - exiting (24268): No heartbeat from core client for 30 sec - exiting (24268): No heartbeat from core client for 30 sec - exiting (24268): No heartbeat from core client for 30 sec - exiting (24268): No heartbeat from core client for 30 sec - exiting (24268): No heartbeat from core client for 30 sec - exiting (24268): No heartbeat from core client for 30 sec - exiting (24340): No heartbeat from core client for 30 sec - exiting (24340): No heartbeat from core client for 30 sec - exiting (24340): No heartbeat from core client for 30 sec - exiting (24340): No heartbeat from core client for 30 sec - exiting (24340): No heartbeat from core client for 30 sec - exiting (24340): No heartbeat from core client for 30 sec - exiting (24340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 Model crash detected, will try to restart... (24628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (24907): No heartbeat from core client for 30 sec - exiting (24907): No heartbeat from core client for 30 sec - exiting (24907): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... (25339): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=26641, selfPID=26641, iMonCtr=1 (26755): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... (27357): No heartbeat from core client for 30 sec - exiting (27357): No heartbeat from core client for 30 sec - exiting (27357): No heartbeat from core client for 30 sec - exiting (27357): No heartbeat from core client for 30 sec - exiting (27357): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (27392): No heartbeat from core client for 30 sec - exiting (27392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 (27645): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (27645): No heartbeat from core client for 30 sec - exiting (27712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (27727): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 (27978): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (27978): No heartbeat from core client for 30 sec - exiting (27978): No heartbeat from core client for 30 sec - exiting (27978): No heartbeat from core client for 30 sec - exiting (27978): No heartbeat from core client for 30 sec - exiting (27978): No heartbeat from core client for 30 sec - exiting (27978): No heartbeat from core client for 30 sec - exiting (27978): No heartbeat from core client for 30 sec - exiting (27978): No heartbeat from core client for 30 sec - exiting (27978): No heartbeat from core client for 30 sec - exiting (27978): No heartbeat from core client for 30 sec - exiting (27978): No heartbeat from core client for 30 sec - exiting (27978): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... (28271): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (28307): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (28307): No heartbeat from core client for 30 sec - exiting (28307): No heartbeat from core client for 30 sec - exiting (28307): No heartbeat from core client for 30 sec - exiting (28307): No heartbeat from core client for 30 sec - exiting (28564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (28774): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... (3544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (3563): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (3563): No heartbeat from core client for 30 sec - exiting (3932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (4094): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (4094): No heartbeat from core client for 30 sec - exiting (4094): No heartbeat from core client for 30 sec - exiting (4113): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (4126): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (4126): No heartbeat from core client for 30 sec - exiting (4157): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (4172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (4567): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 (4616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (4616): No heartbeat from core client for 30 sec - exiting (4616): No heartbeat from core client for 30 sec - exiting (4616): No heartbeat from core client for 30 sec - exiting (4616): No heartbeat from core client for 30 sec - exiting (4993): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (5039): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (5039): No heartbeat from core client for 30 sec - exiting (5039): No heartbeat from core client for 30 sec - exiting (5039): No heartbeat from core client for 30 sec - exiting (5039): No heartbeat from core client for 30 sec - exiting (5039): No heartbeat from core client for 30 sec - exiting (5039): No heartbeat from core client for 30 sec - exiting (5039): No heartbeat from core client for 30 sec - exiting (5039): No heartbeat from core client for 30 sec - exiting (5039): No heartbeat from core client for 30 sec - exiting (5039): No heartbeat from core client for 30 sec - exiting (5039): No heartbeat from core client for 30 sec - exiting (5039): No heartbeat from core client for 30 sec - exiting (5039): No heartbeat from core client for 30 sec - exiting (5039): No heartbeat from core client for 30 sec - exiting (5039): No heartbeat from core client for 30 sec - exiting (5039): No heartbeat from core client for 30 sec - exiting (5039): No heartbeat from core client for 30 sec - exiting (5046): No heartbeat from core client for 30 sec - exiting (5046): No heartbeat from core client for 30 sec - exiting (5046): No heartbeat from core client for 30 sec - exiting (5046): No heartbeat from core client for 30 sec - exiting (5046): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (5046): No heartbeat from core client for 30 sec - exiting BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 (5142): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (5142): No heartbeat from core client for 30 sec - exiting (5142): No heartbeat from core client for 30 sec - exiting (5142): No heartbeat from core client for 30 sec - exiting (5142): No heartbeat from core client for 30 sec - exiting (5142): No heartbeat from core client for 30 sec - exiting (5142): No heartbeat from core client for 30 sec - exiting (5142): No heartbeat from core client for 30 sec - exiting (5142): No heartbeat from core client for 30 sec - exiting (5142): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... (5641): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (5641): No heartbeat from core client for 30 sec - exiting (5641): No heartbeat from core client for 30 sec - exiting (5641): No heartbeat from core client for 30 sec - exiting (5641): No heartbeat from core client for 30 sec - exiting (5641): No heartbeat from core client for 30 sec - exiting (5883): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (5883): No heartbeat from core client for 30 sec - exiting (5894): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (6145): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (6401): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (6401): No heartbeat from core client for 30 sec - exiting (6401): No heartbeat from core client for 30 sec - exiting (6401): No heartbeat from core client for 30 sec - exiting (6401): No heartbeat from core client for 30 sec - exiting (6401): No heartbeat from core client for 30 sec - exiting (6401): No heartbeat from core client for 30 sec - exiting (6401): No heartbeat from core client for 30 sec - exiting (6401): No heartbeat from core client for 30 sec - exiting (6401): No heartbeat from core client for 30 sec - exiting (6401): No heartbeat from core client for 30 sec - exiting (6431): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (7390): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (7523): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (7523): No heartbeat from core client for 30 sec - exiting (7523): No heartbeat from core client for 30 sec - exiting (7523): No heartbeat from core client for 30 sec - exiting (7523): No heartbeat from core client for 30 sec - exiting (7523): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... (12672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (12672): No heartbeat from core client for 30 sec - exiting BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 (13028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (13316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (13343): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (13518): No heartbeat from core client for 30 sec - exiting (13518): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 (13573): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (13573): No heartbeat from core client for 30 sec - exiting (13573): No heartbeat from core client for 30 sec - exiting (13573): No heartbeat from core client for 30 sec - exiting (13573): No heartbeat from core client for 30 sec - exiting (13573): No heartbeat from core client for 30 sec - exiting (13573): No heartbeat from core client for 30 sec - exiting (13573): No heartbeat from core client for 30 sec - exiting (13573): No heartbeat from core client for 30 sec - exiting (13573): No heartbeat from core client for 30 sec - exiting (13788): No heartbeat from core client for 30 sec - exiting (13788): No heartbeat from core client for 30 sec - exiting (13788): No heartbeat from core client for 30 sec - exiting (13788): No heartbeat from core client for 30 sec - exiting (13788): No heartbeat from core client for 30 sec - exiting (13788): No heartbeat from core client for 30 sec - exiting (13788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 (13848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (13848): No heartbeat from core client for 30 sec - exiting (13848): No heartbeat from core client for 30 sec - exiting (13848): No heartbeat from core client for 30 sec - exiting (13848): No heartbeat from core client for 30 sec - exiting (13848): No heartbeat from core client for 30 sec - exiting (13848): No heartbeat from core client for 30 sec - exiting (13848): No heartbeat from core client for 30 sec - exiting (13848): No heartbeat from core client for 30 sec - exiting (13848): No heartbeat from core client for 30 sec - exiting (13848): No heartbeat from core client for 30 sec - exiting (13848): No heartbeat from core client for 30 sec - exiting (13848): No heartbeat from core client for 30 sec - exiting (14185): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (14185): No heartbeat from core client for 30 sec - exiting (14185): No heartbeat from core client for 30 sec - exiting (14185): No heartbeat from core client for 30 sec - exiting (14185): No heartbeat from core client for 30 sec - exiting (14185): No heartbeat from core client for 30 sec - exiting (14185): No heartbeat from core client for 30 sec - exiting (14185): No heartbeat from core client for 30 sec - exiting (14195): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (14195): No heartbeat from core client for 30 sec - exiting (14195): No heartbeat from core client for 30 sec - exiting (14195): No heartbeat from core client for 30 sec - exiting (14531): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (14531): No heartbeat from core client for 30 sec - exiting (14626): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... (14626): No heartbeat from core client for 30 sec - exiting (14626): No heartbeat from core client for 30 sec - exiting BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy Sorry, too many model crashes! :-( (14656): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
19 Sep 2010 12:25:37	904604	11842819	famous_vnrh_1199_200_006716563_0	439,946	78,055	0.1774
19 Sep 2010 11:38:44	904604	11842819	famous_vnrh_1199_200_006716563_0	430,586	76,363	0.1773
19 Sep 2010 10:51:39	904604	11842819	famous_vnrh_1199_200_006716563_0	421,226	74,661	0.1772
19 Sep 2010 10:04:03	904604	11842819	famous_vnrh_1199_200_006716563_0	411,866	72,862	0.1769
19 Sep 2010 09:16:44	904604	11842819	famous_vnrh_1199_200_006716563_0	402,506	71,164	0.1768
19 Sep 2010 08:24:13	904604	11842819	famous_vnrh_1199_200_006716563_0	393,146	69,448	0.1766
19 Sep 2010 07:37:04	904604	11842819	famous_vnrh_1199_200_006716563_0	383,786	67,684	0.1764
19 Sep 2010 06:49:57	904604	11842819	famous_vnrh_1199_200_006716563_0	374,426	65,948	0.1761
18 Sep 2010 16:33:51	904604	11842819	famous_vnrh_1199_200_006716563_0	365,066	64,197	0.1759
18 Sep 2010 15:47:37	904604	11842819	famous_vnrh_1199_200_006716563_0	355,706	62,470	0.1756
18 Sep 2010 15:05:49	904604	11842819	famous_vnrh_1199_200_006716563_0	346,346	60,716	0.1753
18 Sep 2010 14:23:23	904604	11842819	famous_vnrh_1199_200_006716563_0	336,986	58,978	0.1750
18 Sep 2010 13:36:15	904604	11842819	famous_vnrh_1199_200_006716563_0	327,626	57,278	0.1748
18 Sep 2010 12:44:00	904604	11842819	famous_vnrh_1199_200_006716563_0	318,266	55,526	0.1745
18 Sep 2010 12:02:05	904604	11842819	famous_vnrh_1199_200_006716563_0	308,906	53,845	0.1743
18 Sep 2010 11:10:04	904604	11842819	famous_vnrh_1199_200_006716563_0	299,546	52,209	0.1743
18 Sep 2010 10:17:52	904604	11842819	famous_vnrh_1199_200_006716563_0	290,186	50,523	0.1741
18 Sep 2010 09:35:29	904604	11842819	famous_vnrh_1199_200_006716563_0	280,826	48,893	0.1741
18 Sep 2010 08:48:15	904604	11842819	famous_vnrh_1199_200_006716563_0	271,466	47,383	0.1745
18 Sep 2010 08:01:01	904604	11842819	famous_vnrh_1199_200_006716563_0	262,106	45,617	0.1740