climateprediction.net home page
Task 17539958

Task 17539958

Name hadam3pm2_k0va_1959_10_009271064_0
Workunit 9363980
Created 3 Dec 2014, 12:59:46 UTC
Sent 23 Dec 2014, 23:24:39 UTC
Report deadline 6 Dec 2015, 4:44:39 UTC
Received 31 Jan 2015, 7:44:52 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1235846
Run time 5 days 15 hours 24 min 51 sec
CPU time 5 days 13 hours 52 min 34 sec
Validate state Invalid
Credit 4,492.60
Device peak FLOPS 2.47 GFLOPS
Application version UK Met Office HadAM3P (global only) with MOSES II landsurface scheme v7.03
i686-pc-linux-gnu
Stderr
<core_client_version>6.12.34</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
14:39:38 (16796): No heartbeat from client for 30 sec - exiting
14:39:38 (16796): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:41:16 (6772): No heartbeat from client for 30 sec - exiting
14:41:16 (6772): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:42:41 (6800): No heartbeat from client for 30 sec - exiting
14:42:41 (6800): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:43:14 (6829): No heartbeat from client for 30 sec - exiting
14:43:14 (6829): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:45:33 (6856): No heartbeat from client for 30 sec - exiting
14:45:33 (6856): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:47:52 (6905): No heartbeat from client for 30 sec - exiting
14:47:52 (6905): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:50:40 (6943): No heartbeat from client for 30 sec - exiting
14:50:40 (6943): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:51:14 (6986): No heartbeat from client for 30 sec - exiting
14:51:14 (6986): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:52:53 (7014): No heartbeat from client for 30 sec - exiting
14:52:53 (7014): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:56:02 (7051): No heartbeat from client for 30 sec - exiting
14:56:02 (7051): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:59:09 (7100): No heartbeat from client for 30 sec - exiting
14:59:09 (7100): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:01:18 (7146): No heartbeat from client for 30 sec - exiting
15:01:18 (7146): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:01:51 (7208): No heartbeat from client for 30 sec - exiting
15:01:51 (7208): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:03:56 (7235): No heartbeat from client for 30 sec - exiting
15:03:56 (7235): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:06:10 (7274): No heartbeat from client for 30 sec - exiting
15:06:10 (7274): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:08:37 (7314): No heartbeat from client for 30 sec - exiting
15:08:37 (7314): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:09:11 (7351): No heartbeat from client for 30 sec - exiting
15:09:11 (7351): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:11:10 (7378): No heartbeat from client for 30 sec - exiting
15:11:10 (7378): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:13:33 (7422): No heartbeat from client for 30 sec - exiting
15:13:33 (7422): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:15:46 (7466): No heartbeat from client for 30 sec - exiting
15:15:46 (7466): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:18:14 (7507): No heartbeat from client for 30 sec - exiting
15:18:14 (7507): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:18:47 (7543): No heartbeat from client for 30 sec - exiting
15:18:47 (7543): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:21:07 (7570): No heartbeat from client for 30 sec - exiting
15:21:07 (7570): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:24:15 (7616): No heartbeat from client for 30 sec - exiting
15:24:15 (7616): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:26:53 (7662): No heartbeat from client for 30 sec - exiting
15:26:53 (7662): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:27:28 (7708): No heartbeat from client for 30 sec - exiting
15:27:28 (7708): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:29:27 (7729): No heartbeat from client for 30 sec - exiting
15:29:27 (7729): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:32:35 (7782): No heartbeat from client for 30 sec - exiting
15:32:35 (7782): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:35:22 (7828): No heartbeat from client for 30 sec - exiting
15:35:22 (7828): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:38:26 (7876): No heartbeat from client for 30 sec - exiting
15:38:26 (7876): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:38:59 (7915): No heartbeat from client for 30 sec - exiting
15:38:59 (7915): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:41:19 (7942): No heartbeat from client for 30 sec - exiting
15:41:19 (7942): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:43:42 (7993): No heartbeat from client for 30 sec - exiting
15:43:42 (7993): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:46:29 (8031): No heartbeat from client for 30 sec - exiting
15:46:29 (8031): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:47:03 (8075): No heartbeat from client for 30 sec - exiting
15:47:03 (8075): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:48:48 (8104): No heartbeat from client for 30 sec - exiting
15:48:48 (8104): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:51:26 (8142): No heartbeat from client for 30 sec - exiting
15:51:26 (8142): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:54:09 (8194): No heartbeat from client for 30 sec - exiting
15:54:09 (8194): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:56:32 (8234): No heartbeat from client for 30 sec - exiting
15:56:32 (8234): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:57:05 (8274): No heartbeat from client for 30 sec - exiting
15:57:05 (8274): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:59:36 (8302): No heartbeat from client for 30 sec - exiting
15:59:36 (8302): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:02:28 (8355): No heartbeat from client for 30 sec - exiting
16:02:28 (8355): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:04:47 (8422): No heartbeat from client for 30 sec - exiting
16:04:47 (8422): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:05:21 (8453): No heartbeat from client for 30 sec - exiting
16:05:21 (8453): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:07:35 (8484): No heartbeat from client for 30 sec - exiting
16:07:35 (8484): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:10:37 (8530): No heartbeat from client for 30 sec - exiting
16:10:37 (8530): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:13:35 (8583): No heartbeat from client for 30 sec - exiting
16:13:35 (8583): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:16:28 (8630): No heartbeat from client for 30 sec - exiting
16:16:28 (8630): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:17:01 (8672): No heartbeat from client for 30 sec - exiting
16:17:01 (8672): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:19:32 (8700): No heartbeat from client for 30 sec - exiting
16:19:32 (8700): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:22:24 (8753): No heartbeat from client for 30 sec - exiting
16:22:24 (8753): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:25:17 (8799): No heartbeat from client for 30 sec - exiting
16:25:17 (8799): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:25:50 (8841): No heartbeat from client for 30 sec - exiting
16:25:50 (8841): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:27:49 (8869): No heartbeat from client for 30 sec - exiting
16:27:49 (8869): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:30:43 (8908): No heartbeat from client for 30 sec - exiting
16:30:43 (8908): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:32:55 (8963): No heartbeat from client for 30 sec - exiting
16:32:55 (8963): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:35:49 (9001): No heartbeat from client for 30 sec - exiting
16:35:49 (9001): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:36:22 (9043): No heartbeat from client for 30 sec - exiting
16:36:22 (9043): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:37:58 (9071): No heartbeat from client for 30 sec - exiting
16:37:58 (9071): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:40:10 (9109): No heartbeat from client for 30 sec - exiting
16:40:10 (9109): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:42:23 (9154): No heartbeat from client for 30 sec - exiting
16:42:23 (9154): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:42:57 (9191): No heartbeat from client for 30 sec - exiting
16:42:57 (9191): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:45:15 (9219): No heartbeat from client for 30 sec - exiting
16:45:15 (9219): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:47:28 (9262): No heartbeat from client for 30 sec - exiting
16:47:28 (9262): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:50:06 (9307): No heartbeat from client for 30 sec - exiting
16:50:06 (9307): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:52:24 (9352): No heartbeat from client for 30 sec - exiting
16:52:24 (9352): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:52:57 (9390): No heartbeat from client for 30 sec - exiting
16:52:57 (9390): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:54:32 (9418): No heartbeat from client for 30 sec - exiting
16:54:32 (9418): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:56:49 (9459): No heartbeat from client for 30 sec - exiting
16:56:49 (9459): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:59:02 (9497): No heartbeat from client for 30 sec - exiting
16:59:02 (9497): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:59:35 (9534): No heartbeat from client for 30 sec - exiting
16:59:35 (9534): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:01:54 (9556): No heartbeat from client for 30 sec - exiting
17:01:54 (9556): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:04:27 (9629): No heartbeat from client for 30 sec - exiting
17:04:27 (9629): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:07:19 (9677): No heartbeat from client for 30 sec - exiting
17:07:19 (9677): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:10:22 (9718): No heartbeat from client for 30 sec - exiting
17:10:22 (9718): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:10:55 (9769): No heartbeat from client for 30 sec - exiting
17:10:55 (9769): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:13:21 (9797): No heartbeat from client for 30 sec - exiting
17:13:21 (9797): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:15:49 (9844): No heartbeat from client for 30 sec - exiting
17:15:49 (9844): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:18:03 (9886): No heartbeat from client for 30 sec - exiting
17:18:03 (9886): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:18:36 (9923): No heartbeat from client for 30 sec - exiting
17:18:36 (9923): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:20:55 (9945): No heartbeat from client for 30 sec - exiting
17:20:55 (9945): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:23:08 (9997): No heartbeat from client for 30 sec - exiting
17:23:08 (9997): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:25:30 (10034): No heartbeat from client for 30 sec - exiting
17:25:30 (10034): timer handler: client dead, exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...

SETPOS: Seek Failed: Invalid argument
SETPOS: Unit 64 to Word Address -198 Failed with Error Code -1

Model crashed: SETPOS: Unit 64 to Word Address -198 Failed with Error Code -1

SETPOS: Seek Failed: Invalid argument
SETPOS: Unit 64 to Word Address -198 Failed with Error Code -1

Model crashed: SETPOS: Unit 64 to Word Address -198 Failed with Error Code -1

SETPOS: Seek Failed: Invalid argument
SETPOS: Unit 64 to Word Address -198 Failed with Error Code -1

Model crashed: SETPOS: Unit 64 to Word Address -198 Failed with Error Code -1

SETPOS: Seek Failed: Invalid argument
SETPOS: Unit 64 to Word Address -198 Failed with Error Code -1

Model crashed: SETPOS: Unit 64 to Word Address -198 Failed with Error Code -1

SETPOS: Seek Failed: Invalid argument
SETPOS: Unit 64 to Word Address -198 Failed with Error Code -1

Model crashed: SETPOS: Unit 64 to Word Address -198 Failed with Error Code -1

SETPOS: Seek Failed: Invalid argument
SETPOS: Unit 64 to Word Address -198 Failed with Error Code -1

Model crashed: SETPOS: Unit 64 to Word Address -198 Failed with Error Code -1
Sorry, too many model crashes! :-(
09:14:24 (3552): called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
30 Jan 2015 15:41:15 1235846 17539958 hadam3pm2_k0va_1959_10_009271064_0 155,588 474,904 3.0523
30 Jan 2015 09:19:08 1235846 17539958 hadam3pm2_k0va_1959_10_009271064_0 152,708 465,806 3.0503
30 Jan 2015 04:58:06 1235846 17539958 hadam3pm2_k0va_1959_10_009271064_0 149,828 457,308 3.0522
29 Jan 2015 23:20:21 1235846 17539958 hadam3pm2_k0va_1959_10_009271064_0 146,948 449,217 3.0570
29 Jan 2015 18:52:35 1235846 17539958 hadam3pm2_k0va_1959_10_009271064_0 144,068 441,240 3.0627
29 Jan 2015 16:41:48 1235846 17539958 hadam3pm2_k0va_1959_10_009271064_0 141,188 433,299 3.0690
24 Jan 2015 23:38:30 1235846 17539958 hadam3pm2_k0va_1959_10_009271064_0 118,148 366,604 3.1029
24 Jan 2015 20:37:28 1235846 17539958 hadam3pm2_k0va_1959_10_009271064_0 115,268 357,663 3.1029
24 Jan 2015 18:11:50 1235846 17539958 hadam3pm2_k0va_1959_10_009271064_0 112,388 349,247 3.1075
24 Jan 2015 15:05:53 1235846 17539958 hadam3pm2_k0va_1959_10_009271064_0 109,508 339,696 3.1020
24 Jan 2015 11:24:36 1235846 17539958 hadam3pm2_k0va_1959_10_009271064_0 106,628 330,962 3.1039
23 Jan 2015 15:29:06 1235846 17539958 hadam3pm2_k0va_1959_10_009271064_0 86,468 276,969 3.2031
23 Jan 2015 05:25:40 1235846 17539958 hadam3pm2_k0va_1959_10_009271064_0 83,588 267,651 3.2020
22 Jan 2015 16:27:16 1235846 17539958 hadam3pm2_k0va_1959_10_009271064_0 80,708 258,571 3.2038
22 Jan 2015 06:47:58 1235846 17539958 hadam3pm2_k0va_1959_10_009271064_0 77,828 249,310 3.2033
22 Jan 2015 04:07:09 1235846 17539958 hadam3pm2_k0va_1959_10_009271064_0 74,948 239,455 3.1949
22 Jan 2015 01:13:34 1235846 17539958 hadam3pm2_k0va_1959_10_009271064_0 72,068 229,373 3.1827
12 Jan 2015 17:15:09 1235846 17539958 hadam3pm2_k0va_1959_10_009271064_0 54,788 178,543 3.2588
12 Jan 2015 13:08:51 1235846 17539958 hadam3pm2_k0va_1959_10_009271064_0 51,908 169,048 3.2567
12 Jan 2015 06:52:16 1235846 17539958 hadam3pm2_k0va_1959_10_009271064_0 49,028 159,412 3.2514


©2024 cpdn.org