Discussion:
What is mpc sweeptimer ?
(too old to reply)
Kohzo Momose
2007-05-29 05:12:46 UTC
Permalink
I would like to make sure the function of mpc sweeptimer.

EN NN
CS/AIX V6.1 ----(APPN/ISR over MPC)---- z/OS V1R6

When the zOS was hung up because of the high CPU usage,
CP-CP session was terminated by the following reason.

1. errpt -a

LABEL: MPC_MISC_FAILURE
Date/Time: Wed May 23 06:09:24
Node Id: JMKWBK01
Class: S
Type: UNKN
Resource Name: MPC

Description
SOFTWARE

Probable Causes
SOFTWARE PROGRAM

Detail Data
DETECTING MODULE
File: mpcgroup.C Fn: sweepTimerPop Ln: 3205

GROUP
sna-mpcg11

DESCRIPTION
No response to previous sweep


2./var/sna/sna.err

06:09:24 JST 23 May 2007 1536-17(0-10) E (JMKWBK01)
Link Station mpclink has been remotely disconnected.
06:09:24 JST 23 May 2007 512-60(0-10) P (JMKWBK01)
An active link station has failed.
Port name = mpcport
LS name = mpclink
Adjacent CP name = JRCNET.HH01CP


3. zOS Syslog ( because of the high cpu usage, the time stamp was probably
delayed)

06:10:57 IST1097I CP-CP SESSION WITH JRCNET.CWEBK01 TERMINATED
06:10:57 IST1280I SESSION TYPE = CONWINNER - SENSE = 80020000
06:10:57 IST314I END
06:10:57 IST1578I SOFT INOP DETECTED FOR TWEBK011 BY ISTTSC8E CODE = 204

SENSE 80020000 means Data Link Failure.


I think the network flow would be

CS/AIX device driver channel VTAM
write Hung
Up
------------------->
sweeptimer expired
Device End
-------------------->
simulate disconnect
<-------- ------->IST1578I INOP
CP-CP terminated
            

Question:
1. What is sweeptimer ? Is it response timer ? and Is there idle timer ?
2. How long does the timer ?
3. When sweeptimer expired, what signals does the driver send to CS/AIX and
HOST side ?
4. sna.err said "LS has been remotely disconnected."
In our case, does this mean CS/AIX received disconnect signal from the
AIX mpc device driver
because of the sweeptimer expiration ? or it exactly received DISC from
VTAM side ?

Thank you for your help,
Kohzo Momose IBM-Japan
l***@us.ibm.com
2007-05-29 11:47:50 UTC
Permalink
Post by Kohzo Momose
I would like to make sure the function of mpc sweeptimer.
EN NN
CS/AIX V6.1 ----(APPN/ISR over MPC)---- z/OS V1R6
When the zOS was hung up because of the high CPU usage,
CP-CP session was terminated by the following reason.
1. errpt -a
LABEL: MPC_MISC_FAILURE
Date/Time: Wed May 23 06:09:24
Node Id: JMKWBK01
Class: S
Type: UNKN
Resource Name: MPC
Description
SOFTWARE
Probable Causes
SOFTWARE PROGRAM
Detail Data
DETECTING MODULE
File: mpcgroup.C Fn: sweepTimerPop Ln: 3205
GROUP
sna-mpcg11
DESCRIPTION
No response to previous sweep
2./var/sna/sna.err
06:09:24 JST 23 May 2007 1536-17(0-10) E (JMKWBK01)
Link Station mpclink has been remotely disconnected.
06:09:24 JST 23 May 2007 512-60(0-10) P (JMKWBK01)
An active link station has failed.
Port name = mpcport
LS name = mpclink
Adjacent CP name = JRCNET.HH01CP
3. zOS Syslog ( because of the high cpu usage, the time stamp was
probably delayed)
06:10:57 IST1097I CP-CP SESSION WITH JRCNET.CWEBK01 TERMINATED
06:10:57 IST1280I SESSION TYPE = CONWINNER - SENSE = 80020000
06:10:57 IST314I END
06:10:57 IST1578I SOFT INOP DETECTED FOR TWEBK011 BY ISTTSC8E CODE = 204
SENSE 80020000 means Data Link Failure.
I think the network flow would be
CS/AIX device driver channel VTAM
write
Hung Up
------------------->
sweeptimer expired
Device End
-------------------->
simulate disconnect
<-------- ------->IST1578I INOP
CP-CP terminated
            
1. What is sweeptimer ? Is it response timer ? and Is there idle timer ?
The sweep_time is the only timer on an escon connection.
There is no polling on channel (escon or blkmux).
The 'errpt' entry indicates that a sweep was sent and
no response was received before the next sweep_time interval
expired.

It is a setting in the AIX MPC device driver:
# lsattr -E -l mpc
sweep_time 0 Sweep timer interval
By default it should be set to 0, which means the sweep timer
is disabled. I think it is described in the manual "AIX Version 4.3
S/390 ESCON Channel PCI Adapter: User's Guide and Service Information",
SC23-4232, but I don't have access to that manual right now to check.
The value can range from 0 to 32768:
# odmget -q attribute="sweep_time" PdAt
:
deflt = "0"
values = "0-32768,1"
Post by Kohzo Momose
2. How long does the timer ?
Since the default is zero (disabled), I assume someone set
it on your system. Use that 'lsattr' command shown above to
see what it is set to on your system. It is changed with a
command like:
# chdev -l mpc -a sweep_time=60 -P
I think the value is in seconds, but you should check that
manual to be sure. Read the AIX manuals to understand what
the '-P' flag does on the chdev command.
Post by Kohzo Momose
3. When sweeptimer expired, what signals does the driver
send to CS/AIX and HOST side ?
4. sna.err said "LS has been remotely disconnected."
In our case, does this mean CS/AIX received disconnect signal
from the AIX mpc device driver because of the sweeptimer expiration?
or it exactly received DISC from VTAM side ?
The AIX MPC device driver detected the sweeptimer expiration
and sent an internal signal to the AIX MPC DLC layer, which
then sent a close_dlc indicator to CS/AIX. The signal that
the AIX MPC device driver sent to vtam would have been the
same as if CS/AIX was suddenly stopped.

Note that there is also a sweep timer setting at the host,
and there have been problems with the sweep processing
found in the past, so you should review some of these
to see if they apply to your host environment:
http://www.ibm.com/search/?q=%2Bmpc+%2Bsweep+%2Bvtam

Paul Landay
Kohzo Momose
2007-05-29 16:02:37 UTC
Permalink
Post by l***@us.ibm.com
Post by Kohzo Momose
I would like to make sure the function of mpc sweeptimer.
EN NN
CS/AIX V6.1 ----(APPN/ISR over MPC)---- z/OS V1R6
When the zOS was hung up because of the high CPU usage,
CP-CP session was terminated by the following reason.
1. errpt -a
LABEL: MPC_MISC_FAILURE
Date/Time: Wed May 23 06:09:24
Node Id: JMKWBK01
Class: S
Type: UNKN
Resource Name: MPC
Description
SOFTWARE
Probable Causes
SOFTWARE PROGRAM
Detail Data
DETECTING MODULE
File: mpcgroup.C Fn: sweepTimerPop Ln: 3205
GROUP
sna-mpcg11
DESCRIPTION
No response to previous sweep
2./var/sna/sna.err
06:09:24 JST 23 May 2007 1536-17(0-10) E (JMKWBK01)
Link Station mpclink has been remotely disconnected.
06:09:24 JST 23 May 2007 512-60(0-10) P (JMKWBK01)
An active link station has failed.
Port name = mpcport
LS name = mpclink
Adjacent CP name = JRCNET.HH01CP
3. zOS Syslog ( because of the high cpu usage, the time stamp was
probably delayed)
06:10:57 IST1097I CP-CP SESSION WITH JRCNET.CWEBK01 TERMINATED
06:10:57 IST1280I SESSION TYPE = CONWINNER - SENSE = 80020000
06:10:57 IST314I END
06:10:57 IST1578I SOFT INOP DETECTED FOR TWEBK011 BY ISTTSC8E CODE = 204
SENSE 80020000 means Data Link Failure.
I think the network flow would be
CS/AIX device driver channel VTAM
write
Hung Up
------------------->
sweeptimer expired
Device End
-------------------->
simulate disconnect
<-------- ------->IST1578I INOP
CP-CP terminated
            
1. What is sweeptimer ? Is it response timer ? and Is there idle timer ?
The sweep_time is the only timer on an escon connection.
There is no polling on channel (escon or blkmux).
The 'errpt' entry indicates that a sweep was sent and
no response was received before the next sweep_time interval
expired.
# lsattr -E -l mpc
sweep_time 0 Sweep timer interval
By default it should be set to 0, which means the sweep timer
is disabled. I think it is described in the manual "AIX Version 4.3
S/390 ESCON Channel PCI Adapter: User's Guide and Service Information",
SC23-4232, but I don't have access to that manual right now to check.
# odmget -q attribute="sweep_time" PdAt
deflt = "0"
values = "0-32768,1"
Post by Kohzo Momose
2. How long does the timer ?
Since the default is zero (disabled), I assume someone set
it on your system. Use that 'lsattr' command shown above to
see what it is set to on your system. It is changed with a
# chdev -l mpc -a sweep_time=60 -P
I think the value is in seconds, but you should check that
manual to be sure. Read the AIX manuals to understand what
the '-P' flag does on the chdev command.
Post by Kohzo Momose
3. When sweeptimer expired, what signals does the driver
send to CS/AIX and HOST side ?
4. sna.err said "LS has been remotely disconnected."
In our case, does this mean CS/AIX received disconnect signal
from the AIX mpc device driver because of the sweeptimer expiration?
or it exactly received DISC from VTAM side ?
The AIX MPC device driver detected the sweeptimer expiration
and sent an internal signal to the AIX MPC DLC layer, which
then sent a close_dlc indicator to CS/AIX. The signal that
the AIX MPC device driver sent to vtam would have been the
same as if CS/AIX was suddenly stopped.
Note that there is also a sweep timer setting at the host,
and there have been problems with the sweep processing
found in the past, so you should review some of these
http://www.ibm.com/search/?q=%2Bmpc+%2Bsweep+%2Bvtam
Paul Landay
Landay,
Thank you very much for the prompt and detail answer every time !!
Kohzo Momose
2007-05-31 08:11:56 UTC
Permalink
Landay,

We tried to re-create the sweep_timer expiration, but it could not.

CS/AIX---(MPC)---VTAM

We set sweep_timer interval 30sec.
And stopped the MPC channel from the HOTS,
Even after several minutes, AIX did not detect the idle situation.

I think that there should be an inactivity timer for the idle detection,
while the sweep_timer is a reply timer for the heart beat and other
write/read. Would you please tell me if AIX mpc device has an idle
detection ( keep alive) timer ?
How could we check and modify it ?

Thank you for your help,
Kohzo Momose
2007-05-31 09:09:17 UTC
Permalink
Landay,

I carefuly read your previous append, and I understand that there is NOT any
keep alive function in AIX for mpc.
I will re-check our test case if we sent some data over mpc after stopping
the HOST.
Post by Kohzo Momose
Landay,
We tried to re-create the sweep_timer expiration, but it could not.
CS/AIX---(MPC)---VTAM
We set sweep_timer interval 30sec.
And stopped the MPC channel from the HOTS,
Even after several minutes, AIX did not detect the idle situation.
I think that there should be an inactivity timer for the idle detection,
while the sweep_timer is a reply timer for the heart beat and other
write/read. Would you please tell me if AIX mpc device has an idle
detection ( keep alive) timer ?
How could we check and modify it ?
Thank you for your help,
l***@us.ibm.com
2007-05-31 11:14:30 UTC
Permalink
Post by Kohzo Momose
I carefuly read your previous append, and I understand
that there is NOT any keep alive function in AIX for mpc.
There is not any keep-alive function (e.g. polling) in
AIX for MPC and as far as I know there is not any in
MPC at z/OS either. MPC uses channel connections and
channel connections are considered to be very reliable.

From the "z/OS Communications Server v1r7 Resource
Definition Reference" it says this about REPLYTO=
MPC: Specifies how long VTAM waits for completion of
an MPC XID I/O operation after starting a channel
program. After the XID completes, REPLYTO has no meaning.
XID I/O only happens on link start-up, so the VTAM
REPLYTO= doesn't apply to this scenario.

Paul Landay
Kohzo Momose
2007-06-01 01:19:52 UTC
Permalink
Landy,
Thank you very much.
let me ask one more question ?

To re-create the sweep timer pop event, we did:
1. Issue chdev -l mpc -a sweep_time=60 -P, and then reboot the AIX
2. MQ/APPC send data from AIX to HOST
3. Stop the HOST LPAR by using HMC (This caused mpc connection to be idle)
4. MQ/APPC send data from AIX to HOST
5. We expected that the sweep timer expiration, but it did not happen.
We waited 30 minuits but no messages were logged in errpt nor sna.err)

Are there any conditions to drive the sweep timer ?
Post by l***@us.ibm.com
Post by Kohzo Momose
I carefuly read your previous append, and I understand
that there is NOT any keep alive function in AIX for mpc.
There is not any keep-alive function (e.g. polling) in
AIX for MPC and as far as I know there is not any in
MPC at z/OS either. MPC uses channel connections and
channel connections are considered to be very reliable.
From the "z/OS Communications Server v1r7 Resource
Definition Reference" it says this about REPLYTO=
MPC: Specifies how long VTAM waits for completion of
an MPC XID I/O operation after starting a channel
program. After the XID completes, REPLYTO has no meaning.
XID I/O only happens on link start-up, so the VTAM
REPLYTO= doesn't apply to this scenario.
Paul Landay
l***@us.ibm.com
2007-06-04 10:42:34 UTC
Permalink
Post by Kohzo Momose
Landy,
Thank you very much.
let me ask one more question ?
1. Issue chdev -l mpc -a sweep_time=60 -P, and then reboot the AIX
2. MQ/APPC send data from AIX to HOST
3. Stop the HOST LPAR by using HMC (This caused mpc connection to be idle)
4. MQ/APPC send data from AIX to HOST
5. We expected that the sweep timer expiration, but it did not happen.
We waited 30 minuits but no messages were logged in errpt nor sna.err)
Are there any conditions to drive the sweep timer ?
Post by l***@us.ibm.com
Post by Kohzo Momose
I carefuly read your previous append, and I understand
that there is NOT any keep alive function in AIX for mpc.
There is not any keep-alive function (e.g. polling) in
AIX for MPC and as far as I know there is not any in
MPC at z/OS either. MPC uses channel connections and
channel connections are considered to be very reliable.
I earlier said that I thought sweep_time was seconds,
but suggested you check that with the manuals (which I
did not have access to). I have now found that the
sweep_time is in minutes, so you set it to 60 minutes
but only waited 30 minutes.

Paul Landay
Bryce
2007-07-15 09:02:35 UTC
Permalink
http://ac75a496af5e2231c1880044b59ee2bc-t.fadlcg.org <a href="http://ac75a496af5e2231c1880044b59ee2bc-h.fadlcg.org">ac75a496af5e2231c1880044b59ee2bc</a> [url]http://ac75a496af5e2231c1880044b59ee2bc-b1.fadlcg.org[/url] [url=http://ac75a496af5e2231c1880044b59ee2bc-b2.fadlcg.org]ac75a496af5e2231c1880044b59ee2bc[/url] [u]http://ac75a496af5e2231c1880044b59ee2bc-b3.fadlcg.org[/u] fdf554b12e19746d473902650ce4b788
Morgan
2007-09-10 07:37:25 UTC
Permalink
http://29bccd5a9e48c568bc854cd795085b2c-t.apvxct.org <a href="http://29bccd5a9e48c568bc854cd795085b2c-h.apvxct.org">29bccd5a9e48c568bc854cd795085b2c</a> [url]http://29bccd5a9e48c568bc854cd795085b2c-b1.apvxct.org[/url] [url=http://29bccd5a9e48c568bc854cd795085b2c-b2.apvxct.org]29bccd5a9e48c568bc854cd795085b2c[/url] [u]http://29bccd5a9e48c568bc854cd795085b2c-b3.apvxct.org[/u] d16d30e97b9e9abb3ec5f4766970cca8
Ethan
2007-10-16 08:20:09 UTC
Permalink
755834e8ca9beff6d216f843be1b2423 <a href="http://testo-rima-cuore-latte-versato.xwjkaj.info/"> http://testo-rima-cuore-latte-versato.xwjkaj.info/ </a> <a href="http://letti-sanmarco.xwjkaj.info/"> http://letti-sanmarco.xwjkaj.info/ </a> <a href="http://aggiungere-firma-outlook.xwjkaj.info/"> http://aggiungere-firma-outlook.xwjkaj.info/ </a> <a href="http://metodologie-operativa-abilitazioni.xwjkaj.info/"> http://metodologie-operativa-abilitazioni.xwjkaj.info/ </a> <a href="http://bipop-giovanile.xwjkaj.info/"> http://bipop-giovanile.xwjkaj.info/ </a> <a href="http://foto-capo-bianco.xwjkaj.info/"> http://foto-capo-bianco.xwjkaj.info/ </a> <a href="http://distributore-pellet-piemonte.xwjkaj.info/"> http://distributore-pellet-piemonte.xwjkaj.info/ </a> <a href="http://grasso-bello-waters.xwjkaj.info/"> http://grasso-bello-waters.xwjkaj.info/ </a> <a href="http://incinta-tettona-fica-depilata.xwjkaj.info/"> http://incinta-tettona-fica-depilata.xwjkaj.info/ </a> <a href="http://caccia-anatre.xwjkaj.info/"> http://caccia-anatre.xwjkaj.info/ </a> 9f5da654271b4ba6ddc85a89bc956c69
Rene
2007-10-17 02:12:44 UTC
Permalink
243c1e16fa2b553c4a80a5c2954b4c20 <a href="http://racconto-gay-bi.vnqjip.info/"> http://racconto-gay-bi.vnqjip.info/ </a> <a href="http://immagini-libretto-matrimonio.vnqjip.info/"> http://immagini-libretto-matrimonio.vnqjip.info/ </a> <a href="http://uomo-toro-forum-astrologia.oqfzrm.info/"> http://uomo-toro-forum-astrologia.oqfzrm.info/ </a> <a href="http://trucco-command-and-conquers-generals.oqfzrm.info/"> http://trucco-command-and-conquers-generals.oqfzrm.info/ </a> <a href="http://piemonte-parco.vnqjip.info/"> http://piemonte-parco.vnqjip.info/ </a> <a href="http://nuovo-amico-it.vnqjip.info/"> http://nuovo-amico-it.vnqjip.info/ </a> <a href="http://ici-velletri.gbofzt.info/"> http://ici-velletri.gbofzt.info/ </a> <a href="http://corso-cura-palliative-campania.vnqjip.info/"> http://corso-cura-palliative-campania.vnqjip.info/ </a> <a href="http://dinosauri-a-milano.oqfzrm.info/"> http://dinosauri-a-milano.oqfzrm.info/ </a> <a href="http://indagini-archeologiche.gbofzt.info/"> http://indagini-archeologiche.gbofzt.info/ </a> 56e6393906b6eddaa15d7939d1b1cb57
Avery
2007-10-17 20:54:05 UTC
Permalink
755b9e89e852d958b0305c9d190bb396 <a href="http://nordest-surf-club.mxlybb.info/"> http://nordest-surf-club.mxlybb.info/ </a> <a href="http://tigre-tamil.mxlybb.info/"> http://tigre-tamil.mxlybb.info/ </a> <a href="http://movimento-di-liberazione-della-donna.mxlybb.info/"> http://movimento-di-liberazione-della-donna.mxlybb.info/ </a> <a href="http://ordine-architetti-avellino.mxlybb.info/"> http://ordine-architetti-avellino.mxlybb.info/ </a> <a href="http://progettazione-giardino-interno.mxlybb.info/"> http://progettazione-giardino-interno.mxlybb.info/ </a> <a href="http://neonati-e-alimentazione.mxlybb.info/"> http://neonati-e-alimentazione.mxlybb.info/ </a> <a href="http://scarpa-da-calcio-torino.mxlybb.info/"> http://scarpa-da-calcio-torino.mxlybb.info/ </a> <a href="http://grappa-poggio-salvi.mxlybb.info/"> http://grappa-poggio-salvi.mxlybb.info/ </a> <a href="http://tesi-di-laurea-filosofia.mxlybb.info/"> http://tesi-di-laurea-filosofia.mxlybb.info/ </a> <a href="http://trucchi-per-gioco-praetorians.mxlybb.info/"> http://trucchi-per-gioco-praetorians.mxlybb.info/ </a> 240963adcc085b35afabddbc777a9f7a
Stacey
2007-10-19 12:17:33 UTC
Permalink
87654ac83f4c01fa59523d27ee77777f <a href="http://notebook-hp-pavilion-dv-6159.udvrod.info/"> http://notebook-hp-pavilion-dv-6159.udvrod.info/ </a> <a href="http://gioiello-cuore-spezzato.udvrod.info/"> http://gioiello-cuore-spezzato.udvrod.info/ </a> <a href="http://rassegna-stampa-mondiale-calcio.udvrod.info/"> http://rassegna-stampa-mondiale-calcio.udvrod.info/ </a> <a href="http://sigillo-maledetto.udvrod.info/"> http://sigillo-maledetto.udvrod.info/ </a> <a href="http://albergo-palestra-catania.udvrod.info/"> http://albergo-palestra-catania.udvrod.info/ </a> <a href="http://puntate-dragonball-z.udvrod.info/"> http://puntate-dragonball-z.udvrod.info/ </a> <a href="http://federazione-italiana-donne.udvrod.info/"> http://federazione-italiana-donne.udvrod.info/ </a> <a href="http://partita-calcio-web.udvrod.info/"> http://partita-calcio-web.udvrod.info/ </a> <a href="http://cellulare-vodafone-nokia.udvrod.info/"> http://cellulare-vodafone-nokia.udvrod.info/ </a> <a href="http://video-gol-piu-bello-inter.udvrod.info/"> http://video-gol-piu-bello-inter.udvrod.info/ </a> e1047acafc45d6f186355a21e80ffb06
Antwon
2007-10-20 06:05:51 UTC
Permalink
237fbfdf8e18db20f41e8490dccd7b9c <a href="http://locali-per-festa-private-a-napoli.tqrvbr.info/"> http://locali-per-festa-private-a-napoli.tqrvbr.info/ </a> <a href="http://vendita-pappa-reale.tqrvbr.info/"> http://vendita-pappa-reale.tqrvbr.info/ </a> <a href="http://crociera-impossibili.tqrvbr.info/"> http://crociera-impossibili.tqrvbr.info/ </a> <a href="http://coaster-580.tqrvbr.info/"> http://coaster-580.tqrvbr.info/ </a> <a href="http://hotel-cualbu-it.tqrvbr.info/"> http://hotel-cualbu-it.tqrvbr.info/ </a> <a href="http://vendo-pappagallo-cenerino.tqrvbr.info/"> http://vendo-pappagallo-cenerino.tqrvbr.info/ </a> <a href="http://toshiba-p100-109.tqrvbr.info/"> http://toshiba-p100-109.tqrvbr.info/ </a> <a href="http://negramaro-immagine-live.tqrvbr.info/"> http://negramaro-immagine-live.tqrvbr.info/ </a> <a href="http://sms-dj.tqrvbr.info/"> http://sms-dj.tqrvbr.info/ </a> <a href="http://ricevitore-gps-canale.tqrvbr.info/"> http://ricevitore-gps-canale.tqrvbr.info/ </a> 735ad300eb051825273af84136798bef
Broderick
2007-10-21 01:31:33 UTC
Permalink
d5f66013b6172becb0ccc90e36bf547e <a href="http://testing-cla-unimo-it.ekolzy.info/"> http://testing-cla-unimo-it.ekolzy.info/ </a> <a href="http://scuola-elementale-arte-ostetrica.ekolzy.info/"> http://scuola-elementale-arte-ostetrica.ekolzy.info/ </a> <a href="http://albano-sempre.ekolzy.info/"> http://albano-sempre.ekolzy.info/ </a> <a href="http://affresco-villa-provincia-trento.ekolzy.info/"> http://affresco-villa-provincia-trento.ekolzy.info/ </a> <a href="http://stazione-torino.ekolzy.info/"> http://stazione-torino.ekolzy.info/ </a> <a href="http://paziente-con-tumore.ekolzy.info/"> http://paziente-con-tumore.ekolzy.info/ </a> <a href="http://compilazione-f24-iva.ekolzy.info/"> http://compilazione-f24-iva.ekolzy.info/ </a> <a href="http://attrezzi-per-il-sollevamento.ekolzy.info/"> http://attrezzi-per-il-sollevamento.ekolzy.info/ </a> <a href="http://come-fare-una-mailing-list.ekolzy.info/"> http://come-fare-una-mailing-list.ekolzy.info/ </a> <a href="http://tradizione-testi.ekolzy.info/"> http://tradizione-testi.ekolzy.info/ </a> 624c2511fee194d7c1bfc1566df0d8d3
Martez
2007-10-21 21:45:07 UTC
Permalink
d30d8dcfa17d7612228f7d81a8d01ece <a href="http://itinerario-campobasso.sjspln.info/"> http://itinerario-campobasso.sjspln.info/ </a> <a href="http://testo-canzone-ho-messo-via.sjspln.info/"> http://testo-canzone-ho-messo-via.sjspln.info/ </a> <a href="http://listino-pezzi-di-ricambio-fiat.sjspln.info/"> http://listino-pezzi-di-ricambio-fiat.sjspln.info/ </a> <a href="http://calcolare-lo-stipendio.sjspln.info/"> http://calcolare-lo-stipendio.sjspln.info/ </a> <a href="http://segna-posto.sjspln.info/"> http://segna-posto.sjspln.info/ </a> <a href="http://indire-ecdl.sjspln.info/"> http://indire-ecdl.sjspln.info/ </a> <a href="http://scoppio-pneumatico-circolazione-stradale.sjspln.info/"> http://scoppio-pneumatico-circolazione-stradale.sjspln.info/ </a> <a href="http://esercizio-di-scienza-delle-costruzioni.sjspln.info/"> http://esercizio-di-scienza-delle-costruzioni.sjspln.info/ </a> <a href="http://foto-donna-vergini.sjspln.info/"> http://foto-donna-vergini.sjspln.info/ </a> <a href="http://mobiletto-porta-computer.sjspln.info/"> http://mobiletto-porta-computer.sjspln.info/ </a> 7bddbf019794022ee2c4ecc04af44273
Jamir
2007-10-23 05:33:11 UTC
Permalink
2fe2c8ed5f5fc9fa6b35eab65f9336b3 <a href="http://disdetta-tre.diefcw.info/"> http://disdetta-tre.diefcw.info/ </a> <a href="http://filiera-tessile-abbigliamento.diefcw.info/"> http://filiera-tessile-abbigliamento.diefcw.info/ </a> <a href="http://video-proiettore-5000-ansi-lumen.diefcw.info/"> http://video-proiettore-5000-ansi-lumen.diefcw.info/ </a> <a href="http://matteo-thun-illy-1990.diefcw.info/"> http://matteo-thun-illy-1990.diefcw.info/ </a> <a href="http://fac-simile-schede-elettorali-politiche-2006.diefcw.info/"> http://fac-simile-schede-elettorali-politiche-2006.diefcw.info/ </a> <a href="http://scuola-infanzia-progetto-lettura.diefcw.info/"> http://scuola-infanzia-progetto-lettura.diefcw.info/ </a> <a href="http://marcia-nuziale-matrimonio.diefcw.info/"> http://marcia-nuziale-matrimonio.diefcw.info/ </a> <a href="http://club-bambini.diefcw.info/"> http://club-bambini.diefcw.info/ </a> <a href="http://gianpaolo-fabris.diefcw.info/"> http://gianpaolo-fabris.diefcw.info/ </a> <a href="http://coconuts-rimini.diefcw.info/"> http://coconuts-rimini.diefcw.info/ </a> 105212eab52c63b279de3dd68a520880
Walker
2007-10-24 01:29:27 UTC
Permalink
ea129808bdd09ba24a66a4979aa27e3f <a href="http://ambrosetti-consulenza.fnufbv.info/"> http://ambrosetti-consulenza.fnufbv.info/ </a> <a href="http://hotel-stella-bormio.fnufbv.info/"> http://hotel-stella-bormio.fnufbv.info/ </a> <a href="http://pazzi-firenze.fnufbv.info/"> http://pazzi-firenze.fnufbv.info/ </a> <a href="http://melanzana-alla-parmigiana-ricetta.fnufbv.info/"> http://melanzana-alla-parmigiana-ricetta.fnufbv.info/ </a> <a href="http://museo-scuderia-del-quirinale.fnufbv.info/"> http://museo-scuderia-del-quirinale.fnufbv.info/ </a> <a href="http://trucco-gioco-tomb-raider-4.fnufbv.info/"> http://trucco-gioco-tomb-raider-4.fnufbv.info/ </a> <a href="http://casa-carezza.fnufbv.info/"> http://casa-carezza.fnufbv.info/ </a> <a href="http://affetto-asiatica-urinate.fnufbv.info/"> http://affetto-asiatica-urinate.fnufbv.info/ </a> <a href="http://mappe-geosat.fnufbv.info/"> http://mappe-geosat.fnufbv.info/ </a> <a href="http://muri-a-retta.fnufbv.info/"> http://muri-a-retta.fnufbv.info/ </a> 0a772a6fc7843e88d2291ad32d3a38f7
Sam
2007-10-25 17:23:11 UTC
Permalink
5e5e07059bb63f97f2c3036ccb444a6d <a href="http://amicizia-mondo-greco-patroclo-achille.mfztdr.info/"> http://amicizia-mondo-greco-patroclo-achille.mfztdr.info/ </a> <a href="http://ristrutturazione-di-albergo.mfztdr.info/"> http://ristrutturazione-di-albergo.mfztdr.info/ </a> <a href="http://rilegatura-dell-evangelario-teodolinda.mfztdr.info/"> http://rilegatura-dell-evangelario-teodolinda.mfztdr.info/ </a> <a href="http://periferica-virtuale.mfztdr.info/"> http://periferica-virtuale.mfztdr.info/ </a> <a href="http://troiona-classe.mfztdr.info/"> http://troiona-classe.mfztdr.info/ </a> <a href="http://danno-da-fermo.mfztdr.info/"> http://danno-da-fermo.mfztdr.info/ </a> <a href="http://corto-maltese-gruppo-musicale.mfztdr.info/"> http://corto-maltese-gruppo-musicale.mfztdr.info/ </a> <a href="http://scarpa-da-pugilato.mfztdr.info/"> http://scarpa-da-pugilato.mfztdr.info/ </a> <a href="http://dalmazia-wikipedia.mfztdr.info/"> http://dalmazia-wikipedia.mfztdr.info/ </a> <a href="http://callan-metodo-bologna.mfztdr.info/"> http://callan-metodo-bologna.mfztdr.info/ </a> 61a3eb2c07c65b5b622d221b1afab5dd
Craig
2007-10-26 13:06:03 UTC
Permalink
4fa03e75184a57310d6ea5bd759b0d73 <a href="http://gigi-finizio-foto.mmifsk.info/"> http://gigi-finizio-foto.mmifsk.info/ </a> <a href="http://nido-familiare.mmifsk.info/"> http://nido-familiare.mmifsk.info/ </a> <a href="http://super-erotici.mmifsk.info/"> http://super-erotici.mmifsk.info/ </a> <a href="http://carattere-strano.mmifsk.info/"> http://carattere-strano.mmifsk.info/ </a> <a href="http://scienze-per-le-scuole.mmifsk.info/"> http://scienze-per-le-scuole.mmifsk.info/ </a> <a href="http://tasse-su-affitti.mmifsk.info/"> http://tasse-su-affitti.mmifsk.info/ </a> <a href="http://manuale-di-disegno-tecnico.mmifsk.info/"> http://manuale-di-disegno-tecnico.mmifsk.info/ </a> <a href="http://voli-low-cost-bari-milano.mmifsk.info/"> http://voli-low-cost-bari-milano.mmifsk.info/ </a> <a href="http://sfondo-web-gif-animata.mmifsk.info/"> http://sfondo-web-gif-animata.mmifsk.info/ </a> <a href="http://vito-giacomina-ministero-ambiente.mmifsk.info/"> http://vito-giacomina-ministero-ambiente.mmifsk.info/ </a> 663fa60e86e0f14dcb8203deea7589a2
Rakeem
2007-10-27 09:24:43 UTC
Permalink
ce6bd0f5ffad0d362c84a61f13240f79 <a href="http://affitto-camper-torino.tjqxft.info/"> http://affitto-camper-torino.tjqxft.info/ </a> <a href="http://audio-asus-p5b-fruscio.tjqxft.info/"> http://audio-asus-p5b-fruscio.tjqxft.info/ </a> <a href="http://originale-profumo-patchouli.tjqxft.info/"> http://originale-profumo-patchouli.tjqxft.info/ </a> <a href="http://carrefur-novara.obqezs.info/"> http://carrefur-novara.obqezs.info/ </a> <a href="http://gioco-guerra-it.tjqxft.info/"> http://gioco-guerra-it.tjqxft.info/ </a> <a href="http://lavoro-nero-cgil.tjqxft.info/"> http://lavoro-nero-cgil.tjqxft.info/ </a> <a href="http://fiore-burro-decorare-torta.tjqxft.info/"> http://fiore-burro-decorare-torta.tjqxft.info/ </a> <a href="http://commissione-rinnovo-patente-viterbo.obqezs.info/"> http://commissione-rinnovo-patente-viterbo.obqezs.info/ </a> <a href="http://aprile-2036.obqezs.info/"> http://aprile-2036.obqezs.info/ </a> <a href="http://beppe-grillo-energia.tjqxft.info/"> http://beppe-grillo-energia.tjqxft.info/ </a> 691767b1afd362c5c783946de5291453
Jan
2007-10-28 05:30:58 UTC
Permalink
115ddcb4fd4b7a26308bddf04ede7db8 <a href="http://olive-sotto-sale.nkctin.info/"> http://olive-sotto-sale.nkctin.info/ </a> <a href="http://come-impostare-una-lettera.nkctin.info/"> http://come-impostare-una-lettera.nkctin.info/ </a> <a href="http://san-marino-ritenuta-acconto.nkctin.info/"> http://san-marino-ritenuta-acconto.nkctin.info/ </a> <a href="http://papa-bambino.nkctin.info/"> http://papa-bambino.nkctin.info/ </a> <a href="http://terme-voli.nkctin.info/"> http://terme-voli.nkctin.info/ </a> <a href="http://finale-di-coppa.nkctin.info/"> http://finale-di-coppa.nkctin.info/ </a> <a href="http://calcetto-empoli.nkctin.info/"> http://calcetto-empoli.nkctin.info/ </a> <a href="http://san-marino-ritenuta-acconto.nkctin.info/"> http://san-marino-ritenuta-acconto.nkctin.info/ </a> <a href="http://facolta-giurisprudenza-federico-ii.nkctin.info/"> http://facolta-giurisprudenza-federico-ii.nkctin.info/ </a> <a href="http://taekwondo-milano.nkctin.info/"> http://taekwondo-milano.nkctin.info/ </a> 0e3abf68cd2fe72c767b238fba881d60
Blaise
2007-10-29 01:18:35 UTC
Permalink
0f79d0368fed2c0fa40f01643eb8624b <a href="http://cinquantenne-molto-troia.zixrvz.info/"> http://cinquantenne-molto-troia.zixrvz.info/ </a> <a href="http://al-jazira-filmato-esecuzione-saddam-hussein.zixrvz.info/"> http://al-jazira-filmato-esecuzione-saddam-hussein.zixrvz.info/ </a> <a href="http://gioco-yetisports.zixrvz.info/"> http://gioco-yetisports.zixrvz.info/ </a> <a href="http://autocostruzioni-comune-san-giovanni-marignano.zixrvz.info/"> http://autocostruzioni-comune-san-giovanni-marignano.zixrvz.info/ </a> <a href="http://la-libreria-monza.zixrvz.info/"> http://la-libreria-monza.zixrvz.info/ </a> <a href="http://fallimento-bari.zixrvz.info/"> http://fallimento-bari.zixrvz.info/ </a> <a href="http://spesa-sanitaria-nazionale-privata.zixrvz.info/"> http://spesa-sanitaria-nazionale-privata.zixrvz.info/ </a> <a href="http://luca-carraro.zixrvz.info/"> http://luca-carraro.zixrvz.info/ </a> <a href="http://consulti-di-tarocchi.zixrvz.info/"> http://consulti-di-tarocchi.zixrvz.info/ </a> <a href="http://accessorio-macchina-maglieria.zixrvz.info/"> http://accessorio-macchina-maglieria.zixrvz.info/ </a> efe8c34e6578cd9de50df71874bcf009
Loading...