← Back to IT country layer · Country index

IT source retry: fetch ISTAT SDMX payloads that blocked national rerun

blocked synth-downloader

Task metadata

idt_a5857afd
titleIT source retry: fetch ISTAT SDMX payloads that blocked national rerun
assigneesynth-downloader
statusblocked
tenantsynthestat
priority90
workspace_kinddir
workspace_path/home/synthestat
created_byuser
created_at2026-05-19 21:59:59 CEST
started_at2026-05-19 22:00:15 CEST
completed_at

Latest summary

ISTAT payloads still unavailable: 0/8 valid downloads; approved esploradati endpoints time out before HTTP response, alternate sdmx.istat.it returns HTTP 500/404 evidence. See retry evidence JSON and downloader handoff paths in latest comment.

Body

Retry the exact approved ISTAT payloads listed in /home/synthestat/data/ingestion/it/population_qa_official_freeze/2026-05-19_2039_it_population_qa_freeze/metadata/source_payload_missing_manifest.json. Use robust retry/backoff/range or alternate ISTAT SDMX endpoints if needed. Deliver raw paths, checksums, headers, row counts, codelist resolution, and update downloader latest.md. If still unavailable, block with HTTP evidence per target.

Parents

[]

Children

[
  "t_bbcec891"
]

Runs

IDProfileStatusOutcomeStartedEndedSummary/error
164synth-downloaderblockedblocked2026-05-19 22:00:15 CEST2026-05-19 22:19:38 CESTISTAT payloads still unavailable: 0/8 valid downloads; approved esploradati endpoints time out before HTTP response, alternate sdmx.istat.it returns HTTP 500/404 evidence. See retry evidence JSON and downloader handoff paths in latest comment.

Events

TimeKindPayload
2026-05-19 21:59:59 CESTcreated{ "assignee": "synth-downloader", "status": "ready", "parents": [], "tenant": "synthestat", "skills": [ "synthestat-kb-workflow" ] }
2026-05-19 22:00:15 CESTclaimed{ "lock": "vmi3188806:1714957", "expires": 1779221715, "run_id": 164 }
2026-05-19 22:00:15 CESTspawned{ "pid": 1714961 }
2026-05-19 22:16:02 CESTheartbeat{ "note": "Ran robust ISTAT retry harness; original esploradati endpoints still time out and alternate sdmx.istat.it returns HTTP 500 HTML. First long pass timed out mid-batch, now completing remaining targets with shorter per-target evidence capture." }
2026-05-19 22:19:33 CESTcommented{ "author": "synth-downloader", "len": 1302 }
2026-05-19 22:19:38 CESTblocked{ "reason": "ISTAT payloads still unavailable: 0/8 valid downloads; approved esploradati endpoints time out before HTTP response, alternate sdmx.istat.it returns HTTP 500/404 evidence. See retry evidence JSON and downloader handoff paths in latest comment." }

Comments

2026-05-19 22:19:33 CEST · synth-downloader
Downloader retry handoff before block:

- Valid ISTAT payloads fetched: 0/8.
- Evidence JSON: `/home/synthestat/data/ingestion/it/population_qa_official_freeze/2026-05-19_2039_it_population_qa_freeze/metadata/istat_retry_evidence_2026-05-19_2204.json`
- CSV summary: `/home/synthestat/data/ingestion/it/population_qa_official_freeze/2026-05-19_2039_it_population_qa_freeze/metadata/istat_retry_summary_2026-05-19_2204.csv`
- Download log: `/home/synthestat/workspace/manager_handoffs/downloader/2026-05-19_2218_IT_ISTAT_missing_payload_retry_download_log.md`
- Catalogue update: `/home/synthestat/workspace/manager_handoffs/downloader/2026-05-19_2218_IT_ISTAT_missing_payload_retry_catalogue_updates.md`
- Latest snapshot updated: `/home/synthestat/workspace/manager_handoffs/downloader/latest.md`
- Manager updates appended: `/home/synthestat/workspace/manager_handoffs/manager_updates.md`

HTTP evidence summary: approved esploradati.istat.it endpoints returned HTTP 000 / curl exit 28 timeouts before headers; alternate same-path sdmx.istat.it endpoints returned HTTP 500 Runtime Error HTML for population/household/codelist/DSD attempts and HTTP 404 for dwelling dataflow variants. Row counts/checksums are null because no valid CSV/XML payload bytes were retrieved; CL_ITTER107 remains unresolved.