mirror of
https://github.com/bilawalsidhu/gods-eye-view.git
synced 2026-11-11 05:42:22 +00:00
fix(shipwrecks): a failed or empty source refresh keeps its last good wrecks, and waits 15 minutes before the next try
A refresh with one source down (or Wikidata answering 200 with no results) was cached as the day's snapshot, replacing the full set; and once the snapshot was a day old, every request after a failure fetched both sources again. Each source now keeps its own last good records, served as stale for up to seven days, and a source that failed is not asked again for 15 minutes, even when there is no data yet. A Wikidata answer without results, or with no wreck in it, counts as a failure.
This commit is contained in:
1 parent
a1200efba6
commit
3b52e24140
3 files changed
+219
-45
No files matched your search
@@ -159,9 +159,10 @@ off by default. `/api/shipwrecks` downloads EMODnet Human Activities'
|
||||
compiled from SHOM, Ireland's National Monuments Service, Historic England and
|
||||
the Oxford Roman Economy Project; CC BY 4.0) and a Wikidata SPARQL query for
|
||||
shipwreck items with a coordinate and at least one Wikipedia article (about
|
||||
1,450 worldwide; CC0), at most once a day, and serves the last good snapshot as
|
||||
stale for up to seven days when a refresh fails. One source failing still serves
|
||||
the other. EMODnet rows the portal took from wrecksite.eu are skipped (that site
|
||||
1,450 worldwide; CC0), each at most once a day. Each source keeps its own last
|
||||
good records: a source that fails, or answers with nothing usable, keeps serving
|
||||
its earlier records as stale for up to seven days and is not asked again for
|
||||
15 minutes, and never removes the other source's wrecks. EMODnet rows the portal took from wrecksite.eu are skipped (that site
|
||||
is not openly licensed). A Wikidata wreck with the same name within 3 km of an
|
||||
EMODnet wreck is merged into one record that keeps the article link and takes
|
||||
EMODnet's year, sinking text, depth and position accuracy. Only ship columns are
|
||||
|
||||
Reference in new issue
Block a user