Files
gods-eye-view/src/data/local_data/natural_earth
Denis Groshev 34c75ff5de Serve the News layer without a news server: GDELT, Liveuamap and World News API
With GEV_NEWS_ORIGIN unset, Core answers the News layer's routes itself.

Conflicts need no key: the last 24 h of GDELT 2.0 event exports, physical
violence only (CAMEO 18-20), one report per story (copies of one agency
story merged), placed where GDELT put it, a town the article's own words
name winning over a bare country, and titled by the article's page title
from the GKG export of the same quarter hour (the newest 3 h), else by its
address words. GDELT's actor coding is never shown. Exports are read up to
the newest GDELT lists; one that cannot be read is given up on without
holding the rest back, and an outage of two hours answers 502 rather than
an empty feed. With LIVEUAMAP_API_KEY, Liveuamap's mapped items join them.

Local reads World News API by the source country at the view centre
(WORLDNEWSAPI_KEY, at most WORLDNEWSAPI_DAILY_READS a day), with the
Conflicts reports placed inside the area. Disputed areas (11 from Natural
Earth, bundled) and territories without a country code are named as
themselves and read from no country's outlets; a country's outline leaves
them out.

Categories, relevance and severity come from shared rules; keyed answers
are cached and served while they refresh, and no key or address is logged.
2026-11-06 00:45:31 +01:00
..

Natural Earth packs

Offline polygons with no network dependency. The voice-annotation resolver (src/data/naturalEarthRegions.js) reads the named regions, so "outline the Alps" resolves to the real range geometry; area annotations read the countries, states and provinces (src/data/adminBoundaries.js); and the News layer reads the countries and the disputed areas (server/providers/news/areas.js).

File Source dataset Features
regions.json ne_10m_geography_regions_polys (ranges, deserts, plateaus, peninsulas, islands, …) 1,046 named
marine.json ne_10m_geography_marine_polys (seas, gulfs, straits, bays, …) 292 named
countries.json ne_10m_admin_0_countries (countries) 256
states_provinces.json ne_10m_admin_1_states_provinces (states, provinces and other first-level units) 4,587 named
disputed_areas.json ne_10m_admin_0_disputed_areas (disputed, breakaway and UN-patrolled areas; a hand-picked set, see below) 11 of 99

Source: Natural Earth 10m physical vectors, via the canonical nvkelso/natural-earth-vector GitHub repo, commit ca96624a56bd078437bca8184e78163e5039ad19 (fetched 2026-07-28T01:36:39Z — exact provenance is in each file's meta header).

License: public domain (https://www.naturalearthdata.com/about/terms-of-use/). No attribution legally required; we credit "Made with Natural Earth" anyway. See DATA_SOURCES.md.

Curation (script not committed — parameters recorded in meta.curation):

  • Named features only; the Dragons-be-here joke feature ("Null Island") dropped.
  • Outer rings only (holes are irrelevant at country-scale outline zoom).
  • Douglas-Peucker simplification at 0.01°, coordinates rounded to 3 decimals (~110 m), rings stored open (no closing duplicate vertex).
  • MultiPolygon crumbs under 20 km² dropped (largest part always kept); rings that survive with fewer than 8 distinct vertices are midpoint-densified (shape-identical) so every ring has ≥8 vertices.
  • Zero-area sliver artifacts dropped. Two marine features are ONLY slivers in the source and are therefore absent: Drake Passage and Luzon Strait.
  • Result: 7.3 MB source → 2.5 MB pack (budget ≤3 MB, enforced by src/data/naturalEarthRegions.test.mjs).

Duplicate names exist upstream (two "Cordillera Oriental", a sliver + real "Canadian Shield", …); the lookup module resolves ties by largest area.

States and provinces (states_provinces.json)

Worldwide first-level administrative units for area annotations ("outline Texas", "outline Bavaria"), read by src/data/adminBoundaries.js.

Source: geojson/ne_10m_admin_1_states_provinces.geojson from nvkelso/natural-earth-vector at commit ca96624a56bd078437bca8184e78163e5039ad19 (SHA-256 22d0e3ad85eb3e27f17cabf8ba2d50e554fbc27a87796ff891d958185da62fb5), fetched 2026-09-25. geojson/ne_10m_populated_places_simple.geojson from the same commit (SHA-256 fd3fa867a320cbd5c5b6bb5bc550afeec2939fb2cef688e508007282a55ac42f) is read only to mark ambiguous names; none of it is bundled.

License: public domain, as above.

Regenerate: node scripts/build-admin-packs.mjs --only admin1 downloads the pinned files (to the system temp directory, or --cache <dir>), checks their SHA-256 and rewrites the pack byte for byte. Parameters are in the script's PARAMS and in the pack's meta.curation.

Schema: meta (source, URLs, hashes, license, curation) and features[] with name, nameEn (when it differs), alt[] (Latin-script name_alt variants and abbreviations), postal, type (type_en), rank (min_label), country (admin), iso2, iso (ISO 3166-2), amb[], ambAbroad[], cityState, label ([lon, lat] label point) and polygons. polygons is a list of parts, largest first, each [outer, ...holes]; every ring is open and stored as integers in units of 10^-3 degrees (10^-d when a feature carries d), the first vertex absolute and each later one as a [dLon, dLat] delta.

Curation:

  • The 7 unnamed features and 2 degenerate Nauru districts are dropped (4,596 → 4,587).
  • Douglas-Peucker per ring at 0.004 × √(unit area in km²) km, clamped to 0.005°–0.02° (Texas ≈ 0.02°, Bavaria ≈ 0.01°); coordinates rounded to 3 decimals. The 75 units too small to survive (Maldives atolls, Malta's councils) keep 4 decimals at 0.001° (d: 4); 3 smaller still (Vatican City) keep their source rings at 5 decimals (d: 5).
  • Parts under 20 km² or under 0.03% of the unit's largest part are dropped; holes under 20 km² are dropped. Outers are counter-clockwise, holes clockwise.
  • amb lists names that are also a country (admin/geonunit of any unit), a populated place of 200,000+ (pop_max) inside the unit's box when the unit is larger than 1,000 km², or a populated place of 50,000+ elsewhere in the same country; ambAbroad lists names shared only with a populated place of 50,000+ in another country. cityState marks a unit of at most 1,000 km² that contains its namesake city (Berlin, Vienna, Paris). 548 units carry amb, 108 ambAbroad, 138 cityState.
  • Result: 3,648,916 bytes (1,260,545 with gzip -9); 6,492 parts, 80 holes, 407,339 vertices.

Countries (countries.json)

Natural Earth 10m admin-0 countries, public domain under the terms above. Source: geojson/ne_10m_admin_0_countries.geojson at the same pinned commit; SHA-256 239eec57ac17f100a11e2536cffc56752c318b50ae765b0918ff7aab4ce8f255. Regenerate with node scripts/build-admin-packs.mjs --only countries. Uses the state/province encoding and simplification, retaining parts of at least 20 km² and 0.003% of the largest part (including Alaska and Hawaii); the largest part always stays. Holes under 20 km² are dropped. Includes England, Scotland, Wales and Northern Ireland from ne_10m_admin_0_map_units.geojson at the same commit (SHA-256 57da82be755f4afccd8f3b14251bb2752f5df1395f47d2d86f817470c4a48862). Result: 945,843 bytes; 260 features, 2,088 parts, 122,788 vertices.

Disputed areas (disputed_areas.json)

The News layer's areas that no one country's name may stand for (server/providers/news/areas.js): a place inside one is named with the area ("Crimea"), and Local there reads no country's outlets.

Source: geojson/ne_10m_admin_0_disputed_areas.geojson at the same pinned commit (SHA-256 9cafef8b7dfb6b164dc58f218f981f4ace9f716f6c03795d4c62d1ac9f3d50f5), fetched 2026-11-05. Public domain, as above.

Selection: a hand-picked 11 of the source's 99 features. No rule picks them; this is the list:

Area Natural Earth's note (NOTE_BRK)
Golan Heights Admin. By Israel; Claimed by Syria
UNDOF Zone UN Patrolled Zone in Syria
Transnistria Self admin.; Claimed by Moldova
Abyei Admin. by Sudan; Claimed by South Sudan
Crimea Admin. by Russia; Claimed by Ukraine
Shebaa Farms Admin. By Israel; Claimed by Lebanon
Bir Tawil Between Egypt and Sudan
Halayib Triangle Admin. by Egypt; Claimed by Sudan
East Jerusalem Admin. By Israel; Claimed by Palestine
Abu Musa I. Admin. by Iran; Claimed by UAE
Doumera Island Admin. By Eritrea; Claimed by Djibouti

The source names three of these by a country ("Moldova", "Sudan", "Iran"); the pack names them as the area. The 2014 Donetsk and Luhansk lines are left out as out of date. Every other feature is left out too, so a place there is named by its country in countries.json.

Curation: kind (held, self, un, unclaimed), heldBy and claimedBy are read from NOTE_BRK, and note keeps it as published. Every part is kept; each ring is Douglas-Peucker simplified at 0.003°, coordinates are rounded to 3 decimals and rings are stored open. Provenance is in the pack's meta. Result: 14,504 bytes.