naj-market-pulse

Najma Market Pulse is a Dubai property market data pipeline and content engine for Naj, built only on official data. It fetches Dubai Land Department (DLD) open data and a fixed MEED corpus, then runs fail-closed sanity gates before publishing aggregates to public/pulse.json. The project includes a dashboard, weekly WhatsApp updates, and content angles for HeyGen podcasts, LinkedIn, and Instagram. The system runs from Windows scheduled tasks on a local PC because the DLD gateway does not serve cloud IPs. Daily, sweep, weekly government, and nightly backup chains are orchestrated through scripts/refresh_runner.py, with dry-run and single-step options. A run ledger records every step's status, exit code, and duration, while contracts hold feeds that break their promises rather than publishing them. The Data Spine phases introduce a published store with two dates on register rows, window contracts that hold short pulls, availability intervals, identity matching between sales project names and registered project IDs, a metric registry with claims, and register key joins across community, sales projects, parcels, service charges, and Makani data. DEWA account processing keeps nationality data internal and applies strict privacy rules. Hard rules from HANDOVER.md govern the project: every source passes a fail-closed sanity gate, reads are always read-only, no raw-row redistribution occurs, no individual is ever named, every published figure carries source and period, bulk leases are excluded, and the official DLD price index is cite-only. Attribution to DLD and MEED Projects must appear on every published surface.