Commit Graph

20 Commits

Author SHA1 Message Date
Elie Habib
c353cf2070 Reduce egress costs, add PWA support, fix Polymarket and Railway relay
Egress optimization:
- Add s-maxage + stale-while-revalidate to all API endpoints for Vercel CDN caching
- Add vercel.json with immutable caching for hashed assets
- Add gzip compression to sidecar responses >1KB
- Add gzip to Railway RSS responses (4 paths previously uncompressed)
- Increase polling intervals: markets/crypto 60s→120s, ETF/macro/stablecoins 60s→180s
- Remove hardcoded Railway URL from theater-posture.js (now env-var only)

PWA / Service Worker:
- Add vite-plugin-pwa with autoUpdate strategy
- Cache map tiles (CacheFirst), fonts (StaleWhileRevalidate), static assets
- NetworkOnly for all /api/* routes (real-time data must be fresh)
- Manual SW registration (web only, skip Tauri)
- Add offline fallback page
- Replace manual manifest with plugin-generated manifest

Polymarket fix:
- Route dev proxy through production Vercel (bypasses JA3 blocking)
- Add 4th fallback tier: production URL as absolute fallback

Desktop/Sidecar:
- Dual-backend cache (_upstash-cache.js): Redis cloud + in-memory+file desktop
- Settings window OK/Cancel redesign
- Runtime config and secret injection improvements
2026-02-14 19:53:04 +04:00
Admin
e0e1b40e1a feat: add think tank, arms control, and food security RSS feeds
- Add RUSI, Wilson Center, GMF, Stimson, CNAS, Lowy Institute feeds
- Add Arms Control Association, Bulletin of Atomic Scientists feeds
- Add FAO GIEWS food security alerts, EU ISS feeds
- Add www.iss.europa.eu to RSS proxy allowlist
- Add SOURCE_TIERS and SOURCE_TYPES entries for new feeds
2026-02-13 15:06:33 -08:00
Elie Habib
f7fd4ad24d Fix Chatham House 403 and FAO parse errors
- Chatham House RSS returns 403 from cloud IPs, use Google News fallback
- FAO FPMA feed returns HTML (Angular app), not RSS — replaced with fao.org/rss
- Updated rss-proxy allowlist domain
2026-01-31 08:00:13 +04:00
Elie Habib
8f4cba06e5 feat(worldmonitor): 10 initiatives - launch prep and enhancements
COMPLETED INITIATIVES:

1. **Critical RSS Feeds** - Added 20+ feeds (RUSI, Chatham House, CFR, FAO, etc.)
2. **CII Trends** - 7-day/30-day rolling baselines with trend detection
3. **Trending Stories** - Analytics panel with localStorage persistence
4. **Launch Copy** - Finalized Twitter, LinkedIn, Reddit, Product Hunt materials
5. **Product Hunt** - Submission ready with tagline, bullets, screenshots
6. **Reddit Posts** - Ready for r/cybersecurity, r/INTELLIGENCE, r/geopolitics
7. **OG Meta Tags** - Dynamic meta tags for story sharing + Twitter Cards
8. **Story Templates** - 6 templates (analysis, crisis, brief, markets, compare, trend)
9. **Deep Link Router** - /story?c=UA routing to open country stories
10. **Self-Review Logging** - DEVELOPMENT_LOG.md per @jumperz pattern

FILES ADDED:
- src/services/meta-tags.ts - Dynamic OG/Twitter meta tags
- src/services/story-templates.ts - Template configurations
- src/services/cii-trends.ts - CII trend tracking
- src/services/trending-stories.ts - Story analytics
- 10_INITIATIVES.md - Initiative tracker
- ENHANCEMENT_PLAN.md - Comprehensive plan
- DEVELOPMENT_LOG.md - Self-review log

FILES MODIFIED:
- src/config/feeds.ts - Added 20+ RSS feeds
- api/rss-proxy.js - Added domains to allowlist
- src/main.ts - Initialize meta tags
- src/App.ts - Deep link handling
- index.html - OG meta tags
- LAUNCH_MATERIALS.md - Final launch copy

READY FOR LAUNCH!
2026-01-29 20:58:17 +00:00
Elie Habib
7e1dfcb160 Improve search results and fix RSS feeds
- Double MAX_RESULTS from 12 to 24
- Prioritize news over static infrastructure in search
- Update News24 URL to post-redirect destination (feeds.capi24.com)
- Add trailing slash to SCMP URL
- Add feeds.capi24.com to both proxy allowlists
2026-01-25 13:51:54 +04:00
Elie Habib
b92c501582 Add 13 missing domains to RSS proxy allowlist
Fixes 403 errors for:
- Middle East: Al Arabiya, Arab News, Times of Israel, SCMP
- Regional: Kyiv Independent, Moscow Times, News24
- Int'l Orgs: UN News, IAEA, WHO, CISA, Crisis Group
- Other: Hacker News (news.ycombinator.com)
2026-01-25 13:13:30 +04:00
Elie Habib
1245cac966 Fix bugs found in code review
- CORS regex: now matches root domain (worldmonitor.app) not just subdomains
- Alert keywords: re-add important terms (military, drone strike, terror/cyber attack, evacuation order)
2026-01-25 12:40:10 +04:00
Elie Habib
3e5e6f3dbf Add CORS support for Vercel preview domains in RSS proxy 2026-01-25 12:32:27 +04:00
Elie Habib
a9eba9a975 Add RSS proxy domains, FwdStart scraper, fix status URLs
- Add 25+ domains to RSS proxy allowlist (VC blogs, regional startups, funding)
- Create /api/fwdstart.js custom scraper for Beehiiv newsletter
- Fix Anthropic status URL (status.claude.com)
- Fix Zoom status URL (www.zoomstatus.com)
- Remove panel debug logging
- Add CLAUDE.md with dev documentation
2026-01-23 13:46:00 +04:00
Elie Habib
9fb3c34628 Add service status panel and improve tech variant feeds
- Add ServiceStatusPanel: monitors AWS, Azure, GCP, GitHub, OpenAI, Slack, etc.
- Add new feeds: Engadget, Fast Company, MIT Research, Show HN, YC Launches, Dev Events
- Remove broken feeds: Protocol Policy, Axios AI, AnandTech (shut down)
- Add "SOON" badge for events within 2 days
- Fix GitHub Trending to use actual RSS feed (mshibanami.github.io)
- Add domains to rss-proxy allowlist
2026-01-23 09:11:20 +04:00
Elie Habib
633faae158 Fix broken feeds: add domains to allowlist, replace defunct Protocol/rsshub feeds 2026-01-23 08:51:09 +04:00
Elie Habib
9dd3a403cd Add missing tech variant domains to RSS proxy allowlist 2026-01-23 08:01:52 +04:00
Elie Habib
9df91b2dd5 Remove The Telegraph feed - blocks all cloud providers
Akamai CDN blocks both Vercel and Railway IPs, making the
feed unreachable from any cloud infrastructure. Guardian
already provides UK news coverage.
2026-01-11 17:29:42 +04:00
Elie Habib
6ad3552a27 Add atlanticcouncil.org to RSS proxy whitelist 2026-01-11 17:24:39 +04:00
Elie Habib
f194e16273 Fix broken RSS feeds
- Update Brookings URL to new /feeds/rss/research/ path
- Replace CFR (404) with Foreign Affairs (CFR's publication)
- Remove The Telegraph (blocks Vercel IPs)
- Add foreignaffairs.com to proxy whitelist
2026-01-11 17:16:29 +04:00
Elie Habib
aaad2b9ca0 Add missing RSS feed domains to proxy whitelist 2026-01-11 17:00:40 +04:00
Elie Habib
8f6600a85e Increase RSS proxy timeouts for Google News
- Google News feeds: 20s timeout (often slow)
- Other feeds: 12s timeout
- Use more realistic browser User-Agent
2026-01-11 10:21:59 +04:00
Elie Habib
6a073c392c Fix PizzINT routes with explicit endpoint files
- Replace catch-all route with explicit files
- api/pizzint/dashboard-data.js for /api/pizzint/dashboard-data
- api/pizzint/gdelt/batch.js for /api/pizzint/gdelt/batch
- Improve rss-proxy error handling with more details
2026-01-11 10:21:13 +04:00
Elie Habib
0c75c85960 Fix API timeouts and reduce OpenSky requests
- Add explicit timeouts to OpenSky (12s) and RSS (8s) proxies
- Consolidate 10 military hotspots into 4 larger regions
- Increase military refresh interval from 2 to 5 minutes
- Switch OpenAI feed to Google News (OpenAI blocks proxies)
2026-01-11 08:50:19 +04:00
Elie Habib
a928db67ab Replace corsproxy.io with Vercel serverless proxies
- Add /api/yahoo-finance.js for stock quotes
- Add /api/coingecko.js for crypto prices
- Add /api/polymarket.js for prediction markets
- Add /api/rss-proxy.js for RSS feeds (with domain allowlist)
- Add /api/earthquakes.js for USGS data
- Update feeds.ts to use direct URLs with RSS proxy
- Simplify proxy.ts (no external CORS proxy needed)
- Update earthquakes.ts and polymarket.ts to use new endpoints

Eliminates dependency on unreliable third-party CORS proxy.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-11 07:34:57 +04:00