Files
worldmonitor/consumer-prices-core
Elie Habib 8db8ef3f6e fix(consumer-prices): disable wholefoods_us -- Amazon login wall blocks Firecrawl (#2100)
* fix(consumer-prices): disable wholefoods_us -- Amazon login wall blocks Firecrawl

WFM product pages require Amazon authentication. Without a session cookie,
every page renders an auth modal containing img-login-tomato.png and
img-login-cheese.png. Firecrawl's LLM extracts those image alt-texts as
the product name, causing 11/12 title mismatch failures per run.

Confirmed via direct Firecrawl scrape: markdown shows "Log in with Amazon"
and the tomato/cheese auth prompt images -- no product content rendered.
US basket is well covered by kroger_us (12/12) and walmart_us (11/12).

* fix(consumer-prices): seed 9 new global baskets and their canonical products

Migration 006 seeds baskets for AU, BR, CH, GB, IN, KE, SA, SG, US.
These were added as YAML configs in the global expansion PR but never
seeded into the DB, causing "Basket not found in DB -- run seed first"
failures for all 9 markets in every aggregate run.

Also fixes ON CONFLICT for canonical_products to use the partial index
added in migration 003 (canonical_products_name_category_null_idx),
which covers rows where brand_norm/variant_norm/size_value/size_unit
are all NULL. Shared canonical names (Basmati Rice, Sunflower Oil 1L,
White Sugar 1kg, etc.) are reused via ON CONFLICT DO NOTHING.

Note: migration 005 (computed_indices_null_idx) must also be applied
on the production DB -- it was committed but may not have run, causing
the separate "no unique or exclusion constraint" error on essentials-ae.
2026-03-23 08:04:25 +04:00
..