Elie Habib 261d40dfa1 fix(consumer-prices): block restaurant URLs and reject null productName extractions (#2156) ...

Two data-quality regressions found in the 2026-03-23 scrape:

1. ananinja_sa: Exa returns restaurant menu URLs (e.g. /restaurants/burger-king)
   alongside product pages. isTitlePlausible passes "onion rings" for "Onions 1kg"
   because "onion" is a substring. Add urlPathContains: /product/ to restrict Exa
   results to product pages only, matching the existing pattern used by tamimi/carrefour.

2. search.ts parseListing: when Firecrawl can't extract a productName, we fell back
   to the canonical name as rawTitle. This silently stored unverifiable matches
   (raw_title = canonical_name) as real prices — e.g. Noon matched a chicken product
   as "Eggs Fresh 12 Pack". Reject the result outright when productName is missing.

DB: manually disabled 30 known-bad pins (26 canonical-name=raw-title failures,
2 restaurant URLs, 2 bundle-size mismatches) via pin_disabled_at.

2026-03-23 21:47:53 +04:00

..

configs

fix(consumer-prices): block restaurant URLs and reject null productName extractions (#2156)

2026-03-23 21:47:53 +04:00

migrations

feat(consumer-prices): product pinning, BigBasket fix, spread threshold, retailer sync (#2136)

2026-03-23 14:19:30 +04:00

plans

feat(consumer-prices): product pinning, BigBasket fix, spread threshold, retailer sync (#2136)

2026-03-23 14:19:30 +04:00

src

fix(consumer-prices): block restaurant URLs and reject null productName extractions (#2156)

2026-03-23 21:47:53 +04:00

tests/unit

fix(consumer-prices): add size-aware extraction to prevent Walmart pack-size mismatches (#2148)

2026-03-23 17:08:14 +04:00

.env.example

feat(consumer-prices): wire Exa engine into DB pipeline for time-series tracking (#1932)

2026-03-20 17:59:42 +04:00

Dockerfile

fix(consumer-prices): install devDeps before tsc build in Dockerfile (#1935)

2026-03-20 18:45:57 +04:00

package-lock.json

chore(consumer-prices): add package-lock.json for Railway Docker build (#1934)

2026-03-20 18:28:22 +04:00

package.json

fix(consumer-prices): fold validate into aggregate job, remove separate cron step (#2062)

2026-03-22 20:29:18 +04:00

tsconfig.json

feat(consumer-prices): add basket price monitoring domain (#1901)

2026-03-20 17:08:22 +04:00