Skip to content

feat: Improve TF-IDF weighting, match explanations, and MovieLens enrichment - #5

Merged
LavishSphere merged 4 commits into
mainfrom
feat/changes
Jun 22, 2026
Merged

LavishSphere merged 4 commits into
mainfrom
feat/changes

Conversation

@LavishSphere

@LavishSphere LavishSphere commented Jun 20, 2026 •

Copy link
Copy Markdown
Owner

Summary

  • Replaced weighted tfidf_soup repetition with separate TF-IDF indexes for description, genres, cast, and director
  • Added explicit TF-IDF field weights:
    • Description: 50%
    • Genres: 30%
    • Cast: 10%
    • Director: 10%
  • Integrated MovieLens 32M metadata into the data loader
    • Adds MovieLens genres
    • Adds user tag signals
    • Adds cached aggregate rating signals via ratings_summary.csv
  • Updated TF-IDF input data so MovieLens genres and tags contribute to recommendation matching
  • Updated recommender scoring so TF-IDF content similarity has more influence than IMDb/popularity
  • Added match_breakdown to recommendation results so the backend can explain how match scores are calculated
  • Disabled MDP diversity re-ranking for now so final results stay ordered by relevance score
  • Updated README data notes to reflect included MovieLens assets

## Summary

- Replaced weighted `tfidf_soup` repetition with separate TF-IDF indexes for description, genres, cast, and director
- Added explicit TF-IDF field weights:
  - Description: 50%
  - Genres: 30%
  - Cast: 10%
  - Director: 10%
- Updated recommender scoring so TF-IDF content similarity has more influence than IMDb/popularity
- Added `match_breakdown` to recommendation results so the backend can explain how match scores are calculated
- Disabled MDP diversity re-ranking for now so final results stay ordered by relevance score
@LavishSphere LavishSphere self-assigned this Jun 20, 2026
@LavishSphere
LavishSphere requested a review from cheangie June 20, 2026 04:53
@LavishSphere LavishSphere changed the title feat: Improve TF-IDF weighting and expose match breakdown feat: Improve TF-IDF weighting, match explanations, and MovieLens enrichment Jun 22, 2026
@LavishSphere
LavishSphere merged commit 5a3ac4c into main Jun 22, 2026
4 checks passed
@LavishSphere
LavishSphere deleted the feat/changes branch June 22, 2026 02:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants