Skip to content

feat(ingestion): Stop deduplicating data#764

Closed
runkelcorey wants to merge 1 commit into
mainfrom
feature-stop-deduplicating
Closed

feat(ingestion): Stop deduplicating data#764
runkelcorey wants to merge 1 commit into
mainfrom
feature-stop-deduplicating

Conversation

@runkelcorey

Copy link
Copy Markdown
Collaborator

What changes does this PR propose?

  1. Remove all the hashing
  2. Remove all the deduplicating

How were these changes validated?

  1. Updated tests
  2. Ran successfully on dev

What questions should reviewers consider?

  1. What impacts would you expect on Rail PM?

@runkelcorey runkelcorey requested a review from a team as a code owner June 15, 2026 21:25
@runkelcorey runkelcorey requested a review from huangh June 15, 2026 21:25
@runkelcorey runkelcorey self-assigned this Jun 15, 2026
@github-actions

Copy link
Copy Markdown

LCOV of commit 6434ca8 during Continuous Integration (Python) #1985

Summary coverage rate:
  lines......: 64.2% (3551 of 5527 lines)
  functions..: 29.4% (270 of 918 functions)
  branches...: no data found

Files changed coverage rate:
                                                                                     |Lines       |Functions  |Branches    
  Filename                                                                           |Rate     Num|Rate    Num|Rate     Num
  =========================================================================================================================
  src/lamp_py/ingestion/convert_gtfs_rt.py                                           |88.6%    220|50.0%    26|    -      0

@huangh huangh left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this is crash looping performance manager.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants