Commit e3aedce
committed
Add append delta filename to metadata.append_deltas view
Why these changes are being introduced:
* The method for merging append deltas into the static metadata database file
needs the filenames of append deltas to easily identify which files
to delete (once merged). Prior to this change, the append deltas view
only had a 'filename' column, which referred to the path or S3 URI for
the TIMDEXDataset parquet file.
How this addresses that need:
* Set filename='append_delta_filename' when creating metadata.append_deltas view
* Explicitly select metadata column names when creating metadata.records view
Side effects of this change:
* None
Relevant ticket(s):
* https://mitlibraries.atlassian.net/browse/TIMX-5281 parent dba26cc commit e3aedce
1 file changed
Lines changed: 8 additions & 4 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
396 | 396 | | |
397 | 397 | | |
398 | 398 | | |
399 | | - | |
| 399 | + | |
| 400 | + | |
400 | 401 | | |
401 | 402 | | |
402 | 403 | | |
| |||
414 | 415 | | |
415 | 416 | | |
416 | 417 | | |
| 418 | + | |
417 | 419 | | |
418 | | - | |
| 420 | + | |
419 | 421 | | |
420 | 422 | | |
421 | | - | |
| 423 | + | |
| 424 | + | |
422 | 425 | | |
423 | 426 | | |
424 | | - | |
| 427 | + | |
| 428 | + | |
425 | 429 | | |
426 | 430 | | |
427 | 431 | | |
| |||
0 commit comments