Releases: MITLibraries/timdex-dataset-api
Releases · MITLibraries/timdex-dataset-api
v3.4 - Pin DuckDB dependency in pyproject.toml
v3.3 - Pin DuckDB client to 1.3.2
v3.2 - Read optimizations
What's Changed
- TIMX 543 - Optimize current records metadata queries and data retreival by @ghukill in #168
- TIMX 543 - keyset pagination for read methods by @ghukill in #169
Full Changelog: v3.0...v3.2
v3.0 - Enhanced dataset metadata and SQL querying
What's Changed
- TIMX 515 - static DuckDB file prep by @ghukill in #154
- Timx 530 prep work and s3 client by @ghukill in #156
- TIMX 530 - rebuild TIMDEXDatasetMetadata with static database file approach by @ghukill in #157
- TIMX 527 - write append deltas by @ghukill in #158
- TIMX 526 - projected views by @ghukill in #159
- TIMX 533 - Load pyarrow dataset on TIMDEXDataset init by @ghukill in #160
- TIMX 529 - read methods utilize SQL + metadata context by @ghukill in #161
- TIMX 515 - dependency hotfix by @ghukill in #162
- TIMX 540 - adjust AWS credential chain for ECS context by @ghukill in #164
- TIMX 541 - handle missing HOME env in AWS Lambda by @ghukill in #165
- Bump version to v3.0 by @ghukill in #166
- Timx 528 merge append deltas by @jonavellecuerdo in #163
- Merge long running feature branch
epic-TIMX-515by @ghukill in #167
Full Changelog: v2.3...v3.0
v2.3 - Current records via TIMDEXDatasetMetadata
v2.2 - TIMDEXDatasetMetadata introduced
What's Changed
Full Changelog: v2.1...v2.2
v2.1 - Explicit run_timestamp
What's Changed
- TIMX 496 - add migrations folder and run_timestamp migration by @ghukill in #147
- TIMX 509 - explicit run timestamp by @ghukill in #149
Full Changelog: v1.1...v2.1
v2.0 - Support for "current" records
What's Changed
- TIMX 494 - pip audit and logging updates by @ghukill in #142
- TIMX 494 - TIMDEXRunManager for producing ETL run metadata by @ghukill in #143
- TIMX 494 - yield deduped, most recent records by @ghukill in #144
- TIMX 497 - filtering current records by @ghukill in #145
- TIMX 496 - Add run_timestamp column to dataset by @ghukill in #146
Full Changelog: v1.0...v2.0
v1.0
What's Changed
- TIMX 427 - improve logging by @ghukill in #68
- TIMX 465 - Add
run_record_offsetcolumn to dataset by @ghukill in #73 - Add support for 'or' conditions to filtering method by @jonavellecuerdo in #99
- bump version to v0.9.0 by @jonavellecuerdo in #100
- TIMX 468 - surface pyarrow read configs to address memory footprint by @ghukill in #108
- v1 release by @ghukill in #129
Full Changelog: v0.6.0...v1.0
v0.6.0 - dataset read methods
What's Changed
- Timx 425 update load dataset and apply filtering; Timx 440 replace static fixture of local dataset by @jonavellecuerdo in #31
- TIMX 417 - read from dataset by @ghukill in #52
- Add read method for yielding transformed records to TIMDEXDataset by @jonavellecuerdo in #58
- bump version to v0.6.0 by @ghukill in #61
Full Changelog: v0.3.0...v0.6.0