Skip to content

Conversation

@the-other-tim-brown
Copy link
Contributor

@the-other-tim-brown the-other-tim-brown commented Jan 26, 2026

Describe the issue this Pull Request addresses

Moves implementation of utils to HoodieSchemaUtils directly to remove the direct reliance on Avro.

Summary and Changelog

  • Removes following from AvroSchemaUtils: findNestedField, appendFieldsToSchemaDedupNested, appendFieldsToSchema, pruneDataSchema, createNullableSchema, containsFieldInSchema
  • Removes following from HoodieAvroUtils: createHoodieWriteSchema, addMetadataFields, isSchemaNull, removeMetadataFields, getRecordKeyPartitionPathSchema, addOperationToRecord, generateProjectionSchema, getNestedFieldSchemaFromRecord, getNullSchema
  • The above are moved to HoodieSchemaUtils
  • Tests are copied over if they do not already exist, otherwise they are simply removed

Impact

Breaks away from Avro schema usage

Risk Level

Low

Documentation Update

Contributor's checklist

  • Read through contributor's guide
  • Enough context is provided in the sections above
  • Adequate tests were added if applicable

@github-actions github-actions bot added size:L PR with lines of changes in (300, 1000] size:XL PR with lines of changes > 1000 and removed size:L PR with lines of changes in (300, 1000] labels Jan 26, 2026
@the-other-tim-brown the-other-tim-brown changed the title feat(schema): Remove usage of migrated AvroSchemaUtils and HoodieAvroUtils methods feat(schema): Remove usage of migrated AvroSchemaUtils and HoodieAvroUtils methods (part 1) Jan 27, 2026
@the-other-tim-brown the-other-tim-brown marked this pull request as ready for review January 27, 2026 16:39
@hudi-bot
Copy link
Collaborator

CI report:

Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run azure re-run the last Azure build

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size:XL PR with lines of changes > 1000

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants