Add spec_id back to data file

[puchengy]

Spec id was removed in https://github.com/apache/iceberg-python/pull/40/files to wait for the decision of apache/iceberg#8730. This PR adds it back and is needed to unblock issue #46

[Fokko]

This is a great start, but I think we need to inherit the spec from the manifest.

I think we can generalize the _inherit_sequence_number by renaming it to something like _inherit_from_manifest, and add a line to copy the spec-id from the manifest:

entry.data_file.spec_id = manifest.partition_spec_id

[Fokko]

I don't think we want to add the fields here since the spec_id isn't read/written.

[Fokko]

Thank you @puchengy for fixing this 🙌

[Fokko]

@puchengy can you fix the CI? We need to make this part of 0.5.1 since the spec_id was there before (as you pointed out on Slack :)

[puchengy]

@Fokko Will do that.

[Fokko]

@puchengy

make install && make lint should fix it. It also looks like the integration test is failing because FastAvro is missing the spec_id (and this is correct because it isn't written, the test should be updated).

[puchengy]

@Fokko thanks I will address that today or tomorrow. If this becomes a blocker of the release and we need get it done quick, feel free to take it over.

[Fokko]

@puchengy let me give it a try

[Fokko]

@puchengy I think this fixes it: puchengy#1

[puchengy]

@Fokko Thanks, adopted your suggestion and tried a local integration test and it passed.

[Fokko]

Thanks!

It looks like some changes on the request side broke the CI: #69

[Fokko]

This is great, thanks @puchengy for fixing this 👍