chore: remove pyarrow feature

[timsaucer]

Which issue does this PR close?

• Closes RFC: Should we remove pyarrow feature from datafusion core #14197

Rationale for this change

Our python downstream library no longer uses the feature pyarrow in this repository #1000. As such, this feature is no longer needed.

What changes are included in this PR?

Code removal

Are these changes tested?

Tested against datafusion-python repo. No build issues.

Are there any user-facing changes?

If any user needs this code, they will need to migrate to the datafusion-python repository as their dependency.

[milenkovicm]

Minor comment, would it be appropriate to include this breaking change in the “Upgrade Guide”? You already mentioned in the issue description that “if you need it, use DataFusion Python”.

[alamb]

Thanks @timsaucer -- I agree with @milenkovicm that a note in the upgrade guide would be best

I also suggest we wait until we have made the branch-51 for the 51 release to merge this one so it gets more "bake time" on main

[timsaucer]

Moved to draft until release 51 branch is created.

[alamb]

FYI branch-51 is created

[alamb]

here is the ticket: #18566

[timsaucer]

I added in a minor fix to cargo machete introduced on main recently.

[alamb]

I added in a minor fix to cargo machete introduced on main recently.

I think @comphead did a similar change in

• chore: Remove unused tokio dependency and clippy #18598

[milenkovicm]

i guess this can be merged once conflicts are resolved

[alamb]

I merged up from main and resolved some conflicts