[Data] Add seed for read files

[Bye-legumes]

Why are these changes needed?

Close #46177

Related issue number

Checks

• [√] I've signed off every commit(by using the -s flag, i.e., git commit -s) in this PR.
• [√] I've run scripts/format.sh to lint the changes in this PR.
• I've included any doc changes needed for https://docs.ray.io/en/master/.
  • I've added any new APIs to the API Reference. For example, if I added a
    method in Tune, I've added it in doc/source/tune/api/ under the
    corresponding .rst file.
• I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failures at https://flakey-tests.ray.io/
• Testing Strategy
  • [√] Unit tests
  • Release tests
  • This PR is not tested :(

[xingyu-long]

Hey @Bye-legumes, do we still need your another PR #46306? it seems this PR is doing similar thing, right?

cc @richardliaw

[Bye-legumes]

Hey @Bye-legumes, do we still need your another PR #46306? it seems this PR is doing similar thing, right?

cc @richardliaw

HI, we dont need PR #46306 if this can be merged. This is the plan bveeramani mentioned that we use a fileshuffleconfig to unify the shuffle.

[xingyu-long]

Hey @Bye-legumes, do we still need your another PR #46306? it seems this PR is doing similar thing, right?
cc @richardliaw

HI, we dont need PR #46306 if this can be merged. This is the plan bveeramani mentioned that we use a fileshuffleconfig to unify the shuffle.

Got it, maybe we can close the another one to avoid duplicate? thanks!

[Bye-legumes]

Hey @Bye-legumes, do we still need your another PR #46306? it seems this PR is doing similar thing, right?
cc @richardliaw

HI, we dont need PR #46306 if this can be merged. This is the plan bveeramani mentioned that we use a fileshuffleconfig to unify the shuffle.

Got it, maybe we can close the another one to avoid duplicate? thanks!

Closed!

[bveeramani]

Can you add a docstring example and arg description? Maybe something like:

# (Pseudocode. You'll need to make this actually run or CI will fail)
>>> import ray
>>> import FileShuffleConfig
>>> read_parquet(...., shuffle=FileShuffleConfig(seed=42))

Also, maybe add a ..note that even if you seed the file shuffling, you might still get a somewhat random row order since tasks complete in non-deterministic order.