Fix potenial missing reads of exclude nodes by zuston · Pull Request #269 · apache/uniffle · GitHub
Skip to content

Fix potenial missing reads of exclude nodes#269

Merged
roryqi merged 1 commit into
apache:masterfrom
zuston:fixTime
Oct 18, 2022
Merged

Fix potenial missing reads of exclude nodes#269
roryqi merged 1 commit into
apache:masterfrom
zuston:fixTime

Conversation

@zuston

@zuston zuston commented Oct 18, 2022

Copy link
Copy Markdown
Member

What changes were proposed in this pull request?

Use the original latest modification time to fix potenial missing reads of exclude nodes

Why are the changes needed?

I found that after doing parseExcludeNodesFile(hadoopFileSystem.open(hadoopPath));, the file was updated of adding the new nodes, in the current implementation, the newly added nodes wont be recognized.

Does this PR introduce any user-facing change?

No

How was this patch tested?

Dont need

@codecov-commenter

codecov-commenter commented Oct 18, 2022

Copy link
Copy Markdown

@zuston zuston requested a review from roryqi October 18, 2022 06:10

@roryqi roryqi left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks @zuston

@roryqi

roryqi commented Oct 18, 2022

Copy link
Copy Markdown
Contributor

Have you tested this patch by hand?

@zuston

zuston commented Oct 18, 2022

Copy link
Copy Markdown
Member Author

@roryqi roryqi merged commit b845381 into apache:master Oct 18, 2022
@zuston zuston deleted the fixTime branch October 18, 2022 14:18
kaijchen pushed a commit that referenced this pull request Nov 12, 2022
### What changes were proposed in this pull request?
Use the original latest modification time to fix potenial missing reads of exclude nodes

### Why are the changes needed?
I found that after doing `parseExcludeNodesFile(hadoopFileSystem.open(hadoopPath));`, the file was updated of adding the new nodes, in the current implementation, the newly added nodes wont be recognized.

### Does this PR introduce _any_ user-facing change?
No

### How was this patch tested?
By hand
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants