FLUME-3342:Fix the taildir source read the data duplication. by zhulh200868 · Pull Request #291 · apache/logging-flume · GitHub
Skip to content

FLUME-3342:Fix the taildir source read the data duplication. - #291

Open
zhulh200868 wants to merge 1 commit into
apache:trunkfrom
zhulh200868:dev-001
Open

zhulh200868 wants to merge 1 commit into
apache:trunkfrom
zhulh200868:dev-001

Conversation

@zhulh200868

Copy link
Copy Markdown
Contributor

If the file a.log reaches a certain size, it will be renamed a.log.1 and a new file a.log, then a.log and a.log.1 inode are the same, but the file name is different, the default flume taildir source will think that this is a new file, it will be re-read, that causing data duplication.

@xiaoqingwuku

xiaoqingwuku commented Jul 24, 2019 •

Copy link
Copy Markdown

@iijima-satoshi

iijima-satoshi commented May 11, 2022 •

Copy link
Copy Markdown

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants