Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

file input plugin: define watching_dir from include patterns #567

Merged
merged 11 commits into from
Oct 9, 2024

Conversation

DmitryRomanov
Copy link
Collaborator

try to define watching_dir from paths.include

see also #566

pipelines:
  welcome:
    input:
      type: file
      persistence_mode: async
      # watching_dir: /var/lib/docker/containers 
      # filename_pattern: "*-json.log"
      paths:
        include:
          - '/var/lib/docker/containers/30b28763e40a7649ef73c8afce0b0f4e62546f2a07a174d97e56bd02854facbd/*-json.log'
          - '/var/lib/docker/containers/65d343a9cc0a9fe6e466a370fcaf8ad6458eb912d19f8e8832e941e2ab7cafa0/*-json.log'
          - '/var/lib/docker/containers/**/*-json.log'
          - '/var/log/clickhouse-server/*.log'
        exclude:
          - '/var/lib/docker/overlay2/**'
          - '/var/lib/docker/volumes/**'
      offsets_file: ./offsets.yaml
      offsets_op: reset
    output:
      type: stdout

@DmitryRomanov DmitryRomanov force-pushed the file-without-watch-dir branch from bb5c30b to 132f92a Compare January 9, 2024 09:10
@DmitryRomanov DmitryRomanov force-pushed the file-without-watch-dir branch 2 times, most recently from 4492952 to b6d8da6 Compare March 5, 2024 09:22
@DmitryRomanov DmitryRomanov changed the base branch from file-input-paths to master March 5, 2024 09:25
@DmitryRomanov DmitryRomanov force-pushed the file-without-watch-dir branch 2 times, most recently from e74ed9b to 0e46da7 Compare March 5, 2024 09:45
Copy link

codecov bot commented Mar 5, 2024

Codecov Report

Attention: Patch coverage is 71.96262% with 30 lines in your changes missing coverage. Please review.

Project coverage is 71.02%. Comparing base (67ecc39) to head (d01873c).
Report is 17 commits behind head on master.

Current head d01873c differs from pull request most recent head 9675047

Please upload reports for the commit 9675047 to get more accurate results.

Files Patch % Lines
plugin/input/file/watcher.go 75.29% 14 Missing and 7 partials ⚠️
plugin/input/file/info.go 0.00% 9 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##           master     #567      +/-   ##
==========================================
+ Coverage   70.83%   71.02%   +0.18%     
==========================================
  Files         124      124              
  Lines       12572    12644      +72     
==========================================
+ Hits         8906     8981      +75     
+ Misses       3150     3141       -9     
- Partials      516      522       +6     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@DmitryRomanov DmitryRomanov force-pushed the file-without-watch-dir branch from 0e46da7 to c313439 Compare March 6, 2024 14:28
@DmitryRomanov DmitryRomanov force-pushed the file-without-watch-dir branch 3 times, most recently from ba58ad7 to d01873c Compare March 28, 2024 08:42
@DmitryRomanov DmitryRomanov force-pushed the file-without-watch-dir branch from d01873c to 5446e1f Compare April 19, 2024 04:58
@goshansmails goshansmails self-requested a review April 19, 2024 09:34
@DmitryRomanov DmitryRomanov force-pushed the file-without-watch-dir branch from 97c718a to eea327b Compare June 11, 2024 08:14
@DmitryRomanov DmitryRomanov force-pushed the file-without-watch-dir branch 2 times, most recently from b795a8b to 02acfa4 Compare September 6, 2024 06:41
@DmitryRomanov DmitryRomanov force-pushed the file-without-watch-dir branch from 02acfa4 to 1d28baf Compare October 7, 2024 12:51
@DmitryRomanov DmitryRomanov merged commit b897426 into master Oct 9, 2024
8 checks passed
@DmitryRomanov DmitryRomanov deleted the file-without-watch-dir branch October 9, 2024 12:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants