Skip to content

Log Files

Log Files (file)

Append events to one or more files.

Contents

Fields

FieldTypeRequiredDescription
batchBatchBatching input events together.
retryRetryRetry options.
pathstringPath to the file to be written. Can have ${} expansions.
input-fieldevent-field (string)Use the specified field as the content for the file line.
compress-afterboolean (bool)Compress the written file after the filename changes.
create-directoriesboolean (bool)Create parent directories for the given path if they do not exist.
file-per-eventboolean (bool)Each event is written out to a new file, overwriting if needed.
truncateboolean (bool)Existing files are truncated before writing.
flush-at-endboolean (bool)Don’t flush after each event.

Batch Fields

FieldTypeRequiredDescription
fixed-sizeintegermaximum number of events in an output batch.
modesymbolIf ‘document’ send on end of document generated by input. If ‘fixed’, use fixed_size.
timeoutstringinterval after which the batch is sent, to keep throughput going (default 100ms).
headerstringput a header line before the batch.
footerstringput a header line after the last line of the batch.
use-document-markerboolEnrich the job metadata with a document marker (for document handling in batch mode).
wrap-as-jsonboolFormat the output batch as a JSON array.

Retry Fields

FieldTypeRequiredDescription
countintegerThe number of retry attempts. If unspecified, retries will continue indefinitely.
pausestringHow long to pause before re-trying.