Skip to content

OpenTelemetry

OpenTelemetry (open-telemetry)

Accept OpenTelemetry OTLP signals over gRPC.

Observability json

Minimal example

input:
open-telemetry:
listen:
address: ""
JSON
{
"input": {
"open-telemetry": {
"listen": {
"address": ""
}
}
}
}

Contents

Fields

FieldTypeRequiredDescription
listen ConnectionListengRPC listener configuration.
trigger TriggerTriggerOptional trigger for scheduled ingestion.
retry ReliabilityRetryRetry configuration applied to downstream emission.
signals SignalsSignals[]OpenTelemetry signals to process (default: logs, traces).
Allowed values: logs, traces, metrics
batch BatchingBatchOptional batching semantics shared with other inputs.
resource-overrides Attributesmap (string)Static resource attributes to merge into each inbound record.
default-attributes Attributesmap (string)Default attributes applied to emitted events.
auth SecurityAuthAuthentication configuration for inbound requests.

Trigger

Show fields
FieldTypeRequiredDescription
triggerTriggerOptional trigger for scheduled ingestion.

Reliability

Show fields
FieldTypeRequiredDescription
retryRetryRetry configuration applied to downstream emission.

Connection

Show fields
FieldTypeRequiredDescription
listenListengRPC listener configuration.

Signals

Show fields
FieldTypeRequiredDescription
signalsSignals[]OpenTelemetry signals to process (default: logs, traces).
Allowed values: logs, traces, metrics

Batching

Show fields
FieldTypeRequiredDescription
batchBatchOptional batching semantics shared with other inputs.

Attributes

Show fields
FieldTypeRequiredDescription
resource-overridesmap (string)Static resource attributes to merge into each inbound record.
default-attributesmap (string)Default attributes applied to emitted events.

Security

Show fields
FieldTypeRequiredDescription
authAuthAuthentication configuration for inbound requests.

Schema

Trigger - Cron - Window - Start Options

OptionNameTypeDescription
start-timeStart Timeobject
trackedTrackedstringExamples: /path/to/file, c:\users\joe\data\file.txt

Trigger - Interval - Window - Start Options

OptionNameTypeDescription
start-timeStart Timeobject
trackedTrackedstringExamples: /path/to/file, c:\users\joe\data\file.txt

Trigger Options

OptionNameTypeDescription
messageMessageobject
cronCronobject
intervalIntervalobject

Trigger - Message Fields

FieldTypeRequiredDescription
limitnumber (integer)The number of times to run the input.
Examples: 42, 1.2e-10
filter-kindFilter KindSpecifies whether the message originated from the “system” or by the “user”.
Allowed values: system, user, runtime-artifact-fetch, runtime-artifact-fetch-error, runtime-artifact-clear, runtime-artifact-clear-ack, runtime-artifact-fetch-reply, runtime-artifact-update, …
filter-sourceFilter Source[]Specifies what process generated the message. Was it a “server”, “worker” or “job”?
Allowed values: job, worker, server
filter-workerstringSpecifies what worker to select.
filter-jobstringSpecifies the name of the job that the message came from.
filter-typeFilter Type[]Specifies that particular types of message ought to match.
Allowed values: worker-licensed, worker-unlicensed, variable, variable-deleted, begin-shutting-down-job, begin-shutting-down-server, begin-shutting-down-worker, broadcast-job-thread-state, …
filter-tagstringSpecifies that messages matched ought to carry a tag with a particular value. This only matches against user-generated messages.

Trigger - Cron - Window - Start - Start Time Fields

FieldTypeRequiredDescription
start-timetime-format (string)Allows the windowing to start at a specified time.
Hint: %Y-%m-%d %H:%M:%S%.3f %z
highwatermark-filepath (string)Specify file where timestamp would be stored in order to resume, for when Job has been restarted.
Examples: /path/to/file, c:\users\joe\data\file.txt

Trigger - Cron - Window Fields

FieldTypeRequiredDescription
sizeduration (string)Window size.
offsetduration (string)Window offset.
startStartSpecify file where timestamp would be stored in order to resume, for when Job has been restarted.

Trigger - Cron Fields

FieldTypeRequiredDescription
croncron-expression (string)The Cron pattern.
immediateboolean (bool)Run as soon as invoked, instead of waiting for the specified cron interval.
random-offsetduration (string)Sets a random offset to the schedule, then sticks to it.
windowWindowOptional window definition when the schedule should only read a bounded range.

Trigger - Interval - Window - Start - Start Time Fields

FieldTypeRequiredDescription
start-timetime-format (string)Allows the windowing to start at a specified time.
Hint: %Y-%m-%d %H:%M:%S%.3f %z
highwatermark-filepath (string)Specify file where timestamp would be stored in order to resume, for when Job has been restarted.
Examples: /path/to/file, c:\users\joe\data\file.txt

Trigger - Interval - Window Fields

FieldTypeRequiredDescription
sizeduration (string)Window size.
offsetduration (string)Window offset.
startStartSpecify file where timestamp would be stored in order to resume, for when Job has been restarted.

Trigger - Interval Fields

FieldTypeRequiredDescription
durationduration (string)Duration to wait between events.
random-offsetduration (string)Sets a random offset to the schedule, then sticks to it.
windowWindowOptional window definition when the interval should only cover a bounded range.

Retry Fields

FieldTypeRequiredDescription
timeouttime-interval (string)timeout (e.g. 500ms, 2s etc. - default is 30).
Examples: 500ms, 2h
retriesnumber (integer)number of retries.
Examples: 42, 1.2e-10

Listen - Tls Fields

FieldTypeRequiredDescription
certificatepath (string)Examples: /path/to/file, c:\users\joe\data\file.txt
private-keypath (string)Examples: /path/to/file, c:\users\joe\data\file.txt
client-capath (string)Examples: /path/to/file, c:\users\joe\data\file.txt
require-client-authboolean (bool)

Listen Fields

FieldTypeRequiredDescription
addresshostname (string)Examples: example.com, localhost
concurrencynumber (integer)Maximum concurrent requests handled by the server.
Examples: 42, 1.2e-10
max-message-sizenumber (integer)Maximum message size in bytes accepted by the server.
Examples: 42, 1.2e-10
tlsTls

Batch Fields

FieldTypeRequiredDescription
uuid-fieldfield (string)Field where generated uuid, the unique marker for the group, will be stored.
Examples: data_field
invocation-time-fieldfield (string)Field where invocation time will be stored.
Examples: data_field
completion-time-fieldfield (string)Field where completion (end of execution) time will be stored.
Examples: data_field
begin-marker-fieldfield (string)Field used to mark first event in the group.
Examples: data_field
end-marker-fieldfield (string)Field used to mark last event in the group.
Examples: data_field
line-count-fieldfield (string)Field used to store the line count of the batch.
Examples: data_field
line-num-fieldfield (string)Field used to store the line number of the batch.
Examples: data_field

Auth - Basic Fields

FieldTypeRequiredDescription
usernamestring
passwordstring

Auth Fields

FieldTypeRequiredDescription
bearer-tokensstring[]Allowed bearer tokens matched against Authorization headers.
basicBasic[]Allowed basic auth credentials.
required-headersmap (string)Static headers that must be present on requests.

Resource Overrides Table

AttributeValue
service.namevalue

Value format: templated-text.

Default Attributes Table

AttributeValue
service.namevalue

Value format: templated-text.

Auth - Required Headers Table

HeaderValue
Header-Namevalue

Value format: templated-text.

Trigger - Message - Filter Kind Options

ValueDescription
systemSystem
userUser
runtime-artifact-fetchRuntime Artifact Fetch
runtime-artifact-fetch-errorRuntime Artifact Fetch Error
runtime-artifact-clearRuntime Artifact Clear
runtime-artifact-clear-ackRuntime Artifact Clear Ack
runtime-artifact-fetch-replyRuntime Artifact Fetch Reply
runtime-artifact-updateRuntime Artifact Update
runtime-artifact-update-ackRuntime Artifact Update Ack

Trigger - Message - Filter Source Options

ValueDescription
jobJob
workerWorker
serverServer

Trigger - Message - Filter Type Options

ValueDescription
worker-licensedWorker Licensed
worker-unlicensedWorker Unlicensed
variableVariable
variable-deletedVariable Deleted
begin-shutting-down-jobBegin Shutting Down Job
begin-shutting-down-serverBegin Shutting Down Server
begin-shutting-down-workerBegin Shutting Down Worker
broadcast-job-thread-stateBroadcast Job Thread State
broadcast-server-thread-stateBroadcast Server Thread State
broadcast-worker-thread-stateBroadcast Worker Thread State
check-job-report-timeCheck Job Report Time
check-worker-report-timeCheck Worker Report Time
de-register-job-thread-dependencyDe Register Job Thread Dependency
de-register-server-thread-dependencyDe Register Server Thread Dependency
de-register-worker-thread-dependencyDe Register Worker Thread Dependency
deployed-job-activeDeployed Job Active
deployed-job-removedDeployed Job Removed
deployed-job-should-be-runningDeployed Job Should Be Running
deployment-phaseDeployment Phase
heart-beatHeart Beat
initialise-internal-stateInitialise Internal State
initialise-job-statesInitialise Job States
job-batch-endJob Batch End
job-backlog-updateJob Backlog Update
job-checkpoint-updateJob Checkpoint Update
job-deploy-readyJob Deploy Ready
job-deployedJob Deployed
job-document-endJob Document End
job-document-startJob Document Start
job-errorsJob Errors
job-execution-anomalyJob Execution Anomaly
job-execution-statusJob Execution Status
job-emit-customJob Emit Custom
job-finishedJob Finished
job-idleJob Idle
job-initiatedJob Initiated
job-is-processingJob Is Processing
job-logsJob Logs
job-metricsJob Metrics
job-notificationsJob Notifications
job-removingJob Removing
job-removedJob Removed
job-remove-failedJob Remove Failed
job-remove-readyJob Remove Ready
job-replacedJob Replaced
job-requiredJob Required
job-run-endedJob Run Ended
job-runtime-errorJob Runtime Error
job-runtime-settingsJob Runtime Settings
job-run-startedJob Run Started
job-running-dockerJob Running Docker
job-running-scriptJob Running Script
job-running-subprocessJob Running Subprocess
job-running-system-dJob Running System D
job-settingsJob Settings
job-step-statisticsJob Step Statistics
job-startedJob Started
job-stagedJob Staged
job-state-transitionJob State Transition
job-shutting-downJob Shutting Down
job-stoppingJob Stopping
job-stoppedJob Stopped
job-timed-outJob Timed Out
job-suspicious-silenceJob Suspicious Silence
job-thread-stateJob Thread State
job-traceJob Trace
job-trace-requires-samplesJob Trace Requires Samples
job-updatedJob Updated
job-worker-comms-errorJob Worker Comms Error
job-unstagedJob Unstaged
license-state-changedLicense State Changed
license-validation-failedLicense Validation Failed
license-validation-okLicense Validation Ok
license-volume-violationLicense Volume Violation
new-licenseNew License
override-job-coordinated-shutdownOverride Job Coordinated Shutdown
override-server-coordinated-shutdownOverride Server Coordinated Shutdown
override-worker-coordinated-shutdownOverride Worker Coordinated Shutdown
register-job-thread-dependencyRegister Job Thread Dependency
register-server-thread-dependencyRegister Server Thread Dependency
register-worker-thread-dependencyRegister Worker Thread Dependency
run-job-failureRun Job Failure
server-logsServer Logs
server-metrics-batchServer Metrics Batch
server-startedServer Started
server-startingServer Starting
server-stoppingServer Stopping
server-thread-stateServer Thread State
server-worker-comms-errorServer Worker Comms Error
shutdown-jobsShutdown Jobs
shutdown-workerShutdown Worker
system-shutdownSystem Shutdown
update-upstream-sync-for-jobUpdate Upstream Sync For Job
update-upstream-sync-for-workerUpdate Upstream Sync For Worker
update-variableUpdate Variable
user-alertUser Alert
user-generatedUser Generated
user-notificationUser Notification
worker-command-for-jobWorker Command For Job
worker-auth-lease-ackWorker Auth Lease Ack
worker-connectedWorker Connected
worker-createdWorker Created
worker-debug-heart-beatWorker Debug Heart Beat
worker-errorWorker Error
worker-first-seenWorker First Seen
worker-heart-beatWorker Heart Beat
worker-logsWorker Logs
worker-metrics-batchWorker Metrics Batch
worker-offlineWorker Offline
worker-requests-auth-leaseWorker Requests Auth Lease
worker-server-comms-errorWorker Server Comms Error
worker-settingsWorker Settings
worker-shutdownWorker Shutdown
worker-shutting-downWorker Shutting Down
worker-startedWorker Started
worker-state-uuidWorker State Uuid
worker-stoppingWorker Stopping
worker-suspicious-silenceWorker Suspicious Silence
worker-system-informationWorker System Information
worker-thread-stateWorker Thread State
worker-updatedWorker Updated
worker-modifiedWorker Modified
worker-removedWorker Removed
context-changedContext Changed
rerender-deploymentRerender Deployment
job-killedJob Killed
message-servicedMessage Serviced
failed-to-service-messageFailed To Service Message
worker-wants-initial-settingsWorker Wants Initial Settings
worker-wants-initial-settings-replyWorker Wants Initial Settings Reply
worker-wants-deployed-jobsWorker Wants Deployed Jobs
worker-wants-deployed-jobs-replyWorker Wants Deployed Jobs Reply
worker-wants-job-configurationWorker Wants Job Configuration
worker-wants-job-configuration-replyWorker Wants Job Configuration Reply
job-wants-dslir-keyJob Wants Dslir Key
job-wants-dslir-key-replyJob Wants Dslir Key Reply
worker-wants-dslir-keyWorker Wants Dslir Key
worker-wants-dslir-key-replyWorker Wants Dslir Key Reply
job-wants-variablesJob Wants Variables
job-wants-variables-replyJob Wants Variables Reply
job-wants-credentialsJob Wants Credentials
job-wants-credentials-replyJob Wants Credentials Reply
job-wants-credentials-errorJob Wants Credentials Error
job-wants-secret-variables-replyJob Wants Secret Variables Reply
job-credentials-invalidatedJob Credentials Invalidated
aggregator-healthAggregator Health
worker-verification-tokenWorker Verification Token
worker-requests-verification-tokenWorker Requests Verification Token
runtime-artifact-updateRuntime Artifact Update
runtime-artifact-update-ackRuntime Artifact Update Ack
runtime-artifact-clearRuntime Artifact Clear
runtime-artifact-clear-ackRuntime Artifact Clear Ack
runtime-artifact-fetchRuntime Artifact Fetch
runtime-artifact-fetch-replyRuntime Artifact Fetch Reply
runtime-artifact-fetch-errorRuntime Artifact Fetch Error

Signals Options

ValueDescription
logsLogs
tracesTraces
metricsMetrics