Skip to content

DSL Reference

DSL Reference

Use the filters below to quickly surface DSL inputs, actions, and outputs.

Type Name Summary
ActionAbortAbort the job if the condition is met.
ActionAddAdd fields to the event.
ActionAggregateAggregate events by key and emit summary statistics.
ActionAssertValidate an event against a JSON Schema, based on IETF's draft v7 (http://json-schema.org).
InputAzure BlobRetrieve (or list) Microsoft Azure Storage blobs (Block Storage).
OutputAzure BlobSend data to a Microsoft Azure Storage blob (Block Storage).
OutputAzure Monitor Data CollectorSpecialized preset that wraps `azure-monitor` output parameters so deployments can ship datasets into Azure Log Analytics/Sentinel without hand-authoring `http-post` jobs.
ActionBatch InAccumulate events into batches before downstream processing.
InputBigQueryIngest data from Google BigQuery.
OutputBigQueryStream data into Google BigQuery.
ActionBucketAssign numeric values to named buckets using ordered thresholds.
ActionChunkSegment large payloads into smaller chunks for downstream processing.
InputClickHouseQuery a ClickHouse cluster on a schedule.
OutputClickHouseWrite events to a ClickHouse table using the HTTP interface or native endpoint.
ActionClusterAssign cluster identifiers to numeric vectors.
ActionConvertConvert fields from one type to another, supporting simple and unit conversions Convert fields from one type to another, e.g. strings to numbers.
ActionCopyCopy fields of an event using JSONPATH expressions.
ActionCsvParse CSV from field text.
ActionDeltaConvenience wrapper that enables `stream` delta mode with a slim option set.
OutputDiscardDiscard any output from the job.
ActionDocx to TextExtract content from Microsoft Word documents with optional image emission.
InputEchoCreate a simple static event.
OutputElasticsearchBulk-index events into Elasticsearch clusters.
ActionEnrichLook up values in a CSV or Sqlite database and add matching fields.
InputExecObtain data by executing a shell command.
ActionExpandexpand data in various ways: events, XML, multiline events.
ActionExpand Eventsexpand a single JSON document into multiple JSON events.
ActionExtractExtract fields from text using regular expressions.
InputFacebook Graph PollOpinionated preset for polling Facebook Graph posts with cursor pagination and AI-prep ready defaults.
InputFile StoreRead from a local file system object store.
OutputFile StoreWrite to a local file system object store.
ActionFilterOnly let certain events pass through.
ActionFlattenFlatten nested JSON Objects and Arrays into a single JSON Object containing only top-level fields.
InputFtpPoll remote FTP/SFTP/TFTP servers for new files.
OutputFtpUpload events to FTP/SFTP/TFTP servers.
InputGoogle Cloud StorageRead objects from Google Cloud Storage.
OutputGoogle Cloud StorageWrite events to a Google Cloud bucket.
OutputHTTP GetSend event data to a remote server using GET.
InputHTTP PollRun HTTP queries.
InputHTTP Poll (Header Token)Opinionated preset for polling HTTP endpoints that authenticate via a header token (bearer tokens, API keys, etc).
InputHTTP Poll (OAuth2 via Credential Manager)Opinionated preset for polling HTTP endpoints using a credential-backed OAuth2 access token and cursor pagination.
OutputHTTP PostPOST event data to an HTTPS server.
InputHTTP ServerRun an HTTP server and output any received requests.
ActionInferExecute inference workloads (LLM, embeddings, anomaly detection).
InputInternal MessagesReceive internal messages.
ActionJava ScriptExecute embedded JavaScript to transform events.
InputJournaldRead events from systemd-journald (Linux-only).
ActionJsonParse text as JSON.
InputKafkaConsume records from Kafka/Redpanda clusters.
OutputKafkaPublish events to Kafka/Redpanda clusters.
ActionKey ValueParse key-value pairs, like "k1=v1,k2=v2,....".
ActionLabel MapMap string values to canonical labels using ordered rules.
OutputLog FilesAppend events to one or more files.
InputLog FilesMonitor one or more log files for new lines.
InputMQTTIngest events from MQTT brokers (client mode) or an embedded broker (broker mode).
OutputMQTTPublish events to external MQTT brokers or an embedded broker instance.
ActionMarkdown OutlineParse Markdown documents into structured outline data.
ActionMessageConditionally generate a message when an event meets the provided condition.
OutputMessageCreate a message to the internal message subsystem.
InputMicrosoft GraphIngest data from Microsoft Graph resources such as mail, calendars, or directory objects via REST calls.
OutputOpenSearchBulk-index events into OpenSearch clusters, including AWS-managed variants.
InputOpenTelemetryAccept OpenTelemetry OTLP signals over gRPC.
OutputOpenTelemetryExport events using the OpenTelemetry OTLP protocol.
ActionPDF to TextExtract text content from PDF documents using auto or render-based strategies.
ActionPrintPrint event payloads to the terminal.
OutputPrintPrint event payloads to the terminal.
ActionRemoveRemove fields from an event.
ActionRenameRename event fields.
InputS3Stream data from an S3 object.
OutputS3Write events to an S3 bucket.
InputSQLQuery relational databases or stream change data capture events.
OutputSQLExecute parameterised statements against relational databases.
ActionScoringEvaluate weighted conditions to produce a composite score.
ActionScriptCalculated fields.
ActionSlugifyGenerate stable slugs from one or more fields.
OutputSplunk HECOutput events to a Splunk HTTP Event Collector endpoint (Splunk HEC).
ActionStalledEmit stall markers when no matching events arrive within the configured timeout.
ActionStop WordRemove or mask common stop words from textual content.
ActionStreamTrack per-key changes and emit deltas, elapsed times, and optional aggregates.
OutputSyslogEmit events as syslog messages to remote or local syslog receivers. Supported endpoint schemes: - `udp://host:port` - `tcp://host:port` - `tls://host:port` - `unix:///path` (unix stream) - `unixgram:///path` (unix datagram).
ActionTimeTime processing: parsing and formatting time values.
ActionTokenizeConvert free-form text into token sequences for downstream analytics.
ActionTransactionSessionize related events using start/end markers and optional summary fields.
ActionTransitionTrack field transitions, elapsed time since last change, and optional state metadata.
InputTriggerManaged trigger input that emits scheduler messages with optional Worker KV leadership.
ActionUnbatchExpand a batched event back into individual events.
InputWeb Dav StoreRead from a WebDAV-compatible object store.
OutputWeb Dav StoreWrite to a WebDAV-compatible object store.
InputWebSocketConsume events from remote WebSocket endpoints.
OutputWebSocketSend events to remote WebSocket peers or expose an embedded server.
InputWindows Event LogRead events from Windows Event Log.
InputWorker ChannelReceive events from a worker managed channel.
OutputWorker ChannelReceive events from a worker managed channel.
InputWorker KVInteract with the deployments-managed Worker KV store.
OutputWorker KVMutate the deployments-managed Worker KV store.
ActionXLSX ExpandExpand Microsoft Excel worksheets into individual events or CSV-like structures.
ActionXmlexpand XML into JSON events.