Pipeline management endpoints
Get pipeline
Get pipeline
path Parameters
organization_idOrganization ID
pipeline_idPipeline ID
Get pipeline › Responses
Pipeline details
component_tiercreated_atcron_scheduledescriptionenabledidinput_idmanaged_bynameorganization_idupdated_atUpdate pipeline
Update pipeline
path Parameters
organization_idOrganization ID
pipeline_idPipeline ID
Update pipeline › Request Body
Decision Table
| Variant | Matching Criteria |
|---|---|
| type = object | |
| type = object · requires: name |
Update pipeline › Responses
Response body for updating a pipeline
component_tiercreated_atcron_scheduledescriptionenabledidinput_idmanaged_bynameorganization_idupdated_atGet pipeline metrics
Get time series metrics for a pipeline
path Parameters
organization_idOrganization ID
pipeline_idPipeline ID
query Parameters
metricMetric to retrieve (ingress_bytes|egress_bytes|ingress_records|egress_records|errors)
startISO3339 start time, default 6 hours ago
endISO3339 end time, default now
resolutionResolution of the data, default determined by time window
Get pipeline metrics › Responses
Pipeline metrics
end_atmetricnode_idnode_slugorganization_idorganization_namepipeline_idpipeline_nameresolutionstart_atGet pipeline node metrics
Get pipeline node metrics
path Parameters
organization_idOrganization ID
pipeline_idPipeline ID
node_idNode ID
query Parameters
metricMetric to retrieve (ingress_bytes|egress_bytes|ingress_records|egress_records|errors)
startISO3339 start time, default 6 hours ago
endISO3339 end time, default now
resolutionResolution of the data, default determined by time window
Get pipeline node metrics › Responses
Pipeline node metrics
end_atmetricnode_idnode_slugorganization_idorganization_namepipeline_idpipeline_nameresolutionstart_atGet status of all pipelines for an organization
Get status of all pipelines for an organization
path Parameters
organization_idOrganization ID
query Parameters
startISO3339 start time, default 24 hours ago
endISO3339 end time, default now
Get status of all pipelines for an organization › Responses
Organization Pipeline Summary
organization_idCreate pipeline
Create a new pipeline with specified configuration
path Parameters
organization_idOrganization ID
Create pipeline › Request Body
Decision Table
| Variant | Matching Criteria |
|---|---|
| type = object | |
| type = object · requires: edges, enabled, name +1 more |
Create pipeline › Responses
Pipeline created successfully
billingAccountIdcomponent_tiercreatedAtcron_scheduledescriptionenabledidis_syntheticmanaged_bynamenext_cron_run_atorganizationIdorganizationNameupdatedAtGet metrics for specific pipelines
Get aggregated ingress and egress metrics for specific pipelines
path Parameters
organization_idOrganization ID
query Parameters
pipeline_idsComma-separated list of pipeline IDs
resolutionResolution for metrics (default: 5m)
Get metrics for specific pipelines › Responses
Pipeline metrics data
Get pipeline status
Retrieve the status of pipelines within an organization for a specified time period.
path Parameters
organization_idOrganization ID
query Parameters
limitMaximum number of pipelines to return (default is 10)
offsetOffset for pagination (default is 0)
startStart time (RFC3339 format) for status metrics (default: 24 hours ago)
endEnd time (RFC3339 format) for status metrics (default: now)
Get pipeline status › Responses
List of pipelines with status
idstatuslast_ingested_timeGet pipeline configuration
Retrieve a specific pipeline configuration by pipeline ID
path Parameters
organization_idOrganization ID
pipeline_idPipeline ID
query Parameters
include_statusInclude the status of the pipeline nodes
Get pipeline configuration › Responses
Pipeline configuration retrieved successfully
billingAccountIdcomponent_tiercreatedAtcron_scheduledescriptionenabledidis_syntheticmanaged_bynamenext_cron_run_atorganizationIdorganizationNameupdatedAtUpdate pipeline
Update an existing pipeline with the specified configuration
path Parameters
organization_idOrganization ID
pipeline_idPipeline ID
Update pipeline › Request Body
Decision Table
| Variant | Matching Criteria |
|---|---|
| type = object | |
| type = object · requires: edges, enabled, name +1 more |
Update pipeline › Responses
Pipeline updated successfully
billingAccountIdcomponent_tiercreatedAtcron_scheduledescriptionenabledidis_syntheticmanaged_bynamenext_cron_run_atorganizationIdorganizationNameupdatedAtUpdate pipeline edge
Enable or disable a pipeline edge
path Parameters
organization_idOrganization ID
pipeline_idPipeline ID
edge_idEdge ID
Update pipeline edge › Request Body
Decision Table
| Variant | Matching Criteria |
|---|---|
| type = object | |
| type = object |
Update pipeline edge › Responses
Edge updated successfully
Get pipeline status
Get pipeline status
path Parameters
organization_idOrganization ID
pipeline_idPipeline ID
query Parameters
metricsMetrics to retrieve (all|health|ingress_bytes|egress_bytes|ingress_records|egress_records|backpressure)
startISO3339 start time, default 24 hours ago
endISO3339 end time, default now
Get pipeline status › Responses
Pipeline status
average_size_egressedaverage_size_ingestederrorslast_ingested_timelast_updated_atorganization_idorganization_namepipeline_idpipeline_namestatusGet pipeline node status
Get pipeline node status
path Parameters
organization_idOrganization ID
pipeline_idPipeline ID
node_idNode ID
query Parameters
metricsMetrics to retrieve (all|health|ingress_bytes|egress_bytes|ingress_records|egress_records|backpressure)
startISO3339 start time, default 24 hours ago
endISO3339 end time, default now
Get pipeline node status › Responses
Pipeline Node status
avg_bytes_per_record_egressavg_bytes_per_record_ingresscomponent_typecomponent_type_iderrorslast_ingested_timelast_record_processed_timelast_updated_atnode_idnode_slugstatusGet pipeline node metrics
Get pipeline node metrics
path Parameters
organization_idOrganization ID
pipeline_idPipeline ID
node_idNode ID
query Parameters
metricMetric to retrieve (ingress_bytes|egress_bytes|ingress_records|egress_records|errors)
startISO3339 start time, default 6 hours ago
endISO3339 end time, default now
resolutionResolution of the data, default determined by time window
Get pipeline node metrics › Responses
Pipeline node metrics
end_atmetricnode_idnode_slugorganization_idorganization_namepipeline_idpipeline_nameresolutionstart_at