Graphs & Pipelines

Task graph execution and pipeline processing. More...

Files
file	graph.h
file	graph_executor.h
file	pipeline.h

Detailed Description

Task graph execution and pipeline processing.

Task graphs allow expressing complex dependencies between tasks, while pipelines provide a streaming model for processing data through multiple stages.

Example: Task Graph with Dependencies

#include <dispenso/graph.h>
#include <dispenso/graph_executor.h>
 
dispenso::Graph graph;
 
// Create nodes
auto& nodeA = graph.addNode([]() { /* compute A */ });
auto& nodeB = graph.addNode([]() { /* compute B */ });
auto& nodeC = graph.addNode([]() { /* uses A and B */ });
 
// C depends on A and B completing first
nodeC.dependsOn(nodeA, nodeB);
 
// Execute the graph
dispenso::TaskSet tasks(dispenso::globalThreadPool());
dispenso::ParallelForExecutor executor;
executor(tasks, graph);

Example: Pipeline Processing

#include <dispenso/pipeline.h>
 
int itemIndex = 0;
 
dispenso::pipeline(
    // Generator stage: produces items
    [&]() -> dispenso::OpResult<int> {
        if (itemIndex < 100) return itemIndex++;
        return {};  // Empty result signals completion
    },
    // Transform stage: process in parallel
    dispenso::stage([](int x) { return x * 2; }, 4),
    // Sink stage: consume results
    [](int result) { /* use result */ }
);