aiagent.ProcessingPipeline¶
- class ProcessingPipeline(pipeline_id, config)¶
Manages a collection of PipelineStages that will be used to process input data to generate an output data.
Processing pipelines are used when user queries happen and when documents are ingested. This allows custom processing functions to be added into the processing pipeline without having to build classes that inherit from aiAgent classes to override functionality. This also allows different pipelines to be used in different runtime conditions such as certain types of users or certain companies hosting in the system.
- __init__(pipeline_id, config)¶
Methods
__init__
(pipeline_id, config)add_processors
(stage_name, processors)Add processors to a specific stage of a specific pipeline.
process
(input_data[, state, start_at_stage, ...])Start processing the input data by running through the stages of the pipeline and running through all the processor functions to generate final output.
process_single_stage
(state, stage, input_data)