Input & Output

Source agents

Source agents are responsible for getting records into the pipeline from external services.

• Web Crawler

• S3 Source

• Azure Blob Storage Source

• Apache Camel source agent

Sink agents

Sink agents are responsible for exporting records from the pipeline to external services.

• Kafka connect Sink

• Vector Database Sink