Haystack Pipeline Skill

Capabilities

• Configure Haystack pipeline components
• Set up document stores and retrievers
• Implement reader/generator models
• Design custom pipeline graphs
• Configure preprocessing pipelines
• Implement evaluation pipelines

Target Processes

• rag-pipeline-implementation
• intent-classification-system

Implementation Details

Core Components

1. DocumentStores: Elasticsearch, Weaviate, FAISS, etc.
2. Retrievers: BM25, Dense, Hybrid
3. Readers/Generators: Extractive and generative QA
4. Preprocessors: Document cleaning and splitting

Pipeline Types

• Retrieval pipelines
• RAG pipelines
• Evaluation pipelines
• Indexing pipelines

Configuration Options

• Component selection
• Pipeline graph design
• Document store backend
• Model selection
• Preprocessing settings

Best Practices

• Modular pipeline design
• Proper preprocessing
• Evaluation integration
• Component versioning

Dependencies

• haystack-ai
• farm-haystack (legacy)