Back to skills
extension
Category: Data & AnalyticsNo API key required

使用 easy-dataset 从源材料生成 LLM 微调、RAG 和评估数据集

将原始文档转换为结构化的微调、RAG和评估数据集,因为真正的任务是数据集准备,而不是通用的文档解析。

personAuthor: user_3c6cb52ehubcommunity

使用 easy-dataset 从源材料生成 LLM 微调、RAG 和评估数据集

Turn raw documents into structured fine-tuning, RAG, and evaluation datasets when the real job is dataset preparation, not generic document parsing.

Prerequisites

easy-dataset application, supported source documents such as PDF/Markdown/DOCX/TXT/EPUB, and an operator or agent preparing datasets

Installation

Use the upstream install or setup path that matches your environment:

  • git clone https://github.com/1991513ccie-png/skills
  • npm install
  • npm run build
  • npm run start

Requirements and caveats from upstream:

  • Using the Official Docker Image

  • Modify the docker-compose.yml file:

Basic usage or getting-started notes:

  • FeaturesQuick StartDocumentationContributingLicense

  • 🎉🎉 Easy Dataset Version 1.7.0 launches brand-new evaluation capabilities! You can effortlessly convert domain-specific documents into evaluation datasets (test sets) and automatically run multi-dimensional evaluation...

  • Local Run

  • Source: https://github.com/1991513ccie-png/skills

  • Extracted from upstream docs: https://raw.githubusercontent.com/ConardLi/easy-dataset/HEAD/README.md

Documentation

  • https://github.com/1991513ccie-png/skills