📄DataSet

Integrating LLM with your own custom dataset is crucial for building applications. To achieve this goal, we allow you to seamlessly import data from any source.

  • Document loaders: Load documents from various different sources.

  • Document converters: Split documents, convert them into question-answer format, remove redundant documents, etc.

  • Text embedding models: Obtain unstructured text and convert it into a list of floating-point numbers.

  • Vector store: Store and search embedding data.

Last updated