📄DataSet

Integrating LLM with your own custom dataset is crucial for building applications. To achieve this goal, we allow you to seamlessly import data from any source.

• Document loaders: Load documents from various different sources.

• Document converters: Split documents, convert them into question-answer format, remove redundant documents, etc.

• Text embedding models: Obtain unstructured text and convert it into a list of floating-point numbers.

• Vector store: Store and search embedding data.