Creating Diverse LLM Training Data with Gretel Navigator
Video description
Use Gretel Navigator to generate new diverse, high-quality training examples for training and fine-tuning
More Videos
Read the blog post
Transcription
In this video walkthrough, we will leverage Gretel Navigator (formerly called Gretel Tabular LLM) to generate new diverse, high-quality training examples building on these techniques to create better LLMs. We will cover Gretel Navigator's SDK- only requiring 3 lines of code to generate synthetic data, the new inference and streaming API, and finally how to assess synthetic data output quality using Gretel's synthetic text quality score (SQS).
Our goal with this notebook is to demonstrate how to get started creating high quality synthetic data for LLM training and facilitate further research into safeguards for completion models. Notebook link: https://colab.research.google.com/gist/zredlined/50ef5cbf09aa63302f963e14dc1bf5a9
Gretel Navigator is our first generative AI system designed to create, edit, and augment tabular data using natural language or SQL prompts. It's a tool for working with and enhancing datasets in a more intuitive and interactive way.#syntheticdata #machinelearning #generativeai #LLMs