programming-GPTs
Programming GPTs 🦜
Book available on Amazon 📖 https://www.amazon.com/dp/B0DP76LL4D
In this repo, you will learn how to program GPTs primarily leveraging OpenAI’s APIs. If you don’t know what an API is (Application Programming Interface), then this is not the repo you’re looking for. Go look it up on the internet, and come back after learning some basics of programming, preferably in Python, as this will be the language used for the tutorials in each chapter. Generative Pre-Trained Transformers are quite complicated general-purpose machines that can do a lot of different things, like handling sequences of text, images, and sounds. You will learn the basic concepts and principles behind GPTs, and how they work under the hood. But more importantly, you will learn how to integrate them inside of your applications.
The repo is divided into 10 chapters, each covering a different topic and a different aspect of programming GPTs. The chapters are:
-
Chapter 1: 🤖 Introducing GPTs. How they work and their evolution.
-
Chapter 2: 🐱💬 OpenAI APIs. In this chapter, you will learn how to use the OpenAI APIs, a simple way to create AI agents with GPT Models. You will start by learning how to create your own chatbot.
- Chapter 3: 🔗 Prompting, Chaining & Summarization. In this chapter, you will learn how to engineer prompts, chain calls to a Large Language Model and use it to summarize texts, such as articles, books, or transcripts. You will use the OpenAI API together with the LangChain package to enhance GPTs.
- Chapter 4: 🔎❓ Vector search & Question Answering. In this chapter, you will learn how to use embeddings and vector search as a way to retrieve informative answers to answer questions while quoting sources.
- Chapter 5: 🕵️♀️🛠️ Agent & Tools. In this chapter, you will learn to build an Agent, called Smith, that has access to tools, such as getting the current weather. You will also learn how to use the Assistant API provided by OpenAI, and to extend their capabilities with tools to integrate GPTs with external services. This will be illustrated with the implementation of your own Code Interpreter, that can help you write and run code with GPTs.
- Chapter 6: 🗣️📢 Text to Speech & Synthesis. In this chapter, you will learn how to use GPTs to transcript text from speech (such as Youtube videos), and synthetize speech from text (such as articles).
- Chapter 7: 👀 Vision API. In this chapter, you will learn how to use GPTs to process and analyze images, such as mock-ups or drawings. You will learn how to use the Vision API, to perform various tasks with GPTs, such as text recognition, or video captioning.
- Chapter 8: 🎨🖌️ Dall-E image generation. In this chapter, you will learn how to use Dall-E 2 & 3, which can create stunning and creative images from any text input. You will also learn how to use the outpainting, inpainting and variations APIs, which can complete or modify existing images.
- Chapter 9: 📌 Deploying GPTs. In this chapter, you will reuse what you have learned, and you will deploy your own GPTs. This will be made concrete with a small team of GPTs covering each one chapter of the book.
- Chapter 10: 📚 Appendix. In this chapter, you will find additional resources to keep up with the latest developments and innovations in the field of GPTs.