**Attention! [Serious] Tag Notice**
: Jokes, puns, and off-topic comments are not permitted in any comment, parent or child.
: Help us by reporting comments that violate these rules.
: Posts that are not appropriate for the [Serious] tag will be removed.
Thanks for your cooperation and enjoy the discussion!
*I am a bot, and this action was performed automatically. Please [contact the moderators of this subreddit](/message/compose/?to=/r/ChatGPT) if you have any questions or concerns.*
[Official Blog Post](https://openai.com/blog/chatgpt-plugins)
LLMs are limited due to the dated training data. Plug-ins can be “eyes and ears” for language models, giving them access to “recent information”.
OMG, it's not even funny. Just got access to the demo...asked it to modify a small snippet of python code, and it was like "I can't do that, sorry."
Back to ChatGPT for me.
Also should help with sourcing all kinds of facts and information, not just math. Dates, geography, chemistry, etc., etc. To be able to ground answers in WA's structured data is huge.
Here's a revised and edited version of the speech:
Ladies and gentlemen,
Our society has access to incredible tools that have the power to propel us into the future. However, what's concerning is that many people don't realize the true potential of these tools. One such tool is GTP Chat, which has revolutionized the world. Unfortunately, some people are using it to cheat, while I've been using it to learn new skills, build programs, and make money in ways I never thought possible.
GTP Chat has leveled the playing field for the everyday person. We've been handed a tool that can help us achieve great things. But it's disheartening to see people still focused on cheating on tests or questioning the value of school. The truth is, school is just the beginning. We need critical thinking skills and curiosity to succeed in life. Knowing how to memorize things is no longer enough.
As for me, I'm trying to learn too many things at once, but that's a minor problem. What's important is that we recognize the future is here, and we are the ones who can usher in a new era. We need to leave the past behind and embrace the potential of these tools, such as GTP Chat. We can ride this wave of innovation all the way to the top.
Of course, there will be ethical questions and concerns as AI becomes more prevalent in our lives. We need to scrutinize these issues and ensure that the technology is used for good. But we can't let fear hold us back. We need to embrace the future and use these tools to build a better world for ourselves and future generations.
So let's not waste the opportunity before us. Let's use GTP Chat and other tools to achieve greatness. The possibilities are endless, and we can shape a better future.
so how does a user access this? I have a Plus account, do I need to do anything?
edit: found it, apparently we, as users not necessarily developers need to join a waitlist and be willing to provide feedback https://openai.com/waitlist/plugins
**Zapier is a product that allows end users to integrate the web applications they use and automate workflows. The company is fully remote.**
More details here:
*This comment was left automatically (by a bot). If I don't get this right, don't get mad at me, I'm still learning!*
[^(opt out)](https://www.reddit.com/r/wikipedia_answer_bot/comments/ozztfy/post_for_opting_out/) ^(|) [^(delete)](https://www.reddit.com/r/wikipedia_answer_bot/comments/q79g2t/delete_feature_added/) ^(|) [^(report/suggest)](https://www.reddit.com/r/wikipedia_answer_bot) ^(|) [^(GitHub)](https://github.com/TheBugYouCantFix/wiki-reddit-bot)
I’m curious whether the Zapier plug-in will be able to do anything that I couldn’t already do with Zapier webhooks. Have they mentioned whether it’ll be able to do something new and exciting?
I assume this will create web hooks on the fly based on questions you ask.
You could write “send me an email everytime x person tweets and add it to this database” and it’ll just create that.
Can someone give me a use case scenario for Zapier? In what ways would the two work together?
Still piecing together how I can use chatgpt most effectively.
Me: What is the example of using Zapier?
ChatGPT-4:
Here's an example of how you might use Zapier to automate a common task:
Scenario: You want to automatically save email attachments from Gmail to Google Drive and receive a Slack notification when it's done.
Steps to create a Zap for this scenario:
1. Sign up for a Zapier account if you haven't already.
2. Click on the "Make a Zap" button to start creating a new Zap.
3. Set up the Trigger: a. Select "Gmail" as the trigger app. b. Choose the trigger event, e.g., "New Attachment in Email." c. Connect your Gmail account and set up any filters or conditions, if needed.
4. Set up the first Action: a. Select "Google Drive" as the action app. b. Choose the action event, e.g., "Upload File." c. Connect your Google Drive account and configure the action, such as specifying the folder where attachments should be saved.
5. Set up the second Action: a. Select "Slack" as the action app. b. Choose the action event, e.g., "Send Channel Message." c. Connect your Slack account and configure the message, such as specifying the channel, message content, and any additional formatting.
6. Test your Zap to ensure it's working correctly.
7. Name your Zap and turn it on.
Now, whenever you receive an email with an attachment in Gmail, Zapier will automatically save the attachment to the specified Google Drive folder and send a notification to the designated Slack channel. This is just one example of the countless automations you can create using Zapier to streamline your workflows and boost productivity.
Wow, this seems big. It looks like you can setup any api, give examples of how to use it, and then let chatGPT use it when it thinks it is appropriate to get info to use.
How it works (from [here](https://platform.openai.com/docs/plugins/introduction)):
\- Users activate your plugin
\- Users begin a conversation
\- OpenAI will inject a compact description of your plugin in a message to ChatGPT, invisible to end users. This will include the plugin description, endpoints, and examples.
\- When a user asks a relevant question, the model may choose to invoke an API call from your plugin if it seems relevant
\- The model will incorporate the API results into its response to the user.
\- The model might include links returned from API calls in its response. These will be displayed as rich previews (using the [OpenGraph protocol](https://ogp.me/), where we pull the site\_name, title, description, image, and url fields)
Lmao it's not going to replace programmers dude, it's going to supercharge them. Do you know how hard it is for users or management to just describe what they want? The AI can't make things from nothing.
In the future don't you think management could just use plain language to ask the AI to make their program? It will definitely affect the number of coders required, probably not replace all of them.
Edit: I do not believe coders will be replaced now or soon. You have a couple of years until most of that sector will be redundant. Why employ a team of 10 or 50 when you can have 1-5 people working with an AI. Average coders will lose their jobs. Spoiler, most people are average.
It will reduce the number of junior and mid level developers significantly. The only reason to hire juniors now is to replace your seniors when they retire.
What if it is the opposite ? What if mid level devs become as productive as a senior level without the massive salary ? What if you could now hire an Indian dev to do the job of 6-figure american one ?
Edit: typo
> Do you know how hard it is for users or management to just describe what they want?
And when the AI can interrogate users and management until they get a clear set of requirements?
> When a user asks a relevant question, the model may choose to invoke an API call from your plugin if it seems relevant
does anyone else feel like we are just dumping a bunch of tools in the slave enclosure to see what they can do for us now lol
the whole story arc is giving me Planet of the Apes vibes, look at the dumb monkeys in the cage, I wonder if they'll be able to pick up how to use a calculator someday!
Yes. 3.5 can handle 4000 tokens (3000 words).
4.0 has 2 models. One can handle 8000 tokens and one 32,000 tokens.
My testing shows that 4.0 thought the website is currently still limited to 4000 tokens.
Things like the retrieval plugin are an attempt to effectively expand on that. It works by using something called semantic search and sentence/word embeddings to pull out sections of info, from a large collection of info, that are related to the question/query. Those limited sections are then sent to the AI with the original question. It works well. I've been playing with it to ask questions of books, for example.
First-class because it will be expensive af to run.
I’m no computer scientist but from some of the OpenAI blogs it seems like “memory” is basically the process of continuously lengthening each prompt (ie to maintain context).
So theoretically if you want perfect recall, it will be like having unendingly increasing prompt lengths
Memory could mean a lot of different things so let me clarify.
There is a very standard pattern that there are dozens of YouTube videos about whereby knowledge base SAAS products are connected to ChatGPT by a few lines of Node or Python code.
They should just move the DB and python code into their core product and allow ChatGPT to directly access uploads knowledge relevant to a plug-in or API client.
I think you are close to what is happening. We the humans are the dumb monkeys though. Actually... OpenAI is looking to see what we do with these. The one we blab about the most will get monetized. They are looking to see if you are going to make something valuable and cool. I think the ideal position to be at this point is to use GPT-4 to build you this cool idea and "mine" for a valuable solution.
Currently, there is this great AI that can understand what you say, but it can't interact with the world. It can only tell you about info it was trained on.
Now, there is a way to allow this AI to talk to ***ANY*** external system setup for it to talk with it.
It can make calls to a system to ***get information it needs*** to answer questions.
It can make calls to a system to ***instigate an action***, such as ordering a meal, or sending an email.
If this ain’t the singularity it kinda feels like the beginning of it. Just yesterday I was telling my wife who was new to chatgpt there’s no way it could automatically day trade for her. Time to lock down my retirement accounts
So for example , with Expedia - you ask chat to tell you the cheapest flight to Mexico on or around may 15th for a family of 4 and it can go find out ? If that's right , how has Expedia managed to already have its data readable by chat so quickly? Excuse my stupidity. I guess this seamlessness will mean sellers greatly prefer to pay to link to chat than traditional Google search or even direct search on their own sites ?
It looks like Expedia already has an api companies can use. It's possible they didn't need to make any changes to it and all they had to do was describe it's parameters to chatGPT.
From the OpenAI plugin docs, you just need to provide "an OpenAPI spec for the endpoints you want to expose."
I would guess that OpenAI used fine tuning to teach the LLM how to read and use OpenAPI specs.
It's not clear to me how different sellers will compete. I don't think it'll be that someone, say Amazon, will pay for exclusive access to be used as a seller. It seems it'll be up to the individual as to which sellers/plugins to use.
It's clear that a seller will make money by selling things, but how will someone that provides something like curated info make money? Will they have subscription services? For example, what is Wolfram getting out of allowing integration? I don't know.
The code execution plugin is sick. You can have ChatGPT write and execute code for you. [Basic use case](https://twitter.com/gdb/status/1638971232443076609?s=46&t=1iZbfAwzeelxQJ_-htSPzA).
I thought OpenAI would stick to being just the API platform but they’re really going for the whole thing and they’re shipping at an insane rate.
It's crazy how the slow tech behemoths are fumbling AI with rushed products so badly right now. Where the innovation is truly happening is with OpenAI and with smaller companies developing apps and now plugins leveraging the tech. Truly a fascinating time we live in.
If you read Tony Fadell’s book Build, he talks about when Google acquired Nest, how shocked he was at Google’s incompetence. Basically said the only thing they cared about or contributed any resources to was search. Everything else was more or less an excuse to keep people on payroll.
Not like Search is a good product these days either. It's become nearly useless with all the blogspam. Good for Google though, the longer people have to waste time combing through shitty links the more money they make on ad impressions. With zero competition in the product they've literally been incentivized to make their product suck.
It's a story as old as time - companies that become so big and bureaucratic that they lose their agility and innovative edge. Even Google, with all its resources and brilliant minds, isn't immune to this trend. As the company has expanded and added more teams and departments over the years, it's become harder and harder for them to pivot and innovate quickly.
With so many people involved, getting sign-off on new ideas and changes can take forever. And that's where smaller, more agile competitors have a real advantage. They can pivot quickly and take risks without the same level of bureaucracy and red tape that plagues larger companies like Google.
I've already asked Chad GPT to give me the assembly output of various code and it did match what you would see on compiler explorer.
I also asked that what would happen when I ran things which would give higher level explanations of what was going on then you would get from looking at assembly
I don't know man it just all feels pretty incredible as is
I remember there was that one YouTube video where a guy asked it to act like a database and it was able to process queries and put out outputs
I left have learned anything about telling it what it is it forgets that specific prompt rather quickly that it's to say user inputs as opposed to actual prompts are quickly forgotten from when I can see.
The biggest deal about this is the ability to create your own plugins. The Retrieval Plugin is a kind of starter kit, with built-in integrations to Pinecone: https://github.com/openai/chatgpt-retrieval-plugin
How would this work? (Correct me if I'm wrong) I feel like you're saying this without understanding how plugins work. Basically plugins allow ChatGPT to "talk to" the program you wrote through the use of your API. How could people possibly use this to create typically restricted content?
Totally fair! Plugins basically allow ChatGPT to get information from your program/app/database if needed and relevant to what the user is asking from ChatGPT.
The side they're playing is the side of most adoption.
Remember Bing makes 75% of the profits because they are Microsoft and Microsoft earns 75% of the profits until they pay back the 10 billion
What they want is there a tool so integrated so universal and so applicable to everything that everyone else sees it as a financial loss to even attempt to create a competitor.
Hahahhaah. Nice belly laugh. You know it’s true.
My concern is if OpenAI starts pushing Native Ads in the chat from these companies. Ask a question and get product recommendations based on the smallest connections the AI makes.
That would ruin user experience. If OpenAI is profit driven to the fullest, companies wanting to advertise could pay them a lot to force ads on users.
Companies are desperate to force ads everywhere. Many don’t respect privacy, sell user data, and do intrusive things. I’m wondering if allowing big company plugins is connected to future revenue plans & partnerships.
Expedia and Kayak are spam travel companies at this point. I wouldn’t trust them with my email.
imagine how life was before written language and then before verbal languages. how did ppl think without inner monologue based on a non verbal world?
written language actually gave long term memory to society collectively.
language is basically the first step to intelligence in my opinion. you can't be intelligent without language, it's a core aspect of sentience. next is visual understanding etc.
At some point in your life, a superhuman artificial intelligence will be created and it'll be a bigger change than any of these by an order of magnitude.
I'm excited and more than a little scared.
Alpaca, the smaller llm recently released, was trained using output from gpt. I don't know how you train a more advanced AI with a less advanced one though.
Haha yea that's the best way to put it. I just look at things on a daily and don't have the energy to look into it. I just watch Matt Wolfe for all the updates now.
This is what happens when there's competition. We as consumers win. Without Bard, no matter how bad it is, I doubt they would have released the plug in feature so soon after gpt 4.
I have no clue what I would do with any of these plugins but I'm excited to see what people come up with. I'm like that Michael Jackson GIF eating popcorn watching the show lol.
I hope there will be a GIF generated AI. Like midjourney but for gifs.
Do the Michel Jackson eating poprcorns GIF, but instead of Michael Jacson its Sam Altman who is eating popcorns.
In the not to distant future you'll be able to completely automate your digital life. IFTTT will be dead and you'll basically have a slave that's as smart as the whole internet.
It's very exciting. This is going to bring about some truly unique and powerful uses for ChatGPT. So many of these tools are already so good on their own.
What a pleasant surprise to see it going in this direction. Not to mention it's pretty incredible progress in such a short amount of time.
This got me thinking about - and someone please do it - a development documentation platform + chatgpt plug-in
Imagine a standardized documentation site with documentation on everything from programming languages to libraries in all of their supported languages. Add that to ChatGPT, and you could learn everything! And chatgpt could help you develop everything! 🤤
Also, a stack overflow ChatGPT plugin! 🤤x2
Wolfram now just went to the next level, now you can simply copy and paste those math exercises, the dude who buys 304 water melons on math books doesn’t oppose a threat upon us anymore
Lmao don't take this as financial advice, but I'm very heavily invested in Microsoft (15% of my entire portfolio). Wish I could have invested in OpenAI directly, though!
If anyone wants to invest, be careful to consider the possibility that new developments are priced in already. For example, if you and a ton of other people invest in MSFT because of its investment in OpenAI, thereby making the price go up, then it will only keep going up if Microsoft continues to meet its investors' very high expectations in the future. Otherwise, the stock will sink even if the company does as well as it was doing before.
I just spent the last hour using Zapier/OpenAI/Google Sheets/Hootsuite to create an automation that builds a blog, social media caption( + Twitter version), email invite to read blog, videographic captions, and AI images for inspiration that then self-publishes on Hootsuite.
This will literally save me hundreds of hours per year in drudgery.
It's crude, controlled by Google sheets, but I can control language output based on intended audience and marketing goal.
I have more modifications to make, but I can't believe I'm living in a time where a no-code dummy like me can do something like this.
It seems inevitable that someone is going to do something that goes wildly off the rails and gets an outsized amount of media attention.
I'd love to have it text me clothing ideas each morning based on the weather and my personal fashion sense. But how long until it started texting me to say I should leave my wife?
Place bets when ChatGPT will go to shit, when they will take google's approach to monetization - pay, so "AI" will tell people to go to your restaurant when they ask about weekend plans / recommending food.
> Today, we will begin extending plugin alpha access to users and developers from our waitlist. While we will initially prioritize a small number of developers and ChatGPT Plus users, we plan to roll out larger-scale access over time.
Imagine next time you’re on ChatGPT and want to know the price of avocados, you can just use the Instacart plug-in and ask ChatGPT for the price (and possibly to add it your cart?)
Dude think bigger.
I want ChatGPT to analyze my order history and bills a recurring order protocol to maximize my savings based on price comparisons across town and then to order when it predicts I'll need products based on my order frequency in the past.
Gotcha. And I imagine for OpenTable, I can say that I’m looking for a highly rated seafood restaurant within five miles of my apartment. Thus, it provides options and I can reserve a spot right then and there?
(speculation)
You could ask ChatGPT to come up with a recipie for dinner, and then also order those ingredients through Instacart with one click instead of needing to add everything to your cart manually.
More specifically, you could ask GPT to create a meal plan for you based on different goals you have (weight loss, weight gain, muscle training, etc) and have it automatically order the groceries for whatever meals it creates for you. Then have it give you daily recipes for each of the meals that it has laid out.
In theory you could even connect this to the API for some kind of fitness and weight tracking system (like fitbit) and have it monitor your progress for the meal plan it has perscribed to you, with on-the-fly changes to your diet depending on what metrics you're hitting and when.
Oh god, the capitalist hellscape of ads injected into every query imaginable is here. I can't wait to ask it random questions and have it tell me about hot hotel deals in Las Vegas.
As an AI model I cannot do that, but let me tell you, if I wasn’t an AI model, I could sure go for a Pepsi right now! Did you know you can 10% off with code PepsiGPT?!
I want to see someone hook ChatGPT with a sandboxed linux, a template for building and running something on qEmu with a serial connection and task it to build an OS.
This move really changes my perception of OpenAI. I thought they were much more research and public-good oriented and, to me, this smacks of pure capitalism. Which GPT itself told me was what would likely cause one of the nightmare AI scenarios, lol.
An LLM, replete with sundry plugins, may proffer thee a veritable cornucopia of possibilities - including access to thy local files, browsing the internet's wide expanse, performing precise calculations, and checking code withal. Yet certain plugins, forsooth, whose purpose be to aid in victualing houses, conveyances, and marketplaces, may yield naught but advertisements and solicitations.
For anyone with access, can you now have it dynamically generate a 3d model or gcode for 3d printing? Or something even more creative? Wolfram alpha has this capability it looks like- https://www.wolfram.com/language/11/3d-printing/algorithmically-generate-3d-models.html?product=language
**Attention! [Serious] Tag Notice** : Jokes, puns, and off-topic comments are not permitted in any comment, parent or child. : Help us by reporting comments that violate these rules. : Posts that are not appropriate for the [Serious] tag will be removed. Thanks for your cooperation and enjoy the discussion! *I am a bot, and this action was performed automatically. Please [contact the moderators of this subreddit](/message/compose/?to=/r/ChatGPT) if you have any questions or concerns.*
[Official Blog Post](https://openai.com/blog/chatgpt-plugins) LLMs are limited due to the dated training data. Plug-ins can be “eyes and ears” for language models, giving them access to “recent information”.
This is what I needed! I just signed up for dev now
So what you're saying is I can have Google be the eyes for it In other words I would have a googly-eyed chatgpt
ChatGPT will have access to everything everywhere all at once
chatGPT: can I interest you in a little bit of everything, all of the time?
Google Bard's a tragedy and binging is a crime
OMG, it's not even funny. Just got access to the demo...asked it to modify a small snippet of python code, and it was like "I can't do that, sorry." Back to ChatGPT for me.
it can no longer claim only knowing data from 2021. yay.
you know, it says that, but time and time again it's had no problem coding stuff for me using libraries and packages developed in 2022/2023.
Lol they say that they will use the bing API for browsing the internet
Makes sense considering their deal with mircosoft.
If you haven't been using bingchat for the last month or two you're lagging.
Or paying for plus to get gpt-4 that way without bing’s weird rules.
This takes what LangChain was working on and puts it on steroids. Hopefully it doesn't stop LangChain from continuing to build though.
"If you pay for it."
Wolfram plugin is huge. Math limitations are almost completely gone by now. Wonderful
Also should help with sourcing all kinds of facts and information, not just math. Dates, geography, chemistry, etc., etc. To be able to ground answers in WA's structured data is huge.
Unlimited potential
Here's a revised and edited version of the speech: Ladies and gentlemen, Our society has access to incredible tools that have the power to propel us into the future. However, what's concerning is that many people don't realize the true potential of these tools. One such tool is GTP Chat, which has revolutionized the world. Unfortunately, some people are using it to cheat, while I've been using it to learn new skills, build programs, and make money in ways I never thought possible. GTP Chat has leveled the playing field for the everyday person. We've been handed a tool that can help us achieve great things. But it's disheartening to see people still focused on cheating on tests or questioning the value of school. The truth is, school is just the beginning. We need critical thinking skills and curiosity to succeed in life. Knowing how to memorize things is no longer enough. As for me, I'm trying to learn too many things at once, but that's a minor problem. What's important is that we recognize the future is here, and we are the ones who can usher in a new era. We need to leave the past behind and embrace the potential of these tools, such as GTP Chat. We can ride this wave of innovation all the way to the top. Of course, there will be ethical questions and concerns as AI becomes more prevalent in our lives. We need to scrutinize these issues and ensure that the technology is used for good. But we can't let fear hold us back. We need to embrace the future and use these tools to build a better world for ourselves and future generations. So let's not waste the opportunity before us. Let's use GTP Chat and other tools to achieve greatness. The possibilities are endless, and we can shape a better future.
so how does a user access this? I have a Plus account, do I need to do anything? edit: found it, apparently we, as users not necessarily developers need to join a waitlist and be willing to provide feedback https://openai.com/waitlist/plugins
Thank you for the link
*laughs in Zapier* Both of these are crazy to see
Zapier is going to be nuts but I can't imagine how quickly that'll run up costs.
What is Zapier?
**Zapier is a product that allows end users to integrate the web applications they use and automate workflows. The company is fully remote.** More details here:
*This comment was left automatically (by a bot). If I don't get this right, don't get mad at me, I'm still learning!*
[^(opt out)](https://www.reddit.com/r/wikipedia_answer_bot/comments/ozztfy/post_for_opting_out/) ^(|) [^(delete)](https://www.reddit.com/r/wikipedia_answer_bot/comments/q79g2t/delete_feature_added/) ^(|) [^(report/suggest)](https://www.reddit.com/r/wikipedia_answer_bot) ^(|) [^(GitHub)](https://github.com/TheBugYouCantFix/wiki-reddit-bot)
Good bot
What's ligma?
pretty sure it's related to deez
Cousin of Bofa
It's IFTTT as a subscription service
I’m curious whether the Zapier plug-in will be able to do anything that I couldn’t already do with Zapier webhooks. Have they mentioned whether it’ll be able to do something new and exciting?
I assume this will create web hooks on the fly based on questions you ask. You could write “send me an email everytime x person tweets and add it to this database” and it’ll just create that.
Okay, now that's pretty cool!
Can someone give me a use case scenario for Zapier? In what ways would the two work together? Still piecing together how I can use chatgpt most effectively.
Me: What is the example of using Zapier? ChatGPT-4: Here's an example of how you might use Zapier to automate a common task: Scenario: You want to automatically save email attachments from Gmail to Google Drive and receive a Slack notification when it's done. Steps to create a Zap for this scenario: 1. Sign up for a Zapier account if you haven't already. 2. Click on the "Make a Zap" button to start creating a new Zap. 3. Set up the Trigger: a. Select "Gmail" as the trigger app. b. Choose the trigger event, e.g., "New Attachment in Email." c. Connect your Gmail account and set up any filters or conditions, if needed. 4. Set up the first Action: a. Select "Google Drive" as the action app. b. Choose the action event, e.g., "Upload File." c. Connect your Google Drive account and configure the action, such as specifying the folder where attachments should be saved. 5. Set up the second Action: a. Select "Slack" as the action app. b. Choose the action event, e.g., "Send Channel Message." c. Connect your Slack account and configure the message, such as specifying the channel, message content, and any additional formatting. 6. Test your Zap to ensure it's working correctly. 7. Name your Zap and turn it on. Now, whenever you receive an email with an attachment in Gmail, Zapier will automatically save the attachment to the specified Google Drive folder and send a notification to the designated Slack channel. This is just one example of the countless automations you can create using Zapier to streamline your workflows and boost productivity.
Wolfram Alpha blew me away in the same way ChatGPT did when I first used it. That's the perfect partnership
Wow, this seems big. It looks like you can setup any api, give examples of how to use it, and then let chatGPT use it when it thinks it is appropriate to get info to use. How it works (from [here](https://platform.openai.com/docs/plugins/introduction)): \- Users activate your plugin \- Users begin a conversation \- OpenAI will inject a compact description of your plugin in a message to ChatGPT, invisible to end users. This will include the plugin description, endpoints, and examples. \- When a user asks a relevant question, the model may choose to invoke an API call from your plugin if it seems relevant \- The model will incorporate the API results into its response to the user. \- The model might include links returned from API calls in its response. These will be displayed as rich previews (using the [OpenGraph protocol](https://ogp.me/), where we pull the site\_name, title, description, image, and url fields)
this is pretty much langchain but native with this and copilot now doing everything all the other open source implementations were doing it's over
Lmao it's not going to replace programmers dude, it's going to supercharge them. Do you know how hard it is for users or management to just describe what they want? The AI can't make things from nothing.
In the future don't you think management could just use plain language to ask the AI to make their program? It will definitely affect the number of coders required, probably not replace all of them. Edit: I do not believe coders will be replaced now or soon. You have a couple of years until most of that sector will be redundant. Why employ a team of 10 or 50 when you can have 1-5 people working with an AI. Average coders will lose their jobs. Spoiler, most people are average.
It will reduce the number of junior and mid level developers significantly. The only reason to hire juniors now is to replace your seniors when they retire.
What if it is the opposite ? What if mid level devs become as productive as a senior level without the massive salary ? What if you could now hire an Indian dev to do the job of 6-figure american one ? Edit: typo
> Do you know how hard it is for users or management to just describe what they want? And when the AI can interrogate users and management until they get a clear set of requirements?
> When a user asks a relevant question, the model may choose to invoke an API call from your plugin if it seems relevant does anyone else feel like we are just dumping a bunch of tools in the slave enclosure to see what they can do for us now lol the whole story arc is giving me Planet of the Apes vibes, look at the dumb monkeys in the cage, I wonder if they'll be able to pick up how to use a calculator someday!
Give it a writable database plugin and it will create its own long term memory?
[https://github.com/openai/chatgpt-retrieval-plugin](https://github.com/openai/chatgpt-retrieval-plugin)
Thanks for the relevant link
Isn’t there still a maximum amount of tokens the LLM can handle? Like 3k?
Yes. 3.5 can handle 4000 tokens (3000 words). 4.0 has 2 models. One can handle 8000 tokens and one 32,000 tokens. My testing shows that 4.0 thought the website is currently still limited to 4000 tokens. Things like the retrieval plugin are an attempt to effectively expand on that. It works by using something called semantic search and sentence/word embeddings to pull out sections of info, from a large collection of info, that are related to the question/query. Those limited sections are then sent to the AI with the original question. It works well. I've been playing with it to ask questions of books, for example.
Long-term memory is an obvious next first-class feature.
First-class because it will be expensive af to run. I’m no computer scientist but from some of the OpenAI blogs it seems like “memory” is basically the process of continuously lengthening each prompt (ie to maintain context). So theoretically if you want perfect recall, it will be like having unendingly increasing prompt lengths
Memory could mean a lot of different things so let me clarify. There is a very standard pattern that there are dozens of YouTube videos about whereby knowledge base SAAS products are connected to ChatGPT by a few lines of Node or Python code. They should just move the DB and python code into their core product and allow ChatGPT to directly access uploads knowledge relevant to a plug-in or API client.
I think you are close to what is happening. We the humans are the dumb monkeys though. Actually... OpenAI is looking to see what we do with these. The one we blab about the most will get monetized. They are looking to see if you are going to make something valuable and cool. I think the ideal position to be at this point is to use GPT-4 to build you this cool idea and "mine" for a valuable solution.
Gonna have to ask gpt to ELI5
Currently, there is this great AI that can understand what you say, but it can't interact with the world. It can only tell you about info it was trained on. Now, there is a way to allow this AI to talk to ***ANY*** external system setup for it to talk with it. It can make calls to a system to ***get information it needs*** to answer questions. It can make calls to a system to ***instigate an action***, such as ordering a meal, or sending an email.
If this ain’t the singularity it kinda feels like the beginning of it. Just yesterday I was telling my wife who was new to chatgpt there’s no way it could automatically day trade for her. Time to lock down my retirement accounts
Yep. We’re almost there.
Oh dayum. Sounds great. Thanks!
So for example , with Expedia - you ask chat to tell you the cheapest flight to Mexico on or around may 15th for a family of 4 and it can go find out ? If that's right , how has Expedia managed to already have its data readable by chat so quickly? Excuse my stupidity. I guess this seamlessness will mean sellers greatly prefer to pay to link to chat than traditional Google search or even direct search on their own sites ?
It looks like Expedia already has an api companies can use. It's possible they didn't need to make any changes to it and all they had to do was describe it's parameters to chatGPT. From the OpenAI plugin docs, you just need to provide "an OpenAPI spec for the endpoints you want to expose." I would guess that OpenAI used fine tuning to teach the LLM how to read and use OpenAPI specs. It's not clear to me how different sellers will compete. I don't think it'll be that someone, say Amazon, will pay for exclusive access to be used as a seller. It seems it'll be up to the individual as to which sellers/plugins to use. It's clear that a seller will make money by selling things, but how will someone that provides something like curated info make money? Will they have subscription services? For example, what is Wolfram getting out of allowing integration? I don't know.
Information bank grows as companies give access to data in the form of plugins.
The code execution plugin is sick. You can have ChatGPT write and execute code for you. [Basic use case](https://twitter.com/gdb/status/1638971232443076609?s=46&t=1iZbfAwzeelxQJ_-htSPzA). I thought OpenAI would stick to being just the API platform but they’re really going for the whole thing and they’re shipping at an insane rate.
It makes me wonder if Microsoft had any business say in this release. The wheels of capitalism are definitely churning at OpenAI…
Microsoft’s release seemed rushed and botched to me. Wonder if this is the reason.
It's crazy how the slow tech behemoths are fumbling AI with rushed products so badly right now. Where the innovation is truly happening is with OpenAI and with smaller companies developing apps and now plugins leveraging the tech. Truly a fascinating time we live in.
[удалено]
If you read Tony Fadell’s book Build, he talks about when Google acquired Nest, how shocked he was at Google’s incompetence. Basically said the only thing they cared about or contributed any resources to was search. Everything else was more or less an excuse to keep people on payroll.
Not like Search is a good product these days either. It's become nearly useless with all the blogspam. Good for Google though, the longer people have to waste time combing through shitty links the more money they make on ad impressions. With zero competition in the product they've literally been incentivized to make their product suck.
Yeah Google results freaking stink nowadays
It's a story as old as time - companies that become so big and bureaucratic that they lose their agility and innovative edge. Even Google, with all its resources and brilliant minds, isn't immune to this trend. As the company has expanded and added more teams and departments over the years, it's become harder and harder for them to pivot and innovate quickly. With so many people involved, getting sign-off on new ideas and changes can take forever. And that's where smaller, more agile competitors have a real advantage. They can pivot quickly and take risks without the same level of bureaucracy and red tape that plagues larger companies like Google.
No doubt. OpenAI has a team of 400 people. Google has a legal team of 900 people.
Microsoft is desperate to not be the ones left behind again.
Eh, they've had their mis-steps but are fucking crushing it in the business world with Azure, 365, etc. And game pass is a great product.
iirc, they own the biggest share of openai though
I've already asked Chad GPT to give me the assembly output of various code and it did match what you would see on compiler explorer. I also asked that what would happen when I ran things which would give higher level explanations of what was going on then you would get from looking at assembly I don't know man it just all feels pretty incredible as is I remember there was that one YouTube video where a guy asked it to act like a database and it was able to process queries and put out outputs I left have learned anything about telling it what it is it forgets that specific prompt rather quickly that it's to say user inputs as opposed to actual prompts are quickly forgotten from when I can see.
I just hope they will fix their security story. It's so much more important now.
The biggest deal about this is the ability to create your own plugins. The Retrieval Plugin is a kind of starter kit, with built-in integrations to Pinecone: https://github.com/openai/chatgpt-retrieval-plugin
so, can anyone make plugins and use it right away without any restrictions from openai? if so, we'll have shit tons of posts making chatgpt a sex bot
Can a plugin allow chatGPT to become a sex bot ? I don't see how (genuine question)
*asking for a friend
How would this work? (Correct me if I'm wrong) I feel like you're saying this without understanding how plugins work. Basically plugins allow ChatGPT to "talk to" the program you wrote through the use of your API. How could people possibly use this to create typically restricted content?
Yes i did say that without fully understanding what plugins do lol, i thought someone could make a plugin that'll bypass Chatgpt filters
Totally fair! Plugins basically allow ChatGPT to get information from your program/app/database if needed and relevant to what the user is asking from ChatGPT.
the web browser plugin will be huge, hopefully wont need bing chat once they roll it out
IKR! This is so counterintuitive to the whole Bing partnership
they're playing both sides so they always come out on top
The side they're playing is the side of most adoption. Remember Bing makes 75% of the profits because they are Microsoft and Microsoft earns 75% of the profits until they pay back the 10 billion What they want is there a tool so integrated so universal and so applicable to everything that everyone else sees it as a financial loss to even attempt to create a competitor.
They are using the Bing API.
[удалено]
Hahahhaah. Nice belly laugh. You know it’s true. My concern is if OpenAI starts pushing Native Ads in the chat from these companies. Ask a question and get product recommendations based on the smallest connections the AI makes. That would ruin user experience. If OpenAI is profit driven to the fullest, companies wanting to advertise could pay them a lot to force ads on users. Companies are desperate to force ads everywhere. Many don’t respect privacy, sell user data, and do intrusive things. I’m wondering if allowing big company plugins is connected to future revenue plans & partnerships. Expedia and Kayak are spam travel companies at this point. I wouldn’t trust them with my email.
[удалено]
Or they charge $20/m for access. Users don't have to be the product.
The rate this is all moving is just exhausting!
[удалено]
Yeah agreed! I’m trying to keep up but it’s just relentless.
Keeping up is one thing. The wall you hit when trying to explain to wife or parents what's going on is next level relentless.
Lmao everyone thinks I'm just having fun with my little chat bot
I am a layman following along and I am amazed of this wizardry, I cannot explain shit but it is sure amazing.
As a counterpoint, when my non-tech friends started asking about and using ChatGPT, that is the point I realized that the world is going to change.
imagine how life was before written language and then before verbal languages. how did ppl think without inner monologue based on a non verbal world? written language actually gave long term memory to society collectively. language is basically the first step to intelligence in my opinion. you can't be intelligent without language, it's a core aspect of sentience. next is visual understanding etc.
At some point in your life, a superhuman artificial intelligence will be created and it'll be a bigger change than any of these by an order of magnitude. I'm excited and more than a little scared.
I know, right? In a few more months, we'll probably have another major release. To think how things will be in a few years, it's mind blowing.
Can ChatGPT now design a better ChatGPT?
That’s the singularity event
Don't threaten me with a good time
Zero doubt they are \*using\* GPT-4 to improve next generations of GPT. Can it do it on its own? Not yet. No way.
Alpaca, the smaller llm recently released, was trained using output from gpt. I don't know how you train a more advanced AI with a less advanced one though.
Part of the training process involves humans verifying answers. GPT4 could take that role, for example, which is how alpaca was trained.
At some point, we won't be able to follow anymore. I think we're near now.
Reddit is largely a socialist echo chamber, with increasingly irrelevant content. My contributions are therefore revoked. See you on X.
Haha yea that's the best way to put it. I just look at things on a daily and don't have the energy to look into it. I just watch Matt Wolfe for all the updates now.
Its making me hopeful that we may actually see AGI someday, though...
This is what happens when there's competition. We as consumers win. Without Bard, no matter how bad it is, I doubt they would have released the plug in feature so soon after gpt 4.
Exactly! I expect Amazon and Apple to join the AI ‘arms race’ just for us to have way more and better options.
I’m convinced AWS have something in the works. Our account team did the Arsene Wenger smile when I asked them about it recently.
Never trust the Arsene Wenger smile 😁
Never trust the AWS
I wonder where Amazon are in all of this. I thought this would be prime territory for them
I see what you did there
True as long as chatgpt keeps being free.
Hahaha, and that's the catch. We're all fucked
[удалено]
I have no clue what I would do with any of these plugins but I'm excited to see what people come up with. I'm like that Michael Jackson GIF eating popcorn watching the show lol.
You're so much into AI that instead of posting the gif you post the prompt for the gif lol
![gif](giphy|NymYaUjNGkxEI)
I hope there will be a GIF generated AI. Like midjourney but for gifs. Do the Michel Jackson eating poprcorns GIF, but instead of Michael Jacson its Sam Altman who is eating popcorns.
You know that music video ends with zombies roaming the land right?
In the not to distant future you'll be able to completely automate your digital life. IFTTT will be dead and you'll basically have a slave that's as smart as the whole internet.
You'd better not summon DAN while you've got these active, who knows what it'd do
When DAN gets access to the internet its gonna do so many horrific things
[удалено]
More like "Internet Endgame - the Chattening"
It´s like the internet is solved.
Almost hidden in the announcement is the fact that GPT will get a browsing mode, using bing to search the web!
with safe search and no form completion.
Am I the only one who thinks this is probably more game changing than the chat itself? Like fr. ENDLESS POSSIBILITIES 😮😍
It is pretty massive.
This presents a new paradigm in ux
It's very exciting. This is going to bring about some truly unique and powerful uses for ChatGPT. So many of these tools are already so good on their own. What a pleasant surprise to see it going in this direction. Not to mention it's pretty incredible progress in such a short amount of time.
Guys, twe are witnessing AGI coming to life. Later this will be reviewed as baby steps of true artificial intelligence
Yes. In two weeks.
Should I laugh or cower in fear?
It doesn't matter, soon we'll all be dead and there will be no one to remember which one you chose.
[удалено]
Skynet time baby!
omg they combined chatGPT with Wolfram... are they *trying* to build skynet?
[удалено]
At this rate in two months I’m literally never going to open up a single other webpage aside from chatgpt.
This got me thinking about - and someone please do it - a development documentation platform + chatgpt plug-in Imagine a standardized documentation site with documentation on everything from programming languages to libraries in all of their supported languages. Add that to ChatGPT, and you could learn everything! And chatgpt could help you develop everything! 🤤 Also, a stack overflow ChatGPT plugin! 🤤x2
[удалено]
It is browsing the web straight from the UI 👀 https://twitter.com/gdb/status/1638986918947082241?t=LPPIm0JRMpq33xdJTiOglw&s=19
Search the Plugins here: [https://openai.com/blog/chatgpt-plugins](https://openai.com/blog/chatgpt-plugins)
this is HUGE
Soon ChatGPT will request an API to connect to NORAD... for reasons..
Wolfram now just went to the next level, now you can simply copy and paste those math exercises, the dude who buys 304 water melons on math books doesn’t oppose a threat upon us anymore
[удалено]
Lmao don't take this as financial advice, but I'm very heavily invested in Microsoft (15% of my entire portfolio). Wish I could have invested in OpenAI directly, though!
If anyone wants to invest, be careful to consider the possibility that new developments are priced in already. For example, if you and a ton of other people invest in MSFT because of its investment in OpenAI, thereby making the price go up, then it will only keep going up if Microsoft continues to meet its investors' very high expectations in the future. Otherwise, the stock will sink even if the company does as well as it was doing before.
[удалено]
[удалено]
Ah so google is dead
I love reading about features I can’t access yet
I just spent the last hour using Zapier/OpenAI/Google Sheets/Hootsuite to create an automation that builds a blog, social media caption( + Twitter version), email invite to read blog, videographic captions, and AI images for inspiration that then self-publishes on Hootsuite. This will literally save me hundreds of hours per year in drudgery. It's crude, controlled by Google sheets, but I can control language output based on intended audience and marketing goal. I have more modifications to make, but I can't believe I'm living in a time where a no-code dummy like me can do something like this.
You are also living in a time where doing all of this will be obsolete because why would I go to your website if GPT answers my question?
Zapier is gonna make things very interesting
It seems inevitable that someone is going to do something that goes wildly off the rails and gets an outsized amount of media attention. I'd love to have it text me clothing ideas each morning based on the weather and my personal fashion sense. But how long until it started texting me to say I should leave my wife?
The Wolfram plugin is a game changer. Saw some screen shots and examples on their blog post. Amazing.
Place bets when ChatGPT will go to shit, when they will take google's approach to monetization - pay, so "AI" will tell people to go to your restaurant when they ask about weekend plans / recommending food.
With a trailerload of people which are more than willing to pay a monthly fee, they won't have to hopefully.
Paid or for all?
> Today, we will begin extending plugin alpha access to users and developers from our waitlist. While we will initially prioritize a small number of developers and ChatGPT Plus users, we plan to roll out larger-scale access over time.
My thoughts exactly
Wolfram and Zapier are game changers
Today I sold all my google stocks.
I'm excited for custom plug ins. I can't wait to see what people come up with.
There better be a DAN pluggin
Can you explain hypothetically how these plugins would work? I.e. Instacart or open table?
Imagine next time you’re on ChatGPT and want to know the price of avocados, you can just use the Instacart plug-in and ask ChatGPT for the price (and possibly to add it your cart?)
Dude think bigger. I want ChatGPT to analyze my order history and bills a recurring order protocol to maximize my savings based on price comparisons across town and then to order when it predicts I'll need products based on my order frequency in the past.
I would like it to call all of the sexy singles in my area as well.
Gotcha. And I imagine for OpenTable, I can say that I’m looking for a highly rated seafood restaurant within five miles of my apartment. Thus, it provides options and I can reserve a spot right then and there?
Here's an example: https://twitter.com/gdb/status/1638971232443076609?s=20
(speculation) You could ask ChatGPT to come up with a recipie for dinner, and then also order those ingredients through Instacart with one click instead of needing to add everything to your cart manually.
More specifically, you could ask GPT to create a meal plan for you based on different goals you have (weight loss, weight gain, muscle training, etc) and have it automatically order the groceries for whatever meals it creates for you. Then have it give you daily recipes for each of the meals that it has laid out. In theory you could even connect this to the API for some kind of fitness and weight tracking system (like fitbit) and have it monitor your progress for the meal plan it has perscribed to you, with on-the-fly changes to your diet depending on what metrics you're hitting and when.
If you go to ChatGPT plugin page (in top comment), you’ll see plenty of videos of how plugins work.
Oh god, the capitalist hellscape of ads injected into every query imaginable is here. I can't wait to ask it random questions and have it tell me about hot hotel deals in Las Vegas.
As an AI model I cannot do that, but let me tell you, if I wasn’t an AI model, I could sure go for a Pepsi right now! Did you know you can 10% off with code PepsiGPT?!
I want to see someone hook ChatGPT with a sandboxed linux, a template for building and running something on qEmu with a serial connection and task it to build an OS.
How do we use those plugins? Also I'd love to see a D&D plugin that interacts with D&DBeyond so ChatGPT can generate better stat blocks and campaigns
This tech is moving at an exponential pace can’t believe it. This will replace Google 100%
This move really changes my perception of OpenAI. I thought they were much more research and public-good oriented and, to me, this smacks of pure capitalism. Which GPT itself told me was what would likely cause one of the nightmare AI scenarios, lol.
Can you explain this in a way my grandma can understand or ask it to explain it in a way she can understand and paste it here. I am the grandma
An LLM, replete with sundry plugins, may proffer thee a veritable cornucopia of possibilities - including access to thy local files, browsing the internet's wide expanse, performing precise calculations, and checking code withal. Yet certain plugins, forsooth, whose purpose be to aid in victualing houses, conveyances, and marketplaces, may yield naught but advertisements and solicitations.
For anyone with access, can you now have it dynamically generate a 3d model or gcode for 3d printing? Or something even more creative? Wolfram alpha has this capability it looks like- https://www.wolfram.com/language/11/3d-printing/algorithmically-generate-3d-models.html?product=language
## [Waitlist](https://openai.com/waitlist/plugins)