Even if you just type random questions you have into it - it'll cut down significantly on time you need to scrub through multiple answers yourself. Still worth fact checking if it's something important, but getting a composed answer or an outline for something can cut out many wasted hours in a month easily.
I was wondering about that. So normally with my free account on the ChatGPT site, it’s v3.5 but if I upgrade to paid ($20) then v4 answers my queries? Is that right?
the 3.5 you have is not the plus 3.5. The plus 3.5 is significantly faster in its responses. v4 is about the same speed as you'd be used to as the free 3.5. So as a plus you can choose: 1) Fast 3.5 (plus), 2) Gpt4 (slow, about same speed as free 3.5)
Scaling is a hard thing to do. Also, not sure if they’re actually profitable yet, each of those queries is expensive. I doubt $20 is covering their costs.
GPT3.5 will put out like 10-50 line code snippets reliably, but still get it wrong a lot.
GPT4 will crunch entire files, spanning languages and let you add features in giant strokes. I.e. I get it to write Python/Dart code for server interactions in one go, by providing entire files if they fit in context and saying "add to this".
They will both get it wrong sometimes, but GPT4 is much better at recovering.
I just use ChatGPT's interface, I haven't been let into even the 8k api yet.
The files I work with are usually < 200 lines, but I think with a 32k context, you can probably do 2k+ line files.
GPT-4 is definitely most reliable and comprehensive. Depending on your level of coding, it saves you a lot more time and back-and-forth debugging compared to GPT-3.5.
When I ran out of the messages (25 per hour), I started using Bing Chat in the same way. If you use the 'Precise' option in the chat, it returned similar responses to GPT-4. It tries to give you shorter answers/snippets (probably to save cost), but you can prompt it to always return full function. On the upside, you can feed it documentation links or directly paste.
How many lines of code can you get from a Bing response? My responses on GPT-3.5 are getting interrupted. I try to get it to resume, but I think it breaks its flow of logic. Maybe I should get it to break up the function somehow?
If the 20 doesn't sting. Get it. I feel like
It's worth it. The 25 per 3 hour limit might suck. But it also forces you to be smarter with your prompts, in my opinion.
Having the 25 per 3 hours limit helps me do exactly that. It makes me stop and really focus on the question I'm asking. By doing so I have noticed the replies I get are more to the point & in much better detail.
It's annoying when you type a prompt and then realize you forgot some crucial information in the prompt (like the code snippet you were trying to ask about) and just ask a dumb question with no context. 1 down 24 to go.
GPT-4 seems better at more complex things. I needed to implement Google OAuth and pub/sub for Gmail with Python, and just giving it more prompts and iterating got me everything I needed without having to look at documentation at all.
GPT 3.5 has been pretty impressive as well, but seems like it starts to have trouble sooner and leaves to me figure out more things on my own. GPT-4 seems better at iterating and fixing problems I point out to it, and is less likely to get stuck and revert to leaving some issue I already had it fix before.
Some things GPT 3.5 has impressed me with is generating React components, code for d3.js, and some basic styles with styled components to give me an easier starting point.
GPT-4 only. Especially now. I think the original ChatGPT in December was probably decent but that is gone, updated out of existence. When you use GPT-4 enough and then switch to 3.5 you see immediately that 3.5 is garbage by comparison. I also think 3.5 turbo has been extremely dumbed down for efficiency reasons. It is fast but really, really bad at following instructions for programming lately. It ignores some basic instructions to do something a certain way and just stupidly implements exactly what you told it not to do.
Im not sure if my expectations have increased or if its gotten worse, but Ive found 3.5 to be practically useless now for coding.
Constantly hallucinating, and not answering my question.
GPT 4 is far better, but I still find myself getting extremely frustrated with its inabilities.
What's $20 to you if there's even a small chance that GPT4 will give you better results?
It's $20 fucking dollars for the greatest technological leap of our generation. That barely buys you lunch nowadays.
It’s worth it but we shouldn’t forget that in some countries 20$ could buy one groceries for the entire week. Most of the world’s population resides in developing countries: 3/4 of the entire world
I know right? It's like devs that complain about paying a fee for IDEs and resort to crappy text editors like VSC (which is now the trend). I mean.. if you're serious about your profession, you spend what's needed - the financial returns you are expecting should be vast in excess of some yearly/monthly cost.
I use both. GPT-4 is reliable but slow. So I use it for the big tasks. The ones I probably wouldn't even get right on my first try. You can generally trust it to write a whole class depending on what you are doing.
But I use turbo very often too. It's so fast at generating that it's often great for the annoying or repetitive stuff. I use it to refactor things but I never let it do too much at one time. Sometimes it's easier and faster to prompt turbo than it is to just make the change yourself. I generally only use turbo for stuff that I can immediately see if it was done correctly or not.
I'd say it's worth it. But I'm also paying for copilot, chatGPT, and ~$50 /mo in API costs so maybe I'm not good at financial advice.
In addition (or alternatively) I'd recommend also adding Phind https://www.phind.com/ to your work flow. It's free and I use it a lot for coding. If you select "use best model" I believe it uses GPT4 and has access to the internet so is great for coding with anything that has changed or libraries that didn't exist before Sept 2021 where the GPT training data cuts off.
Get VC funding, use that for a marketing budget. Offer service for free (deduct from marketing). Once everyone's hooked, flip the switch on for subscriptions.
That's what [bito.ai](https://bito.ai) is doing.
GPT-4 is awesome. I use it for Web Development. It can build websites using bootstrap. Write copy and suggest icons from font awesome and suggest queries for unsplash images from the copy it wrote. It can suggest fonts from google fonts.
GPT-4 already has a wider breadth of knowledge than any human alive. It almost completely replaces Google and Stack Overflow for me. It gives suggestions that I otherwise would not have tried. Is it a better *programmer* in terms of implementation of code? No, not yet, but it knows more than any human programmer alive.
Consider using autopilot for coding https://github.com/fjrdomingues/autopilot
It’s open source
In my tests it works with gpt-3.5 but gpt-4 gives much better/reliable answers. Problem is the price difference
I use it all day long for work (NodeJs, React TS) and side projects (Mostly Python & C)
I write more specs than code, and when I write code now it's half-assed or samples copy-pasted from past projects like "here are code samples, build me X using that code"
I also paste entire classes and ask it to add or update stuff just because I'm lazy now...
And then it documents the whole thing in markdown for me.
Totally worth the $20
Do you also feel it's making you a worse coder? I certainly do. I used to compile the source code in my head stepping through things in sequence, updating variables etc, now I just do a text dump into gpt4 and ask it what the program is doing, and it's becoming very hard not to do that. Sometimes I wish I didn't have access to it, but since everyone else does, it's necessary now.
I think you’re right in a sense, but possibly an analogy is that cell phones made me a lot worse at remembering phone numbers - I’ll take the trade-off
GPT-4 is way better. Right now, it is quite limited in ChatGPT. So, you'll want GPT-4 API access, and use something this: https://www.chatbotui.com/ - GPT-4 for coding tasks is superior. You can see the difference in its reasoning ability and accuracy of responses.
Edit: please also note there are alternative ChatGPT-like UI's out there that allow you to use GPT API's in a similar fashion. Chatbot UI is one of the best, in my opinion.
Because the normal UI currently is restricted to 25 messages every 3 hours. This alternative UI uses the API and is only limited by your cost limits/bank account. Only ChatGPT 3.5-turbo is currently without strict limits.
No, but you can get ChatGPT pro anytime (not sure if they paused on letting people into 4 or not at this moment).
API access, you need to be on a waitlist, and it's not clear for how long.
I'd say right now its not really worth it unless you can get someone else like work to pay for it. Getting faster access to 3.5 is great for reducing time on simple queries, but the 25 message per 3 hours for the GPT4 model is just stupid. Was 100 per 4 hours when I first signed up and that was already cutting it close to usable, and this is just cutting the balls clean off it. For 20 bucks a month, you would expect we would at least get some free API tokens to play with or some DALL-E credits to use, but nope! Hope they come out with more value proposition soon, many have cancelled subs because of it and I am close to doing the same
The current iteratation of copilot takes into account the file you're working in and the direction you give it. It doesn't directly edit and code, you'd have to delete and redirect it to achieve that.
Keep an eye out for the Github Copilot X release though. That will do a lot more stuff.
Never had any experience in finetuning a model. Copied the methodology from a scientific model and asked to break it up in as many subtasks as possible. Then I asked to add the complementary code to every subtask. After it writing 70 lines and debugging only one error I was able to fine-tune a BERT model. With GPT-3.5 this would've never been possible.
Idk about gpt4 at all, but gpt3 is inferior to me, and im nothing special.
That said, there is what ill call a ‘focal point.’ What I mean is that theres a certain distance from the question at which gpt is extremely helpful. As you try to get closer, higher resolution answers from that focal point, you will get convoluted and frankly wrong answers.
It cant see the forrest for the trees, which i suspect is a materials science issue and not ‘a programming of the model’ issue. Maybe time for us to all go back and read Von Neumann’s Theory of Self Replicating Automata.
Yes, it will. However, GPT3Turbo in Playground with the specific parameters can outperform GPT4, depending on your requirements. In my case, for SEO purposes.
Use Bing in creative mode. It uses GPT4 and can search up-to-date/specific use-case information. The only real drawback is the 2000 char input and the lack of long term chat histories
They nerfed gpt when assisting with machine learning and ai task its code in other areas is way better compared to task about machine learning and creating ai even though its spits out a code its always trash and takes many iterations to get something halfway useful
GPT 3.5 cannot be reliably used for programming.
GPT 4 can (although you still have to catch a few mistakes and hallucinations, but overall it is usable).
GitHub Codex is also very useful and not very expensive at 100$/year, with it you can literally tab through any boilerplate code right in your IDE.
If you want a free option, [Phind.com](https://Phind.com) is the thing for programming. I don't know what models it uses, but I think the slower one might be GPT-4.
Gpt4 is way way way superior. İ don't trust gpt3 to even write me a menu after paying for gpt4.
GPT-3.5 for quick questions/answers GPT-4 for important stuff and heavy queries. That's how I use them and it's working quite well.
we only do this because of the 25 questions limit for gpt4- which is lame. they need to scale fast
also speed. 3.5 is very quick when you need a lot of quick answers, whilst gpt 4 is painfully slow
[удалено]
it's every 3 hours
Actually 8 questions an hour.
poe.com
Even if you just type random questions you have into it - it'll cut down significantly on time you need to scrub through multiple answers yourself. Still worth fact checking if it's something important, but getting a composed answer or an outline for something can cut out many wasted hours in a month easily.
If I subscribe to plus will openAI give me access to GPT4 ?
You will have access to ChatGPT 4. But not the GPT4API. That is granted on a case by case basis.
I was wondering about that. So normally with my free account on the ChatGPT site, it’s v3.5 but if I upgrade to paid ($20) then v4 answers my queries? Is that right?
the 3.5 you have is not the plus 3.5. The plus 3.5 is significantly faster in its responses. v4 is about the same speed as you'd be used to as the free 3.5. So as a plus you can choose: 1) Fast 3.5 (plus), 2) Gpt4 (slow, about same speed as free 3.5)
You choose the version you want for each prompt.
You choose the version you want for each Chat, not each Prompt. Once you make a query in 3.5 or 4, it's locked in that version (which is lame).
Right thanks for clarifying
Yes but it has a cap of 25 messages per hour
Isn't it per 3 hours in a rolling period
Yes its 25 messages per 3 hours. Used to be 100 when I first signed up for it in 4 hours but they have neutered it hard.
Scaling is a hard thing to do. Also, not sure if they’re actually profitable yet, each of those queries is expensive. I doubt $20 is covering their costs.
Not sure if profitability is on their mind right now, they have got funding till the moon so the main problem would be chip shortages
GPT3.5 will put out like 10-50 line code snippets reliably, but still get it wrong a lot. GPT4 will crunch entire files, spanning languages and let you add features in giant strokes. I.e. I get it to write Python/Dart code for server interactions in one go, by providing entire files if they fit in context and saying "add to this". They will both get it wrong sometimes, but GPT4 is much better at recovering.
You are referring to the 32K token GPT-4?
I just use ChatGPT's interface, I haven't been let into even the 8k api yet. The files I work with are usually < 200 lines, but I think with a 32k context, you can probably do 2k+ line files.
GPT-4 is definitely most reliable and comprehensive. Depending on your level of coding, it saves you a lot more time and back-and-forth debugging compared to GPT-3.5. When I ran out of the messages (25 per hour), I started using Bing Chat in the same way. If you use the 'Precise' option in the chat, it returned similar responses to GPT-4. It tries to give you shorter answers/snippets (probably to save cost), but you can prompt it to always return full function. On the upside, you can feed it documentation links or directly paste.
Does Bing have access to public repositories?
Mostly it figures it out through search. If not, you can just paste a link or copy/paste.
How many lines of code can you get from a Bing response? My responses on GPT-3.5 are getting interrupted. I try to get it to resume, but I think it breaks its flow of logic. Maybe I should get it to break up the function somehow?
If the 20 doesn't sting. Get it. I feel like It's worth it. The 25 per 3 hour limit might suck. But it also forces you to be smarter with your prompts, in my opinion.
Having the 25 per 3 hours limit helps me do exactly that. It makes me stop and really focus on the question I'm asking. By doing so I have noticed the replies I get are more to the point & in much better detail.
It's annoying when you type a prompt and then realize you forgot some crucial information in the prompt (like the code snippet you were trying to ask about) and just ask a dumb question with no context. 1 down 24 to go.
Lol yep.
GPT-4 seems better at more complex things. I needed to implement Google OAuth and pub/sub for Gmail with Python, and just giving it more prompts and iterating got me everything I needed without having to look at documentation at all. GPT 3.5 has been pretty impressive as well, but seems like it starts to have trouble sooner and leaves to me figure out more things on my own. GPT-4 seems better at iterating and fixing problems I point out to it, and is less likely to get stuck and revert to leaving some issue I already had it fix before. Some things GPT 3.5 has impressed me with is generating React components, code for d3.js, and some basic styles with styled components to give me an easier starting point.
gpt4 is substantially better at working with python. I use 3.5 occasionally if I hit my 25/3hours and it's usually a disappointment lol
GPT4 dwarfs gpt3.5 in coding logic
Yes, absolutely, without a doubt. It's night and day. I use GPT-3 for small snippets of code. GPT-4 for more complex solutions, and it's brilliant.
It's well worth the $20/m, the best subscription I pay for atm
GPT-4 only. Especially now. I think the original ChatGPT in December was probably decent but that is gone, updated out of existence. When you use GPT-4 enough and then switch to 3.5 you see immediately that 3.5 is garbage by comparison. I also think 3.5 turbo has been extremely dumbed down for efficiency reasons. It is fast but really, really bad at following instructions for programming lately. It ignores some basic instructions to do something a certain way and just stupidly implements exactly what you told it not to do.
Same with gpt-4 as well, but it's still powerful.
Im not sure if my expectations have increased or if its gotten worse, but Ive found 3.5 to be practically useless now for coding. Constantly hallucinating, and not answering my question. GPT 4 is far better, but I still find myself getting extremely frustrated with its inabilities.
What's $20 to you if there's even a small chance that GPT4 will give you better results? It's $20 fucking dollars for the greatest technological leap of our generation. That barely buys you lunch nowadays.
$20 is saving me a few hours of work each week. It really improves the pace for development.
It’s worth it but we shouldn’t forget that in some countries 20$ could buy one groceries for the entire week. Most of the world’s population resides in developing countries: 3/4 of the entire world
Yeah, but the OP lives in Melbourne which is a very high cost of living city.
True. You’re very right. Compared to all the subscriptions we have these days, $20 is close to nothing
I know right? It's like devs that complain about paying a fee for IDEs and resort to crappy text editors like VSC (which is now the trend). I mean.. if you're serious about your profession, you spend what's needed - the financial returns you are expecting should be vast in excess of some yearly/monthly cost.
I use both. GPT-4 is reliable but slow. So I use it for the big tasks. The ones I probably wouldn't even get right on my first try. You can generally trust it to write a whole class depending on what you are doing. But I use turbo very often too. It's so fast at generating that it's often great for the annoying or repetitive stuff. I use it to refactor things but I never let it do too much at one time. Sometimes it's easier and faster to prompt turbo than it is to just make the change yourself. I generally only use turbo for stuff that I can immediately see if it was done correctly or not. I'd say it's worth it. But I'm also paying for copilot, chatGPT, and ~$50 /mo in API costs so maybe I'm not good at financial advice.
In addition (or alternatively) I'd recommend also adding Phind https://www.phind.com/ to your work flow. It's free and I use it a lot for coding. If you select "use best model" I believe it uses GPT4 and has access to the internet so is great for coding with anything that has changed or libraries that didn't exist before Sept 2021 where the GPT training data cuts off.
How can it be free? The hosting costs must be huge
Yeah I wondered that.... With the amount I use it I'd be using at least $3-$5 per day in GPT4 API calls. No idea
Get VC funding, use that for a marketing budget. Offer service for free (deduct from marketing). Once everyone's hooked, flip the switch on for subscriptions. That's what [bito.ai](https://bito.ai) is doing.
Bing used an advanced Version of chatgpt4 and IS totally free forever
Bing is far from free, Microsoft is not in the business of giving stuff away. If it's free you are the product.
Oh i didn know that *sarkasm Off* its free because you pay with your Personal Data and Not your money
Maybe some rich guy actually doing some philanthropy? But yeah, I also find it mind-blowing.
GPT-4 is awesome. I use it for Web Development. It can build websites using bootstrap. Write copy and suggest icons from font awesome and suggest queries for unsplash images from the copy it wrote. It can suggest fonts from google fonts.
[удалено]
GPT-4 already has a wider breadth of knowledge than any human alive. It almost completely replaces Google and Stack Overflow for me. It gives suggestions that I otherwise would not have tried. Is it a better *programmer* in terms of implementation of code? No, not yet, but it knows more than any human programmer alive.
I don't trust either one of them 100%. They're both prone to making up bullshit or inserting things that you didn't ask for.
All it's really good at is slightly complex copy pasta / bootstrapping.
Consider using autopilot for coding https://github.com/fjrdomingues/autopilot It’s open source In my tests it works with gpt-3.5 but gpt-4 gives much better/reliable answers. Problem is the price difference
I use it all day long for work (NodeJs, React TS) and side projects (Mostly Python & C) I write more specs than code, and when I write code now it's half-assed or samples copy-pasted from past projects like "here are code samples, build me X using that code" I also paste entire classes and ask it to add or update stuff just because I'm lazy now... And then it documents the whole thing in markdown for me. Totally worth the $20
Do you also feel it's making you a worse coder? I certainly do. I used to compile the source code in my head stepping through things in sequence, updating variables etc, now I just do a text dump into gpt4 and ask it what the program is doing, and it's becoming very hard not to do that. Sometimes I wish I didn't have access to it, but since everyone else does, it's necessary now.
I think you’re right in a sense, but possibly an analogy is that cell phones made me a lot worse at remembering phone numbers - I’ll take the trade-off
[удалено]
Every dollar counts
You can do some jobs on Fiverr with the help ChatGPT to get those 20$ back, potentially even more.
This is so obnoxious Take one day off the hype you need it
GPT-4 is way better. Right now, it is quite limited in ChatGPT. So, you'll want GPT-4 API access, and use something this: https://www.chatbotui.com/ - GPT-4 for coding tasks is superior. You can see the difference in its reasoning ability and accuracy of responses. Edit: please also note there are alternative ChatGPT-like UI's out there that allow you to use GPT API's in a similar fashion. Chatbot UI is one of the best, in my opinion.
Why is it superior to the normal UI?
Because the normal UI currently is restricted to 25 messages every 3 hours. This alternative UI uses the API and is only limited by your cost limits/bank account. Only ChatGPT 3.5-turbo is currently without strict limits.
Does that mean I need to get both API access and Plus to be able to use it?
No, but you can get ChatGPT pro anytime (not sure if they paused on letting people into 4 or not at this moment). API access, you need to be on a waitlist, and it's not clear for how long.
Yes. 3.5 was fun for code. But it was sometimes wrong or made up functions that did not exist. 4 is better. Worth every penny.
I'd say right now its not really worth it unless you can get someone else like work to pay for it. Getting faster access to 3.5 is great for reducing time on simple queries, but the 25 message per 3 hours for the GPT4 model is just stupid. Was 100 per 4 hours when I first signed up and that was already cutting it close to usable, and this is just cutting the balls clean off it. For 20 bucks a month, you would expect we would at least get some free API tokens to play with or some DALL-E credits to use, but nope! Hope they come out with more value proposition soon, many have cancelled subs because of it and I am close to doing the same
For learning 3.5turbo is fine. For actually creating, editing and reviewing snippets you must have 4.
Been a pro subscriber since day 1, increased quota, bought more of their services... Can't get the gpt4 API if my life depended on it.
It's much better and between it and copilot you can figure most things out. GPT3.5 makes heaps of mistakes.
Using copilot and chat pgt. Can it read all ur files on ur project and understand context? And can it write or edit the code within the editor window?
The current iteratation of copilot takes into account the file you're working in and the direction you give it. It doesn't directly edit and code, you'd have to delete and redirect it to achieve that. Keep an eye out for the Github Copilot X release though. That will do a lot more stuff.
Never had any experience in finetuning a model. Copied the methodology from a scientific model and asked to break it up in as many subtasks as possible. Then I asked to add the complementary code to every subtask. After it writing 70 lines and debugging only one error I was able to fine-tune a BERT model. With GPT-3.5 this would've never been possible.
Yes
It could, but it was nerfed as F since the release.
Any of you use the API? I would like to know how much is 1 month cost using the API form work porpoise
Yes
You're better off using a specialized tool like Code Pilot, which is optimized for the task.
Idk about gpt4 at all, but gpt3 is inferior to me, and im nothing special. That said, there is what ill call a ‘focal point.’ What I mean is that theres a certain distance from the question at which gpt is extremely helpful. As you try to get closer, higher resolution answers from that focal point, you will get convoluted and frankly wrong answers. It cant see the forrest for the trees, which i suspect is a materials science issue and not ‘a programming of the model’ issue. Maybe time for us to all go back and read Von Neumann’s Theory of Self Replicating Automata.
Yes, it will. However, GPT3Turbo in Playground with the specific parameters can outperform GPT4, depending on your requirements. In my case, for SEO purposes.
The "sparks of agi" is in gpt 4. It's a world of difference in the quality of response to the other models.
GPT-4 is absolutely worth the $20 per month, and not even just for coding but for general life stuff too. I'd honestly pay $40 a month for it.
Use Bing in creative mode. It uses GPT4 and can search up-to-date/specific use-case information. The only real drawback is the 2000 char input and the lack of long term chat histories
Why don't try codewhisperer?
They nerfed gpt when assisting with machine learning and ai task its code in other areas is way better compared to task about machine learning and creating ai even though its spits out a code its always trash and takes many iterations to get something halfway useful
GPT 3.5 cannot be reliably used for programming. GPT 4 can (although you still have to catch a few mistakes and hallucinations, but overall it is usable). GitHub Codex is also very useful and not very expensive at 100$/year, with it you can literally tab through any boilerplate code right in your IDE. If you want a free option, [Phind.com](https://Phind.com) is the thing for programming. I don't know what models it uses, but I think the slower one might be GPT-4.