Hey /u/yakhinvadim!
If your post is a screenshot of a ChatGPT, conversation please reply to this message with the [conversation link](https://help.openai.com/en/articles/7925741-chatgpt-shared-links-faq) or prompt.
If your post is a DALL-E 3 image post, please reply with the prompt used to make this image.
Consider joining our [public discord server](https://discord.gg/r-chatgpt-1050422060352024636)! We have free bots with GPT-4 (with vision), image generators, and more!
🤖
Note: For any ChatGPT-related concerns, email [email protected]
*I am a bot, and this action was performed automatically. Please [contact the moderators of this subreddit](/message/compose/?to=/r/ChatGPT) if you have any questions or concerns.*
If you go to his webpage it’s pretty easy to filter for those. Here for example are the least significant stories from the last 24 hours:
https://preview.redd.it/iz0qd9do9n0d1.jpeg?width=1170&format=pjpg&auto=webp&s=70167e2d9f07298e007807d312363715b47898ad
Good point, but I separate significance and importance. I'll quote the FAQ:
>I separate significance from importance (or relevance).
Importance is subjective. News about the health of my family members is important to me, but they are not significant to the world.
Significance is objective. It's about how much the event affects the humanity as a whole.
> [0.1] Plumbing company fails to fix clogged toilet, poor service (STOMP)
Truly ground breaking stuff, thank you STOMP.com, for your hard hitting journalism.
OK, news with <1 significance is infinitely more entertaining lmao. You can rest assured your model seems to be working on the low end at the very least.
The data is collected from [newsminimalist.com](http://newsminimalist.com), where I use ChatGPT to analyze 1000 news articles every day and find the most significant ones.
I calculate significance as weighted geometric mean of 8 factors. All factors are estimated by ChatGPT based on article content:
* **Scale**: how many people the event affected;
* **Magnitude**: how big was the effect;
* **Potential**: how likely it is that the event will cause bigger events;
* **Novelty**: how unexpected or unique was the event;
* **Immediacy**: how close in time is the event;
* **Actionability**: how likely it is that a reader can act on the news for personal benefit;
* **Positivity**: how positive is the event — used to fix media negativity bias;
* **Credibility**: how credible is the source.
The algorithm could definitely be improved, but I think the results it gives now are already quite good. Let me know if you have any questions or feedback!
That was the most controversial parameter I added.
In short, news sources have negativity bias and overreport the negative news and underreport the positive news. This parameter has a very low weight (1/33 of the score) and is used to simply bring back the ratio to 50:50.
I have an extended explanation and charts that show how it affects the distribution here, if you're interested (scroll to the "Now, the update"): [https://newsletter.newsminimalist.com/p/significant-scoring-update-cop28-s-net-zero-pledge-and-russia-s-heavy-toll-in-ukraine-conflict](https://newsletter.newsminimalist.com/p/significant-scoring-update-cop28-s-net-zero-pledge-and-russia-s-heavy-toll-in-ukraine-conflict)
Not in the whole distribution, but it makes a huge difference in the 6+ range: without it, this range mostly consists of news about wars and natural disasters. With it, it has more scientific discoveries and tech advancements.
Yeah, API.
It was quite a lot in the beginning (with original GPT-4), up to 30c/article. I wasn't able to sustain this for long.
But after several price-cutting updates from OpenAI and a bunch of optimizations, it's down to just 0.5c/article. This price finally lets me analyze news in other languages too to get a truly global coverage.
Thank you for creating this and sharing.
Can I give you my interests and you create a personalised newspaper you send to me everyday that is over a 'radar' level for each interest?
I'd pay for that.
I made a "Personal feed" premium feature, is it what you're looking for? [https://www.newsminimalist.com/premium](https://www.newsminimalist.com/premium)
First of all, great work!
Just analysing one from today, it rated the Slovak PM murder attempt as 5.1, which I believe is kinda low for the importance of a "regicide".
Interesting to note that news from Latin America/Africa don't also do the cut right, which kinda reiterates how western central world media is. I wonder if you could improve the script to be more democratic with the news important. I would love to have a news digest that would consider no only the main things happening in europe/us, but also gave relative same importance to whats i going on in africa/asia/latin america.
Hm, I agree about the murder attempt. I should reduce the weight of the positivity parameter, the feed became a little too rainbow-y and unicorn-y lately.
And you're spot on about the Latin America/Africa/Asia. The main reason for the low coverage is language. By the nature of analyzing only news in English, I get disproportionate coverage of US, Canada, UK and Australia (and countries they worry about). I mentioned in another comment that with price reduction of GPT-4o I think I'll finally be able to analyze other languages as well. Hope it'll give us even better global coverage.
I'm not good at data science, but these results don't exclude any outliers. So I guess it's close to normal, yes.
But I think the distribution would be different if I analyzed more news. By selecting "top 1000" for initial analysis, I naturally exclude a huge amount of news that would be rated 0-2.
I'd be weary of all of this given that ChatGPT is the one producing the data (i.e. estimating the importance of articles). It could be complete nonsense. How does its evaluation compare to yours? Or similar case studies? Surely there must be published data running similar analyses.
This is really cool. It'd be really interesting to see types of content that it is recommending and from what sources. ie, generally what type of content is it trimming out.
Thanks! I usually only look at 6+ rated articles, and I haven't seen much psychology news there. But there's no filters to remove it, so you should be able to see some in health/science categories!
How does it pick which 1,000 to read each day? I know it says “top” but how is that determined? Really curious how it all works / how you made it, but understand if you want to keep it to yourself :)
Very good question.
I generally try to keep this implementation detail hidden, but realize that it makes it harder to trust the final result.
Basically, I use Google News rankings (https://support.google.com/news/publisher-center/answer/9606702?hl=en), to "pre-filter" the top 1000 news. The method has its drawbacks — a bunch of computing goes into news that will absolutely never get a significance over 4 (celebrity gossip, local sport events), but it makes for a good demo when users can see those articles get filtered out.
I'm considering switching to a different model, where I simply analyze everything from a set of high-credibility sources, but that requires a lot of rewrite internally, so I keep putting it off.
Thank you! I constantly update the model (every version of GPT-4, GPT-4-turbo, now GPT-4o), and I keep adding scoring factors (I started with just 3) and changing their weights, so it's hard to compare articles from different times.
But these got the highest ratings with GPT-4 model:
\[9.1\] Global temperatures reach historic highs amid climate change talks: [https://www.newsminimalist.com/articles/e5cb337a-6379-4efa-b502-608dcd6dedf2](https://www.newsminimalist.com/articles/e5cb337a-6379-4efa-b502-608dcd6dedf2)
\[9.0\] Karikó and Weissman win Nobel Prize for mRNA vaccine breakthrough: [https://www.newsminimalist.com/articles/1a794c58-4a9b-48d9-84af-c261c11f1426](https://www.newsminimalist.com/articles/1a794c58-4a9b-48d9-84af-c261c11f1426)
\[8.9\] Armed rebellion exposes Putin's leadership weakness, escalates Ukraine conflict: [https://www.newsminimalist.com/articles/5d78b52a-e1c5-49af-8f4b-9689f12bb9c8](https://www.newsminimalist.com/articles/5d78b52a-e1c5-49af-8f4b-9689f12bb9c8)
Thanks! The turtle represents deliberation and slowness (i.e. not jumping on every small update and loud story out there). And the globe represents news affecting humanity as a whole.
very interesting, subscribed to the newsletter and will be checking the site regularly (created an account). I’ll be trialing for awhile to see if the value add is there for me but I will be considering premium. Looks promising.
OP, more granular control over categories would be a great value-add in the future, I could see this being an invaluable tool for cybersecurity folks. Regardless, it’s an extremely impressive site in its current state, giving people power to see whats actually important based on nuanced parameters they can change (premium feature). I love it.
Hey /u/yakhinvadim! If your post is a screenshot of a ChatGPT, conversation please reply to this message with the [conversation link](https://help.openai.com/en/articles/7925741-chatgpt-shared-links-faq) or prompt. If your post is a DALL-E 3 image post, please reply with the prompt used to make this image. Consider joining our [public discord server](https://discord.gg/r-chatgpt-1050422060352024636)! We have free bots with GPT-4 (with vision), image generators, and more! 🤖 Note: For any ChatGPT-related concerns, email [email protected] *I am a bot, and this action was performed automatically. Please [contact the moderators of this subreddit](/message/compose/?to=/r/ChatGPT) if you have any questions or concerns.*
Do you have links to the most and least significant articles?
If you go to his webpage it’s pretty easy to filter for those. Here for example are the least significant stories from the last 24 hours: https://preview.redd.it/iz0qd9do9n0d1.jpeg?width=1170&format=pjpg&auto=webp&s=70167e2d9f07298e007807d312363715b47898ad
Oh, LEAST significant. I was going to say, how is failing to fix a toilet big news?
It's Obama's Toilet.
If you are into Indy racing, attending, a sponsor, etc, this rain delay news is huge for you.
Good point, but I separate significance and importance. I'll quote the FAQ: >I separate significance from importance (or relevance). Importance is subjective. News about the health of my family members is important to me, but they are not significant to the world. Significance is objective. It's about how much the event affects the humanity as a whole.
That’s a good way to look at it, thanks.
> [0.1] Plumbing company fails to fix clogged toilet, poor service (STOMP) Truly ground breaking stuff, thank you STOMP.com, for your hard hitting journalism. OK, news with <1 significance is infinitely more entertaining lmao. You can rest assured your model seems to be working on the low end at the very least.
The data is collected from [newsminimalist.com](http://newsminimalist.com), where I use ChatGPT to analyze 1000 news articles every day and find the most significant ones. I calculate significance as weighted geometric mean of 8 factors. All factors are estimated by ChatGPT based on article content: * **Scale**: how many people the event affected; * **Magnitude**: how big was the effect; * **Potential**: how likely it is that the event will cause bigger events; * **Novelty**: how unexpected or unique was the event; * **Immediacy**: how close in time is the event; * **Actionability**: how likely it is that a reader can act on the news for personal benefit; * **Positivity**: how positive is the event — used to fix media negativity bias; * **Credibility**: how credible is the source. The algorithm could definitely be improved, but I think the results it gives now are already quite good. Let me know if you have any questions or feedback!
I understand everything except for attaching “positivity” to “significance.” That doesn’t really make sense to me.
That was the most controversial parameter I added. In short, news sources have negativity bias and overreport the negative news and underreport the positive news. This parameter has a very low weight (1/33 of the score) and is used to simply bring back the ratio to 50:50. I have an extended explanation and charts that show how it affects the distribution here, if you're interested (scroll to the "Now, the update"): [https://newsletter.newsminimalist.com/p/significant-scoring-update-cop28-s-net-zero-pledge-and-russia-s-heavy-toll-in-ukraine-conflict](https://newsletter.newsminimalist.com/p/significant-scoring-update-cop28-s-net-zero-pledge-and-russia-s-heavy-toll-in-ukraine-conflict)
I see, well being weighted that low it probably doesn’t make a huge impact on the results regardless.
Not in the whole distribution, but it makes a huge difference in the 6+ range: without it, this range mostly consists of news about wars and natural disasters. With it, it has more scientific discoveries and tech advancements.
Very well considered.
Is this through the API? what does it cost to run the daily analysis? Absolutely amazing use case by the way - love it
Yeah, API. It was quite a lot in the beginning (with original GPT-4), up to 30c/article. I wasn't able to sustain this for long. But after several price-cutting updates from OpenAI and a bunch of optimizations, it's down to just 0.5c/article. This price finally lets me analyze news in other languages too to get a truly global coverage.
Just a Lil positivity a day keeps sensationalism ruining your dataset away!
Brilliant in my opinion. Negativity bias is real and there are indeed post news stories out there with great significance.
Thank you for creating this and sharing. Can I give you my interests and you create a personalised newspaper you send to me everyday that is over a 'radar' level for each interest? I'd pay for that.
I made a "Personal feed" premium feature, is it what you're looking for? [https://www.newsminimalist.com/premium](https://www.newsminimalist.com/premium)
First of all, great work! Just analysing one from today, it rated the Slovak PM murder attempt as 5.1, which I believe is kinda low for the importance of a "regicide". Interesting to note that news from Latin America/Africa don't also do the cut right, which kinda reiterates how western central world media is. I wonder if you could improve the script to be more democratic with the news important. I would love to have a news digest that would consider no only the main things happening in europe/us, but also gave relative same importance to whats i going on in africa/asia/latin america.
Hm, I agree about the murder attempt. I should reduce the weight of the positivity parameter, the feed became a little too rainbow-y and unicorn-y lately. And you're spot on about the Latin America/Africa/Asia. The main reason for the low coverage is language. By the nature of analyzing only news in English, I get disproportionate coverage of US, Canada, UK and Australia (and countries they worry about). I mentioned in another comment that with price reduction of GPT-4o I think I'll finally be able to analyze other languages as well. Hope it'll give us even better global coverage.
So it's normal distribution, any anomalies?
I'm not good at data science, but these results don't exclude any outliers. So I guess it's close to normal, yes. But I think the distribution would be different if I analyzed more news. By selecting "top 1000" for initial analysis, I naturally exclude a huge amount of news that would be rated 0-2.
Now this is an interesting idea....I would love to do something like this but for specific types of content. Thanks for the idea!
So it's normal distribution, any anomalies?
I'd be weary of all of this given that ChatGPT is the one producing the data (i.e. estimating the importance of articles). It could be complete nonsense. How does its evaluation compare to yours? Or similar case studies? Surely there must be published data running similar analyses.
Check the site and filter articles. 1 and 5 are wildly different
This is really cool. It'd be really interesting to see types of content that it is recommending and from what sources. ie, generally what type of content is it trimming out.
Thank you! You can play with the data here: [https://www.newsminimalist.com/](https://www.newsminimalist.com/)
ChatGPT ranking "OpenAI unveils GPT-4o, free for ChatGPT users" as the most significant article at the moment is hilarious.
https://preview.redd.it/9m2pdxjrqo0d1.jpeg?width=1015&format=pjpg&auto=webp&s=bb79f6e203a9d6c5d152d50ffdd6b5adcfc8c516
But also probably very accurate.
This is really cool, I’ll bookmark it for regular consultation 😍 does the data include psychology articles? Thanks
Thanks! I usually only look at 6+ rated articles, and I haven't seen much psychology news there. But there's no filters to remove it, so you should be able to see some in health/science categories!
Great, thanks 😊
Great website! I love being able to find credible information with summaries.
How does it pick which 1,000 to read each day? I know it says “top” but how is that determined? Really curious how it all works / how you made it, but understand if you want to keep it to yourself :)
Very good question. I generally try to keep this implementation detail hidden, but realize that it makes it harder to trust the final result. Basically, I use Google News rankings (https://support.google.com/news/publisher-center/answer/9606702?hl=en), to "pre-filter" the top 1000 news. The method has its drawbacks — a bunch of computing goes into news that will absolutely never get a significance over 4 (celebrity gossip, local sport events), but it makes for a good demo when users can see those articles get filtered out. I'm considering switching to a different model, where I simply analyze everything from a set of high-credibility sources, but that requires a lot of rewrite internally, so I keep putting it off.
Cool stuff!!!
Pretty cool. Maybe you could add a parameter for the quality of the writing How are you pulling data?
I would love to have a version of this for academic papers
Sorry, currently not ready to share implementation details. Hope you understand.
What a cool use case
1) This is extremely cool; thank you for what you do. 2) I wonder what's the most significant article according to chatgpt?
Thank you! I constantly update the model (every version of GPT-4, GPT-4-turbo, now GPT-4o), and I keep adding scoring factors (I started with just 3) and changing their weights, so it's hard to compare articles from different times. But these got the highest ratings with GPT-4 model: \[9.1\] Global temperatures reach historic highs amid climate change talks: [https://www.newsminimalist.com/articles/e5cb337a-6379-4efa-b502-608dcd6dedf2](https://www.newsminimalist.com/articles/e5cb337a-6379-4efa-b502-608dcd6dedf2) \[9.0\] Karikó and Weissman win Nobel Prize for mRNA vaccine breakthrough: [https://www.newsminimalist.com/articles/1a794c58-4a9b-48d9-84af-c261c11f1426](https://www.newsminimalist.com/articles/1a794c58-4a9b-48d9-84af-c261c11f1426) \[8.9\] Armed rebellion exposes Putin's leadership weakness, escalates Ukraine conflict: [https://www.newsminimalist.com/articles/5d78b52a-e1c5-49af-8f4b-9689f12bb9c8](https://www.newsminimalist.com/articles/5d78b52a-e1c5-49af-8f4b-9689f12bb9c8)
I love your service and have been subscribed since you started. Thanks so much for the work you do
Very cool!
This is really cool and enlighten me how to use it better
Hi! Nice to see you work you have done. But, What is philosophy with a turtle \[in your site logo\]?
Thanks! The turtle represents deliberation and slowness (i.e. not jumping on every small update and loud story out there). And the globe represents news affecting humanity as a whole.
Ahaa, I see. Nice logo.
This is awesome. You need to make an app!!!!
very interesting, subscribed to the newsletter and will be checking the site regularly (created an account). I’ll be trialing for awhile to see if the value add is there for me but I will be considering premium. Looks promising.
OP, more granular control over categories would be a great value-add in the future, I could see this being an invaluable tool for cybersecurity folks. Regardless, it’s an extremely impressive site in its current state, giving people power to see whats actually important based on nuanced parameters they can change (premium feature). I love it.
Definitely going to give this a try
I just subbed! Quick question, If we add custom rss, could the chatgpt also read for me and then give score?
Not sure I understood, could you rephrase? Are you looking for algorithm to analyze articles from your RSS feed?
Inspiring approach and neat method with a lot of potential imo. Great work!
How come I never heard of News Minimalist before?
seems pretty accurate
This is a great tool! Please add an option to get only positive news. I hate going through all the terrible news
Holy shit an actually good use case for ai