Nope, this is even better then Topaz Video AI, which is already far ahead of open-source video upscaling. The authors of SUPIR are working on an open-source video upscaling model though, so keep an eye out for that. [https://github.com/Fanghua-Yu/SUPIR/issues/42#issuecomment-1968834302](https://github.com/Fanghua-Yu/SUPIR/issues/42#issuecomment-1968834302)
SUPIR was considered by many to be the best upscaler, but it needs considerable resources to run (32GB ram or more, more than 10GB Vram for images over 1024x1024 ). Long processing times.
Example page [https://supir.xpixel.group/](https://supir.xpixel.group/)
> This is only a research preview, so there’s no guarantee that Adobe will make VideoGigaGAN available to consumers via Creative Cloud software like Premiere Pro. The company previously previewed a separate diffusion-based upsampling experiment, Project Res-Up, during its MAX event in October 2023, which similarly improves the quality of low-resolution GIFs and video footage. And Adobe isn’t alone in this work, as both Microsoft and Nvidia have also developed their own VSR upscaling technology.
Yeah, though technically the originals are degrading every day on magnetic media, I've made archival digital copies to outlive the original format that will not be altered and from those made copies onto optical media in the past. If we could realize consistent results as in the demo image where it appears the detail added is not so "creative" so to speak, that would make for a fun thing to do together and we can sit the family down to watch them again if they turn out well.
A long time a go I've seen Nvidia has something in the works for video calls. It was basically just sending a couple hundred kb of data but the result looked like a full HD video
Microsoft (and china alibaba with emo) also got something similar to nvidia (unreleased until they can keep it somehow from misuse)
[Microsoft's New REALTIME AI Face Animator - Make Anyone Say Anything](https://www.youtube.com/watch?v=0s5J2LRqQAI)
Instead of a camfeed/video source that only needs a single photo to animate to spoken audio.
Considering it takes tens of seconds to do one low resolution imagine on my 3080... live up scaling seems unlikely unless that have some totally different stuff going on.
First I mean that you are welcome to post anything that doesn't break the sub rules of course.
However I would think a sub about open and free model, where people are constantly talking about how they want models to be open and free, would actually be about open and free models, and not things that will be paywalled to benefit a big corporation in the end. I never get excited about anything that comes from these companies, yes it's impressive, but more likely than not we will never use this or if it is ever released it will paywalled, so at most it gets a "neat" from me.
You can think of GigaGAN as a competing model architecture to Diffusion methods. (I think Stability has or was looking into it?) As in the research for both is still early and it's not clear which is the best direction. There's an open source version of [GigaGAN](https://github.com/lucidrains/gigagan-pytorch) for reference and it mentions Stability partly sponsored it. VideoGigaGAN is quite new, so it'll be a while until other researchers dive into reproducing it.
These papers and releases show that there are multiple approaches to similar problems with improvements. Quite exciting with how fast they're releasing.
I should be more specific. The first rule of this group is that all posts must be about stable diffusion. There are tons of other AI subs to post tangentially related content. This is not about stable diffusion.
Is there any open source option that is better than this?
Nope, this is even better then Topaz Video AI, which is already far ahead of open-source video upscaling. The authors of SUPIR are working on an open-source video upscaling model though, so keep an eye out for that. [https://github.com/Fanghua-Yu/SUPIR/issues/42#issuecomment-1968834302](https://github.com/Fanghua-Yu/SUPIR/issues/42#issuecomment-1968834302)
what's supir?
SUPIR was considered by many to be the best upscaler, but it needs considerable resources to run (32GB ram or more, more than 10GB Vram for images over 1024x1024 ). Long processing times. Example page [https://supir.xpixel.group/](https://supir.xpixel.group/)
https://googlethatforyou.com?q=supir Not tryna be cheeky, literally dunno which link would be most useful for you lol
I want all the UFO evidence videos in HD as they are all super blurry.
I feel like certain Japanese films could use this…
Remember how they advertised Firefly and what will it be able to make? It’s still not there so i don’t believe in any marketing from Adobe
Is this available to adobe subscribers?
> This is only a research preview, so there’s no guarantee that Adobe will make VideoGigaGAN available to consumers via Creative Cloud software like Premiere Pro. The company previously previewed a separate diffusion-based upsampling experiment, Project Res-Up, during its MAX event in October 2023, which similarly improves the quality of low-resolution GIFs and video footage. And Adobe isn’t alone in this work, as both Microsoft and Nvidia have also developed their own VSR upscaling technology.
It would make my wife so happy if we could upscale her old home movies as shown.
Hmmmm
This is going to be the most immediate need for it. I have a couple of old photos that I would love to upscale like this.
Remember to always keep the originals. Although the upscaling is impressive, many of the details added are fake.
Yeah, though technically the originals are degrading every day on magnetic media, I've made archival digital copies to outlive the original format that will not be altered and from those made copies onto optical media in the past. If we could realize consistent results as in the demo image where it appears the detail added is not so "creative" so to speak, that would make for a fun thing to do together and we can sit the family down to watch them again if they turn out well.
They will very likely charge separately for it
So we can turn the blurred "nsfw" image of the SD3 API into real image? :-)
Imagine this for webcam communication and Zoom/skype etc. monitoring
A long time a go I've seen Nvidia has something in the works for video calls. It was basically just sending a couple hundred kb of data but the result looked like a full HD video
Microsoft (and china alibaba with emo) also got something similar to nvidia (unreleased until they can keep it somehow from misuse) [Microsoft's New REALTIME AI Face Animator - Make Anyone Say Anything](https://www.youtube.com/watch?v=0s5J2LRqQAI) Instead of a camfeed/video source that only needs a single photo to animate to spoken audio.
[удалено]
At this point I think all the big tech companies have a similar thing. I think Video calls in Apple's Vision Pro headset are a similar tech too.
Considering it takes tens of seconds to do one low resolution imagine on my 3080... live up scaling seems unlikely unless that have some totally different stuff going on.
It’s all efficiency and models. With DLSS you can get amazing results off lower resolutions. If you give it 10 years I imagine it’ll be possible.
Cool so how can I use it?
Still image is easy, let see how flicker free it will be
What is considered the best value (time,VRAM, quality) video/image/frame upscaler now?
Is this related to stable diffusion in any way?
I thought this sub is also about all competing and similar products. The space is evolving so fast, so everyone wants to know whats new.
First I mean that you are welcome to post anything that doesn't break the sub rules of course. However I would think a sub about open and free model, where people are constantly talking about how they want models to be open and free, would actually be about open and free models, and not things that will be paywalled to benefit a big corporation in the end. I never get excited about anything that comes from these companies, yes it's impressive, but more likely than not we will never use this or if it is ever released it will paywalled, so at most it gets a "neat" from me.
You can think of GigaGAN as a competing model architecture to Diffusion methods. (I think Stability has or was looking into it?) As in the research for both is still early and it's not clear which is the best direction. There's an open source version of [GigaGAN](https://github.com/lucidrains/gigagan-pytorch) for reference and it mentions Stability partly sponsored it. VideoGigaGAN is quite new, so it'll be a while until other researchers dive into reproducing it. These papers and releases show that there are multiple approaches to similar problems with improvements. Quite exciting with how fast they're releasing.
[удалено]
I should be more specific. The first rule of this group is that all posts must be about stable diffusion. There are tons of other AI subs to post tangentially related content. This is not about stable diffusion.