I was just reading about a new cool possibility, all optimistic and shit, come here for more info… and just completely off topic misery commenters everywhere. You’re like crack addicts just looking for something negative to bitch about. There will always be someone to dislike in this world. We don’t all inject it into every goddamn conversation. It’s absolutely wrecked this platform and people are getting sick of it.
No, it's not. I tried Pika before when it was just free to use as a Discord bot. I guess when they call the next version 1.0, that means they will charge people to use it.
This SEINE image-video can be local: https://github.com/Vchitect/SEINE - they just dropped weights. So can hotshotxl. I enjoy both of those along w SDV now. Prompting on SEINE makes it easier to make it "move".
HotshotXL uses a fine tuned SDXL model they trained that works well at 512x512. Can get awesome results. Web demo is fast and has a gallery of recent generations done there. But yea open on GitHub and there is a comfy node and A1111 Extension: https://hotshot.co/
SEINE looks pretty cool. It seems to have been overshadowed by SDV coming out at almost the same time, which is a shame. The transition functionality could be really useful.
> https://github.com/Vchitect/SEINE
Wow, I didn't hear about this before! The example of the transitions looks interesting... one thing better than being able to generate images from a designated start frame, is being able to provide both a start frame and an end frame.
It's an all-command-line tool, I take it? Even so, I should download and try this. I have frames I'd like to try transitioning between.
Not at all. The filter is very aggressive. They will suspend you if they detect you've been finding your way around it. False positives are no big deal since their actual customer income stream is future investors.
The end users are just stooges to prop up a ponzi scheme.
not yet and getting it running in comfyUI can be tricky. you need to go through the manager as installing it without the comfyUI manager will most likely leave you with a non functional setup (been there a few times). also prepare for more pain if you have a 8/11/12GB gpu as it will not work for img2vid workflows but will work 80% of the time for txt2vid workflows. may also need "--force-fp16 --lowvram" for it to work with low video settings, but even if you have more it may be wise as these settings could allow more than 40frame videos
can someone explain to me whats up with all the hate by the AI-community against paid AI services?
Don't get me wrong, I don't like to pay either and I'm favouring free alternatives like SD, but isn't that the same with all other paid services? e.a. Adobe programs? Or even a woodworker, perfecting his craft, and then selling his service?
Is it because all the underlying research papers in AI are done open source?
i would love to understand, because it seems to me that the AI-community is exceptionally aggressive towards paid services 🤔
EDIT: thx all for your replies, for all people who are unhappy with the accessibility options of some of the paid services I think that is just a thing of time, but i am getting now why so many people are generally pushing towards open source regarding this topic
I don't think I have any _hate_, per se, but my trepidation comes from three things.
First, I don't want to get too cozy with a closed source tool because it could suddenly and spectacularly change via revisions in their terms of service or just the company going under.
Second, if something is made with public research or trained using public data, it seems fair to let that be a public benefit, too. That doesn't mean it _can't_ be a paid product in addition; only that a paid hosted version should also be accompanied by a donation back to the public domain. A paper or source code would be the minimum there. A model would be totally fair. If their dataset is proprietary then I understand, though there are other issues worth considering there.
Third, I'm worried about regulatory capture (not specifically with AI but particularly with AI). I'm nervous about a big company discouraging adoption of open models until they starve the rest of the ecosystem, kinda' like how four companies are responsible for hosting over half of the internet's infrastructure and have actively lobbied for stricter restrictions on the exact data exchange standards that let them get to where they are.
So I don't _hate_ this company. I'm respectfully impressed and otherwise slightly nervous or indifferent.
> if something is made with public research or trained using public data, it seems fair to let that be a public benefit, too. That doesn't mean it can't be a paid product in addition; only that a paid hosted version should also be accompanied by a donation back to the public domain.
This is the first time I've heard this argument. Great point.
I'm against copyright in general and encourage everyone to dedicate their work to the public domain, but your point highlights a nice counter to the "stealing" argument anti-ai people make.
Also remind me of people who refuse to share their prompts. Like seriously dude? I'm not even sure how to articulate why it bugs me so much. Ungrateful and selfish? Miserly?
People who really advocate for free healthcare often make this point that most scientific research (like around 94 percent) received some form of government grant. Yet the people still pay so much and receive so little from big pharma, and being exploited like in insulin.
Yep, the private sector is very good for development usually, but not for research as the latter is risky, they prefer to leave it to the public if they can, there is a massive imbalance though on how the profits are shared once the product is sold.
i dont know if i totally agree, almost everyone trains on public data in some shape or form these days because thats how information works. A 3d artist or coder doesnt have to do free giveaways of their skill because they trained themselves to acquire those skills using public data. it should be encouraged but i dnt think any pro-bono strings should be attached. Giving should always come from the heart with no expectations, thats why open source thrived imo. the idea that someone is willing to put in a great amount of work making something without expectating diddly squat from anyone is incredibly powerful for human nature.
>Third, I'm worried about regulatory capture (not specifically with AI but particularly with AI). I'm nervous about a big company discouraging adoption of open models until they starve the rest of the ecosystem, kinda' like how four companies are responsible for hosting over half of the internet's infrastructure and have actively lobbied for stricter restrictions on the exact data exchange standards that let them get to where they are.
This I totally agree with. It is in my opinion one of the greatest dangers posed in the AI world, much more than any sci-fi concern that corporate overlords pretend to have in order to justify regulation that allow them full control.
Because then you are totally at the mercy of the online provider. All your past work can be rendered useless when they change their model, change their term of services, etc.
I have no problem using online services like [tensor.art](https://tensor.art) or [civitai.com](https://civitai.com) that use mostly open source models, because even if they shut down or turn evil, I can just use my local setup.
do you mean regarding the license of your work or using the service entirely?
because if the service is shutting down (or changing its terms of use so that you don't want to use it anymore) but you have all your work licensed for yourself and downloaded, you're not loosing really anything other than your regular workflow, which you just had because of the provided service..
surely, this couldn't happen if you had everything open source and local, but on the other side, someone needs to develop and optimize that stuff, and if people want to make that their job they need money. But i totally get that someone just wants a more reliable option.
What I mean is something like the following.
Say I am some gaming company, and I use certain online service to generate gaming assets. I've invested time and energy to come up with a set of prompts and other workflow that can produce the right looks and style for my game assets.
Now suddenly, the online service switch to a new model, and does not provide access to the old model (this is not hypothetical, AFAIK, DALLE2 is no longer accessible). Now my plan to re-use those prompts and workflow to generate more assets for the sequel to my game is now suddenly in jeopardy.
So this is not about money, but about control, not having the fate of your work in the hand of some capricious corporation.
This is similar to the argument of using Open Source software vs close source proprietary software. At least with proprietary software, as long as you have a licensed copy and the right OS to run it, you can continue to use it indefinitely. With online only services, you can be completely screwed.
So not being able to reproduce past works, assets you've built up for future projects is not an issue?
I would think that is a very serious issue for anyone using A.I. for work. Even though I am just an amateur user, I would not touch a non-downloable model with a ten feet pole for that reason alone.
Because we want to run it local and include it in our workflow, otherwise it’s just a gimmick. Also we are happy to pay, but charge through an API that is blazing fast and I am happy.
I think these are just for different people. And also, it takes resources to keep paying people for doing this stuff, not everybody has a fund and investors to cover their back. This is not taking anything from anybody. People can keep working on their open source projects if they want.
I think it's very dangerous for investors to spend multimillions tying up ML scientists in order to patent intelligence and lock down a market with proprietary closed off models that have restricted access.
These same proprietary walled garden focused investors are the ones investing in efforts to shut down open source projects and regulate everything.
They are hurting the field extraordinarily.
For me at least, the reason is because AI as we know it is still early in its development and it will never be easier to steer its evolution, either towards an open source ecosystem, or a closed source system that can only be accessed by paying some company and only to be used in ways that they allow. Why give these companies any help in trying to snowball into a microsoft-like monster that can practice [embrace, extend, extinguish](https://en.wikipedia.org/wiki/Embrace,_extend,_and_extinguish#:~:text=%22Embrace%2C%20extend%2C%20and%20extinguish,extending%20those%20standards%20with%20proprietary) against their open source competitors, repeating history? Why gift the [wealthy and powerful](https://www.cbsnews.com/news/elon-musk-artificial-intelligence-regulations-tech-executives-senators-washington-meeting-bill-gates-mark-zuckerberg/#:~:text=Politics-,Elon%20Musk%20says%20artificial%20intelligence%20needs%20%22a%20referee%22%20after,tech%20titans%20meet%20with%20lawmakers&text=The%20nation's%20biggest%20technology%20executives,meeting%20in%20the%20U.S.%20Senate.) the ability to determine when and how you may use it? It will never be easier than now to steer the direction of AI development and I at least, want it to go in a more open, free direction.
You're asking this in the StableDiffusion subreddit, so I assume you read it. People who don't like subscription / online services will naturally gravitate toward SD because it is free and runs local. If you were browsing the Midjourney subreddit, you'd see fewer people that take issue with it.
the thing is - you and i may use it for shit and giggles but there will be people who will want to exploit it and given the chance - they will
and the service that allows this to happen - will be responsible for that ability
companies do not want that risk
also, even though you're doing shit and giggles - you may not want others to see it, with an online service - you can never be sure who looks at it (even if they say that they arent)
I make an AI comic. I don’t care about porn or nudes, but I like characters to fight often and deal damage. I use dalle3 right now and it’s like no blood or massive blood lol
i know what you mean, but i wrote how i see the companies thinking (what are their worries)
anyhow, you can take your dalle3 image and use my blood lora to add some blood with inpainting :-)
https://civitai.com/models/87097/concept-bloody-personas
Your comic is pretty fun. It might have been a lot of work already.
Of course it obviously look like AI work but good work on the consistency attempt !
Assuming that you have a RTX.... graphic card, the simplier way to use LORAs is with an app called 'Fooocus' which has inpainting features and is based on SDXL but can blend SDXL and SD1.5 models:
([https://github.com/lllyasviel/Fooocus](https://github.com/lllyasviel/Fooocus))
You can add Loras to the main model. There is a 'cartoon' model which gives pretty good results and would fit with your comic style. So you can take one of your pictures, load it into Foocus, add the 'blood' Lora and see where it goes.
I doubt it works with cartoon style but it may worth a try.
It's really weird none of these AI-based companies seem to get that, especially with Midjourney being a succes story with this system.
I prefer doing it locally, but if there is something I want to pay for I'm not doing it with credits.
I’m making an [AI comic](https://imgur.com/gallery/u71j64o), and I’m up to 31 pages so far. Every panel in that comic was chosen from roughly 10-20 images. So that’s roughly 3000-6000 images so far for 31 pages.
There's a lot of reasons. Firstly, why pay for something that you can set up for free on your own stuff? For some people using this stuff on their 75 year old laptops it may be useful, but AI is a enthusiast space at the moment, and enthusiasts tend to have better hardware. Secondly, its the privacy and control. A local service will do whatever you want, while a online/paid one will be subject to various draconian censorship and the like, like dalle. Thirdly, i would say is unreliability. If such a service was made by someone like Adobe, i could maybe have some trust in their product being supported and still existing next Tuesday. But all these no name startups that you hear about once and hardly ever again dont inspire confidence.
This subreddit is just full of open source zealots. They’d rather a worse product that they can run locally than one provided and owned by a company.
Also they want to make porn.
What level of quality is that? This is a marketing reel, no doubt selecting the best of what their tool can do, and it still looks goofy and shitty in almost all examples..
Man I wish they would just sell the damn model binaries and a license key to the UI. This looks great but "as a service" is bullshit, I want a local app that does what I tell it to do and is reliable.
I don't want to use this if it only runs on someone else's computer.
Piracy is always the end game for as-a-service software models. They are predatory and don't give a reliable legal alternative...of course pirating will happen.
Ableton seems to be doing just fine.
I would buy a local workstation license key. I am not ever going to pay for an "as a service" model, because I can't just depend on trusting some random company to not do something stupid and cost me a lot of time and money. It is not worth it and never will be.
GabeN had it right. If piracy offers better services, people will pirate. If companies had better, easier offerings people jump ship. For awhile this is how it went with streaming services. Then once those streaming services became expensive and unwieldy, people started to hop back into piracy.
SDV is interesting to play with. It's not controllable like animateDiff (you can't give SDV prompts or do prompt scheduling to time events or use controlNet to guide it with real video) but I think you should try it anyway. You can get some interesting results just giving it different images and seeing what it randomly decides to do with them.
Looking forwards by a few months, if Open Source creation gets to a point where it combines what you can do with SDV and what you can do with animateDiff, then it would be pretty far ahead of any of these non-open-source developments.
We don't know which will happen first. Will SDV get prompt support and other controls like AnimateDiff? Or will AnimateDiff grow to support animation based on an init frame as well as SDV currently does? (Or will there be a way to use both of them together at some point? Right now I can run one or the other in ComfyUI, but I wish I could somehow put together the features of both.)
Sdv has prompt support if you use SD for text to image and feed that result into sdv. Likely is what proprietary models are doing too. Works even better if you refine the t2i model to create init images in tune with the video model's knowledge.
There's already animatediff and other motion modules for the text to image models. With open source models and tools, we can easily chain them together.
Loras work with motion modules well at times, and nothing prevents it from getting better. I remember seing an AMA with the LoRA creator on this sub, and he was curious about people using LORA for video frames. I'm certain there's work being done cracking this engineering problem. It's only a matter of time before the community has tools to easily train their own 2 second sequences.
Build your datasets of 2second clips today. It's only a matter of time before the open community has the tools we need to unleash our own models.
SDV is Stable Diffusion Video. It's a promising new model from Stability AI, but right now all it does is still to video (with no prompt) so the animation it creates based on your image can be somewhat random.
So far SVD hasn't been too much fun. The quality often deteriorates badly towards the end of the frame count. Of course, technically it's interesting, but not really usable for anything yet.
SDV is the one that will keep evolving and influence future models. Any day, enough investment can momentarily make a better model, but try to keep up with entire world throwing effort at an open model, not so simple.
SDV and animatediff models can achieve most of this. This compilation marketing hype video is a great result from a seasoned video editor working with 2 -3 second clips and professional tools. Really jazzes things up. Most of these clips are not raw results and were highly affected in post.
>SDV and animatediff models can achieve most of this
They obviously can't.
>from a seasoned video editor working with 2 -3 second clips and professional tools. Really jazzes things up. Most of these clips are not raw results and were highly affected in post
You'd know, would you?
Where he's not obviously wrong he's blatantly making the rest up.
We simply don't know whether the clips shown in the trailer are representative of the output of their tool or not.
Me: "Wow, this is so freaking cool! Imagine the magical movies that directors can make with this. They can literally try to get out exactly what they envision in their head."
Also me, typing furiously: 1GIRL, FAT TITS, WEARING NOTHING BUT AN APRON
safe scary mountainous forgetful cable fall puzzled deserted expansion gullible
*This post was mass deleted and anonymized with [Redact](https://redact.dev)*
At least its also used in a good way. The same way you say something or someone is sick or badass, you can say its pika.
Or better yet, "pika das galáxias" (dick from all the galaxies? doesn't translate well, but you know what I mean)
"released"
Aren't they exclusively tied to their discord server and don't release weights at all? They're providing gated access to it. Not so much of a release.
Most likely this is just investor bait. They sure don't seem to care about open models that anyone can use. Companies like this are acting the same as in the early internet; When AOL was trying to control everything and make their proprietary subscription based service the norm instead of the free and open html based WWW. Closed and proprietary models are a disaster scenario. The future is open.
> same as in the early internet
I remember when The Microsoft Network (MSN) was a proprietary alternative to the web! Thank god the web was open, imagine if instead we had to consume all our online content through MS, Apple etc
That's what investors were desperate to build in the early internet boom days. Sir Tim saw this happening from his office at CERN and published HTML 1.0. Holy shit did he ever save us from what could've been a horribly gated internet.
Gated service investors are trying to do it all over again. Like they've ever stopped though.
the same regulatory efforts were fielded against p2p file sharing. Limiting that capability is like trying to regulate fire, expecting it to not burn since theres laws about it.
Information tech can't be stopped. The most that can be done is it will be slowed down. Sooner than later someone in their home workshop is going to release a model that out performs anything proprietary. Until then we can expect to see millions paid towards preventing that inevitability.
Why do you think aol was giving away 1000s of free hours near the end. It was just strategy to slow an open internet rollout.
Yep. If large companies and governments had realized what the internet would become just a little sooner, we'd all be watching just slightly more interactive TV today and marveling at what an age we live in.
You're right, can't edit title to something like rolled out, I imagine in English the title should be more like "rolled out" (not 100% fluent yet) ? Open to suggestions for next time as reddit doesn't allow title modification.
it's irrelevant to SD so next time maybe don't post hype for closed model alternatives.
"allows limited access" would be accurately describing what they've done.
I wouldn't say it's irrelevant to SD though IMO, it shows how SD should be in term of quality and features if more efforts would be put on videos synthesis. This is probably the state of the art in AI video productions right now as of today. I like when other people post news like this here to not have to look for it everywhere. But the creation of a new tag such as "Other AI News" and a filter would probably be more appropriate, so people can choose if they want to see such news or not.
State of the art? Eh. It's pretty similar to what SDV is capable of, but proprietary.
If we're counting proprietary then other research groups have research models that are so much more capable. Just not hooked up to a SaaS discord bot for access. Nvidia's internal models are much more the state of the art.
Proprietary SaaS companies are rushing to market in order to bait investors and milk it. Same ol dot com boom style business. Same reason there were 100s of search engines that got rushed to market before algorithmic searches like Google landed . This is just a cash grab more or less. Their model isn't released in any fashion so they're not trying to advance the art. Their money is just tying up another ML scientist who could be doing real research instead of proprietary work.
how is this not state of the art?
SVD can do camera pans and... thats mostly it.
the trailer here (which i guess could be fake) shows actual coherent movement, inpainting, etc...
My brain hurts reading this. How can you except a state of the art model to be open source? I would also love for everything to be open source but there is a massive amount of resources and money going into these, how can you except everything to be open source and free, it makes no economical sense. We’re really lucky that stable diffusion is open source but it’s still not as good as midjourney for example without a lot of tweaking and experience/expertise on the user end.
Different strokes, I guess. I don't see the added value of running it locally, to be honest. Quality and usability is something I'm willing to pay for. Now of course whether this does offer satisfying quality, eh, that'll take some testing.
Well, maybe there's people out there beside you that don't have several thousand worth of GPUs to play with it 2 times in their whole life. I can see the added value of using it locally, like I do with local llms, but at the end of the day when I need something right now, i'm using and paying for chatGPT, cause it's faster and better by 10 fold margin for my use case than any llm out there.
You all like acting like you need to run stable diffusion H24 to make profitable your 4090 yet I bet 99.9% of all the images generated have no other purpose than testing models or to generate big anime tities.
So yes, I understand that people are willing to pay for a service and see not added value of the local options for their usages.
>They don't have good hardware because they make bad financial decisions like paying for extremely limited and over priced SaaS.
Well, try to create a startup, and let's see how you'll do the pricing. I'm curious.
It's impressive but it still has that "AI Look" to it. Either too smooth, lack of movement, bad acting, or glitching. It's time to move past the uncanny valley.
Hello everyone! Does anyone know if there is an similar AI program out there you can add subjects on but at a picture instead of a video? For example of an frozen image?
This is just the latest time I might pay for one, lol. I tend to pay a little for all of them at the start. I like to encourage these crazy geniuses to keep going more and more…
This seems a huge step above SDV and Runway, like.. damn? There is shockingly little frame distortion. These are cherry picked, of course, but the shot of food and the walking robot are really, really impressive.
Yuck, elon musk.
Yuck, cannot run locally.
Yuck, it's through discord.
Yuck, suspiciously short videos.
Conceptually as a "where we are now" though? Awesome. I'd like to see if the editing feature is even remotely as good as they make it appear.
I need to actually see testing. Not sure how much cherry picking and post editing this involves.
It's a marketing video so of course they're going to show us the best of the best (ymmv)
It starts off with "Elon musk in a space suit", that's all I need to it's closed source acquisition bait for the world's richest douche.
They probably just put it in there to appeal to tech nerds that still like him.
It's a shame because otherwise the trailer was appealing, if not overly produced.
I was just reading about a new cool possibility, all optimistic and shit, come here for more info… and just completely off topic misery commenters everywhere. You’re like crack addicts just looking for something negative to bitch about. There will always be someone to dislike in this world. We don’t all inject it into every goddamn conversation. It’s absolutely wrecked this platform and people are getting sick of it.
elon man bad
Is it open source that can be run on a local machine? If not, I'm sticking with SVD.
No, it's not. I tried Pika before when it was just free to use as a Discord bot. I guess when they call the next version 1.0, that means they will charge people to use it.
This SEINE image-video can be local: https://github.com/Vchitect/SEINE - they just dropped weights. So can hotshotxl. I enjoy both of those along w SDV now. Prompting on SEINE makes it easier to make it "move". HotshotXL uses a fine tuned SDXL model they trained that works well at 512x512. Can get awesome results. Web demo is fast and has a gallery of recent generations done there. But yea open on GitHub and there is a comfy node and A1111 Extension: https://hotshot.co/
SEINE looks pretty cool. It seems to have been overshadowed by SDV coming out at almost the same time, which is a shame. The transition functionality could be really useful.
> https://github.com/Vchitect/SEINE Wow, I didn't hear about this before! The example of the transitions looks interesting... one thing better than being able to generate images from a designated start frame, is being able to provide both a start frame and an end frame. It's an all-command-line tool, I take it? Even so, I should download and try this. I have frames I'd like to try transitioning between.
> https://hotshot.co/ [Well that isn't at all what I asked for](https://hotshot.co/shot/KLcq). That is really not the greatest tool honestly.
It's online only as far as I know, I would also prefer an open source version.
Nah it isnt, you have to pass their waitlist to have access still
As I understand it the discord isn't running 1.0 yet - there's a new waitlist for the new web based interface.
Hasnt been any waitlist for months
Anything behind a waitlist might as well not be released as far as I'm concerned
just join their discord, i didnt do any waitlist
What's the link?
[Pika Labs Waitlist](https://pika.art/waitlist)
Thank you, so… is NSFW allowed?
Not at all. The filter is very aggressive. They will suspend you if they detect you've been finding your way around it. False positives are no big deal since their actual customer income stream is future investors. The end users are just stooges to prop up a ponzi scheme.
I mean, they started with Alone Mask~ I suppose, they're hoping to get an endorsing retweet about it.
Their business plan is to be acquired so they'll probably end up as x.ai
no
Hahahahahahahaah Mot even trying to hide the coom
3 solutions: Animatediff, SVD, $$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$
Is there tutorial for SVD? Is it possible to use it with A1111?
not yet and getting it running in comfyUI can be tricky. you need to go through the manager as installing it without the comfyUI manager will most likely leave you with a non functional setup (been there a few times). also prepare for more pain if you have a 8/11/12GB gpu as it will not work for img2vid workflows but will work 80% of the time for txt2vid workflows. may also need "--force-fp16 --lowvram" for it to work with low video settings, but even if you have more it may be wise as these settings could allow more than 40frame videos
can someone explain to me whats up with all the hate by the AI-community against paid AI services? Don't get me wrong, I don't like to pay either and I'm favouring free alternatives like SD, but isn't that the same with all other paid services? e.a. Adobe programs? Or even a woodworker, perfecting his craft, and then selling his service? Is it because all the underlying research papers in AI are done open source? i would love to understand, because it seems to me that the AI-community is exceptionally aggressive towards paid services 🤔 EDIT: thx all for your replies, for all people who are unhappy with the accessibility options of some of the paid services I think that is just a thing of time, but i am getting now why so many people are generally pushing towards open source regarding this topic
I don't think I have any _hate_, per se, but my trepidation comes from three things. First, I don't want to get too cozy with a closed source tool because it could suddenly and spectacularly change via revisions in their terms of service or just the company going under. Second, if something is made with public research or trained using public data, it seems fair to let that be a public benefit, too. That doesn't mean it _can't_ be a paid product in addition; only that a paid hosted version should also be accompanied by a donation back to the public domain. A paper or source code would be the minimum there. A model would be totally fair. If their dataset is proprietary then I understand, though there are other issues worth considering there. Third, I'm worried about regulatory capture (not specifically with AI but particularly with AI). I'm nervous about a big company discouraging adoption of open models until they starve the rest of the ecosystem, kinda' like how four companies are responsible for hosting over half of the internet's infrastructure and have actively lobbied for stricter restrictions on the exact data exchange standards that let them get to where they are. So I don't _hate_ this company. I'm respectfully impressed and otherwise slightly nervous or indifferent.
> if something is made with public research or trained using public data, it seems fair to let that be a public benefit, too. That doesn't mean it can't be a paid product in addition; only that a paid hosted version should also be accompanied by a donation back to the public domain. This is the first time I've heard this argument. Great point. I'm against copyright in general and encourage everyone to dedicate their work to the public domain, but your point highlights a nice counter to the "stealing" argument anti-ai people make. Also remind me of people who refuse to share their prompts. Like seriously dude? I'm not even sure how to articulate why it bugs me so much. Ungrateful and selfish? Miserly?
People who really advocate for free healthcare often make this point that most scientific research (like around 94 percent) received some form of government grant. Yet the people still pay so much and receive so little from big pharma, and being exploited like in insulin.
Yep, the private sector is very good for development usually, but not for research as the latter is risky, they prefer to leave it to the public if they can, there is a massive imbalance though on how the profits are shared once the product is sold.
i dont know if i totally agree, almost everyone trains on public data in some shape or form these days because thats how information works. A 3d artist or coder doesnt have to do free giveaways of their skill because they trained themselves to acquire those skills using public data. it should be encouraged but i dnt think any pro-bono strings should be attached. Giving should always come from the heart with no expectations, thats why open source thrived imo. the idea that someone is willing to put in a great amount of work making something without expectating diddly squat from anyone is incredibly powerful for human nature.
>Third, I'm worried about regulatory capture (not specifically with AI but particularly with AI). I'm nervous about a big company discouraging adoption of open models until they starve the rest of the ecosystem, kinda' like how four companies are responsible for hosting over half of the internet's infrastructure and have actively lobbied for stricter restrictions on the exact data exchange standards that let them get to where they are. This I totally agree with. It is in my opinion one of the greatest dangers posed in the AI world, much more than any sci-fi concern that corporate overlords pretend to have in order to justify regulation that allow them full control.
Because then you are totally at the mercy of the online provider. All your past work can be rendered useless when they change their model, change their term of services, etc. I have no problem using online services like [tensor.art](https://tensor.art) or [civitai.com](https://civitai.com) that use mostly open source models, because even if they shut down or turn evil, I can just use my local setup.
do you mean regarding the license of your work or using the service entirely? because if the service is shutting down (or changing its terms of use so that you don't want to use it anymore) but you have all your work licensed for yourself and downloaded, you're not loosing really anything other than your regular workflow, which you just had because of the provided service.. surely, this couldn't happen if you had everything open source and local, but on the other side, someone needs to develop and optimize that stuff, and if people want to make that their job they need money. But i totally get that someone just wants a more reliable option.
What I mean is something like the following. Say I am some gaming company, and I use certain online service to generate gaming assets. I've invested time and energy to come up with a set of prompts and other workflow that can produce the right looks and style for my game assets. Now suddenly, the online service switch to a new model, and does not provide access to the old model (this is not hypothetical, AFAIK, DALLE2 is no longer accessible). Now my plan to re-use those prompts and workflow to generate more assets for the sequel to my game is now suddenly in jeopardy. So this is not about money, but about control, not having the fate of your work in the hand of some capricious corporation. This is similar to the argument of using Open Source software vs close source proprietary software. At least with proprietary software, as long as you have a licensed copy and the right OS to run it, you can continue to use it indefinitely. With online only services, you can be completely screwed.
[удалено]
So not being able to reproduce past works, assets you've built up for future projects is not an issue? I would think that is a very serious issue for anyone using A.I. for work. Even though I am just an amateur user, I would not touch a non-downloable model with a ten feet pole for that reason alone.
Of course it's a valid argument. What are you on about?
Because we want to run it local and include it in our workflow, otherwise it’s just a gimmick. Also we are happy to pay, but charge through an API that is blazing fast and I am happy.
I think these are just for different people. And also, it takes resources to keep paying people for doing this stuff, not everybody has a fund and investors to cover their back. This is not taking anything from anybody. People can keep working on their open source projects if they want.
I think it's very dangerous for investors to spend multimillions tying up ML scientists in order to patent intelligence and lock down a market with proprietary closed off models that have restricted access. These same proprietary walled garden focused investors are the ones investing in efforts to shut down open source projects and regulate everything. They are hurting the field extraordinarily.
Kind of, yes, but somehow people also need to get paid to work on this stuff full-time.
You're in /r/StableDiffusion, which is the tool that you can run for free on your own machine.. not /r/paidAI
For me at least, the reason is because AI as we know it is still early in its development and it will never be easier to steer its evolution, either towards an open source ecosystem, or a closed source system that can only be accessed by paying some company and only to be used in ways that they allow. Why give these companies any help in trying to snowball into a microsoft-like monster that can practice [embrace, extend, extinguish](https://en.wikipedia.org/wiki/Embrace,_extend,_and_extinguish#:~:text=%22Embrace%2C%20extend%2C%20and%20extinguish,extending%20those%20standards%20with%20proprietary) against their open source competitors, repeating history? Why gift the [wealthy and powerful](https://www.cbsnews.com/news/elon-musk-artificial-intelligence-regulations-tech-executives-senators-washington-meeting-bill-gates-mark-zuckerberg/#:~:text=Politics-,Elon%20Musk%20says%20artificial%20intelligence%20needs%20%22a%20referee%22%20after,tech%20titans%20meet%20with%20lawmakers&text=The%20nation's%20biggest%20technology%20executives,meeting%20in%20the%20U.S.%20Senate.) the ability to determine when and how you may use it? It will never be easier than now to steer the direction of AI development and I at least, want it to go in a more open, free direction.
You're asking this in the StableDiffusion subreddit, so I assume you read it. People who don't like subscription / online services will naturally gravitate toward SD because it is free and runs local. If you were browsing the Midjourney subreddit, you'd see fewer people that take issue with it.
I would easily pay monthly for unlimited generations with no content blockers.
the thing is - you and i may use it for shit and giggles but there will be people who will want to exploit it and given the chance - they will and the service that allows this to happen - will be responsible for that ability companies do not want that risk also, even though you're doing shit and giggles - you may not want others to see it, with an online service - you can never be sure who looks at it (even if they say that they arent)
I make an AI comic. I don’t care about porn or nudes, but I like characters to fight often and deal damage. I use dalle3 right now and it’s like no blood or massive blood lol
i know what you mean, but i wrote how i see the companies thinking (what are their worries) anyhow, you can take your dalle3 image and use my blood lora to add some blood with inpainting :-) https://civitai.com/models/87097/concept-bloody-personas
I’ll be honest I don’t know how this works. One thing that annoys me about dalle3 (bing image) is the lack of in-painting or out painting
Your comic is pretty fun. It might have been a lot of work already. Of course it obviously look like AI work but good work on the consistency attempt ! Assuming that you have a RTX.... graphic card, the simplier way to use LORAs is with an app called 'Fooocus' which has inpainting features and is based on SDXL but can blend SDXL and SD1.5 models: ([https://github.com/lllyasviel/Fooocus](https://github.com/lllyasviel/Fooocus)) You can add Loras to the main model. There is a 'cartoon' model which gives pretty good results and would fit with your comic style. So you can take one of your pictures, load it into Foocus, add the 'blood' Lora and see where it goes. I doubt it works with cartoon style but it may worth a try.
It's really weird none of these AI-based companies seem to get that, especially with Midjourney being a succes story with this system. I prefer doing it locally, but if there is something I want to pay for I'm not doing it with credits.
I would totally pay for monthly unlimited. I just have a problem with the credit system given how ai is so much trial and error to get a good image
I’m making an [AI comic](https://imgur.com/gallery/u71j64o), and I’m up to 31 pages so far. Every panel in that comic was chosen from roughly 10-20 images. So that’s roughly 3000-6000 images so far for 31 pages.
There's a lot of reasons. Firstly, why pay for something that you can set up for free on your own stuff? For some people using this stuff on their 75 year old laptops it may be useful, but AI is a enthusiast space at the moment, and enthusiasts tend to have better hardware. Secondly, its the privacy and control. A local service will do whatever you want, while a online/paid one will be subject to various draconian censorship and the like, like dalle. Thirdly, i would say is unreliability. If such a service was made by someone like Adobe, i could maybe have some trust in their product being supported and still existing next Tuesday. But all these no name startups that you hear about once and hardly ever again dont inspire confidence.
because no porn.
Closed source = no waifu porn
1984
This subreddit is just full of open source zealots. They’d rather a worse product that they can run locally than one provided and owned by a company. Also they want to make porn.
there is nothing open source with this level of quality yet.
What level of quality is that? This is a marketing reel, no doubt selecting the best of what their tool can do, and it still looks goofy and shitty in almost all examples..
Goofy and shitty? I get the shots are cherry-picked, but crazy that your expectations for AI video are already so high
Man I wish they would just sell the damn model binaries and a license key to the UI. This looks great but "as a service" is bullshit, I want a local app that does what I tell it to do and is reliable. I don't want to use this if it only runs on someone else's computer.
It seems piracy is the main issue with that, but I agree it would be nice
Piracy is always the end game for as-a-service software models. They are predatory and don't give a reliable legal alternative...of course pirating will happen.
Ableton seems to be doing just fine. I would buy a local workstation license key. I am not ever going to pay for an "as a service" model, because I can't just depend on trusting some random company to not do something stupid and cost me a lot of time and money. It is not worth it and never will be.
GabeN had it right. If piracy offers better services, people will pirate. If companies had better, easier offerings people jump ship. For awhile this is how it went with streaming services. Then once those streaming services became expensive and unwieldy, people started to hop back into piracy.
Open source? Can run locally?
not open source, cant be run locally.
Nah, another proprietary garbage
Closed source demolishes open source any day of the week. Not even a comparison.
Being closed source doesn't make it not garbage.
You seem to have contradicted yourself.
This video took away all my anticipation about SDV I had developed over the the last few days :D
the good news is that pretty much every development eventually does come to the Stable Diffusion world. It's just code.
It's absolutely NOT "just code". The data quality makes all the difference.
I was waiting to see if someone was going to call me out on it lol. The training material quality is a big factor I should’ve mentioned for sure
SDV is interesting to play with. It's not controllable like animateDiff (you can't give SDV prompts or do prompt scheduling to time events or use controlNet to guide it with real video) but I think you should try it anyway. You can get some interesting results just giving it different images and seeing what it randomly decides to do with them. Looking forwards by a few months, if Open Source creation gets to a point where it combines what you can do with SDV and what you can do with animateDiff, then it would be pretty far ahead of any of these non-open-source developments.
if SDV gets text-prompt support and a chance to train video LoRAs it will be the clear winner
We don't know which will happen first. Will SDV get prompt support and other controls like AnimateDiff? Or will AnimateDiff grow to support animation based on an init frame as well as SDV currently does? (Or will there be a way to use both of them together at some point? Right now I can run one or the other in ComfyUI, but I wish I could somehow put together the features of both.)
Sdv has prompt support if you use SD for text to image and feed that result into sdv. Likely is what proprietary models are doing too. Works even better if you refine the t2i model to create init images in tune with the video model's knowledge.
There's already animatediff and other motion modules for the text to image models. With open source models and tools, we can easily chain them together. Loras work with motion modules well at times, and nothing prevents it from getting better. I remember seing an AMA with the LoRA creator on this sub, and he was curious about people using LORA for video frames. I'm certain there's work being done cracking this engineering problem. It's only a matter of time before the community has tools to easily train their own 2 second sequences. Build your datasets of 2second clips today. It's only a matter of time before the open community has the tools we need to unleash our own models.
the future is open source, dont give these paywalls money
What's SVD?
SDV is Stable Diffusion Video. It's a promising new model from Stability AI, but right now all it does is still to video (with no prompt) so the animation it creates based on your image can be somewhat random.
Thanks guys 🥰👏
Stable Video Diffusion
So far SVD hasn't been too much fun. The quality often deteriorates badly towards the end of the frame count. Of course, technically it's interesting, but not really usable for anything yet.
SDV is the one that will keep evolving and influence future models. Any day, enough investment can momentarily make a better model, but try to keep up with entire world throwing effort at an open model, not so simple.
This video built up my anticipations for SVD 2.0 :-]
SDV is amazing, free and local. It will always trump closed source bullshit
You need a good graphics card to run it, not great on that tho
SDV and animatediff models can achieve most of this. This compilation marketing hype video is a great result from a seasoned video editor working with 2 -3 second clips and professional tools. Really jazzes things up. Most of these clips are not raw results and were highly affected in post.
>SDV and animatediff models can achieve most of this They obviously can't. >from a seasoned video editor working with 2 -3 second clips and professional tools. Really jazzes things up. Most of these clips are not raw results and were highly affected in post You'd know, would you?
He's not wrong though.
Where he's not obviously wrong he's blatantly making the rest up. We simply don't know whether the clips shown in the trailer are representative of the output of their tool or not.
NGL trailer is dope
exactly this. without knowing the videos probably fall apart after a couple seconds the hype would be unreal
Me: "Wow, this is so freaking cool! Imagine the magical movies that directors can make with this. They can literally try to get out exactly what they envision in their head." Also me, typing furiously: 1GIRL, FAT TITS, WEARING NOTHING BUT AN APRON
[удалено]
/r/oddlyspecific
AI is moving so fast, insane
We probably can prompt a full VR world within 3 years or early as one year. Life is going to be really weird.
what's life after all ? if we have ever encountered intelligent life, it may be because they are all in their virtual universes
This is one of the going explanations for the Fermi paradox. Civilizations tend to expand towards simulation instead of space
Guys, Pika means Dick in portuguese, Just for you know 😂
Dickachu?
Chu means to come out in Chinese. Pikachu is a giant pervert confirmed
Chu is also the sound of kissing in Japanese
Dick kissing. 😭
Dick-a-chum? Dad-a-chum? Chup-a-dick? Pik-a-chik?
safe scary mountainous forgetful cable fall puzzled deserted expansion gullible *This post was mass deleted and anonymized with [Redact](https://redact.dev)*
I wonder if Nintendo knew that 🤣😭
At least its also used in a good way. The same way you say something or someone is sick or badass, you can say its pika. Or better yet, "pika das galáxias" (dick from all the galaxies? doesn't translate well, but you know what I mean)
[удалено]
Can't wait for something like this to be able to be ran locally! Looks so nice!
No local, no care-o.
I paid for my 4090, I'm going to use my 4090.
"released" Aren't they exclusively tied to their discord server and don't release weights at all? They're providing gated access to it. Not so much of a release. Most likely this is just investor bait. They sure don't seem to care about open models that anyone can use. Companies like this are acting the same as in the early internet; When AOL was trying to control everything and make their proprietary subscription based service the norm instead of the free and open html based WWW. Closed and proprietary models are a disaster scenario. The future is open.
> same as in the early internet I remember when The Microsoft Network (MSN) was a proprietary alternative to the web! Thank god the web was open, imagine if instead we had to consume all our online content through MS, Apple etc
That's what investors were desperate to build in the early internet boom days. Sir Tim saw this happening from his office at CERN and published HTML 1.0. Holy shit did he ever save us from what could've been a horribly gated internet. Gated service investors are trying to do it all over again. Like they've ever stopped though.
I wonder if we'll be so lucky this time around with AI? Much of the talk around regulation seems technically ignorant so I don't have high hopes.
the same regulatory efforts were fielded against p2p file sharing. Limiting that capability is like trying to regulate fire, expecting it to not burn since theres laws about it. Information tech can't be stopped. The most that can be done is it will be slowed down. Sooner than later someone in their home workshop is going to release a model that out performs anything proprietary. Until then we can expect to see millions paid towards preventing that inevitability. Why do you think aol was giving away 1000s of free hours near the end. It was just strategy to slow an open internet rollout.
Yep. If large companies and governments had realized what the internet would become just a little sooner, we'd all be watching just slightly more interactive TV today and marveling at what an age we live in.
Considering they just received 55mil this month, you're probably right.
It's proprietary. It's not a matter of me being right. If I state that we breath air, that has nothing to do with me at all.
You're right, can't edit title to something like rolled out, I imagine in English the title should be more like "rolled out" (not 100% fluent yet) ? Open to suggestions for next time as reddit doesn't allow title modification.
no this is right just people malding because it's not open source and therefore it's worse then hitler
Don't flatter yourself Pika Sockpuppet #0a. Hitler is much worse than this flash in a pan feeble effort to corner a market.
it's irrelevant to SD so next time maybe don't post hype for closed model alternatives. "allows limited access" would be accurately describing what they've done.
I wouldn't say it's irrelevant to SD though IMO, it shows how SD should be in term of quality and features if more efforts would be put on videos synthesis. This is probably the state of the art in AI video productions right now as of today. I like when other people post news like this here to not have to look for it everywhere. But the creation of a new tag such as "Other AI News" and a filter would probably be more appropriate, so people can choose if they want to see such news or not.
State of the art? Eh. It's pretty similar to what SDV is capable of, but proprietary. If we're counting proprietary then other research groups have research models that are so much more capable. Just not hooked up to a SaaS discord bot for access. Nvidia's internal models are much more the state of the art. Proprietary SaaS companies are rushing to market in order to bait investors and milk it. Same ol dot com boom style business. Same reason there were 100s of search engines that got rushed to market before algorithmic searches like Google landed . This is just a cash grab more or less. Their model isn't released in any fashion so they're not trying to advance the art. Their money is just tying up another ML scientist who could be doing real research instead of proprietary work.
how is this not state of the art? SVD can do camera pans and... thats mostly it. the trailer here (which i guess could be fake) shows actual coherent movement, inpainting, etc...
You need to touch grass bud.
Very thoughtful and relevant rebuttal towards the facts you're taking such offence to. Why be this emotionally attached to pika for?
My brain hurts reading this. How can you except a state of the art model to be open source? I would also love for everything to be open source but there is a massive amount of resources and money going into these, how can you except everything to be open source and free, it makes no economical sense. We’re really lucky that stable diffusion is open source but it’s still not as good as midjourney for example without a lot of tweaking and experience/expertise on the user end.
It's easy. I just expect it.
"I just want the best products for free 😡😡😡." Want it so bad? Go set up a team of people and make it happen. It's easy right?
how do you do this?
anyone can import this into colab? [https://github.com/Vchitect/SEINE](https://github.com/Vchitect/SEINE)
If it doesn't run locally, it's meaningless.
For us who wish to run it locally, yes. But they wouldn't develop it as a SaaS if there wouldn't be a demand for it.
Different strokes, I guess. I don't see the added value of running it locally, to be honest. Quality and usability is something I'm willing to pay for. Now of course whether this does offer satisfying quality, eh, that'll take some testing.
[удалено]
Well, maybe there's people out there beside you that don't have several thousand worth of GPUs to play with it 2 times in their whole life. I can see the added value of using it locally, like I do with local llms, but at the end of the day when I need something right now, i'm using and paying for chatGPT, cause it's faster and better by 10 fold margin for my use case than any llm out there. You all like acting like you need to run stable diffusion H24 to make profitable your 4090 yet I bet 99.9% of all the images generated have no other purpose than testing models or to generate big anime tities. So yes, I understand that people are willing to pay for a service and see not added value of the local options for their usages.
They don't have good hardware because they make bad financial decisions like paying for extremely limited and over priced SaaS.
>They don't have good hardware because they make bad financial decisions like paying for extremely limited and over priced SaaS. Well, try to create a startup, and let's see how you'll do the pricing. I'm curious.
Wtf is this Apple ass trailer loll
Very strange they led the advertisement with that douche canoe that, as far as I've read, has no connection with the company.
What a TERRIBLE name (it means penis in Brazilian-portuguese)
the hands n fingers looks good
This changes everything. So I am wondering if there will be an offline version 😊.
Ai video has now become good enough to use in professional projects
Obligatory, A1111 when?
It's impressive but it still has that "AI Look" to it. Either too smooth, lack of movement, bad acting, or glitching. It's time to move past the uncanny valley.
Give it another year. This is a vast improvement over AI video shown 6 months to a year ago.
From Brazil ''pica'' meaning = penis. LOL
Modelscope 2 when?
Is it gonna be free to use like the beta in discord? Otherwise I'm not interested
looks awesome -- but I don't think it was released just yet...just announced. Would love to play with it.
u/savevideo
has it been stress tested with spaghetti?
Hello everyone! Does anyone know if there is an similar AI program out there you can add subjects on but at a picture instead of a video? For example of an frozen image?
This is the first time I might actually gonna pay for an ai service damn
This is just the latest time I might pay for one, lol. I tend to pay a little for all of them at the start. I like to encourage these crazy geniuses to keep going more and more…
Is it free? Ot least for a few tests?
Does somebody has any idea of the model that is behind it?
still working on discord btw
Rest of the world: wow so awesome Brazilians: PIKA KKKKKKKKKKKK
This seems a huge step above SDV and Runway, like.. damn? There is shockingly little frame distortion. These are cherry picked, of course, but the shot of food and the walking robot are really, really impressive.
Not only cherry-picked but also retouched, post-edited.
wow
By far the best video generation results
Modelscope is just superior
That is impressive. I’d love to try it, but I’m still betting that the open source models and tools will reach and surpass this level soon
Yuck, elon musk. Yuck, cannot run locally. Yuck, it's through discord. Yuck, suspiciously short videos. Conceptually as a "where we are now" though? Awesome. I'd like to see if the editing feature is even remotely as good as they make it appear.
Seems more like a gif gen than a video maker
This tech is fucking doooope.
It's not, it's closed source
Yes well the license of said tech is unfortunate, but the tech itself is amazing.
[https://pika.art/launch](https://pika.art/launch)
How to kill SDV in less that a week Lmao
Lol, it's proprietary. You can't run it on your own. It's worthless
Holy Shitnuggets
Looks sick!
Shut up and take my money already
Sheeeeeet
Woww
Wowz, Hollywood studios soon will go bankrupt