• 1 Post
  • 13 Comments
Joined 1 year ago
cake
Cake day: July 31st, 2023

help-circle









  • oats@110010.wintoMemes@lemmy.mlToday was not that day.
    link
    fedilink
    arrow-up
    9
    arrow-down
    2
    ·
    1 year ago

    This usually depends on the country/region. For example in India ikea is obscenely expensive for what they are selling when you can get a miles better product at a similar price.

    At least in Delhi you can get really really good furniture at a fair price.


  • I have used it mainly for dreambooth, textual inversion and hypernetworks, just using it for stable diffusion. For models i have used the base stable diffusion models, waifu diffusion, dreamshaper, Anything v3 and a few others.

    The 0.79 USD is charged only for the time you use it, if you turn off the container you are charged for storage only. So, it is not run 24/7, only when you use it. Also, have you seen the price of those GPUs? That 568$/month is a bargain if the GPU won’t be in continuous use for a period of years.

    Another important distinction is that LLMs are a whole different beast, running them even when renting isn’t justifiable unless you have a large number of paying users. For the really good versions of LLM with large number of parameters you need a lot of things than just a good GPU, you need at least 10 of the NVIDIA A100 80GB (Meta’s needs 16 https://blog.apnic.net/2023/08/10/large-language-models-the-hardware-connection/) running for the model to work. This is where the price to pirate and run yourself cannot be justified. It would be cheaper to pay for a closed LLM than to run a pirated instance.



  • Why not build a new PC or buy an old pc? One with ryzen 5 5600G, 8gb Ram, 250GB ssd should cost ~250USD whether you buy new/old, i recently checked the prices, cause I needed one and they were similar. This should take you a long way. As for storage just pick a case with enough ssd/harddisk slots.

    You can also go much cheaper depending on what you get.

    The advantage is you can add a GPU like the intel A380 for av1 encoding of video if you feel like you need it.

    For OS depending on what you are doing there are a few choices:

    • True nas: mid difficulty
    • debian: i just use this with docker, does the job
    • alma linux/Rocky linux
    • ubuntu
    • yunohost: if you would be interested in hosting activitypub apps, easy
    • casaos: easy