• 0 Posts
  • 43 Comments
Joined 3 months ago
cake
Cake day: May 28th, 2024

help-circle



      • Learning. If you ever found yourself tired of learning new things, your life is basically done.
      • Cost. You already have an internet connection at home. It’s practically a necessity these days. The connection is likely fast enough for most things. Renting even the most piddly of VPS is wildly expensive. Just throw a spare machine at it and go wild.
      • Freedom. Your own data is constantly being collected, regurgitated, and sold back to you. More people need to care about this incessant invasion of our lives.
      • Backups. 3 copies, on different forms of storage, in multiple PHYSICALLY distinct locations. Just when you have that teeny little imp in the back of your mind say “hmm, I should probably back up soon” – stop everything you’re doing and run a backup.
      • Test your recovery! Backups are only good if you can recover from them. Many have lost data because they failed to ever fail-test their backups.
      • Google. Legitimately the best skill you can ever attain is simply being able to search effectively and be able to learn jargon quickly. Once you have the lingo down, searches become clearer, quicker, more precise.










  • kitnaht@lemmy.worldtoSelfhosted@lemmy.worldUses for local AI?
    link
    fedilink
    English
    arrow-up
    1
    ·
    edit-2
    24 days ago

    Those were statements. Statements of fact.

    Once the models are already trained, it takes almost no power to use them.

    Yes, TRAINING the models uses an immense amount of power - but utilizing the training datasets locally consumes almost nothing. I can run the llama 7b set on a 15w Raspberry Pi for example. Just leaving my PC on uses 400w. This is all local – Nothing entering or leaving the Pi. No communication to an external server, nothing being done on anybody else’s server or any AWS instances, etc.