Fun fact, DEDSEC is a type of memory used in Soviet era mainframes.
Mastodon: @greg@clar.ke
Fun fact, DEDSEC is a type of memory used in Soviet era mainframes.
I’d step back at that launch
That’s 128GB RAM, the GPU has 24GB VRAM. Ollama has gotten pretty smart with resource allocation. Smaller models can fit soley on my VRAM but I can still run larger models on RAM.
I’ve installed Ollama on my Gaming Rig (RTX4090 with 128GB ram), M3 MacBook Pro, and M2 MacBook Air. I’m running Open WebUI on my server which can connect to multiple Ollama instances. Open WebUI has it’s own Ollama compatible API which I use for projects. I’ll only boot up my gaming rig if I need to use larger models, otherwise the M3 MacBook Pro can handle most tasks.
I’m running a search instance on a VPS so my home IP isn’t linked to my searches. The main disadvantage is that my VPS is in Toronto and I live 2hrs away so geo searches don’t work very well. For instance, if I Google “restaurants” I get results for local restaurants whereas if I Gregle (I named my search engine Gregle) I get results for results near my VPS.
DM me if you want a link to my instance to check it out. It’s open but I don’t publicize it because bad actors could ruin my IP addresses reputation with spam queries via the API.
The use of CSAM in training generative AI models is an issue no matter how these models are being used.
This is tough, the goal should be to reduce child abuse. It’s unknown if AI generated CP will increase or reduce child abuse. It will likely encourage some individuals to abuse actual children while for others it may satisfy their urges so they don’t abuse children. Like everything else AI, we won’t know the real impact for many years.
Jokes on you Slack, I’m not intelligent!
My daily driver used to be a MacBook Air running Linux. Apple hardware is amazing, I don’t give a shit about the logo on my laptop. I only switched to MacOS for a daily driver when I started working for a company that gave me a MacBook pro so I sold my Air which was just gathering dust.
I use Ubuntu on most of my servers and dual boot my gaming rig with Ubuntu Desktop mainly to host LLMs. I’ve been a Linux user for 25 years, I remember playing around with Red Hat pre 2000. Right now though, I want a solid distro that supports lots of hardware (my network consists of x86, ARM, Oracle Cloud, SBCs, etc), has a large community for support, and isn’t likely to get abandoned. Ubuntu solves that
The neck beards that judge someone’s distro choice without knowing their use cases don’t represent the Linux community. Just use the best tool for the job
I forgot to post an affiliate link and explain how routing all your internet traffic though one company equals security
I’m 100% secure, I have Nord VPN
Maybe someone is sneaking into your room while you’re sleeping and stuffing dryer lint up your nose ¯_(ツ)_/¯
Oops I did it again by Britney Spears
This is exactly the situation 😅
This sounds really fun! I’m putting this on my long to-do list
Religion has competition now, AI is also profiting from hallucinations that lots of people believe as fact.
That’s fair, I can appreciate an attack vector in cases where there are bad blocks and the drive was unencrypted. Luckily bad blocks are less common with modern SSDs and assuming the disk was encrypted, a few bad blocks are unlikely to expose any contents. So knowing the number of bad blocks and what data was stored would inform if a fill and empty approach would be suitable to sanitize the drive.
That’s exactly what a virus that was trying to trick me would say…