I just spent a good few hours optimizing my LLM rig. Disabling the graphical interface to squeeze 150mb of vram from xorg, setting programs cpu niceness to highest priority, tweaking settings to find memory limits.

I was able to increase the token speed by half a second while doubling context size. I don’t have the budget for any big vram upgrade so I’m trying to make the most of what ive got.

I have two desktop computers. One has better ram+CPU+overclocking but worse GPU. The other has better GPU but worse ram, CPU, no overclocking. I’m contemplating whether its worth swapping GPUs to really make the most of available hardware. Its bee years since I took apart a PC and I’m scared of doing somthing wrong and damaging everything. I dunno if its worth the time, effort, and risk for the squeeze.

Otherwise I’m loving my self hosting llm hobby. Ive been very into l learning computers and ML for the past year. Crazy advancements, exciting stuff.

I die in a four way sesh-to-the-death match between snoop dog, cheech, Ricky from TBP and myself.

Cryptocurrency.

Kidding! Sorry, I couldn’t help myself. I’m sure that will ruffle someone’s feathers for a fraction of a second.

Does vegan based meat/milk alternatives count as a technology sector? The moment we figure out a way to actually seriously imitate high quality steaks and 2% cow milk with it being indistinguishable and half the price I think that will hurt factory farming which is a bit of a domino effect that would lead to less co2 and methane produced, less agricultural effort wasted on feeding animals, that kind of thing.

deleted by creator

Sounds like ollama was loaded up with an either overly censored or plain brain dead language model. Do you know which model it was? Maybe try mistral if it fits in your computer.

I run kobold.cpp which is a cutting edge local model engine, on my local gaming rig turned server. I like to play around with the latest models to see how they improve/change over time. The current chain of thought thinking models like deepseek r1 distills and qwen qwq are fun to poke at with advanced open ended STEM questions.

STEM questions like “What does Gödel’s incompleteness theorem imply about scientific theories of everything?” Or “Could the speed of light be more accurately refered to as ‘the speed of causality’?”

As for actual daily use, I prefer using mistral small 24b and treating it like a local search engine with the legitimacy of wikipedia. Its a starting point to ask questions about general things I don’t know about or want advice on, then do further research through more legitimate sources.

Its important to not take the LLM too seriously as theres always a small statistical chance it hallucinates some bullshit but most of the time its fairly accurate and is a pretty good jumping off point for further research.

Lets say I want an overview of how can I repair small holes forming in concrete, or general ideas on how to invest financially, how to change fluids in a car, how much fat and protein is in an egg, ect.

If the LLM says a word or related concept I don’t recognize I grill it for clarifying info and follow it through the infinite branching garden of related information.

I’ve used an LLM to help me go through old declassified documents and speculate on internal gov terminalogy I was unfamiliar with.

I’ve used a speech to text model and get it to speek just for fun. Ive used multimodal model and get it to see/scan documents for info.

Ive used websearch to get the model to retrieve information it didn’t know off a ddg search, again mostly for fun.

Feel free to ask me anything, I’m glad to help get newbies started.

At some point I considered editing the comment to include the “or if really desperate with few hands peek the deck for pairs with most cards likely to pay out” but just… didn’t. So congratz you are correct, usually its not necessary but I find myself peeking more and more as I climb up to gold stake

You are spot on. At that point the game is sending a message which could be interpreted as “Go Fuck Yourself”. I always play chicken and double down on the full house play even if it fucks the run. Gotta hedge the bets and discard two of the lowest value pairs out of the four pairs just to bait statistics into maybe giving you a third of the higher two remaining pairs.

Use IronFox, its based on fennec but with all Mozilla’s telemetry stuff ripped out and disabled.

@CubitOom@infosec.pub theres no need for finding a replacement. The benefit of open source projects is that theres usually someone who forks the project and continues the legacy if its popular enough.

You are very fortunate github user agrhan forked your pass command based android password manager. Here’s a direct link to the apk snapshot while im at it.

This is maintenance-only meaning it only updates dependencies. So don’t expect new features. There might be some others more actively worked on, but this is the most popular and stable one.

In the future maybe take a moment to browse forks on the projects git page instead of just assuming the project is dead and running to a replacement.

Ah the old Schrodingers Dexter X The Good Place Crossover Episode Gambit, a decent argument. However I think it can be disproven through the axioms suggested through Zenos Jurrasic Park III X Terminator Clause.

3blue1brown, veritasium, welsh Labs

1. Download server files and run them. Modern Minecraft requires java runtime enviroment 17, 1.16 and belore jre8. If you have synaptic package manager search for jre there.

2. I usually make a batch file to execute server. You can run jre as is by executing as an application but a batch file helps set memory size usage, nogui and stuff.

3. It will stop on first server startup to produce a EULA text file. Open it up, set to true, save, restart server. See if you can connect through LAN by using another computer and entering your servers local IP address probably 10.0.0.xx:25565

4. Open up the port for default mc server in your router so others can connect on public network. 25565, TCP+UDP, in out both ways. Make exceptions in your firewall too.

To do good when nobody is looking and to not pride yourself or adknolwedge that you do it is very close to the concept of ‘real virtue’. False virtue is what most practice, doing good things to feel morally superior, or to brag about it on social media to look good in the eyes of others, or to earn brownie points with their god for a personal paradise afterlife as a reward, any good that these people do are not truly virtuous.

Anyone sharing their feel good stories here would be practicing false virtue out of definition. A truly good and virtuous person wouldn’t even recognize themselves picking up the trash or voulenteering the homeless shelter as ‘good’ actions or themselves as good people for doing them.

The problem is that theres a real subset of people who pride themselves on not needing to know about the things they use and throw tantrums when forced outside their one-click UI spoonfed comfort zone.

The modern ultra minimalistic simplistic UI design is largely to appeal to the lowest common denominator of human intelligence who can barely find the on button and freeze up when faced with the prospect of actually pushing it.

Why should they have the learn about computer operating systems? Thats nerd shit. Why should they learn about car mechanics? Thats blue collar shit. Taking time out of your day to learn something or use two braincells to work your way out of a bad situation is a sign of defeat.

The people who win life are those who never have to think for themselves, or struggle through a problem, or change their bad behaviors. Only idiots would ever intentionally give themselves more challenge or work. As long as they can get by on the slop of convinence and someone else to figure out things for them, they’re winners.

I think all experienced balatro players have that learning moment of regret/I’m an idiot when they have the reroll boss for 10$ voucher and get countered anyways by the final ante 8 boss. Simply because they were rushing and didn’t read the boss effect that perfectly counters them. No worse feeling knowing you lost because you didnt take two seconds to read some words and hit the reroll button.

After that you learn to check the boss blind descriptions more ahead of time and the reroll voucher goes from mid that you don’t think of using to game saving

I wrote a guide on here about the differences between alternative search engines. I recommend for you either YaCy or marginalia.nu. searxng supports calling YaCy (I actually contributed to that feature on the github).

The problem with decentralized engines like marginalia and YaCy is that they aren’t good at the things a average user wants from a typical search engine. Ideally a search engine is meant to quickly provide you links to webpages which are strongly related in content to you are looking for. Shopping, weather, map directions, local business hours. On some level you need to prioritize showing the user what they want ideally within the first few results.

Decentralized engines by their nature don’t do this easily. Instead using YaCy or marginalia feels like a scavenger hunt where you get handed a page of random websites loosely connected by your keyword search term and are told to start looking. This is good when your in the mood for blogspam and personal webpage blog dicovery, but not great for finding local buisniess info quickly. YaCy has a user curated priority system but not enough user mass adoption to be worth a damn in practice.

So sadly if you want anything resembling google or bing results for your practical convinence driven daily internet searching needs, you need to scrape them with searxng or use one of their few real search engine company competitors funding their own indexers and web crawlers. So really your options are scraping google, bing, mojeek, qwant, kagi and DuckDuckGo(ish they still use bing for indexing a lot).

Out of those Ive actually warmed up to Kagi over the year. I was put off at the idea of subscription based internet search but its a really good service they provide and they line out their reasoning for pricing well. They seem to be using that monthly sub money to actually improve the service and user experiences while remaining transparent with constant changelogs and blog updates. Kagis recent implimentation of privacy pass protocol, available TOR access, anonymous payment options, and taking fediverse + small net indexing seriously are all green flags to me. Never thought I would pay for a search engine but the way the world is going I’d rather eat the equivalent of a 5-10$ patreon sub to grow a service I believe is respecting me as a customer over fucking FAANG treating me like cattle and absolutely violating user experience so hard just for another nickles worth value in data scraping.

Being able to comment and post without jumping through arbitrary hoops. No automod bots telling me I need 10 karma to post, no oops sorry not allowed to share external links to other websites, no oh no sharing pictures in the comments below post. Lemmy aligns with the principles of respecting user interaction on a technical level and not choking the life out of you with corporate TOS regulation.

Lemmy is not perfect. I am not really politically or ideologically aligned with a lot of the stuff the community as a whole is into, so being constantly exposed to the same themes and propaganda over and over gets a little grating. However I’m happy to deal and tolerate as long as I feel respected by the platform as a intelligent person using an open free as in freedom discussion fourm and not made to feel like yet another drone fueling a corpo content mill.

IH didn’t really get canceled by his viewers though. They still get plently of views and there was no real mass flaming in the comments from what I recall. The ones who canceled them was HbomberGuy and a small amount of his supporters.

IH played it smart by keeping their mouth shut, not giving the situation any more ammo with a shitty apology, just quietly swept it under the rug and everyone moved on after a week or two.

Yes exactly how I feel tbh. The first friends of jumbo was disappointing but could have just been a one off thing. Thee next two were hype crushing. I’m not even against more card art but I want actual non-gaming art like the alternative themes you would find in pysol or other generic solitaire games. Also some art that unlocks when you do milestones like gold stake or challenge runs.