Where is this in Sophia?
- 3 Posts
- 8 Comments
xylogx@lemmy.worldto
Selfhosted@lemmy.world•Linux Kernel TCP Flaw With 9.8 CVSS Score Affects Ubuntu, Red Hat and Other DistributionsEnglish
14·5 days agoThey found a previously unknown vulnerability and it was fixed:
“This vulnerability (CVE-2026-98432) was patched upstream and backported to all maintained stable kernel branches.”
This is good no?
NSA has a dual mandate, they do both offense and defense. It leads to conflicts…
xylogx@lemmy.worldOPto
pics@lemmy.world•Foggy morning on the Key Bridge going into DCEnglish
3·10 days agoIt is the time-of-day that is doing the heavy lifting here. My bike-ride takes me over the bridge at what is, at this time of year, sunrise. They do not call it the golden hour for nothing! I have had many beautiful sunrises over the river as crossing the bridge, but the fog really adds something special to it.
xylogx@lemmy.worldto
You Should Know@lemmy.world•YSK - (bigger) straws are often designed to make you drink more, faster. Get a smaller diameter set of stainless steel drinking straws no greater in diameter at the opening than 1/4 inch, in*stead*English
1·13 days agoThe only winning move is not to play. Just drink water, then it doesn’t matter how much you drink or how big your straw is. LPT lemon wedges are no extra charge.
xylogx@lemmy.worldto
Selfhosted@lemmy.world•Is anyone self-hosting their own AI?English
63·18 days agoWith my NVidia Geforce 3070 card with 8GB of VRAM I can get 40 tokens per second on smallish models such as llama3.1 or qwen 3.8. I use it mostly for NLP processing of game server logs to create match summaries and I use whisper for audio-to-text transcription of videos.
While I do not have enough vram to put large logfiles into the LLM directly I was able to have it create a python script that generates a summary file at the end of each match. I feed the LLM the summary file and it generates color commentary that gets posted to Discord. Here is an example:
[🌟]Color Commentary: A Display of Skill on dod_napoli_b1! [📈]Multi-Player Action: On 08/05/2026 at 19:33:25, the action was intense on dod_napoli_b1, with key moments including the [Loft] capture by Inspector Lag (Allies) and [Axis Barn] capture by THE ROCK/BionicTwin (Allies). [🏆]Impact Players: Allies: Inspector Lag (Kills: 37), [415]Drago (Caps: 10). Axis: The Notorious C.U.M. (Kills: 39), [415]IronHeaD (Caps: 8).
$ollama list NAME ID SIZE MODIFIED
qwen3:8b 500a1f067a9f 5.2 GB 5 months ago
llama3.1:8b 46e0c10c039e 4.9 GB 5 months ago$ollama run llama3.1:8b
what is the best AI model to run on an Nvidia 3070 with 8gb of vram? The best AI model to run on an NVIDIA GeForce RTX 3070 with 8 GB of VRAM depends on several factors, such as:
- Specific task or application: Are you interested in tasks like image classification, object detection, natural language processing (NLP), or generative models?
- Desired level of complexity: Do you want to run small, simple models or larger, more complex ones that require more computational resources?
- Computational requirements: What’s your expected performance target? Do you need high-throughput, low-latency, or a balance between the two?
Considering these factors and the specifications of your GPU, here are some popular AI model examples suitable for an NVIDIA GeForce RTX 3070 with 8 GB VRAM:
Computer Vision:
- YOLOv5: A lightweight yet powerful object detection model that’s well-suited for real-time applications.
- EfficientNet-B3: A compact and efficient image classification model, part of the EfficientNet family.
Natural Language Processing (NLP):
- BERT-base-uncased: A popular language representation model for various NLP tasks like text classification, sentiment analysis, and question answering.
- RoBERTa-base: A transformer-based language model that outperforms BERT on several tasks.
Generative Models:
- StyleGAN2: A state-of-the-art generative adversarial network (GAN) for image synthesis and manipulation.
- DDPM (Denoising Diffusion Probabilistic Model): A flexible and efficient generative model suitable for various image generation tasks.
Keep in mind that these models have varying computational requirements, memory footprints, and performance characteristics. You may need to experiment with different hyperparameters or architectures to find the best match for your specific needs.
To estimate which models will run smoothly on your hardware, consider the following:
- Memory usage: Make sure the model fits within your GPU’s VRAM (8 GB). Larger models might require downsampling or other memory-saving techniques.
- FLOPS (Floating-Point Operations Per Second): Estimate the computational requirements of each model. The RTX 3070 has a peak FLOPS rating of around 12 TFLOPS, but actual performance may vary depending on the specific workload.
For more detailed estimates and comparisons, I recommend exploring resources like:
- TensorFlow Model Garden: A collection of pre-trained models for various tasks.
- PyTorch Hub: A library of pre-trained models and implementations.
- NVIDIA Deep Learning SDK: Offers a range of tools, including cuDNN-accelerated deep learning primitives.
Feel free to provide more specific requirements or task details if you’d like me to help with model selection!
total duration: 13.256527877s load duration: 71.80054ms prompt eval count: 466 token(s) prompt eval duration: 62.91049ms prompt eval rate: 7407.35 tokens/s eval count: 572 token(s) eval duration: 12.889617619s eval rate: 44.38 tokens/s
xylogx@lemmy.worldto
Funny@sh.itjust.works•The weirdest thing about American cultureEnglish
0·3 months agoMy daughter sent me a TikTok about the government using counterintelligence techniques against left wing groups. I sent her the wikipedia page on Cointellpro with the comment “Sadly this is not new”

A typical ip address scheme is to assign lower blocks to dhcp pools and reserve high ip addresses to servers and network gear. Anything over 250 is typically a switch or a router in this case.